ERIC Number: EJ1003321
Record Type: Journal
Publication Date: 2013
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: N/A
Does Test Preparation Work? Implications for Score Validity
Xie, Qin
Language Assessment Quarterly, v10 n2 p196-218 2013
This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning of a 2-month test preparation period; a posttest and a test preparation questionnaire were administered about 9 weeks later. Multiple regression and structural equation modeling were used in data analysis. The study found that test preparation pattern was better explained by the perceived functions of strategy use in improving test scores rather than the information processing mechanism underlying strategy use. Test preparation did improve test scores, but the effects were primarily from preparation practices via narrowing the curriculum, especially drilling. Although the effects were small in absolute terms, they represented almost one third of the effects from the pretest. Findings of this study suggest that the extrapolation validity of CET4 scores may warrant special attention in future validation studies. (Contains 10 tables, 4 figures and 2 footnotes.)
Descriptors: Foreign Countries, Undergraduate Students, College English, Language Tests, Scores, Test Preparation, Test Validity, Context Effect, Test Construction, Test Wiseness, Educational Improvement, Test Coaching, Pretests Posttests, Data Analysis, Structural Equation Models, Information Processing
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A