NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1178892
Record Type: Journal
Publication Date: 2018
Pages: 23
Abstractor: As Provided
ISSN: ISSN-0026-7902
Using Corpus-Based Register Analysis to Explore the Authenticity of High-Stakes Language Exams: A Register Comparison of TOEFL iBT and Disciplinary Writing Tasks
Staples, Shelley; Biber, Douglas; Reppen, Randi
Modern Language Journal, v102 n2 p310-332 Sum 2018
One of the central considerations in the validity argument for the TOEFL iBT is the relationship between the language on the exam and the language required for university courses. Corpus linguistics has recently been shown to be an effective way to explore this relationship, which can also be considered as an aspect of authenticity. Applying Multi-Dimensional Analysis, our study is the first to directly compare the lexico-grammatical characteristics of texts produced by second language writers on a high-stakes standardized exam (the TOEFL iBT) to the characteristics of texts produced by the same writers for disciplinary writing tasks required as part of their academic career (e.g., lab reports, argumentative essays). Our findings show that the language of TOEFL iBT tasks have patterns of both similarity and difference from disciplinary tasks with respect to four linguistic dimensions of language use: (a) Compressed Procedural Information versus Stance toward the Work of Others, (b) Personal Stance, (c) Possible versus Completed Events, and (d) Information Density. Integrated iBT tasks show similarities to certain kinds of disciplinary tasks, while independent iBT tasks differ linguistically from almost all disciplinary writing tasks. These general patterns hold regardless of the score levels of test takers. We discuss the implications of these findings for language teaching and assessment.
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A