ERIC Number: EJ1117196
Record Type: Journal
Publication Date: 2016-Oct
Pages: 30
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0142-6001
EISSN: N/A
Available Date: N/A
Predicting Patterns of Grammatical Complexity across Language Exam Task Types and Proficiency Levels
Biber, Douglas; Gray, Bethany; Staples, Shelley
Applied Linguistics, v37 n5 p639-668 Oct 2016
In the present article, we explore the extent to which previous research on register variation can be used to predict spoken/written task-type variation as well as differences across score levels in the context of a major standardized language exam (TOEFL iBT). Specifically, we carry out two sets of linguistic analyses based on a large corpus of TOEFL iBT responses: one investigating the use of 23 grammatical complexity features, and the second based on co-occurrence patterns among linguistic features, using Multi-Dimensional (MD) analysis. The first set of analyses confirms the predictions from research on register variation: there are systematic linguistic differences among spoken versus written and independent versus integrated task types. However, hypothesized developmental progressions in the use of these grammatical complexity features were generally not confirmed by score-level differences. In contrast, the MD analysis yielded more robust predictors of both task types and score-level differences, indicating that linguistic descriptions are more reliable and informative when they are based on dimensions of co-occurring lexico-grammatical features. In conclusion, we discuss the application of such dimensions as holistic complexity measures in language development/testing research.
Descriptors: Predictor Variables, Scores, Standardized Tests, Language Tests, English (Second Language), Second Language Learning, Grammar, Language Usage, Speech Communication, Written Language, Linguistics
Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
Publication Type: Journal Articles; Information Analyses; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A
Author Affiliations: N/A