NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1140810
Record Type: Journal
Publication Date: 2017
Pages: 20
Abstractor: As Provided
ISSN: ISSN-1543-4303
Embedding Corpora into the Content Validation of the Grammar Test of the National Matriculation English Test (NMET) in China
Pan, Mingwei; Qian, David D.
Language Assessment Quarterly, v14 n2 p120-139 2017
Grammar assessment has long been a pivotal and regular component of almost all high-stakes English tests in China. In writing grammar items, however, test developers tend to depend largely on their individual knowledge of grammar, or even intuition, without much reference to the typicality or de facto uses of the language. To address this problem in the Chinese assessment context, we demonstrate the benefits of making use of language corpora in developing and validating grammar tests. The present study adopted a corpus-based approach to investigating the content validity of the grammar section of a high-stakes test, the National Matriculation English Test (Shanghai). It was found that the grammar section under study has fairly appropriate content coverage and relevance, which suggests the test content generally assesses the intended grammatical features. In addition, evidence of content significance was present through a strong linkage between the grammar items in the test and grammatical errors produced by learners who had previously taken the test. However, flaws were detected for content typicality, because certain grammar items failed to conform closely to native English speakers' typical output. On the basis of these results, a procedure is proposed for conducting corpus-based content validation for high-stakes grammar tests.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A