NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1061738
Record Type: Journal
Publication Date: 2015
Pages: 35
Abstractor: As Provided
Reference Count: 59
ISSN: ISSN-1543-4303
A Comparison of EFL Raters' Essay-Rating Processes across Two Types of Rating Scales
Li, Hang; He, Lianzhen
Language Assessment Quarterly, v12 n2 p178-212 2015
This study used think-aloud protocols to compare essay-rating processes across holistic and analytic rating scales in the context of China's College English Test Band 6 (CET-6). A group of 9 experienced CET-6 raters scored the same batch of 10 CET-6 essays produced in an operational CET-6 administration twice, using both the CET-6 holistic essay-rating scale and an analytic rating scale designed specifically for the study, while providing think-aloud protocols. The findings indicated that important differences in both rating strategies adopted and the specific aspects of essays attended to existed across the scales. Specifically, raters were found to use more self-monitoring-interpretation strategies, the strategy of considering local language features, as well as certain self-monitoring-judgment strategies when rating holistically. They were found to use more frequently self-monitoring-judgment strategy, error-classifying strategy, and quality-assessing strategy when applying the analytic scale. As for the differences in text focus across the scales, it was found that the use of the holistic scale led to raters paying more attention to the general quality of language use and non-scale-related language features. Meanwhile, the application of the analytic scale resulted in raters giving more attention to coherence and grammar.
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China