NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ905517
Record Type: Journal
Publication Date: 2010-Mar
Pages: 27
Abstractor: As Provided
Reference Count: 38
ISSN: ISSN-0039-8322
Do ESL Essay Raters' Evaluation Criteria Change with Experience? A Mixed-Methods, Cross-Sectional Study
Barkaoui, Khaled
TESOL Quarterly: A Journal for Teachers of English to Speakers of Other Languages and of Standard English as a Second Dialect, v44 n1 p31-57 Mar 2010
This study adopted a mixed-methods cross-sectional approach to identify similarities and differences in the English as a second language (ESL) essay holistic scores and evaluation criteria of raters with different levels of experience. Each of 31 experienced and 29 novice raters rated a sample of ESL essays holistically and analytically and provided written explanations for each holistic score they assigned. Score and qualitative data analyses were conducted to identify the criteria that the raters employed to rate the essays holistically. The findings indicated that both groups gave more importance to the communicative quality of the essays than to other aspects of writing. However, the novice raters tended to be more lenient and to give more importance to argumentation than the experienced raters did. The experienced raters tended to be more severe, to give more importance to linguistic accuracy, and to refer to evaluation criteria other than those listed in the rating scale more frequently than the novices did. The article concludes with a call for longitudinal research to investigate to what extent, how, and why rater evaluation criteria change over time and across contexts. (Contains 5 tables and 4 footnotes.)
Teachers of English to Speakers of Other Languages, Inc. 1925 Ballenger Avenue Suite 550, Alexandria, VA 22314. Tel: 888-547-3369; Tel: 703-836-0774; Fax: 703-836-7864; Fax: 703-836-6447; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A