NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ894454
Record Type: Journal
Publication Date: 2010
Pages: 15
Abstractor: As Provided
Reference Count: 55
ISSN: ISSN-1543-4303
Grading between the Lines: What Really Impacts Professors' Holistic Evaluation of ESL Graduate Student Writing?
Huang, Jinyan; Foote, Chandra J.
Language Assessment Quarterly, v7 n3 p219-233 2010
This study examines score variations and differences in the reliability of ratings between English-as-a-second-language (ESL) and native English (NE) authored papers in a graduate course. Generalizability (G-) theory was used as a framework for analysis because it is powerful in detecting rater variability and the relative contributions of multiple sources of error. The results indicate that ESL papers received consistently lower scores than NE papers. The G-coefficients for ESL and NE papers were considerably different revealing concern about the reliability of ratings of ESL papers. The significant increase in the number of ESL students pursuing graduate degrees in North American institutions warrants further research to determine the extent to which consistency differences affect the validity of the assessment of ESL students' writing and to identify ways to alleviate these differences. (Contains 5 tables and 1 footnote.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A