ERIC Number: EJ894454
Record Type: Journal
Publication Date: 2010
Abstractor: As Provided
Reference Count: 55
Grading between the Lines: What Really Impacts Professors' Holistic Evaluation of ESL Graduate Student Writing?
Huang, Jinyan; Foote, Chandra J.
Language Assessment Quarterly, v7 n3 p219-233 2010
This study examines score variations and differences in the reliability of ratings between English-as-a-second-language (ESL) and native English (NE) authored papers in a graduate course. Generalizability (G-) theory was used as a framework for analysis because it is powerful in detecting rater variability and the relative contributions of multiple sources of error. The results indicate that ESL papers received consistently lower scores than NE papers. The G-coefficients for ESL and NE papers were considerably different revealing concern about the reliability of ratings of ESL papers. The significant increase in the number of ESL students pursuing graduate degrees in North American institutions warrants further research to determine the extent to which consistency differences affect the validity of the assessment of ESL students' writing and to identify ways to alleviate these differences. (Contains 5 tables and 1 footnote.)
Descriptors: Graduate Students, Holistic Evaluation, North Americans, English (Second Language), Native Speakers, Second Language Learning, Scores, Writing (Composition), Generalization, Interrater Reliability, Writing Evaluation, Validity, College Faculty, Grading
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Authoring Institution: N/A