NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1080551
Record Type: Journal
Publication Date: 2008
Pages: 16
Abstractor: As Provided
Reference Count: 34
ISBN: N/A
ISSN: ISSN-1528-5804
Automated Essay Scoring versus Human Scoring: A Correlational Study
Wang, Jinhao; Brown, Michelle Stallone
Contemporary Issues in Technology and Teacher Education (CITE Journal), v8 n4 p310-325 2008
The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance. Spearman rank correlation coefficient tests were utilized for data analyses. Results from the data analyses showed no statistically significant correlation between the overall holistic scores assigned by the AES tool and the overall holistic scores assigned by faculty human raters or human raters who scored another standardized writing test. On the other hand, there was a significant correlation between scores assigned by two teams of human raters. A significant correlation was also present between AES and faculty human scoring in Dimension 4--Sentence Structure, but no significant correlations existed in other dimensions. Findings from the current study do not corroborate previous findings on AES tools. Implications of these findings for English educators reveal that AES tools have limited capability at this point and that more reliable measures for assessment, like writing portfolios and conferencing, still need to be a part of the methods repertoire.
Society for Information Technology and Teacher Education. P.O. Box 1545, Chesapeake, VA 23327. Tel: 757-366-5606; Fax: 703-997-8760; e-mail: business@aace.org; Web site: http://www.aace.org
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Texas