NotesFAQContact Us
Search Tips
ERIC Number: EJ838612
Record Type: Journal
Publication Date: 2007-Oct
Pages: 29
Abstractor: As Provided
Reference Count: 42
ISSN: ISSN-1540-2525
Automated Essay Scoring versus Human Scoring: A Comparative Study
Wang, Jinhao; Brown, Michelle Stallone
Journal of Technology, Learning, and Assessment, v6 n2 Oct 2007
The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned by an AES tool, IntelliMetric [TM] and human raters. Data collection included administering the Texas version of the WriterPlacer "Plus" test and obtaining scores assigned by IntelliMetric [TM] and by human raters. The research sample of 107 participants was drawn from a Hispanic serving institution in South Texas. A One-Way Repeated-Measures ANOVA was conducted to examine the difference between the AES mean score and human raters' mean score. Results of the test indicated that the mean score assigned by AES tool IntelliMetric[TM] was significantly higher than faculty human raters' mean score on WriterPlacer "Plus" test. This finding did not corroborate previous studies that reported non-significant mean score differences between AES and human scoring. (Contains 6 tables and 1 figure.)
Technology and Assessment Study Collaborative. 332 Campion Hall, Boston College, Chestnut Hill, MA 02467. Tel: 617-552-4521; Fax: 617-552-8419; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Texas