NotesFAQContact Us
Search Tips
ERIC Number: ED501148
Record Type: Non-Journal
Publication Date: 2008-Mar-26
Pages: 45
Abstractor: Author
Reference Count: 39
The Impact of Automated Essay Scoring on Writing Outcomes
Shermis, Mark D.; Garvan, Cynthia Wilson; Diao, Yanbo
Online Submission, Paper presented at the Annual Meeting of the National Council on Measurement in Education (New York, NY, Mar 25-27, 2008)
This study was an expanded replication of an earlier endeavor (Shermis, Burstein, & Bliss, 2004) to document the writing outcomes associated with automated essay scoring. The focus of the current study was on determining whether exposure to multiple writing prompts facilitated writing production variables (Essay Score, Essay Length, and Number of Unique Words) and decreased writing errors (Grammar, Usage, Mechanics, Style, Organization & Development) over time. The impacts of these variables were examined in analyses of 11,685 essays written by 2,017 students at four grade levels (grades 6-8, 10). The essays, written in response to seven different prompts, were scored by automated essay scoring. The results showed significant differences across the four grades and over time for each of the eight outcome variables. Peak essay performance occurred with 8th graders who also displayed the highest reduction of both domain errors. Specific types of error reduction were differentially associated with grade level. The implications of the results for future research incorporating writing genre are discussed. (Contains 14 tables and 8 figures.)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: Elementary Education; Grade 10; Grade 6; Grade 7; Grade 8; High Schools; Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United States