ERIC Number: ED411316
Record Type: Non-Journal
Publication Date: 1997-Mar
Reference Count: N/A
Computer Analysis of Student Essays: Finding Trait Differences in Student Profile.
Page, Ellis B.; Poggio, John P.; Keith, Timothy Z.
Most human gradings of essays are holistic, or "overall." Therefore, Project Essay Grade (PEG), an attempt to develop computerized grading of essays, has concentrated most of its research on overall grading. It has successfully simulated human judges. However, since computer grading is less expensive than human grading, PEG has also explored the grading of traits within the essay (content, organization, style, mechanics, and creativity). PEG has found it possible to simulate multiple judges in grading such traits, but to make practical use of trait scores, it is important to discover how the traits vary within the students. In this study, 8 judges rated 495 essays on the 5 focal traits and the overall quality. Taking the holistic score as the overall essay value, researchers then studied the residuals of each trait from the holistic. These residuals turned out to be strikingly predictable. Using these traits and multiple judges, PEG programs may apparently supply diagnostic ratings together with the holistic scores. These may serve for the information of individual students and for use by teachers, school leaders, and test researchers. (Contains 4 tables and 18 references.) (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A