ERIC Number: ED352926
Record Type: Non-Journal
Publication Date: 1992-Apr-21
Reference Count: N/A
Using the Microcomputer To Equate Ratings of Student Writing Samples.
Brown, William L.; Stevens, Betty L.
The objectives of this study were to determine whether student writing portfolios could be rated reliably by trained judges; study the effects on student ratings of the differential leniency of the judges; and ascertain the effects of writing-prompt difficulty and its interactions with rater leniency. Writing samples from 127 students in grades 3, 6, and 9, were randomly selected and analyzed by experienced volunteer judges working under the direction of a consultant experienced in both training judges and reading student writing. The Rasch Multi-Faceted Model using a microcomputer was applied to the rating and a rankings of the writing samples. The most important conclusion reached from this study is that the microcomputer can be used as a tool for equating the ratings of student writing at an economical cost; the Rasch Multi-Faceted Model can be used to compensate for variation in judge leniency and produce consistent ratings; and although the judges appeared to be able to rate writing pieces effectively, they were unable to come up with any consistent approach to ranking pieces within a portfolio. Eight tables illustrate the ratings. (ALF)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: N/A