NotesFAQContact Us
Search Tips
ERIC Number: ED318802
Record Type: Non-Journal
Publication Date: 1990-Apr
Pages: 10
Abstractor: N/A
Reference Count: N/A
Rank Ordering or Judge-Awarded Ratings?
Linacre, John M.
Rank ordering examinees is an easier task for judges than is awarding numerical ratings. A measurement model for rankings based on Rasch's objectivity axioms provides linear, sample-independent and judge-independent measures. Estimates of examinee measures are obtained from the data set of rankings, along with standard errors and fit statistics. Judge quality-control fit statistics are also obtained for each ordering. An example is provided comparing rating and ranking of an essay examination. Even though rank ordering does not perform measurement as precisely as does a highly discriminating rating scale, measures obtained from rankings can be comparable to those obtained from rating scales commonly in use in certifying situations. The simplification of judge training and the easing of the burden on the judge resulting from the use of rank ordering rather than rating scales suggest that this technique merits close scrutiny by examination boards that currently rely on judges to rate examinee performance. Five tables and three figures are included. (Author/TJH)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A