NotesFAQContact Us
Search Tips
ERIC Number: ED307339
Record Type: Non-Journal
Publication Date: 1989-Mar
Pages: 13
Abstractor: N/A
Reference Count: N/A
Objectivity for Judge-Intermediated Certification Examinations.
Linacre, John M.
An accepted criterion for gauging the fairness of examinees' scores, derived from judge-awarded ratings, has been the size of the correlation between the judges and the inter-rater reliability. Various means of achieving inter-rater reliability were reviewed, and a model to measure inter-rater reliability is forwarded. Both theoretical and practical considerations mandate that perfect inter-rater reliability can never be achieved. A stochastic element always remains. Objective measurement of examinees, freed from the severity of the judges and the definition of the rating scale, can be obtained by capitalizing on the stochastic nature of ratings. The resulting measurement model is of the type developed by Rasch. Examples of the model are provided. (TJH)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A