ERIC Number: ED261084
Record Type: RIE
Publication Date: 1985-Apr
Reference Count: 0
Handicapping Raters for Fairer Clinical Grading: A Practical Application.
Cason, Gerald J.; And Others
To minimize the effects of systematic differences in raters' standards of clinical competence, a handicapping system was applied to the ratings made by fourteen preceptors of 128 junior year medical students in a 6-week psychiatry clerkship at the University of Arkansas for Medical Sciences. The handicap of a preceptor was the difference between the grand mean of all ratings and the mean of that preceptors ratings. The handicap was added to the preceptor's raw ratings. Final clerkship grades were based on weighted scores on the National Board of Medical Examiners psychiatry test, local psychiatry tests, and the rating. The observed range of preceptor handicaps (9 points) was quite large when compared to the observed range of raw ratings (16 points). Results showed that the adjusted ratings increased rater reliability by 25 to 35 percent. Adjusted ratings produced an increased correlation among the measures and a slight improvement in the adjusted total reliability when compared to the raw total. Thirteen percent of the students' grades changed one letter, depending on whether raw or adjusted scores were used. (Author/GDC)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the Association of Medical Colleges, Southern Group on Medical Education (San Juan, Puerto Rico, April 17-19, 1985).