NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ803057
Record Type: Journal
Publication Date: 2008
Pages: 13
Abstractor: As Provided
ISSN: ISSN-1842-4562
Halos and Horns in the Assessment of Undergraduate Medical Students: A Consistency-Based Approach
MacDougall, Margaret; Riley, Simon C.; Cameron, Helen S.; McKinstry, Brian
Journal of Applied Quantitative Methods, v3 n2 p116-128 Sum 2008
The authors introduce a consistency-based approach to detecting examiner bias. On comparing intra-class correlation coefficients on transformed data for supervisor continuous performance and report marks (ICC1*) with those for supervisor continuous performance and second marker report marks (ICC2*), a highly significant difference was obtained for both the entire cohort (ICC1* = 0.72, ICC2* = 0.30, F = 2.47, p less than 0.0005 (N = 1085)) and the subgroup with high supervisor ratings for continuous performance (ICC1* = 0.62, ICC2* = 0.24, F = 1.97, p less than 0.0005 (n = 952)). A strong halo effect was detected and preliminary evidence was obtained for the presence of a strong horn effect for students with lower scores, thus providing a basis for future research. (Contains 1 footnote, 1 table, and 1 figure.)
Association for Development through Science and Education. Str. Anastasie Panu 6, BI B5, scara 1, ap 22, etaj 5, sector 3, Bucharest 031164, Romania. Fax: +40-213220544; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A