ERIC Number: EJ803057
Record Type: Journal
Publication Date: 2008
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1842-4562
EISSN: N/A
Halos and Horns in the Assessment of Undergraduate Medical Students: A Consistency-Based Approach
MacDougall, Margaret; Riley, Simon C.; Cameron, Helen S.; McKinstry, Brian
Journal of Applied Quantitative Methods, v3 n2 p116-128 Sum 2008
The authors introduce a consistency-based approach to detecting examiner bias. On comparing intra-class correlation coefficients on transformed data for supervisor continuous performance and report marks (ICC1*) with those for supervisor continuous performance and second marker report marks (ICC2*), a highly significant difference was obtained for both the entire cohort (ICC1* = 0.72, ICC2* = 0.30, F = 2.47, p less than 0.0005 (N = 1085)) and the subgroup with high supervisor ratings for continuous performance (ICC1* = 0.62, ICC2* = 0.24, F = 1.97, p less than 0.0005 (n = 952)). A strong halo effect was detected and preliminary evidence was obtained for the presence of a strong horn effect for students with lower scores, thus providing a basis for future research. (Contains 1 footnote, 1 table, and 1 figure.)
Descriptors: Medical Students, Attention, Correlation, Supervisors, Academic Achievement, Reliability, Evaluation, Foreign Countries, Higher Education
Association for Development through Science and Education. Str. Anastasie Panu 6, BI B5, scara 1, ap 22, etaj 5, sector 3, Bucharest 031164, Romania. Fax: +40-213220544; e-mail: editor@jaqm.ro; Web site: http://www.jaqm.ro
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United Kingdom
Grant or Contract Numbers: N/A