ERIC Number: EJ920117
Record Type: Journal
Publication Date: 2011-May
Abstractor: As Provided
Reference Count: 29
Pick-N Multiple Choice-Exams: A Comparison of Scoring Algorithms
Bauer, Daniel; Holzer, Matthias; Kopp, Veronika; Fischer, Martin R.
Advances in Health Sciences Education, v16 n2 p211-221 May 2011
To compare different scoring algorithms for Pick-N multiple correct answer multiple-choice (MC) exams regarding test reliability, student performance, total item discrimination and item difficulty. Data from six 3rd year medical students' end of term exams in internal medicine from 2005 to 2008 at Munich University were analysed (1,255 students, 180 Pick-N items in total). Scoring Algorithms: Each question scored a maximum of one point. We compared: (a) Dichotomous scoring (DS): One point if all true and no wrong answers were chosen. (b) Partial credit algorithm 1 (PS50): One point for 100% true answers; 0.5 points for 50% or more true answers; zero points for less than 50% true answers. No point deduction for wrong choices. (c) Partial credit algorithm 2 (PS1/m): A fraction of one point depending on the total number of true answers was given for each correct answer identified. No point deduction for wrong choices. Application of partial crediting resulted in psychometric results superior to dichotomous scoring (DS). Algorithms examined resulted in similar psychometric data with PS50 only slightly exceeding PS1/m in higher coefficients of reliability. The Pick-N MC format and its scoring using the PS50 and PS1/m algorithms are suited for undergraduate medical examinations. Partial knowledge should be awarded in Pick-N MC exams.
Descriptors: Medical Students, Test Reliability, Internal Medicine, Scoring, Logical Thinking, Psychometrics, Mathematics, Comparative Analysis, Academic Achievement, Multiple Choice Tests, Difficulty Level, Test Items, Medical Education, Foreign Countries
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: email@example.com; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Location: Germany