ERIC Number: EJ826616
Record Type: Journal
Publication Date: 2008-Apr
Abstractor: As Provided
Reference Count: 13
Does the Answer Order Matter on Multiple-Choice Exams?
Tellinghuisen, Joel; Sulikowski, Michelle M.
Journal of Chemical Education, v85 n4 p572-575 Apr 2008
Surprising version-dependent differences are noted in student performance on certain questions in a standardized general chemistry exam. The exam in question has two versions, on which both questions and answers are ordered differently. For the questions suspected of answer-order bias, the performance is better in ten of twelve cases when students see the correct answer earlier in the list of four choices. Expansion of the study to more abundant data for the same exam from the ACS DivCHED Examinations Institute supports the interpretation of these observations as a primacy effect, characteristic of guessing, but with an aversion for the first choice. However, the single problem that shows the greatest disparity between versions in both data sets is one most chemists would view as so simple as to make guessing unnecessary, hence unlikely as an explanation. (Contains 6 notes and 6 figures.)
Descriptors: Primacy Effect, Multiple Choice Tests, Test Bias, Standardized Tests, Chemistry, Science Instruction, Science Achievement, College Science, Test Construction
Division of Chemical Education of the American Chemical Society. Subscription Department, P.O. Box 1267, Bellmawr, NJ 08099-1267. Tel: 800-691-9846; Tel: 856-931-5825; Fax: 856-931-4115; e-mail: firstname.lastname@example.org; Web site: http://www.jce.divched.org
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Authoring Institution: N/A