NotesFAQContact Us
Search Tips
ERIC Number: ED516023
Record Type: Non-Journal
Publication Date: 2009
Pages: 200
Abstractor: As Provided
Reference Count: 0
ISBN: ISBN-978-1-1096-0962-2
The Presence and Influence of Context Effects on a High-Stakes Certification Examination
Roedl, Amy E.
ProQuest LLC, Ph.D. Dissertation, University of Illinois at Chicago
This study investigated the effects of item position on the stability of item parameters for items used on a large-scale, national certification examination and the resulting impact on examinee performance. Participants in this study included individuals from a large, chain restaurant who completed a nationally accredited food safety examination. The goal of this study was to determine whether context effects occurred as a result of item position and, if so, the extent to which they affected item- and examination-level characteristics such as examinee performance, pass/fail rates, estimates of internal consistency, and measures of decision consistency. Examinee performance on the pilot, unscored items on five different examination forms was analyzed. These items assumed the last 10 item positions on each examination and were arranged in different orders: (a) random arrangement, (b) arrangement by content in the order that the material is presented in the training materials, (c) arrangement by content, in the reverse order that the material is presented in the training materials, (d) arrangement by ascending difficulty, and (e) arrangement by descending difficulty. Performance on the randomly sequenced operational items, in the first 80 serial positions, was also analyzed. Overall, item arrangement had no effect on examinee performance, pass-fail rates, or measures of decision consistency. Measures of decision consistency also differed among forms, but these results cannot be attributed to this study. The results of this study support the randomization of items on high stakes large-scale certification examinations. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page:]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site:
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: Adult Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A