ERIC Number: EJ1024430
Record Type: Journal
Publication Date: 2013
Abstractor: As Provided
Reference Count: 32
The Impact of Item Format and Examinee Characteristics on Response Times
Hess, Brian J.; Johnston, Mary M.; Lipner, Rebecca S.
International Journal of Testing, v13 n4 p295-313 2013
Current research on examination response time has focused on tests comprised of traditional multiple-choice items. Consequently, the impact of other innovative or complex item formats on examinee response time is not understood. The present study used multilevel growth modeling to investigate examinee characteristics associated with response time differences on a medical certification exam comprised of two item formats. A linear model described examinee pacing on the traditional multiple-choice section, while a quadratic or curvilinear model described pacing on a diagnostic study section comprised of complex graphic-intensive multiple-response items. Examinees' gender, ability, and age explained variability in response times for each exam section; notably, older examinees' initial pacing was slower on the multiple-choice section but faster on the complex graphic-intensive multiple-response section. This study has implications for test developers throughout the world who intend to incorporate complex item formats into their high-stakes exams.
Descriptors: Test Items, Test Format, Reaction Time, Individual Characteristics, Hierarchical Linear Modeling, Licensing Examinations (Professions), Multiple Choice Tests, Age Differences, Gender Differences, Ability
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A