NotesFAQContact Us
Search Tips
ERIC Number: ED400287
Record Type: Non-Journal
Publication Date: 1994-Apr
Pages: 26
Abstractor: N/A
Reference Count: N/A
Computerized Adaptive Testing Exploring Examinee Response Time Using Hierarchical Linear Modeling.
Bergstrom, Betty; And Others
Examinee response times from a computerized adaptive test taken by 204 examinees taking a certification examination were analyzed using a hierarchical linear model. Two equations were posed: a within-person model and a between-person model. Variance within persons was eight times greater than variance between persons. Several variables significantly predicted within-person variance. Response time increased with increasing items, test length, and increasing relative item difficulty. Item sequence was negatively related to response time, and some content areas required more time than others. Examinees spent more time on items they got wrong than on items they got right, and they took longer to respond when the correct answer was A, B, or C than when the correct answer was D. Only one variable, test anxiety, significantly predicted variance between examinees. Examinee age, sex, first language, and ethnicity did not predict between-person variance, and low-ability examinees did not take longer to respond to items than high-ability examinees. Understanding how item characteristics impact on response time may allow test developers to allot total test time based on the response time history of the individual test items. This study also suggests that examinee characteristics are generally not related to response time, but that more controllable factors such as item length, position of the keyed correct answer, and use of figures do contribute to response items. An appendix contains the anxiety survey. (Contains 1 figure, 5 tables, and 12 references.) (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A