ERIC Number: EJ1048961
Record Type: Journal
Publication Date: 2015-Jan
Abstractor: As Provided
Improving the Reliability of Student Scores from Speeded Assessments: An Illustration of Conditional Item Response Theory Using a Computer-Administered Measure of Vocabulary
Petscher, Yaacov; Mitchell, Alison M.; Foorman, Barbara R.
Reading and Writing: An Interdisciplinary Journal, v28 n1 p31-56 Jan 2015
A growing body of literature suggests that response latency, the amount of time it takes an individual to respond to an item, may be an important factor to consider when using assessment data to estimate the ability of an individual. Considering that tests of passage and list fluency are being adapted to a computer administration format, it is possible that accounting for individual differences in response times may be an increasingly feasible option to strengthen the precision of individual scores. The present research evaluated the differential reliability of scores when using classical test theory and item response theory as compared to a conditional item response model which includes response time as an item parameter. Results indicated that the precision of student ability scores increased by an average of 5% when using the conditional item response model, with greater improvements for those who were average or high ability. Implications for measurement models of speeded assessments are discussed.
Descriptors: Computer Assisted Testing, Vocabulary, Item Response Theory, Reliability, Scores, Reaction Time, Accuracy, Reading Improvement, Reading Fluency
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: firstname.lastname@example.org; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A