ERIC Number: EJ1152982
Record Type: Journal
Publication Date: 2017
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Available Date: N/A
Detecting Item Drift in Large-Scale Testing
Guo, Hongwen; Robin, Frederic; Dorans, Neil
Journal of Educational Measurement, v54 n3 p265-284 Fall 2017
The early detection of item drift is an important issue for frequently administered testing programs because items are reused over time. Unfortunately, operational data tend to be very sparse and do not lend themselves to frequent monitoring analyses, particularly for on-demand testing. Building on existing residual analyses, the authors propose an item index that requires only moderate-to-small sample sizes to form data for time-series analysis. Asymptotic results are presented to facilitate statistical significance tests. The authors show that the proposed index combined with time-series techniques may be useful in detecting and predicting item drift. Most important, this index is related to a well-known differential item functioning analysis so that a meaningful effect size can be proposed for item drift detection.
Descriptors: Testing, Test Items, Identification, Sample Size, Statistical Analysis, Statistical Significance, Time, Prediction, Effect Size, Item Response Theory
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A