ERIC Number: EJ1195175
Record Type: Journal
Publication Date: 2018
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1536-6367
EISSN: N/A
Evaluating CAT-Adjusted Approaches for Suspected Item Parameter Drift Detection
Cappaert, Kevin J.; Wen, Yao; Chang, Yu-Feng
Measurement: Interdisciplinary Research and Perspectives, v16 n4 p226-238 2018
Events such as curriculum changes or practice effects can lead to item parameter drift (IPD) in computer adaptive testing (CAT). The current investigation introduced a point- and weight-adjusted D[superscript 2] method for IPD detection for use in a CAT environment when items are suspected of drifting across test administrations. Type I error and power rates of the proposed method were compared to a more traditional, non-adjusted D[superscript 2] method and two recently suggested methods for use in a CAT environment: pseudo-count robust z and pseudo-count D[superscript 2] methods. Though all CAT-adjusted IPD detection methods compared resulted in high power, the pseudo-count D[superscript 2] method was found to have the highest power rates, with the proposed D[superscript 2] method a close second. All four methods were found to have acceptable type I error rates.
Descriptors: Adaptive Testing, Computer Assisted Testing, Test Items, Identification, Methods, Statistical Analysis, Sampling, Statistical Inference
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A