ERIC Number: EJ1103008
Record Type: Journal
Publication Date: 2016
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0655
EISSN: N/A
Monitoring Items in Real Time to Enhance CAT Security
Zhang, Jinming; Li, Jie
Journal of Educational Measurement, v53 n2 p131-151 Sum 2016
An IRT-based sequential procedure is developed to monitor items for enhancing test security. The procedure uses a series of statistical hypothesis tests to examine whether the statistical characteristics of each item under inspection have changed significantly during CAT administration. This procedure is compared with a previously developed CTT-based procedure through simulation studies. The results show that when the total number of examinees is fixed both procedures can control the rate of type I errors at any reasonable significance level by choosing an appropriate cutoff point and meanwhile maintain a low rate of type II errors. Further, the IRT-based method has a much lower type II error rate or more power than the CTT-based method when the number of compromised items is small (e.g., 5), which can be achieved if the IRT-based procedure can be applied in an active mode in the sense that flagged items can be replaced with new items.
Descriptors: Computer Assisted Testing, Test Items, Difficulty Level, Item Response Theory, Error of Measurement, Error Correction, Statistics, Comparative Analysis, Simulation, Synchronous Communication, Item Analysis, Item Banks, Adaptive Testing, Testing, Hypothesis Testing
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A