ERIC Number: EJ829912
Record Type: Journal
Publication Date: 2009
Abstractor: As Provided
Reference Count: 21
A Conditional Exposure Control Method for Multidimensional Adaptive Testing
Finkelman, Matthew; Nering, Michael L.; Roussos, Louis A.
Journal of Educational Measurement, v46 n1 p84-103 Spr 2009
In computerized adaptive testing (CAT), ensuring the security of test items is a crucial practical consideration. A common approach to reducing item theft is to define maximum item exposure rates, i.e., to limit the proportion of examinees to whom a given item can be administered. Numerous methods for controlling exposure rates have been proposed for tests employing the unidimensional 3-PL model. The present article explores the issues associated with controlling exposure rates when a multidimensional item response theory (MIRT) model is utilized and exposure rates must be controlled conditional upon ability. This situation is complicated by the exponentially increasing number of possible ability values in multiple dimensions. The article introduces a new procedure, called the generalized Stocking-Lewis method, that controls the exposure rate for students of comparable ability as well as with respect to the overall population. A realistic simulation set compares the new method with three other approaches: Kullback-Leibler information with no exposure control, Kullback-Leibler information with unconditional Sympson-Hetter exposure control, and random item selection.
Descriptors: Test Items, Adaptive Testing, Item Analysis, Item Response Theory, Computer Assisted Testing, Models, Simulation
Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.blackwellpublishing.com/jnl_default.asp
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A