ERIC Number: ED450131
Record Type: Non-Journal
Publication Date: 2000
Reference Count: N/A
Adaptive Mastery Testing Using a Multidimensional IRT Model and Bayesian Sequential Decision Theory. Research Report.
Glas, Cees A. W.; Vos, Hans J.
This paper focuses on a version of sequential mastery testing (i.e., classifying students as a master/nonmaster or continuing testing and administering another item or testlet) in which response behavior is modeled by a multidimensional item response theory (IRT) model. First, a general theoretical framework is outlined that is based on a combination of Bayesian sequential decision theory and multidimensional IRT. Then how multidimensional IRT-based sequential master testing can be generalized to adaptive item- and testlet-selection rules is discussed for the case where the choice of the next item or testlet to be administered is optimized using the information from previous responses. Both compensatory and conjunctive loss structures are considered. Simulation studies are used to evaluate: (1) the performance, in terms of average loss, of multidimensional IRT-based sequential mastery testing as a function of the number of items administered per testing stage; (2) the effects on average loss when turning the sequential procedure into an adaptive sequential procedure; and (3) the impact on average loss when the multidimensional structure is ignored and a unidimensional IRT model is used in the decision procedure. (Contains 9 tables and 20 references.) (Author/SLD)
Descriptors: Adaptive Testing, Bayesian Statistics, Classification, Computer Assisted Testing, Item Response Theory, Mastery Tests, Test Construction, Test Items
Faculty of Educational Science and Technology, University of Twente, TO/OMD, P.O. Box 7500 AE Enschede, The Netherlands.
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Twente Univ., Enschede (Netherlands). Faculty of Educational Science and Technology.