ERIC Number: EJ723304
Record Type: Journal
Publication Date: 2006
Reference Count: 20
A Comparison of Alternative Models for Testlets
Li, Yanmei; Bolt, Daniel M.; Fu, Jianbin
Applied Psychological Measurement, v30 n1 p3-21 2006
When tests are made up of testlets, standard item response theory (IRT) models are often not appropriate due to the local dependence present among items within a common testlet. A testlet-based IRT model has recently been developed to model examinees' responses under such conditions (Bradlow, Wainer, & Wang, 1999). The Bradlow, Wainer, and Wang model introduces separate testlet factors to account for this dependence and applies a common item discrimination parameter to both the general ability and testlet factor. This study investigates several alternative ways of accounting for local dependence that make different assumptions regarding the influence of testlet factors on item performance. The authors implement several Bayesian model selection criteria to compare models using several real test data sets that have a testlet structure. Results suggest that an alternative model in which separate discrimination parameters are applied to the general ability and testlet factors provides a better fit to these data despite its greater complexity.
Descriptors: Models, Markov Processes, Item Response Theory, Tests, Monte Carlo Methods, Evaluation Methods
SAGE Publications, 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243 (Toll Free); Fax: 800-583-2665 (Toll Free).
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A