ERIC Number: EJ784322
Record Type: Journal
Publication Date: 2008
Pages: 19
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0146-6216
EISSN: N/A
A Monte Carlo Approach to the Design, Assembly, and Evaluation of Multistage Adaptive Tests
Belov, Dmitry I.; Armstrong, Ronald D.
Applied Psychological Measurement, v32 n2 p119-137 2008
This article presents an application of Monte Carlo methods for developing and assembling multistage adaptive tests (MSTs). A major advantage of the Monte Carlo assembly over other approaches (e.g., integer programming or enumerative heuristics) is that it provides a uniform sampling from all MSTs (or MST paths) available from a given item pool. The uniform sampling allows a statistically valid analysis for MST design and evaluation. Given an item pool, MST model, and content constraints for test assembly, three problems are addressed in this study. They are (a) the construction of item response theory (IRT) targets for each MST path, (b) the assembly of an MST such that each path satisfies content constraints and IRT constraints, and (c) an analysis of the pool and constraints to increase the number of nonoverlapping MSTs that can be assembled from the pool. The primary intent is to produce reliable measurements and enhance pool utilization. (Contains 11 figures and 2 tables.)
Descriptors: Monte Carlo Methods, Adaptive Testing, Sampling, Item Response Theory, Test Construction, Test Format
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Law School Admission Test
Grant or Contract Numbers: N/A