ERIC Number: ED424273
Record Type: Non-Journal
Publication Date: 1998-May
Reference Count: N/A
Feasibility Studies of Two-Stage Testing in Large-Scale Educational Assessment: Implications for NAEP. NAEP Validity Studies.
Bock, R. Darrell; Zimowski, Michele F.
This report examines the potential of adaptive testing, two-stage testing in particular, for improving the data quality of the National Assessment of Educational Progress (NAEP). Following a discussion of the rationale for adaptive testing in assessment and a review of previous studies of two-stage testing, this report describes a 1993 Ohio field trial of two-stage assessment carried out under the direction of the present authors by the National Opinion Research Center. The trial was part of a larger methodological study of science assessment at school-leaving age supported by the National Science Foundation and the Office of Educational Research Improvement. The two stage study, which was limited to multiple choice items, encompassed the main subject matter areas of contemporary secondary school science. It was conducted in 36 high schools. This report summarizes the instrument design, procedures, and results of the field trial and discusses implications for the conduct of assessment generally and the NAEP specifically. The study showed that two-stage testing can be carried out effectively by local school personnel when the test materials are well-organized and all data handling steps are performed centrally. A technical appendix outlines the measurement justification for two design prototypes and describes procedure used in analyzing the data. (Contains 14 figures, 2 tables, and 19 references.) (SLD)
Publication Type: Reports - Research
Education Level: N/A
Sponsor: National Center for Education Statistics (ED), Washington, DC.
Authoring Institution: American Institutes for Research in the Behavioral Sciences, Palo Alto, CA.
Identifiers - Assessments and Surveys: National Assessment of Educational Progress