ERIC Number: ED467807
Record Type: Non-Journal
Publication Date: 1999-Mar
Reference Count: N/A
An Evaluation of a Two-Stage Testlet Design for Computerized Testing. Law School Admission Council Computerized Testing Report. LSAC Research Report Series.
Reese, Lynda M.; Schnipke, Deborah L.
A two-stage design provides a way of roughly adapting item difficulty to test-taker ability. All test takers take a parallel stage-one test, and based on their scores, they are routed to tests of different difficulty levels in the second stage. This design provides some of the benefits of standard computer adaptive testing (CAT), such as increased precision of ability estimates over a paper-and-pencil design. In addition, the item selection and scoring algorithms in a two-stage design may be easier for test takers and test-result users to understandan important feature for gaining public acceptance of new test designs. This simulation study incorporated testlets (or collections of items) into the two-stage design and compared the precision of the ability estimates derived from this design with those derived from a standard CAT design and from a paper-and-pencil test design. The results indicate that if the testlets are carefully assembled, a two-stage testlet design can produce more precise ability estimates in the middle ability range than those obtained from a paper-and-pencil design with twice as many items. Results of this study provide a baseline against which future research that incorporates content constraints can be compared. (Contains 6 figures, 5 tables, and 12 references.) (Author/SLD)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Law School Admission Council, Princeton, NJ.