ERIC Number: ED414298
Record Type: Non-Journal
Publication Date: 1997-Jul
Reference Count: N/A
Unidimensional Approximations for a Computerized Classification Test When the Item Pool and Latent Space Are Multidimensional. ACT Research Report Series 97-5.
Spray, Judith A.; Abdel-fattah, Abdel-fattah A.; Huang, Chi-Yu; Lau, C. Allen
The primary concern or focus of a certification or licensure test is to obtain valid criterion-referenced information regarding a candidate's competence to practice. When the test is administered by computer, a valid pass/fail decision can be made with fewer items than an equivalent paper/pencil test by targeting items at the passing score and using a likelihood ratio test such as the one used in the sequential probability ratio test (SPRT). When administered on the computer, the SPRT is frequently referred to as a computerized classification test (CCT) to distinguish it from the usual computerized adaptive test. If the CCT is item response theory-based, an assumption of unidimensionality is usually required, and the concern is when the item pool is not essentially unidimensional. This study investigated the effects that a multidimensional item pool and latent ability space have on the accuracy of the decisions made using CCT. An item pool was created from the multidimensional calibration of six forms of the ACT Assessment mathematics test using the computer program NOHARM. The results with this set of 360 items show that the procedure may be fairly robust to such assumption violations. (Contains three tables and nine references.) (Author/SLD)
Descriptors: Classification, Competence, Computer Assisted Testing, Item Banks, Item Response Theory, Licensing Examinations (Professions), Mathematics Tests, Robustness (Statistics)
ACT Research Report Series, P.O. Box 168, Iowa City, IA 52243-0168.
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: American Coll. Testing Program, Iowa City, IA.
Identifiers - Assessments and Surveys: ACT Assessment