ERIC Number: ED372078
Record Type: Non-Journal
Publication Date: 1994-Apr
Reference Count: N/A
The Selection of Test Items for Decision Making with a Computer Adaptive Test.
Spray, Judith A.; Reckase, Mark D.
The issue of test-item selection in support of decision making in adaptive testing is considered. The number of items needed to make a decision is compared for two approaches: selecting items from an item pool that are most informative at the decision point or selecting items that are most informative at the examinee's ability level. The first approach is explored using a method based on sequential Bayes estimation and the second is based on the sequential probability ratio test (SPRT). Simulation studies used item parameters from an actual mathematics item pool developed for COMPASS, the American College Testing Program's computerized adaptive-testing package for college placement. Results could not be compared directly because matching the decision error rates for the two procedures is beyond the scope of the paper. Results do provide clear evidence that selecting items to maximize information at the decision points results in shorter average test lengths than selecting items to maximize information either at true ability (which is impossible) or at the most recent ability estimate. It is expected that these results will generalize to many adaptive-testing applications. (Contains 14 references and 2 figures.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: COMPASS (Computer Assisted Test)