NotesFAQContact Us
Search Tips
ERIC Number: ED464095
Record Type: Non-Journal
Publication Date: 2002-Apr-2
Pages: 37
Abstractor: N/A
Reference Count: N/A
A "Rearrangement Procedure" for Scoring Adaptive Tests with Review Options.
Papanastasiou, Elena C.
Due to the increased popularity of computerized adaptive testing (CAT), many admissions tests, as well as certification and licensure examinations, have been transformed from their paper-and-pencil versions to computerized adaptive versions. A major difference between paper-and-pencil tests and CAT, from an examinees point of view, is that in many cases examinees are not allowed to revise their answers with the CAT system. Examinees generally prefer item review, since they can correct misread or miskeyed items, while some researchers are afraid that examinees might try to use item review to cheat on the test. This study tested the efficacy of a rearrangement procedure that rearranges and skips certain items in order to estimate the examinees abilities better, without allowing them to cheat on the test. The rearrangement procedure allowed examinees to preview previously presented items without allowing them to inflate their test scores artificially by using testwiseness strategies. This approach was examined through a simulation study for which 26,000 examinees were simulated. Results show that the rearrangement procedure is effective in reducing the bias of the ability estimates. The reliability decreased slightly after the procedure, but this decrease was negligible. (Contains 4 figures, 4 tables, and 39 references.) (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A