ERIC Number: ED431797
Record Type: Non-Journal
Publication Date: 1999-Apr
Reference Count: N/A
Pretesting alongside an Operational CAT.
Davey, Tim; Pommerich, Mary; Thompson, Tony D.
In computerized adaptive testing (CAT), new or experimental items are frequently administered alongside operational tests to gather the pretest data needed to replenish and replace item pools. The two basic strategies used to combine pretest and operational items are embedding and appending. Variable-length CATs are preferred because of the control they give test developers over what is measured and the precision of that measurement. When variable-length testing and embedded items are combined, problems arise because of the difficulty of distributing pretest items evenly across tests of unknown length. Simulation studies focused on the procedures for making the necessary adjustments and prediction of test length and the impact of these procedures on operational testing. Accurate prediction was found to be possible provided prediction begins only after at least five items have been administered. Predictions also improve with increasing test length. Very simple regression models proved both effective and highly stable in cross validation. (Contains 1 table, 5 figures, and 14 references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A