ERIC Number: ED395976
Record Type: RIE
Publication Date: 1994-Apr
Reference Count: N/A
A Comparison of the Properties of IRT Parameter Estimates Using Two Different Calibration Designs.
Wightman, Lawrence E.; De Champlain, Andre F.
Two different methods of obtaining three parameter logistic item response theory (IRT) pretest item parameter estimated for the Graduate Management Admissions Testing Program. The first method consisted of calibrating pretest and operational items simultaneously in a LOGIST run, that is a concurrent calibration design. The second approach entailed analyzing the pretest items separately from the operational items holding examinee ability scores constant from a previous operational items run, that is, using a two-stage calibration design. Results show that the means of the item difficulty (b-parameter) estimates were very similar, regardless of the method employed. However, the higher b-parameter values using the two-stage calibration run method (i.e., holding ability fixed excluding the studied items from the criterion) were slightly overestimated and the lower b-parameter values were slightly underestimated. The a-parameters were consistently underestimated using the two-stage estimation procedure. Finally, the slopes of the item-ability regressions using a concurrent calibration (including the studied items) are steeper for nearly all of the items. These preliminary results are consistent with those reported in past studies and suggest that non-operational (pretest) items should be calibrated concurrently with operational items for item banking purposes. (Contains 4 tables, 8 figures, and 16 references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers: Calibration; Graduate Management Admission Test; LOGIST Computer Program; Three Parameter Model