ERIC Number: ED371016
Record Type: RIE
Publication Date: 1994-Apr
Reference Count: N/A
Item Calibration Considerations: A Comparison of Item Calibrations on Written and Computerized Adaptive Examinations.
Stone, Gregory Ethan; Lunz, Mary E.
This paper explores the comparability of item calibrations for three types of items: (1) text only; (2) text with photographs; and (3) text plus graphics when items are presented on written tests and computerized adaptive tests. Data are from five different medical technology certification examinations administered nationwide in 1993. The Rasch model was used to calibrate items for the two test formats. Item calibrations obtained from each administrative mode were then compared. No significant differences were found between text only item calibrations obtained from the written tests and the computerized adaptive test. While some items with photographic or figure accompaniment showed slightly different item calibrations between the administrative modes, nonstatistical explanations explain most of the minor differences discovered. The results of this investigation confirm that Rasch item calibrations from written tests are appropriate for use on computerized adaptive tests. Included are four tables and six figures. (Contains 7 references.) (Author/SLD)
Descriptors: Adaptive Testing, Comparative Analysis, Computer Assisted Testing, Diagrams, Difficulty Level, Illustrations, Item Response Theory, Medical Technologists, Photographs, Test Format, Test Items, Test Reliability, Testing
Mary E. Lunz, American Society of Clinical Psychologists, 2100 West Harrison Street, Chicago, IL 60612.
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Calibration; Comparability; Item Calibration; Item Stability; Rasch Model
Note: Paper presented at the Annual Meeting of the American Educational Research Association (New Orleans, LA, April 4-8, 1994).