ERIC Number: ED334237
Record Type: RIE
Publication Date: 1991-Apr
Reference Count: N/A
Assessing the Effects of Computer Administration on Scores and Parameter Estimates Using IRT Models.
Sykes, Robert C.; And Others
To investigate the psychometric feasibility of replacing a paper-and-pencil licensing examination with a computer-administered test, a validity study was conducted. The computer-administered test (Cadm) was a common set of items for all test takers, distinct from computerized adaptive testing, in which test takers receive items appropriate to their estimated abilities. The Cadm version, scheduled for implementation in 1990, would consist of 230 items. The validation study was designed to use the capabilities of item response theory (IRT) to produce shorter test forms of a specified reliability relative to the original test or the proposed version. Four combinations of paper-and-pencil and Cadm tests were administered to 418 licensure candidates, each of whom were administered 150 items each in a paper-and-pencil mode and in a Cadm mode. No effects of the mode of administration were found, and there were no signs of significant differences in overall performance across the administration modes. Assessment of multiple item forms and candidate samples reinforced the conclusion that there was no significant effect of computer administration on candidate performance. Eleven tables and eight figures present study results. (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Paper and Pencil Tests
Note: Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, IL, April 3-7, 1991).