ERIC Number: ED445119
Record Type: Non-Journal
Publication Date: 2000-Apr
Reference Count: N/A
Applying Specific Information Item Selection to a Passage-Based Test.
Thompson, Tony D.; Davey, Tim
This paper applies specific information item selection using a method developed by T. Davey and M. Fan (2000) to a multiple-choice passage-based reading test that is being developed for computer administration. Data used to calibrate the multidimensional item parameters for the simulation study consisted of item responses from randomly equivalent groups of approximately 3,000 examinees each, each group taking 1 of 8 operational fixed forms from an existing paper-and-pencil test of reading comprehension. The main finding of the study was that the use of specific information item selection greatly aided efforts in creating a computer adapted test that met all the requirements of content specialists while at the same time controlling measurement precision. Although there were many complications in selecting the passage pool, it was worth the trouble because content specialists, under the current design, are able to review the combination of passages examinees can see beforehand, ensuring that each examinee will be administered a test that meets content requirements. Exposure control is done automatically at the passage level, and measurement precision can be specified because of the use of specific information item selection. The study provides evidence that the target information functions can be fairly well matched on average across the ability scale, but no evidence has been presented to show that this finding would hold for all simulated examinees within each score category. (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: American Coll. Testing Program, Iowa City, IA.