ERIC Number: ED395014
Record Type: RIE
Publication Date: 1989-Jul
Reference Count: N/A
An Analysis of Test Writers' Expertise: Modeling Analogy Item Difficulty.
Enright, Mary K.; Bejar, Isaac I.
In this study, the ability of test development staff to predict the difficulty of analogy items was explored. The nature of the item attributes that contributed to test writers' predictions of difficulty as well as actual item difficulty was also investigated. The two expert test writers studied were quite good at predicting item difficulty. Item attributes such as vocabulary difficulty and rationale difficulty contributed to item difficulty. However, a statistical model of item difficulty did not capture all the information that test writers used to judge item difficulty. This research contributes to the construct validation of tests in two ways. First, identification of some item attributes that are associated with item difficulty clarifies what skills and processes are likely to be involved in solving analogies. Second, the expertise of test writers, a crucial ingredient in ensuring the validity of the test, is demonstrated. (Contains 2 figures, 6 tables, and 13 references.) (Author/SLD)
Publication Type: Reports - Research
Education Level: N/A
Sponsor: Graduate Record Examinations Board, Princeton, NJ.
Authoring Institution: Educational Testing Service, Princeton, NJ.