ERIC Number: ED219416
Record Type: RIE
Publication Date: 1982-Mar
The Technical Quality of Test Items Generated Using a Systematic Approach to Item Writing.
Siskind, Theresa G.; Anderson, Lorin W.
The study was designed to examine the similarity of response options generated by different item writers using a systematic approach to item writing. The similarity of response options to student responses for the same item stems presented in an open-ended format was also examined. A non-systematic (subject matter expertise) approach and a systematic (algorithmic) approach were the methods of item writing employed. Results indicated that neither approach resulted in very similar response options being generated by writers. Few response options produced by either approach corresponded with the incorrect student responses. The variation in incorrect student responses illustrated that the use of multiple choice items to test basic mathematics operations would not account for all student errors. It is probable that multiple choice test scores would be inflated over open-ended format test scores utilizing the same items. The study highlighted some potential problems in attempting to construct unbiased multiple choice tests. (DWH)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the National Council of Measurement in Education (New York, NY, March 20-22, 1982).