NotesFAQContact Us
Search Tips
ERIC Number: ED400283
Record Type: Non-Journal
Publication Date: 1991-Apr
Pages: 14
Abstractor: N/A
Reference Count: N/A
Dissecting Item Misfit on Vocabulary Items.
Gershon, Richard C.
The Johnson O'Connor Research Foundation, which produces vocabulary instructional materials for test takers, is in the process of determining the difficulty values of nontechnical words in the English language. To this end, the Foundation writes test items for vocabulary words and tests them in schools. The items are then calibrated using the Rasch model. This procedure results in a significant number of items being labeled as misfitting and being rejected from the item bank. A mislead analysis technique was created to try to uncover the sources of problems in items with poor fit statistics. The dataset used contained test results for over 3,500 items, each of which was administered to 400 to 600 persons, for a total of approximately 23,000 persons. General mislead curves were compared to the actual performance for items previously labeled as misfitting, and a mislead characteristic curve was established. A mislead table was constructed for each item. The mislead was considered to be significantly flawed for a given ability group when the observed performance differed from the means by more than two standard deviations. Each cell in the mislead table was evaluated in this way, giving item writers a way to observe which item choices are not functioning as expected. Five appendixes give examples of the mislead profiles for specific words. (Contains one figure and one table.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A