NotesFAQContact Us
Search Tips
ERIC Number: ED453275
Record Type: Non-Journal
Publication Date: 2001-Apr-11
Pages: 20
Abstractor: N/A
Reference Count: N/A
Item Disordinality with the Bookmark Standard Setting Procedure.
Skaggs, Gary; Tessema, Aster
This paper presents an application of the bookmark procedure to a test comprised of increasing text difficulty levels. The Test of English Proficiency for Adults (TEPA) was used for this study. Three forms of the TEPA were field tested in 1999 with approximately 1,000 non-native English speaking students enrolled in English-as-a-Second-Language programs. Bookmarking was generally successful with this test, but item disordinality played a major role in discussions by the judges. Three possible explanations were considered. The findings suggest that some degree of item disordinality resulted from sampling error of the item parameters. Basing the item map on the three-parameter model as opposed to the Rasch model had little impact on item placements in the booklets. An exploration of text difficulty suggested that the judges did not base their bookmark placements solely on text difficulty. The greatest consistency was found among the placements for items associated with the same text difficulty level. (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A