NotesFAQContact Us
Search Tips
ERIC Number: ED422354
Record Type: Non-Journal
Publication Date: 1998-Apr
Pages: 13
Abstractor: N/A
Reference Count: N/A
Effect of a Modified Angoff Strategy for Obtaining Item Performance Estimates in a Standard Setting Study.
Plake, Barbara S.; Giraud, Gerald
In the traditional Angoff Standard Setting Method, experts are instructed to predict the possibility that a randomly selected, hypothetical minimally competent candidate will be able to answer each multiple choice question in the test correctly. These item performance estimates are averaged across panelists and aggregated to determine the minimum passing score for the test. Some applications have used a modification of this method where panelists are instructed to provide their item performance estimates in deciles, with each decile representing a 10-point probability range. The purpose of the study was to investigate the validity of this approach, in terms of comparability of results to that which would occur from the traditional, open-ended administration procedures. Differences were found between the minimum passing scores across the two methods. A variation that gathered restricted item performance estimates for the initial round and reverted to the full probability scale for round 2 was shown to reduce these differences. Discussion focuses on situations where this variation to the modified Angoff method may be particularly attractive. (Contains one table and four references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A