NotesFAQContact Us
Search Tips
ERIC Number: ED430004
Record Type: Non-Journal
Publication Date: 1999-Apr
Pages: 35
Abstractor: N/A
Reference Count: N/A
Validation of Angoff-based Predictions of Item Performance.
Plake, Barbara S.; Impara, James C.; Irwin, Patrick
Judgmental standard setting methods, such as the Angoff method (W. Angoff, 1971), use item performance estimates as the basis for determining the minimum passing score (MPS). Therefore the accuracy of these item performance estimates is crucial to the validity of the resulting MPS. Recent researchers (L. Shepard, 1994; J. Impara, 1997) have called into question the ability of the judges to make accurate item performance estimates for target subgroups of candidates, such as minimally competent candidates. The purpose of this study was to examine both the reliability and accuracy of item performance estimates from an Angoff standard setting application using as a model the framework suggested by M. Kane (1994). Results from the standard setting example involving 29 judges for an international certification program in financial management provide evidence that item performance estimates were both valid and reliable. Factors that might have influenced this high degree of reliability and validity in the item performance estimates in a standard setting study are discussed. (Contains five tables and nine references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A