NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED379335
Record Type: Non-Journal
Publication Date: 1994-Jun
Pages: 17
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
Technical Issues in Performance Assessment: Setting Performance Standards.
Hansche, Linda
Setting standards on performance measures is discussed in the context of the State Collaborative on Assessment and Student Standards (SCASS) initiative supported by the Council of Chief State School Offices. The usual item-based methods for standard setting, the methods developed by Nedelsky (1954), Angoff (1971), and Ebel (1972), were developed for use with large numbers of multiple choice items of a unidimensional nature with item scores contributing to a summative scale. They have little or no value when applied to performance items, where scores typically do not measure a single construct, and there are often multiple scores for each exercise. One approach that is being considered for performance standard setting is judgmental policy capturing, a general procedure designed to describe statistically the unique information processing strategies of individual raters. It usually includes the derivation of one or more summary policies that characterize all raters. Pilot tests have supported the utility of this approach. Another approach is that of the dominant profile procedure, in which a standard setting panel first states and then redefines policies as they attempt consensus about successful scores. SCASS efforts will consider both these approaches and their generalizability. A handout is attached. (Contains 3 references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A