NotesFAQContact Us
Collection
Advanced
Search Tips
50 Years of ERIC
50 Years of ERIC
The Education Resources Information Center (ERIC) is celebrating its 50th Birthday! First opened on May 15th, 1964 ERIC continues the long tradition of ongoing innovation and enhancement.

Learn more about the history of ERIC here. PDF icon

Back to results
Peer reviewed Peer reviewed
ERIC Number: EJ598373
Record Type: CIJE
Publication Date: 1999
Pages: N/A
Abstractor: N/A
Reference Count: 0
ISBN: N/A
ISSN: ISSN-0013-1644
How Many Raters Should Be Used for Establishing Cutoff Scores with the Angoff Method? A Generalizability Theory Study.
Hurtz, Gregory M.; Hertz, Norman R.
Educational and Psychological Measurement, v59 n6 p885-97 Dec 1999
Evaluated Angoff ratings from eight different occupational licensing examinations through generalizability theory to estimate the optimal number of raters. Results indicate that approximately 10 to 15 raters is an optimal target range. (SLD)
Descriptors: Cutting Scores, Evaluators, Generalizability Theory, Interrater Reliability, Licensing Examinations (Professions), Standard Setting (Scoring)
Publication Type: Journal Articles; Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers: Angoff Methods
Note: Version of a paper presented at the Annual Meeting of the Society for Industrial and Organizational Psychology (April, 1996).