NotesFAQContact Us
Search Tips
ERIC Number: ED442825
Record Type: Non-Journal
Publication Date: 2000-Apr
Pages: 11
Abstractor: N/A
Reference Count: N/A
The ACT/NAGB Standard Setting Process: How "Modified" Does It Have To Be before It Is No Longer a Modified-Angoff Process?
Reckase, Mark D.
The kernel of the Angoff method of standard setting (W. Angoff, 1971) would seem to be the judgment of whether a minimally competent person could answer an item on a test correctly or not. So it would seem that any procedure that requires independent judgment of the correctness or incorrectness of a response to items for a minimally acceptable examinee would merit being labeled as an Angoff method. Standard setting methods that use the Angoff kernel can be quite different in practice, but they may be given the same label in the literature on standard setting. The kernel for the modified Angoff method is not well-defined, but for this paper, it is defined as judgments of the proportion of correct responses for minimally qualified examinees on each item on a test. A look at the American College Test/National Assessment Governing Board (ACT/NAGB) standard setting process for 1992 shows that the definition of the kernel has evolved into something that only contains the essence of the modified Angoff kernel in the first round of ratings. Once the holistic information about test and item performance is provided following round one, it can no longer be argued that panelists are performing independent item-by-item ratings. Labeling a standard setting process by the summary description of the kernel is no longer adequate. The ACT/NAGB method is a multi-round process with a modified Angoff kernel for the first round, holistic feedback, and normative information for later rounds, and direct specification of cutscores on the score scale in the final round. (Contains 12 references.) (SLD)
Publication Type: Reports - Descriptive; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A