NotesFAQContact Us
Search Tips
ERIC Number: ED177194
Record Type: RIE
Publication Date: 1979-Apr
Pages: 28
Abstractor: N/A
Reference Count: 0
A Defensible Model for Determining a Minimal Cut-Off Score for Criterion Referenced Tests.
Bernknopf, Stan; And Others
The effectiveness of a model for determining a minimal cut-off score for criterion-referenced tests was examined. The model, based upon techniques presented originally by Nedelsky and by Angoff, was first used in conjunction with a multiple choice test developed for use in certifying school counselors in Georgia. A "knowledge estimation panel" was used to determine criterion scores; the panel of subject experts estimates the percentages of minimally knowledgeable candidates who could be expected to know (not guess) the correct answers. Nineteen judges on the panel rated 684 items. The resulting criterion scores were then lowered to adjust for standard error and raised to adjust for guessing. The consistency of results was supported by a comparison of parallel test forms and comparable halves of the panel. The panel's estimates of item difficulty were found to be highly correlated with actual difficulty when trial tests were administered. Beta coefficients of agreement also supported the consistency of mastery decisions made. (The legal importance of the models' validity is briefly discussed, and several references to court cases are appended). (GDC)
Publication Type: Speeches/Meeting Papers; Reports - General
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (San Francisco, California, April 9-11, 1979)