ERIC Number: ED163079
Record Type: RIE
Publication Date: 1978-Mar
Reference Count: 0
Validation of a Simplified Method for Determining Passing Scores for Criterion-Referenced, Multiple-Choice Tests.
Meredith, John B., Jr.
The complexity of defining accurate passing scores with a minimum classification error when evaluating criterion-referenced, multiple-choice tests has been a major problem for classroom teachers. Therefore, a practical procedure in which the instructor determines the plausibility of each item option for the minimally acceptable examinee is proposed and examined for validity. A 20-item test was evaluated by subject-matter-experts (SMEs) to determine the Minimal Acceptable Performance Level (MAPL). An analysis of variance procedure was applied to the SME item-ratings, the results of which indicated no difference among SMEs. Further, it was found that the interjudgmental item-ratings were consistent. The test was administered to 14 Naval examinees whose mastery-nonmastery classifications based upon the MAPL were found to be in complete agreement with independent evaluations of the students by SMEs. It was concluded that this is a reasonable method which can be used easily by classroom teachers in a short amount of time. (Author/JAC)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the American Educational Research Association (62nd, Toronto, Ontario, Canada, March 27-31, 1978)