ERIC Number: ED249267
Record Type: RIE
Publication Date: 1984-Apr
Reference Count: 0
Practical Considerations When Setting Test Standards: A Look at the Process Used in Kansas.
Poggio, John P.
Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods have been used to set test standards. While no one method appears to identify true cut scores and cut score comparison over methods is consistent with other research, only the Angoff and Ebel methods are currently being used. While problems were found with all methods, empirical and Nedelsky methods were more confusing to participants and yielded lower standards. A survey approach has replaced panel judgment for data collection. It is more efficient, permits a broader input base, and produces more psychometrically favorable standards. A 26-member State Advising Committee inperpolates for the data gathered to set standards rather than using the mathematics prescribed by the methods. The process, while objective to a point, remains largely value-laden. Standard data for each 1982 test are given. Sample survey forms and rating sheets for the Angoff and Ebel methods are appended. (BS)
Publication Type: Speeches/Meeting Papers; Reports - Descriptive; Tests/Questionnaires
Education Level: N/A
Authoring Institution: N/A
Identifiers: Angoff Methods; Ebel Method; Kansas
Note: Paper presented at the Annual Meeting of the American Educational Research Association (68th, New Orleans, LA, April 23-27, 1984).