ERIC Number: EJ1162520
Record Type: Journal
Publication Date: 2017
Abstractor: As Provided
Condensed Mastery Profile Method for Setting Standards for Diagnostic Assessment Systems
Clark, A. K.; Nash, B.; Karvonen, M.; Kingston, N.
Educational Measurement: Issues and Practice, v36 n4 p5-15 Win 2017
The purpose of this study was to develop a standard-setting method appropriate for use with a diagnostic assessment that produces profiles of student mastery rather than a single raw or scale score value. The condensed mastery profile method draws from established holistic standard-setting methods to use rounds of range finding and pinpointing to specify cut points between performance levels. Panelists are convened to review profiles of mastery and specify cut points between performance levels based on the total number of skills mastered. Following panelist specification of cut points, a statistical method is implemented to smooth cut points over grades to decrease between-grade variability. Procedural evidence, including convergence plots, standard errors of pinpointing ratings, and panelist feedback, suggest the condensed mastery profile method is a useful and technically sound approach for setting performance standards for diagnostic assessment systems.
Descriptors: Diagnostic Tests, Standard Setting (Scoring), Cutting Scores, Performance, Standards, Holistic Evaluation
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Sponsor: Office of Special Education and Rehabilitative Services (ED)
Authoring Institution: N/A
Grant or Contract Numbers: 84373X100001