NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ901766
Record Type: Journal
Publication Date: 2010-Jun
Pages: 27
Abstractor: As Provided
Reference Count: 27
ISBN: N/A
ISSN: ISSN-1076-9986
Estimating Classification Accuracy for Complex Decision Rules Based on Multiple Scores
Douglas, Karen M.; Mislevy, Robert J.
Journal of Educational and Behavioral Statistics, v35 n3 p280-306 Jun 2010
Important decisions about students are made by combining multiple measures using complex decision rules. Although methods for characterizing the accuracy of decisions based on a single measure have been suggested by numerous researchers, such methods are not useful for estimating the accuracy of decisions based on multiple measures. This study presents a simulation method useful for estimating classification accuracy for any measurement model and complex decision rule. The utility of the method is demonstrated by application to actual data from General Educational Development (GED) test takers. Findings in this study illustrate how multiple scores that are combined can have a large impact on the accuracy of the resulting decision. Furthermore, choice of measure of agreement is of central importance in describing decision accuracy. (Contains 11 tables and 4 notes.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: High Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A