ERIC Number: EJ879625
Record Type: Journal
Publication Date: 2009
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1076-9986
EISSN: N/A
Using Discrete Loss Functions and Weighted Kappa for Classification: An Illustration Based on Bayesian Network Analysis
Zwick, Rebecca; Lenaburg, Lubella
Journal of Educational and Behavioral Statistics, v34 n2 p190-200 2009
In certain data analyses (e.g., multiple discriminant analysis and multinomial log-linear modeling), classification decisions are made based on the estimated posterior probabilities that individuals belong to each of several distinct categories. In the Bayesian network literature, this type of classification is often accomplished by assigning individuals to the modal state, based on the estimated posterior probabilities. This procedure is not satisfactory, however, when various types of classification errors have different costs. For example, Lenaburg used Bayesian network methods to forecast students' grades in a college statistics course to identify students who were likely to benefit from extra tutoring, and was most concerned with incorrectly predicting students would pass. We recommend a simple post hoc classification method, based on discrete loss functions, that can lead to improved classification. We further propose that Cohen's weighted kappa statistic be used to evaluate the quality of the classification decisions. We illustrate the approach using Lenaburg's data. (Contains 1 note and 5 tables.)
Descriptors: Classification, Bayesian Statistics, Network Analysis, Probability, College Students, Academic Achievement, Grades (Scholastic), Grade Prediction
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A