NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ782576
Record Type: Journal
Publication Date: 2006-Nov
Pages: 9
Abstractor: Author
Reference Count: 0
ISBN: N/A
ISSN: ISSN-0895-8017
Interpreting Kappa in Observational Research: Baserate Matters
Bruckner, Cornelia Taylor; Yoder, Paul
American Journal on Mental Retardation, v111 n6 p433-441 Nov 2006
Kappa (Cohen, 1960) is a popular agreement statistic used to estimate the accuracy of observers. The response of kappa to differing baserates was examined and methods for estimating the accuracy of observers presented. Results suggest that setting a single value of kappa as "minimally acceptable" (i.e., a criterion value) is not useful in ensuring adequate accuracy of observers. Instead, researchers should use the best estimate of the true baserate of the target behavior "and" the obtained kappa to estimate the accuracy of observers. Investigators can then compare the estimated accuracy of observers to a preselected criterion level. Guidelines are given for selecting a criterion accuracy level.
American Association on Mental Retardation. P.O. Box 7065, Lawrence, KS 66044-7065. Tel: 785-843-1235; Fax: 785-843-1274; e-mail: AJMR@allenpress.com; Web site: http://www.aamr.org/Periodicals/index.shtml
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A