ERIC Number: EJ1069866
Record Type: Journal
Publication Date: 2015-Sep
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1534-5084
EISSN: N/A
Using Consensus Building Procedures with Expert Raters to Establish Comparison Scores of Behavior for Direct Behavior Rating
Jaffery, Rose; Johnson, Austin H.; Bowler, Mark C.; Riley-Tillman, T. Chris; Chafouleas, Sandra M.; Harrison, Sayward E.
Assessment for Effective Intervention, v40 n4 p195-204 Sep 2015
To date, rater accuracy when using Direct Behavior Rating (DBR) has been evaluated by comparing DBR-derived data to scores yielded through systematic direct observation. The purpose of this study was to evaluate an alternative method for establishing comparison scores using expert-completed DBR alongside best practices in consensus building exercises, to evaluate the accuracy of ratings. Standard procedures for obtaining expert data were established and implemented across two sites. Agreement indices and comparison scores were derived. Findings indicate that the expert consensus building sessions resulted in high agreement between expert raters, lending support for this alternative method for identifying comparison scores for behavioral data.
Descriptors: Accuracy, Evaluators, Student Behavior, Scores, Comparative Analysis, Best Practices, Psychometrics, Expertise
SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R324B060014