ERIC Number: EJ1175488
Record Type: Journal
Publication Date: 2018-Mar
Abstractor: As Provided
Concurrent Validity and Sensitivity to Change of Direct Behavior Rating Single-Item Scales (DBR-SIS) within an Elementary Sample
Smith, Rhonda L.; Eklund, Katie; Kilgus, Stephen P.
School Psychology Quarterly, v33 n1 p83-93 Mar 2018
The purpose of this study was to evaluate the concurrent validity, sensitivity to change, and teacher acceptability of Direct Behavior Rating single-item scales (DBR-SIS), a brief progress monitoring measure designed to assess student behavioral change in response to intervention. Twenty-four elementary teacher-student dyads implemented a daily report card intervention to promote positive student behavior during prespecified classroom activities. During both baseline and intervention, teachers completed DBR-SIS ratings of 2 target behaviors (i.e., Academic Engagement, Disruptive Behavior) whereas research assistants collected systematic direct observation (SDO) data in relation to the same behaviors. Five change metrics (i.e., absolute change, percent of change from baseline, improvement rate difference, Tau-U, and standardized mean difference; Gresham, 2005) were calculated for both DBR-SIS and SDO data, yielding estimates of the change in student behavior in response to intervention. Mean DBR-SIS scores were predominantly moderately to highly correlated with SDO data within both baseline and intervention, demonstrating evidence of the former's concurrent validity. DBR-SIS change metrics were also significantly correlated with SDO change metrics for both Disruptive Behavior and Academic Engagement, yielding evidence of the former's sensitivity to change. In addition, teacher Usage Rating Profile-Assessment (URP-A) ratings indicated they found DBR-SIS to be acceptable and usable. Implications for practice, study limitations, and areas of future research are discussed. Impact and Implications: K-12 educators need quick and efficient progress monitoring measures to assess the effectiveness of behavioral interventions in the classroom. The current study found that the Direct Behavior Rating single-item scales achieved this goal by demonstrating high teacher acceptability and appropriate psychometric properties for evaluating student academic engagement and disruptive behaviors in the classroom.
Descriptors: Behavior Rating Scales, Test Validity, Progress Monitoring, Student Behavior, Behavior Change, Response to Intervention, Elementary School Teachers, Elementary School Students, Correlation, Observation, Intervention, Statistical Analysis
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: email@example.com; Web site: http://www.apa.org
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Authoring Institution: N/A
Grant or Contract Numbers: N/A