ERIC Number: EJ1141284
Record Type: Journal
Publication Date: 2017-Mar
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0279-6015
EISSN: N/A
Generalizability of Multiple Measures of Treatment Integrity: Comparisons among Direct Observation, Permanent Products, and Self-Report
Gresham, Frank M.; Dart, Evan H.; Collins, Tai A.
School Psychology Review, v46 n1 p108-121 Mar 2017
The concept of treatment integrity is an essential component to databased decision making within a response-to-intervention model. Although treatment integrity is a topic receiving increased attention in the school-based intervention literature, relatively few studies have been conducted regarding the technical adequacy of treatment integrity assessment methods. In light of recent research utilizing generalizability theory (G theory) to assess the dependability of behavioral measurement in schools, the current study used G theory to examine the dependability of direct observation, permanent products, and self-report as measures of treatment integrity when six teachers implemented the Good Behavior Game across three study sites. Results indicated that direct observation yielded the most reliable treatment integrity data, followed by permanent products and self-report. Specifically, when assessment of treatment integrity is conducted twice per week, direct observation should provide a dependable estimate (f = 0.821) after only four assessments. Implications, limitations, and future directions are discussed.
Descriptors: Fidelity, Generalizability Theory, Observation, Measurement Techniques, Reliability, Behavior Modification, Games, Elementary School Teachers, Evaluation Methods, Correlation
National Association of School Psychologists. 4340 East West Highway Suite 402, Bethesda, MD 20814. Tel: 301-657-0270; Fax: 301-657-0275; e-mail: publications@naspweb.org; Web site: http://www.nasponline.org/publications/
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A