ERIC Number: EJ1022869
Record Type: Journal
Publication Date: 2014-May
Abstractor: As Provided
Reference Count: N/A
The Reliability and User-Feasibility of Materials and Procedures for Monitoring the Implementation Integrity of a Reading Intervention
Begeny, John C.; Easton, Julia E.; Upright, James J.; Tunstall, Kali R.; Ehrenbock, Cassia A.
Psychology in the Schools, v51 n5 p517-533 May 2014
Within the realm of school-based interventions, implementation integrity is important for practical, legal, and ethical purposes. Unfortunately, evidence suggests that proper monitoring of implementation integrity is often absent from both research and practice. School psychology practitioners and researchers have reported that a major barrier to monitoring integrity is a lack of procedural guidance, and currently there is little research that has examined the psychometric reliability of monitoring procedures and materials. Therefore, the purpose of this two-part study was to examine (a) the extent to which relatively novice educators could self-learn and successfully use an implementation integrity monitoring system designed to evaluate a structured reading intervention program, and (b) the inter-observer reliability of two individuals using the system to evaluate the same interventionist. Overall findings suggested that it is feasible for most individuals to learn the implementation integrity monitoring system (and associated materials) and the system can be used reliably across multiple observers. Implications of these findings are discussed, including how the procedures and materials might be adapted for other intervention programs to assist researchers and practitioners with monitoring implementation integrity.
Descriptors: Program Implementation, Fidelity, Intervention, Reading Programs, Evaluation Methods, Program Evaluation, Interrater Reliability, Resource Materials, School Psychology
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: firstname.lastname@example.org; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Authoring Institution: N/A