ERIC Number: EJ1070825
Record Type: Journal
Publication Date: 2015-Sep
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1098-2140
EISSN: N/A
Available Date: N/A
Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients
Abry, Tashia; Hulleman, Chris S.; Rimm-Kaufman, Sara E.
American Journal of Evaluation, v36 n3 p320-338 Sep 2015
Identifying the active ingredients of an intervention--intervention-specific components serving as key levers of change--is crucial for unpacking the intervention black box. Measures of intervention fidelity can be used to identify specific active ingredients, yet such applications are rare. We illustrate how fidelity measures can be used to identify program active ingredients in the context of a social-emotional learning intervention (Responsive Classroom). We applied one customary and two novel approaches to create indices of fidelity. In the customary approach, we averaged fidelity ratings across all core components. In the novel approaches, we computed fidelity indices for specific components by (a) averaging responses from like items and (b) deriving factor scores from a multitrait, multimethod factor analysis. We then tested indices in relation to achievement gains (N = 1,442). Indices derived using novel approaches explained more outcome variance than indices from the customary approach. Further, novel approaches revealed one component as a potential active ingredient. Discussion highlights strengths and limitations of the indices and implications for identifying program active ingredients.
Descriptors: Intervention, Fidelity, Emotional Development, Factor Analysis, Achievement Gains, Classroom Environment, Elementary School Teachers, Grade 4, Elementary School Students, Economically Disadvantaged, Low Income Groups, Eligibility, Questionnaires, Teacher Characteristics, Student Characteristics, Measures (Individuals), Academic Achievement, Correlation, Statistical Analysis, Regression (Statistics)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 4; Intermediate Grades
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A070063; R305B090002; DRL#1252463
Author Affiliations: N/A