NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ993902
Record Type: Journal
Publication Date: 2012-Oct
Pages: 27
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0193-841X
EISSN: N/A
When Is a Program Ready for Rigorous Impact Evaluation? The Role of a Falsifiable Logic Model
Epstein, Diana; Klerman, Jacob Alex
Evaluation Review, v36 n5 p375-401 Oct 2012
Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at multiple sites. Objective: This article argues that more rapid movement to RIE is a partial cause of the low success rate of RIE and proposes a constructive response: process evaluations that compare program intermediate outcomes--in the treatment group, during the operation of the program--against a more falsifiable extension of the conventional logic model. Conclusion: Our examples suggest that such process evaluations would allow funders to deem many programs unlikely to show impacts and therefore not ready for random assignment evaluation--without the high cost and long time lines of an RIE. The article then develops the broader implications of such a process analysis step for broader evaluation strategy. (Contains 2 figures and 20 notes.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A