NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1089547
Record Type: Journal
Publication Date: 2016-Mar
Pages: 18
Abstractor: As Provided
ISSN: ISSN-1098-2140
Reconsidering Findings of "No Effects" in Randomized Control Trials: Modeling Differences in Treatment Impacts
Chaney, Bradford
American Journal of Evaluation, v37 n1 p45-62 Mar 2016
The primary technique that many researchers use to analyze data from randomized control trials (RCTs)--detecting the average treatment effect (ATE)--imposes assumptions upon the data that often are not correct. Both theory and past research suggest that treatments may have significant impacts on subgroups even when showing no overall effect. Giving primacy to ATEs thus may lead to the rejection of treatments that in fact are helpful to some people. Using simulations, I examine the power of ATEs to detect treatment impacts when treatment impacts vary. Models that allow for varying impacts accurately measure the treatment effect in the simulation and are robust in a variety of circumstances. However, a focus on ATEs often fails to find the known treatment effects.
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A