ERIC Number: EJ1159781
Record Type: Journal
Publication Date: 2017
Abstractor: As Provided
How Much Do the Effects of Education and Training Programs Vary across Sites? Evidence from Past Multisite Randomized Trials
Weiss, Michael J.; Bloom, Howard S.; Verbitsky-Savitz, Natalya; Gupta, Himani; Vigil, Alma E.; Cullinan, Daniel N.
Journal of Research on Educational Effectiveness, v10 n4 p843-876 2017
Multisite trials, in which individuals are randomly assigned to alternative treatment arms within sites, offer an excellent opportunity to estimate the cross-site average effect of treatment assignment (intent to treat or ITT) "and" the amount by which this impact varies across sites. Although both of these statistics are substantively and methodologically important, only the first has been well studied. To help fill this information gap, we estimate the cross-site standard deviation of ITT effects for a broad range of education and workforce development interventions using data from 16 large multisite randomized controlled trials. We use these findings to explore hypotheses about factors that predict the magnitude of cross-site impact variation, and we consider the implications of this variation for the statistical precision of multisite trials.
Descriptors: Randomized Controlled Trials, Evidence, Models, Intervention, Outcome Measures, Case Studies, Multitrait Multimethod Techniques, Elementary Secondary Education, Postsecondary Education, Vocational Education, Effect Size, Control Groups, Experimental Groups, Site Analysis, Predictor Variables, Hypothesis Testing, Research Methodology, Research Design, Statistical Analysis
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305D140012