NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1048170
Record Type: Journal
Publication Date: 2014-Dec
Pages: 24
Abstractor: As Provided
Reference Count: 41
ISSN: ISSN-1076-9986
How Generalizable Is Your Experiment? An Index for Comparing Experimental Samples and Populations
Tipton, Elizabeth
Journal of Educational and Behavioral Statistics, v39 n6 p478-501 Dec 2014
Although a large-scale experiment can provide an estimate of the average causal impact for a program, the sample of sites included in the experiment is often not drawn randomly from the inference population of interest. In this article, we provide a generalizability index that can be used to assess the degree of similarity between the sample of units in an experiment and one or more inference populations on a set of selected covariates. The index takes values between 0 and 1 and indicates both when a sample is like a miniature of the population and how well reweighting methods may perform when differences exist. Results of simulation studies are provided that develop rules of thumb for interpretation as well as an example.
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation
Authoring Institution: N/A
Grant or Contract Numbers: 1118978