Download full text
Download full text
ERIC Number: ED562158
Record Type: Non-Journal
Publication Date: 2015
Reference Count: 14
Estimating the Variance of Design Parameters
Hedberg, E. C.; Hedges, L. V.; Kuyper, A. M.
Society for Research on Educational Effectiveness
Randomized experiments are generally considered to provide the strongest basis for causal inferences about cause and effect. Consequently randomized field trials have been increasingly used to evaluate the effects of education interventions, products, and services. Populations of interest in education are often hierarchically structured (such as students nested within classrooms, nested within schools, nested within school districts). The sampling designs used in educational experiments often exploit this hierarchical structure by sampling entire intact units (such as schools or classrooms). The two most frequently used designs in education field experiments are variants of two designs: The hierarchical design or the (generalized) randomized block design. The purpose of this paper is to consider estimators of the treatment effect heterogeneity parameters and their sampling distributions. In addition, the estimation and sampling distributions of intraclass correlations are also reviewed. This research should be of interest to investigators who wish to report empirical estimates of treatment effect heterogeneity parameters (and their uncertainties) from individual experiments or larger datasets.
Descriptors: Randomized Controlled Trials, Hierarchical Linear Modeling, Correlation, Computation, Sampling, Models, Research Design, Statistical Analysis
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: firstname.lastname@example.org; Web site: http://www.sree.org
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Society for Research on Educational Effectiveness (SREE)