NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: ED509387
Record Type: Non-Journal
Publication Date: 2010-Apr
Pages: 88
Abstractor: ERIC
Reference Count: 22
ISBN: N/A
ISSN: N/A
Statistical Power Analysis in Education Research. NCSER 2010-3006
Hedges, Larry V.; Rhoads, Christopher
National Center for Special Education Research
This paper provides a guide to calculating statistical power for the complex multilevel designs that are used in most field studies in education research. For multilevel evaluation studies in the field of education, it is important to account for the impact of clustering on the standard errors of estimates of treatment effects. Using ideas from survey research, the paper explains how sample design induces random variation in the quantities observed in a randomized experiment, and how this random variation relates to statistical power. The manner in which statistical power depends upon the values of intraclass correlations, sample sizes at the various levels, the standardized average treatment effect (effect size), the multiple correlation between covariates and the outcome at different levels, and the heterogeneity of treatment effects across sampling units is illustrated. Both hierarchical and randomized block designs are considered. The paper demonstrates that statistical power in complex designs involving clustered sampling can be computed simply from standard power tables using the idea of operational effect sizes: effect sizes multiplied by a design effect that depends on features of the complex experimental design. These concepts are applied to provide methods for computing power for each of the research designs most frequently used in education research. Appendices include: (1) Design Effects in Two- or Three-Level Hierarchical Designs With and Without Covariates; (2) Design Effects in Two- or Three-Level Randomized-Block Designs With and Without Covariates; (3) Computing Power in Three-Level Randomized-Block Designs; (4) Multilevel Models Defining Tests for Treatment Effects; and (5) Glossary of Terms. (Contains 5 footnotes and 2 tables.)
National Center for Special Education Research. 400 Maryland Avenue SW, Washington, DC 20202. Tel: 800-437-0833; Fax: 202-401-0689; Web site: http://ies.ed.gov/ncser/
Publication Type: Guides - General; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: National Center for Special Education Research (ED)
IES Funded: Yes