ERIC Number: EJ1084510
Record Type: Journal
Publication Date: 2015-Dec
Abstractor: As Provided
Small-Sample Adjustments for Tests of Moderators and Model Fit Using Robust Variance Estimation in Meta-Regression
Tipton, Elizabeth; Pustejovsky, James E.
Journal of Educational and Behavioral Statistics, v40 n6 p604-634 Dec 2015
Meta-analyses often include studies that report multiple effect sizes based on a common pool of subjects or that report effect sizes from several samples that were treated with very similar research protocols. The inclusion of such studies introduces dependence among the effect size estimates. When the number of studies is large, robust variance estimation (RVE) provides a method for pooling dependent effects, even when information on the exact dependence structure is not available. When the number of studies is small or moderate, however, test statistics and confidence intervals based on RVE can have inflated Type I error. This article describes and investigates several small-sample adjustments to F-statistics based on RVE. Simulation results demonstrate that one such test, which approximates the test statistic using Hotelling's T[superscript 2] distribution, is level-a and uniformly more powerful than the others. An empirical application demonstrates how results based on this test compare to the large-sample F-test.
Descriptors: Meta Analysis, Effect Size, Computation, Robustness (Statistics), Sample Size, Statistical Analysis, Simulation, Error Correction, Multivariate Analysis, Multiple Regression Analysis
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A