ERIC Number: EJ1098957
Record Type: Journal
Publication Date: 2016
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1056-3997
EISSN: N/A
Guidelines for Using the "Q" Test in Meta-Analysis
Maeda, Yukiko; Harwell, Michael R.
Mid-Western Educational Researcher, v28 n1 p55-72 2016
The "Q" test is regularly used in meta-analysis to examine variation in effect sizes. However, the assumptions of "Q" are unlikely to be satisfied in practice prompting methodological researchers to conduct computer simulation studies examining its statistical properties. Narrative summaries of this literature are available but a quantitative synthesis of study findings for using the "Q" test has not appeared. We quantitatively synthesized estimated Type I error rates and power values of a sample of computer simulation studies of the "Q" test. The results suggest that "Q" should not be used for standardized mean difference effect sizes like Hedges' g unless the number of studies and primary study sample sizes are at least 40. Use of the Fisher's r-to-z transformed effect size, on the other hand, resulted in "Q" performing well in almost all conditions studied. We summarize our findings in a table that provides guidelines for using this important test.
Descriptors: Meta Analysis, Q Methodology, Effect Size, Research Methodology, Statistical Analysis, Error Patterns, Computer Simulation, Coding
Mid-Western Educational Research Association. P.O. Box 34421, Chicago, IL 60634-0421. Tel: 419-372-7401; Fax: 419-372-2828; e-mail: mer@bgsu.edu; Web site: http://www.mwera.org
Publication Type: Journal Articles; Reports - Research; Information Analyses
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A