NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: ED563102
Record Type: Non-Journal
Publication Date: 2013
Pages: 9
Abstractor: ERIC
Reference Count: 6
Investigating the File Drawer Problem in Causal Effects Studies in Science Education
Taylor, Joseph; Kowalski, Susan; Stuhlsatz, Molly; Wilson, Christopher; Spybrook, Jessaca
Society for Research on Educational Effectiveness
The purpose of this paper is to use both conceptual and statistical approaches to explore publication bias in recent causal effects studies in science education, and to draw from this exploration implications for researchers, journal reviewers, and journal editors. This paper fills a void in the "science education" literature as no previous exploration of its kind can be located. The studies in this publication bias analysis are taken from a larger meta-analysis that includes studies from the Unites States, Europe, and East Asia. The general research design is random effects meta-analysis. Specific tests of publication bias were performed within the meta-analysis context. These include funnel plots, Galbraith plots, and Egger's test of Asymmetry. Publication bias was investigated using both intuitive and statistical techniques. The results of this analysis suggest that meta-analyses may not require significant work in the grey literature to produce unbiased results. The data from this 2010-11 study suggest that small effect-small sample studies are being "submitted" for publication and are being "accepted" for publication. One table and four figures are appended.
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail:; Web site:
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Society for Research on Educational Effectiveness (SREE)
Identifiers - Location: Asia; United States