In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

The present article responds briefly to the comments, in this issue of "Educational Researcher," of Petrosino and of Robinson to the "Propagation of Misinformation About Frequencies of RFTs/RCTs in Education: A Cautionary Tale." The authors emphasize that the context of how the quality of education research is perceived both within and outside the…

Correlation matrices and standard deviations are the building blocks of many of the commonly conducted analyses in published research, and AERA and APA reporting standards recommend their inclusion when reporting research results. The authors argue that the inclusion of correlation/covariance matrices, standard deviations, and means can enhance…

An improved quantitative science would emphasize the use of confidence intervals (CIs), especially CIs for effect sizes. This article reviews definitions and issues related to developing these intervals. CIs for effect sizes are especially valuable because they facilitate meta-analytic thinking and interpretations of intervals via comparison with…

Surveyed AERA members regarding their perceptions of: statistical issues and statistical significance testing; the general linear model; stepwise methods; score reliability; type I and II errors; sample size; statistical probabilities as exclusive measures of effect size; p values as direct measures of result value; and p values evaluating…

Argues that describing results as "significant" rather than "statistically significant" is confusing to the very people most apt to misinterpret this telegraphic wording. The importance of reporting the effect size and the value of both internal and external replicability analyses are stressed. (SLD)

Reviews practices regarding tests of statistical significance and policies of the American Educational Research Association (AERA). Decades of misuse of statistical significance testing are described, and revised editorial policies to improve practice are highlighted. Correct interpretation of statistical tests, interpretation of effect sizes, and…