ERIC Number: ED392819
Record Type: RIE
Publication Date: 1995-Nov-8
Reference Count: N/A
Editorial Policies Regarding Statistical Significance Testing: Three Suggested Reforms.
Editorial practices revolving around tests of statistical significance are explored. The logic of statistical significance testing is presented in an accessible manner--many people who use statistical tests might not place such a premium on them if they knew what the tests really do, and what they do not do. The etiology of decades of misuse of statistical tests is explored, highlighting the bad implicit logic of persons who misuse statistical tests. Finally, three revised editorial policies that would improve conventional practice are discussed. The first is the use of better language, with insistence on universal use of the phrase "statistical significance" to emphasize that the common meaning of "significant" has nothing to do with results being important. A second improvement would be emphasizing effect size interpretation, and a third would be using and reporting strategies that evaluate the replicability of results. Internal replicability analyses such as cross validation, the jackknife, or the bootstrap would help determine whether results are stable across sample variations. (Contains 51 references.) (Author/SLD)
Publication Type: Opinion Papers; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Bootstrap Methods; Cross Validation; Jackknifing Technique; Research Replication
Note: Paper presented at the Annual Meeting of the Mid-South Educational Research Association (Biloxi, MS, November 1995).