ERIC Number: ED408336
Record Type: RIE
Publication Date: 1997-Mar
Reference Count: N/A
Statistical Significance Testing in "Educational and Psychological Measurement" and Other Journals.
Daniel, Larry G.
Statistical significance tests (SSTs) have been the object of much controversy among social scientists. Proponents have hailed SSTs as an objective means for minimizing the likelihood that chance factors have contributed to research results. Critics have both questioned the logic underlying SSTs and bemoaned the widespread misapplication and misinterpretation of the results of these tests. This paper offers a framework for remedying some of the common problems associated with SSTs via modification of journal editorial policies. The controversy surrounding SSTs is reviewed, with attention given to both historical and more contemporary criticisms of bad practices associated with misuse of SSTs. Examples from the editorial policies of "Educational and Psychological Measurement" and several other journals that have established guidelines for reporting results of SSTs are discussed, and suggestions are provided regarding additional ways that educational journals may address the problem. These guidelines focus on selecting qualified editors and reviewers, defining policies about use of SSTs that are in line with those of the American Psychological Association, and stressing effect size reporting. An appendix presents a manuscript review form. (Contains 61 references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Educational and Psychological Measurement
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Chicago, IL, March 25-27, 1997).