NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ885771
Record Type: Journal
Publication Date: 2010-Jun
Pages: 10
Abstractor: As Provided
Reference Count: 24
ISBN: N/A
ISSN: ISSN-1082-989X
Killeen's (2005) "p[subscript rep]" Coefficient: Logical and Mathematical Problems
Maraun, Michael; Gabriel, Stephanie
Psychological Methods, v15 n2 p182-191 Jun 2010
In his article, "An Alternative to Null-Hypothesis Significance Tests," Killeen (2005) urged the discipline to abandon the practice of "p[subscript obs]"-based null hypothesis testing and to quantify the signal-to-noise characteristics of experimental outcomes with replication probabilities. He described the coefficient that he invented, "p[subscript rep]," as the probability of obtaining "an effect of the same sign as that found in an original experiment" (Killeen, 2005, p. 346). The journal "Psychological Science" quickly came to encourage researchers to employ "p[subscript rep]," rather than "p[subscript obs]," in the reporting of their experimental findings. In the current article, we (a) establish that Killeen's derivation of "p[subscript rep]" contains an error, the result of which is that "p[subscript rep]" is not, in fact, the probability that Killeen set out to derive; (b) establish that "p[subscript rep]" is not a replication probability of any kind but, rather, is a quasi-power coefficient; and (c) suggest that Killeen has mischaracterized both the relationship between replication probabilities and statistical inference, and the kinds of claims that are licensed by knowledge of the value assumed by the replication probability that he attempted to derive. (Contains 10 footnotes and 4 figures.)
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002-4242. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org/publications
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A