ERIC Number: ED427020
Record Type: Non-Journal
Publication Date: 1998-Oct
Reference Count: N/A
The Responsibility of Educational Researchers To Make Appropriate Decisions about the Error Rate Unit on Which Type I Error Adjustments Are Based: A Thoughtful Process Not a Mechanical One.
Newman, Isadore; Fraas, John W.
Educational researchers often use multiple statistical tests in their research studies and program evaluations. When multiple statistical tests are conducted, the chance that Type I errors may be committed increases. Thus, the researchers are faced with the task of adjusting the alpha levels for their individual statistical tests in order to keep the overall alpha value at a reasonable level. A three-step procedure is presented that can be used to adjust the alpha levels of the individual statistical tests. This procedure requires researchers to: (1) identify the appropriate conceptual unit for the error rate (pairwise, experimentwise, and familywise); (2) determine the number and nature of tests contained in that error rate unit; and (3) apply a Bonferroni-type adjustment procedure to the various statistical tests contained in each error rate unit. This three-step adjustment procedure emphasizes that it is the obligation of the researchers to make logical decisions, not mechanical ones, when adjusting Type I error rates for multiple statistical tests. (Contains 20 references.) (Author/SLD)
Publication Type: Reports - Descriptive; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A