Analysis of variance is one of the most frequently used statistical analyses in the behavioral, educational, and social sciences, and special attention has been paid to the selection and use of an appropriate effect size measure of association in analysis of variance. This article presents the sample size procedures for precise interval estimation…

The Institute of Education Sciences has funded more than 100 experiments to evaluate educational interventions in an effort to generate scientific evidence of program effectiveness on which to base education policy and practice. In general, these studies are designed with the goal of having adequate statistical power to detect the average…

Many classroom climate studies suffer from 2 critical problems: They (a) treat climate as a student-level (L1) variable in single-level analyses instead of a classroom-level (L2) construct in multilevel analyses; and (b) rely on manifest-variable models rather than on latent-variable models that control measurement error at L1 and L2, and sampling…

The authors assessed correct model identification rates of Akaike's information criterion (AIC), corrected criterion (AICC), consistent AIC (CAIC), Hannon and Quinn's information criterion (HQIC), and Bayesian information criterion (BIC) for selecting among cross-classified random effects models. Performance of default values for the 5…

Given the importance of statistical power analysis in quantitative research and the repeated emphasis on it by American Educational Research Association/American Psychological Association journals, the authors examined the reporting practice of power analysis by the quantitative studies published in 12 education/psychology journals between 2005…

In this study, the authors examined the effect of taking a learning strategies course on grade point average, retention, and graduation rate of 351 first-year students over their first 4 terms in comparison with 351 matched non-course takers. The course taught 4 learning strategies and 8 substrategies to help students overcome procrastination,…

This study deals with the statistical properties of a randomization test applied to an ABAB design in cases where the desirable random assignment of the points of change in phase is not possible. To obtain information about each possible data division, the authors carried out a conditional Monte Carlo simulation with 100,000 samples for each…

There is general agreement that meta-analysis is an important tool for synthesizing study results in quantitative educational research. Yet, a shared feature of many meta-analyses is a failure to report sufficient information for readers to fully judge the reported findings, such as the populations to which generalizations are to be made,…

Students are often faced with the temptation of attractive activities, which may interfere with the learning task and result in detrimental effects on experience and performance. Seventy-seven students (50 girls, 27 boys; M age = 15.9 years; SD = 1.65 years) participated in an experiment that reflected the typical situation of students having to…

Quite often in data reduction, it is more meaningful and economical to select a subset of variables instead of reducing the dimensionality of the variable space with principal components analysis. The authors present a neglected method for variable selection called the BI-method (R. P. Bhargava & T. Ishizuka, 1981). It is a direct, simple method…

To deal with nonnormal and heterogeneous data for the one-way fixed effect analysis of variance model, the authors adopted a trimmed means method in conjunction with Hall's invertible transformation into a heteroscedastic test statistic (Alexander-Govern test or Welch test). The results of simulation experiments showed that the proposed technique…

Studied a major problem with null hypothesis significance testing (NHST) and two common misconceptions about NHST and considered how these issues are treated in 12 recent textbooks used in education research methods and statistics classes. Findings show that almost all textbooks do not acknowledge controversies surrounding NHST. (SLD)

Shows how one can combine a large-scale planned variation experimental design and multilevel analysis to address research questions that go beyond the issue of overall treatment effectiveness. Uses data from a simulated field experiment to describe the multilevel models that can be used. (SLD)

Investigated the patterns of statistical usage and reporting in 756 articles published in the "American Educational Research Journal" (AERJ) and the "Journal of Counseling Psychology" (JCP) over 10 years. Evaluated the analytic practices used. Also discusses changes that may be necessary to improve statistics in behavioral research. (SLD)

Studied the attitudes of representatives of journals in education, sociology, and psychology through an electronic survey completed by 194 journal representatives. Results suggest that the majority of journals do not have written policies concerning the reporting of results from statistical significance testing, and most indicated that statistical…