The purpose of the present study is to provide a historical account and metasynthesis of which statistical techniques are most frequently used in the fields of education and psychology. Six articles reviewing the "American Educational Research Journal" from 1969 to 1997 and five articles reviewing the psychological literature from 1948 to 2001…

All effect sizes are sensitive to design flaws and the failure to meet analytic assumptions. But some effect sizes appear to be more robust to assumption violations (e.g., homogeneity of variance). The present study extended prior Monte Carlo research by exploring the robustness of group overlap "I" indices at the relatively small sample…

Conducted a reliability generalization meta-analysis of subscale and total scale scores on the Web-administered LibQUAL+ (tm) (Cook and others, 2002), a measure of library service quality. Data for 18,161 participants from 43 universities show that score reliabilities are remarkably invariant across campuses and different over groups. (SLD)

Introduces the three subsequent articles from this special section, which extend the discussion of future prospects for progress in the reporting and interpreting of effect sizes by researchers. The authors of these pieces represent diverse views. (SLD)

Reviewed articles published in the "Journal of Applied Psychology" (JAP) to determine how interpretations might have differed if standardized regression coefficients and structure coefficients (or bivariate "r"s of predictors with the criterion) had been interpreted. Summarizes some dramatic misinterpretations or incomplete…

Illustrates a number of ways in which confidence intervals for reliability coefficients can be estimated. Suggests that authors who submit articles to "Educational and Psychological Measurement" report confidence intervals for reliability estimates whenever they report score reliabilities and that they note the interval estimation…

Illustrates the computation of confidence intervals for effect sizes for some analysis of variance applications and shows how the use of intervals involving noncentral distributions is made practical by new software. (SLD)

Editorial board members of "Educational and Psychological Measurement" were asked to list up to five publications each, written since roughly 1950, that they thought were seminal to shaping the measurement field. This bibliography lists 59 of their selections as a "hit parade" of measurement readings. (SLD)

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)

This paper reports a Monte Carlo study of differences induced by different analysis choices over selected types of aptitude treatment interaction (ATI) data (nine combinations of three sample sizes and three population parameter effect sizes). Generally, ANOVA methods tended to overestimate smaller effect sizes and to underestimate larger effect…

Expectations for reporting factor analysis results as part of construct validation are explored in the context of emerging views of measurement validity. Desired practices are discussed for both exploratory and confirmatory factor analysis. A short computer program for conducting parallel analysis is included. (Author/SLD)

The construct validity of scores on the Behavior Rating Scale of the revised Bayley Scales of Infant Development was studied with national standardization samples of children ranging from 1 to 42 months and a variety of factor analytic methods. The factor structure became more complex at older ages. (SLD)

The construct validity of three subtests of the Structure-of-Intellect Learning Abilities Test ( (1) Divergent Production of Figural Units (DFU), (2) Divergent Production of Semantic Units, and (3) Divergent Production of Symbolic Relations) was investigated and generally supported, although results were somewhat mixed with respect to the DFU…

The reliability and construct validity of scores on the Personal Preferences Self-Description Questionnaire (PPSDQ) (B. Thompson) were studied. Classical psychometric analysis of data from 641 participants (item and alpha analyses and both oblique and orthogonal exploratory factor analyses) indicate that the PPSDQ has reasonable properties. (SLD)

A general linear model framework is used to suggest that structure coefficients ought to be interpreted in structural equation modeling confirmatory factor analysis (CFA) studies in which factors are correlated. Two heuristic data sets make the discussion concrete, and two additional studies illustrate the benefits of CFA structure coefficients.…