The purpose of the present study is to provide a historical account and metasynthesis of which statistical techniques are most frequently used in the fields of education and psychology. Six articles reviewing the "American Educational Research Journal" from 1969 to 1997 and five articles reviewing the psychological literature from 1948 to 2001…

All effect sizes are sensitive to design flaws and the failure to meet analytic assumptions. But some effect sizes appear to be more robust to assumption violations (e.g., homogeneity of variance). The present study extended prior Monte Carlo research by exploring the robustness of group overlap "I" indices at the relatively small sample sizes…

Conducted a reliability generalization meta-analysis of subscale and total scale scores on the Web-administered LibQUAL+ (tm) (Cook and others, 2002), a measure of library service quality. Data for 18,161 participants from 43 universities show that score reliabilities are remarkably invariant across campuses and different over groups. (SLD)

Introduces the three subsequent articles from this special section, which extend the discussion of future prospects for progress in the reporting and interpreting of effect sizes by researchers. The authors of these pieces represent diverse views. (SLD)

Reviewed articles published in the "Journal of Applied Psychology" (JAP) to determine how interpretations might have differed if standardized regression coefficients and structure coefficients (or bivariate "r"s of predictors with the criterion) had been interpreted. Summarizes some dramatic misinterpretations or incomplete interpretations.…

Illustrates a number of ways in which confidence intervals for reliability coefficients can be estimated. Suggests that authors who submit articles to "Educational and Psychological Measurement" report confidence intervals for reliability estimates whenever they report score reliabilities and that they note the interval estimation methods used.…

Illustrates the computation of confidence intervals for effect sizes for some analysis of variance applications and shows how the use of intervals involving noncentral distributions is made practical by new software. (SLD)

Responds to criticisms of some "Educational and Psychological Measurement" policies and the reliability generalization meta-analytic methods of T. Vacha-Haase. Explores consequences of misunderstanding score reliability. (SLD)

Investigated how dissimilar in composition and variability samples inducting reliability coefficients from prior studies were from the cited prior samples from which coefficients were generalized. Results from 20 articles show that citing reliability coefficients from prior studies as the basis for concluding new scores are reliable is only…

The reliability and construct validity of scores on the Personal Preferences Self-Description Questionnaire (PPSDQ) (B. Thompson) were studied. Classical psychometric analysis of data from 641 participants (item and alpha analyses and both oblique and orthogonal exploratory factor analyses) indicate that the PPSDQ has reasonable properties. (SLD)

A general linear model framework is used to suggest that structure coefficients ought to be interpreted in structural equation modeling confirmatory factor analysis (CFA) studies in which factors are correlated. Two heuristic data sets make the discussion concrete, and two additional studies illustrate the benefits of CFA structure coefficients.…

Editorial board members of "Educational and Psychological Measurement" were asked to list up to five publications each, written since roughly 1950, that they thought were seminal to shaping the measurement field. This bibliography lists 59 of their selections as a "hit parade" of measurement readings. (SLD)

Expectations for reporting factor analysis results as part of construct validation are explored in the context of emerging views of measurement validity. Desired practices are discussed for both exploratory and confirmatory factor analysis. A short computer program for conducting parallel analysis is included. (Author/SLD)

The construct validity of scores on the Behavior Rating Scale of the revised Bayley Scales of Infant Development was studied with national standardization samples of children ranging from 1 to 42 months and a variety of factor analytic methods. The factor structure became more complex at older ages. (SLD)

An overview of several statistics useful in interpreting variates constructed by using canonical correlation analysis is presented. A computer program which calculates coefficients not typically provided by computer packages is discussed. An illustrative example of the output is provided. (Author/JKS)