This study compared 5 scoring methods in terms of their statistical assumptions. They were then used to score the Teacher Observation of Classroom Adaptation Checklist, a measure consisting of 3 subscales and 21 Likert-type items. The 5 methods used were (a) sum/average scores of items, (b) latent factor scores with continuous indicators, (c)…

The authors performed a Monte Carlo simulation to empirically investigate the robustness and power of 4 methods in testing mean differences for 2 independent groups under conditions in which 2 populations may not demonstrate the same pattern of nonnormality. The approaches considered were the t test, Wilcoxon rank-sum test, Welch-James test with…

Analysis of variance is one of the most frequently used statistical analyses in the behavioral, educational, and social sciences, and special attention has been paid to the selection and use of an appropriate effect size measure of association in analysis of variance. This article presents the sample size procedures for precise interval estimation…

In assessing verbal academic self-concept with preadolescents, researchers have used scales for students' self-concepts in reading and in their native language interchangeably. The authors conducted 3 studies with German students to test whether reading and German (i.e., native language) self-concepts can be treated as the same or different…

The authors examined the distributional properties of 3 improvement-over-chance, I, effect sizes each derived from linear and quadratic predictive discriminant analysis and from logistic regression analysis for the 2-group univariate classification. These 3 classification methods (3 levels) were studied under varying levels of data conditions,…

The Institute of Education Sciences has funded more than 100 experiments to evaluate educational interventions in an effort to generate scientific evidence of program effectiveness on which to base education policy and practice. In general, these studies are designed with the goal of having adequate statistical power to detect the average…

This experiment combined controlled experimental design with a best-practice approach (i.e., real course content, subjective evaluations) to clarify the role of verbal redundancy, confirm the multimodal impact of images and narration, and highlight discrepancies between actual and perceived understanding. The authors presented 1 of 3…

Statistics learners often bypass the critical step of understanding a problem before executing solutions. Worked-out examples that identify problem information (e.g., data type, number of groups, purpose of analysis) key to determining a solution (e.g., "t" test, chi-square, correlation) can address this concern. The authors examined the…

Given the long history of discussion of issues surrounding statistical testing and effect size indices and various attempts by the American Psychological Association and by the American Educational Research Association to encourage the reporting of effect size, most journals in education and psychology have witnessed an increase in effect size…

Increasing the correlation between the independent variable and the mediator ("a" coefficient) increases the effect size ("ab") for mediation analysis; however, increasing a by definition increases collinearity in mediation models. As a result, the standard error of product tests increase. The variance inflation caused by…

This experiment investigated whether study of a scientific text and a visual display that contained redundant text segments would affect memory and transfer. The authors randomly assigned 42 students from a university in the southwestern United States in equal numbers to 1 of 2 conditions: (a) a redundant condition, in which participants studied a…

Math proficiency is related to math calculation fluency. Explicit timing provides repeated practice for math fluency. It is enhanced through goal setting, graphic feedback, and rewards. Self-selected goals have potential to increase performance for math fluency. This study compared the effect of goal lines, and researcher goals versus…

This study investigated changes in elementary school students' (n = 140) situational interest as a function of achievement goal orientation profiles and task characteristics. The authors repeatedly measured situational interest during a simulated science learning task in 2 task conditions that differed in the concreteness of the task…

This study investigated whether a diagnostic testing condition leads to stereotype threat effects for African American children (n = 198) at an urban elementary school. Results indicated that presenting a reading test as diagnostic of abilities hindered the performance of African American children aware of racial stereotypes but not of those…

The authors used a person-centered, longitudinal approach to identify and evaluate naturally occurring combinations of intrinsic and extrinsic motivations among 490 third- through fifth-grade students. Cluster analysis revealed 3 groups, characterized by high levels of both motivations ("high quantity"): high intrinsic motivation but low…