Using a novel design approach, a randomized experiment (RE) was embedded within a regression discontinuity (RD) design (R-RE-D) to evaluate the impact of developmental mathematics at a large midwestern college ("n" = 2,122). Within a region of uncertainty near the cut-score, estimates of benefit from a prospective RE were closely…

Extensive teacher mobility can undermine policy efforts to develop a high-quality workforce. In response, policymakers have increasingly championed financial incentives to retain teachers. In 2006, the Denver Public Schools adopted an alternative teacher compensation reform, the Professional Compensation System for Teachers ("ProComp").…

This study explores the extent to which differences in research design explain variation in Head Start program impacts. We employ meta-analytic techniques to predict effect sizes for cognitive and achievement outcomes as a function of the type and rigor of research design, quality and type of outcome measure, activity level of control group, and…

For more than 40 years, there has been a concerted national effort to promote diversity among the scientific research community. Yet given the persistent national-level disparity in educational achievements of students from various ethnic and racial groups, the efficacy of these programs has come into question. The current study reports results…

Over the past 70 years, all states in the United States began to publicly subsidize kindergarten using state revenue. The variation in adoption dates across states allows for a unique opportunity to measure the effectiveness of the largest early education program implemented in recent history. The significant, immediate increase in the…

Drawing on our five years of experience developing WWC evidence standards and reviewing studies against those standards as well as current literature on the design of impact studies, we highlight in this paper some of the most critical issues and common pitfalls in designing and conducting impact studies in education, and provide practical…

This article examines the power analyses for the first wave of group-randomized trials funded by the Institute of Education Sciences. Specifically, it assesses the precision and technical accuracy of the studies. The authors identified the appropriate experimental design and estimated the minimum detectable standardized effect size (MDES) for each…

There are fierce debates over the best way to prepare teachers. Some argue that easing entry into teaching is necessary to attract strong candidates, whereas others argue that investing in high quality teacher preparation is the most promising approach. Most agree, however, that we lack a strong research basis for understanding how to prepare…

This article describes an independent assessment of the Fast ForWord Language computer-based training program developed by Scientific Learning Corporation. Previous laboratory research involving children with language-based learning impairments showed strong effects on their abilities to recognize brief and fast sequences of nonspeech and speech…

The influence of teachers' qualifications on their teaching practice has been subject to debate. Literature reviews do not settle these debates, partly because the literature is uneven and partly because reviews capture only narrow slices of literature. In particular, many reviews eliminate qualitative studies. Yet without examining qualitative…

This article presents evidence from a national evaluation of the effects of 21st Century Community Learning Center after-school programs. The study was conducted in 12 school districts and 26 after-school centers, at which 2,308 elementary school students who were interested in attending a center were randomly assigned either to the treatment or…

Utilizing the regression-discontinuity research design, this article explores the effectiveness of a developmental English program in a large, multicampus community college. Routinely collected data were extracted from existing records of a cohort of first-time college students followed for approximately 6 years (N = 1,473). Results are consistent…

Studying change in student achievement is of central importance in numerous areas of educational research, including efforts to monitor school performance, investigations of the effects of educational interventions over time, and school effects studies focusing on how differences in school policies and practices relate to differences in student…

Discusses reasons randomized experiments in educational research have been so rare and appraises alternatives to experiments that educational evaluators prefer. These alternatives are found wanting whenever a high standard is needed for justifying causal conclusions. (SLD)

Studied the long-term outcomes and costs of the Success for All program using data from the Baltimore Public Schools, Maryland. Success for All students completed eighth grade at a younger age, with better achievement outcomes, fewer special education placements, fewer retentions, and at the same educational expense. (SLD)