Purpose: The purpose of this study was to design and iteratively improve the quality of survey-based measures of three non-cognitive constructs for Grade 5-6 students, keeping in mind information needs of users in education reform contexts. The constructs are: Mathematics-related Self-Efficacy, Self-Concept, and Anxiety (M-SE, M-SC, and M-ANX).…

Background: Much is still unknown or unclear about how and where validity issues arise in high stakes testing situations in education, and ways by which we can rectify validity problems in practice and policy contexts. Purpose: This paper is the Foreword to the Special Section in the "Teachers College Record," titled, "When…

This article summarizes a comprehensive, systems-oriented framework designed to improve the use of a wide variety of evidence sources to address population-wide obesity problems. The L.E.A.D. framework (for "Locate" the evidence, "Evaluate" the evidence, "Assemble" the evidence, and inform "Decisions"),…

Traditional methods for preparing systematic reviews and syntheses of effectiveness studies rely on a limited set of methodological criteria to include studies that measure and report effects too narrowly to forward the mission of evidence-based practice. This article discusses why and how the criteria for study selection, evidence screening, and…

This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

This study estimated reading achievement gaps in different ethnic, gender, and socioeconomic groups of 1st graders in the U.S. compared with specific reference groups and identified statistically significant correlates and moderators of early reading achievement. A subset of 2,296 students nested in 184 schools from the Early Childhood…

In this article, we provide empirical evidence on the utility of a teacher-mediated diagnostic classroom assessment intervention for identifying and addressing learning gaps in learner domains. Early results, based on 11 treatment and 27 comparison classes with 381 students and 38 teachers overall, indicated positive changes in teachers'…

Federal policy tools for gathering evidence on "What Works" in education, such as the What Works Clearinghouse's (WWC) standards, emphasize randomized field trials as the preferred method for generating scientific evidence on the effectiveness of educational programs. This article argues instead for extended-term mixed-method (ETMM) designs.…

This case study examines the applicability of 1994 standards, offered by the Joint Committee on Standards for Educational Evaluation, to evaluations conducted in international contexts. The work is undertaken in response to an open invitation from the Joint Committee in its 1994 publication. The article addresses two purposes. First, it asks…

In light of the NCLB Act of 2001, this study estimated mathematics achievement gaps in different subgroups of kindergartners and first graders, and identified child- and school-level correlates and moderators of early mathematics achievement. A subset of 2300 students nested in 182 schools from the Early Childhood Longitudinal Study K-First Grade…

What is the news on Florida's student performance since the passage of the A+ legislation? This brief presents a review of long-term data on five state and national indicators. It verifies outcomes and trends and examines the main premise of the A+ mandate that, given appropriate schooling, students will have equitable outcomes and access to…

Examined the validity of data generated by the School Readiness for Reforms: Leader Questionnaire using an iterative procedure that combined classical and Rasch rating scale analysis for the analysis of responses from 167 leaders. The combined approach yielded comprehensive diagnostic information on the quality of the instrument's five subscales.…

Synthesizes research on standards-based reforms and accountability, with specific attention to purposes, models, and methods of inquiry. Concludes that research on reforms has been largely nonsystemic in design and has failed to help individual schools, school systems, and statewide systems develop. (SLD)

Federal policy tools for gathering evidence on "What Works" in education, such as the What Works Clearinghouse's (WWC) standards, emphasize randomized field trials as the preferred method for generating scientific evidence on the effectiveness of educational programs. This article argues instead for extended-term mixed-method (ETMM) designs.…

The No Child Left Behind (NCLB) Act of 2001 requires that public schools adopt research-supported programs and practices, with a strong recommendation for randomized controlled trials (RCTs) as the "gold standard" for scientific rigor in empirical research. Within that policy framework, this paper compares the relative utility of…