Syntheses of research on educational programs have taken on increasing policy importance. Procedures for performing such syntheses must therefore produce reliable, unbiased, and meaningful information on the strength of evidence behind each program. Because evaluations of any given program are few in number, syntheses of program evaluations must…

Every year, teachers, principals, superintendents, and other educators have to make hundreds of decisions of potentially great importance to students. What reading program is most likely to ensure high reading performance? Should "social promotion" be used or should retentions be increased? Should summer school programs be provided to struggling…

In this keynote address presented at the Mid-western Educational Research Association Annual Meeting in October, 2004, the author discusses the increasing interest of federal policy-makers in scientifically-based research. A comparison between education and other disciplines is offered, and a proposal for increased rigor in educational research is…

Discusses the promise and pitfalls of randomized and rigorously matched experiments as a basis for educational policy and practice, concluding that a focus on rigorous experiments evaluating replicable programs and practices is essential to build confidence in educational research among policymakers and educators. Suggests that new funding is…

Comments on S. Pogrow's suggestion that educational programs should be judged by the degree to which schools using them achieve "surprising scores." Emphasizes the importance of the use of control groups in program evaluation. (SLD)

Responds to Sue Klein's comparative analysis on Design Competitions and Expert Panels (Educational Research, 1997) in which the author addresses drawbacks of the Expert Panels approach to educational product evaluation. Cautions that the approach is so minimalist a strategy that it could inhibit more serious attempts to build a system based on…

Proposes the need for a design competition system (DCS) in federally funded educational research and development and discusses the key issues that a DCS must address in methodology. Also addresses the high cost of using a DCS and whether such costs can be justified. Concludes that a DCS is justified and necessary. (GR)

Argues that student achievement cannot be improved unless teachers can implement effective instructional methods. Presents recommendations for using federal and state policy levers to change classroom practices by empowering school staff to participate in reform decisions; for funding of program evaluation and schools tied to adopting effective…

Suggests that what is needed in education is more, not less, research directed at the improvement of instruction and of the schooling experience for children. Such research should be made programmatic, systematic, useful, and cumulative. (Author/AM)

Explores reasons for the tenuous relationship between educational research and educational practice. Suggests changes in research and policy to bring educational research directly to bear on educational problems. The major problem is that researchers are searching for variables that relate to improved outcomes, whereas educational innovators are…

The relevant debate is not whether students differ but what schools should do about student achievement differences. Some forms of ability grouping may be justifiable, but those who would group students should have the burden of proving its effectiveness, because the negative consequences can be serious. (SLD)