The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do…

A process for judging the alignment between curriculum standards and assessments developed by the author is presented. This process produces information on the relationship of standards and assessments on four alignment criteria: Categorical Concurrence, Depth of Knowledge Consistency, Range of Knowledge Correspondence, and Balance of…

This article examines the role of reviewer agreement in judgments about alignment between tests and standards. We used case data from three state alignment studies to explore how different approaches to incorporating reviewer agreement changes alignment conclusions. The three case studies showed varying degrees of reviewer agreement about…

Many states and school districts are making concerted efforts to boost student achievement in mathematics and science. This information brief is intended for those who seek to improve student learning by creating coherent systems of expectations and assessments in states and districts. Other potential audiences are those who study reform, make…

This monograph discusses criteria for judging the alignment between expectations of student achievement and assessment. Alignment is central to current efforts of systemic and standards-based education reforms in mathematics and science. More than four-fifths of the states have content frameworks in place in mathematics and science, and a large…

This paper describes the Study of Systemic Reform in Milwaukee Public Schools (MPS), an embedded research project that crossed the lines between objectivity and subjectivity, technical assistance and evaluation, and qualitative and quantitative research. The project created a collaboration between researchers at the Wisconsin Center for Education…

This document reports on the National Institute for Science Education (NISE) forum on the Evaluation of Systemic Reform in Mathematics and Science. The purposes of the forum were to reflect upon what to understand about the evaluation of reform in the educational system, and to encourage and support continuing efforts to learn more about how…

Reviewers analyzed the alignment of assessments and standards in mathematics and science from four states at a four-day institute conducted June 29 through July 2, 1998. Six reviewers compared the match between assessment items and standards in mathematics and seven compared the match in science. Data from these analyses were processed and used to…

Comments on the fact that conditional equity metrics report differences in performance among groups of students given one or more conditions under which that performance may have been influenced. Discusses their use as a tool for evaluating equity. Contains 16 references. (DDR)

This document reports on a workshop held January 4-5, 1996. Participants of this conference represented the areas of science, mathematics, engineering, and technology (SMET) education and attempted to develop questions regarding systemic education reform. Contents include: (1) "Introduction"; (2) "Evaluation Questions…

Data from over 400 schools shows participation in Library Power increased the percentage of schools where teachers and librarians collaborated to plan instruction and to develop the library collection, and increased the percentage of teachers collaborating with the librarian in schools where collaboration already existed. Collaborative logs…

In this article, the authors describe an alignment and content analysis of the Wisconsin Alternate Assessment (WAA) for students with disabilities. The WAA is an assessment of the academic performance of students with significant disabilities and is an alternative to the traditional on-demand achievement test. Alternate assessments like the WAA…

The primary purpose of the investigation was to determine the extent to which (a) the Wisconsin Alternate Assessment (WAA) adequately measures the skills and concepts that make up the curriculum and instruction of students with significant disabilities; and (b) the WAA adequately measures the concepts and skill areas represented in Wisconsin's…

This document represents the second of two volumes presented in "Study of the Impact of the Statewide Systemic Initiatives Program" (Norman L. Webb and Iris R. Weiss). In an effort to evaluate the impact of the Statewide Systemic Initiatives (SSIs) on student achievement and the lessons that could be learned from the National Science Foundation's…