Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…

Explores methods of assessing opportunity to learn (OTL) and presents data collected as part of a pilot study of an eighth-grade statewide mathematics assessment to explore issues of validity. Investigates the integrity of various dimensions thought to constitute OTL, analyzes the relationships among teachers' and students' self-reports, and draws…

Studied students' erasure behavior on a standardized (low stakes) test. Results for 5,641 students in grades 4, 8, and 11 suggest that students do change their responses at an average of 6 to 7% of the tested items and that overall achievement appears unrelated to the student's tendency to erase and change a response. Discusses conditions under…

Discusses the effects of schooling on the development of intelligence in children and how the amount of schooling should be considered when developing norms for turning intelligence test performance into IQ scores. Suggests that because of differences in schooling among same-age children, use of age-based norms results in biased deviation IQS.…

This instructional module presented by the National Council on Measurement in Education (NCME) provides guidelines for teachers and other test developers to help them construct test item banks. Setting up an item bank and using it are described, with a consideration of software that can be used. (SLD)

Precedents from litigation on state graduation assessments provide insight into the potential legal arguments challengers may raise with regard to mandated content and performance standards for all students. Clearly documented, fairly administered procedures that adhere to professional recommendations will be the hallmark of defensible standards.…

The student assessment tasks identified by administrators in a previous study (J. C. Impara, B. S. Plake, and J. J. Fager, 1993) as tasks they performed are crossed with the knowledge, skills, and abilities identified as requirements of administrators to perform those tasks. The resulting matrix may be useful in designing instructional programs.…

This National Council on Measurement in Education module describes standard setting for achievement measures used in education, licensure, and certification. The purposes, design, and conduct of standard-setting procedures are reviewed, and ways to calculate a cutting score are demonstrated. A self-test and annotated bibliography are included.…

Reviews the status of classroom assessment, focusing on the review of four key research summaries that describe the dismal state of classroom assessment in the past century. Cites four important developments as reasons for optimism about the future of classroom assessment and details a five-part action plan for achieving the untapped potential of…

Discusses the potential positive and negative effects computer-based testing could have on validity, reviews the literature on validation perspectives in computer-based testing, and suggests ways to evaluate the contributions of computer-based testing to more valid measurement practices. (SLD)

Discusses the tension between setting high goals and setting attainable goals for adequate yearly progress. Presents some strategies that can be used to evaluate the level of rigor implied by the expectations for attainable, productive goals. Strategies relate to the understanding of how likely it is that a goal can be met. (SLD)

Discusses some problems, pitfalls, and paradoxes that challenge measurement theory and practice, especially for K-12 achievement testing. Considers a number of technical issues, especially some related to reliability. Also discusses a number of practical or political issues related to validation and accountability. (SLD)

Discusses issues of validity in high-stakes testing, beginning with some purposes of a testing program and proceeding to some underlying assumptions about testing. Suggests four possible studies to address assumptions often ignored by asking various groups of people about testing. (SLD)

Examined the education indicators used in the "Quality Counts" report published by Editorial Projects in Education in 1998. Discusses the degree to which persuasive or normative uses stemmed from the value judgments being made on the basis of the indicator data. (SLD)