The purpose of this study was to validate inferences about scores of one task designed to measure subject matter knowledge and three tasks designed to measure aspects of pedagogical content knowledge. Evidence for the validity of inferences was based on two expectations. First, if tasks were sensitive to expertise, we would find group differences.…

We conducted generalizability studies to examine the extent to which ratings of language arts performance assignments, administered in a large, diverse, urban district to students in second through ninth grades, result in reliable and precise estimates of true student performance. The results highlight three important points when considering the…

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

To provide an accurate reading of students' and schools' rates of progress, and to provide cues for instruction, assessment at every level should be connected to explicit learning goals and standards. To show how this requirement can be fulfilled, and how research-based assessment can effectively support learning and instruction, this article…

Validation of assessments intended to improve instruction and learning should include evidence of instructional sensitivity. This study investigated the instructional sensitivity of a standards-based ninth-grade performance assessment that required students to write an essay about conflict in a literary work. Before administering the assessment,…

This article describes the history, evidence warrants, and evolution of the Center for Research on Evaluation, Standards, and Student Testing's (CRESST) model-based assessments. It considers alternative interpretations of scientific or practical models and illustrates how model-based assessment addresses both definitions. The components of the…

A series of studies by the Technical Review Panel (TRP) of the National Assessment of Educational Progress (NAEP) to improve the quality and utility of the NAEP is introduced, with a description of the NAEP, the creation of the TRP, the education policy issues that influenced the selection of research topics, and the relationship among the…

Three studies evaluating the validity of the descriptors and exemplars of the National Assessment of Educational Progress (NAEP) as characterizations of the actual mathematics performance of students at achievement levels are reported. Serious inconsistencies were found between actual performance and descriptors and exemplars. Recommendations for…

The effects of an incentive (money) on the motivation of students taking the National Assessment of Educational Progress (NAEP) mathematics test were studied. Results with 749 8th graders and 719 12th graders indicate that, at least for 8th graders, student effort can be increased by financial rewards and that this effort results in higher scores.…

Discusses the intellectual history supporting the use of educational testing and describes four current tensions in testing: (1) learning and change versus measurement models; (2) quality of information and policy use; (3) precision versus utility; and (4) individual attainment versus standardized attainment. (SLD)