Multiple-choice (MC) reading comprehension test items comprise three components: text passage, questions about the text, and MC answers. The construct validity of this format has been repeatedly criticized. In three between-subjects experiments, fourth graders (N[subscript 1] = 230, N[subscript 2] = 340, N[subscript 3] = 194) worked on three…

The Performance Assessment for California Teachers (PACT) is an authentic tool for evaluating prospective teachers by examining their abilities to plan, teach, assess, and reflect on instruction in actual classroom practice. The PACT seeks both to measure and develop teacher effectiveness, and this study of its predictive and consequential…

With the implementation of teacher performance pay in 2009 in China, teacher performance evaluation has become a heated topic. This research study follows up on two previous studies of teacher evaluation in China and continues the dialog by analyzing the latest trends in the context of teacher performance pay. There were two sources of information…

Using Singapore as an example, we argue that schools need to equip and encourage teachers to adopt authentic assessment in teaching and learning so as to develop the students' higher-order thinking. The importance of teaching and assessing higher-order thinking in Singapore classrooms is encapsulated in the vision of "Thinking Schools" launched by…

This article describes the findings of studies conducted on a large-scale, classroom-based performance assessment of literacy for the early grades designed to provide information that is useful for reporting, as well as teaching. Technical studies found the assessment to be a promising instrument that is reliable and valid. Follow-up studies of…

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

To provide an accurate reading of students' and schools' rates of progress, and to provide cues for instruction, assessment at every level should be connected to explicit learning goals and standards. To show how this requirement can be fulfilled, and how research-based assessment can effectively support learning and instruction, this article…

Validation of assessments intended to improve instruction and learning should include evidence of instructional sensitivity. This study investigated the instructional sensitivity of a standards-based ninth-grade performance assessment that required students to write an essay about conflict in a literary work. Before administering the assessment,…

A group's average test score is often used to evaluate different educational approaches, curricula, teachers, and schools. Studies of group test scores over time often try to measure "value-added" by holding constant certain student characteristics such as race, parents' education, or socioeconomic status; however, the important statistical…

Alignment has taken on increased importance given the current high-stakes nature of assessment. To make well-informed decisions about student learning on the basis of test results, assessment items need to be well aligned with standards. Project 2061 of the American Association for the Advancement of Science (AAAS) has developed a procedure for…

The purpose of this study was to examine the impact of the Maryland School Performance Assessment Program (MSPAP) and the Maryland Learning Outcomes (MLOs) on mathematics classroom instruction and assessment practices, professional development, and student learning. The data sources included questionnaires for principals, mathematics teachers, and…

Studied reasoning dimensions underlying science achievement in a test made of items from three national and international examinations and items from only one of the tests (National Education Longitudinal Study of 1988; NELS:88) and in performance test results for 35 students from the larger study. Findings provide tentative support for three…

Examined reactions of 246 parents to the use of a curriculum-embedded performance assessment, the Work Sampling System (WSS) with children in kindergarten through grade 3. The majority of parents preferred the WSS reports to conventional report cards and expressed approval of WSS use. (SLD)

Synthesizes literature on performance assessment for individual-level, high-stakes tests and the error variance associated with a person x task interaction. Proposes a research agenda based on this literature. (SLD)

Develops a conceptual framework that addresses score comparability for performance assessments, adaptive tests, paper-and-pencil tests, and alternate item pools for computerized tests. Outlines testing situation aspects that might threaten score comparability and describes procedures for evaluating the degree of score comparability. Suggests ways…