This paper draws upon a broader piece of research aimed at investigating the implementation process of a recent policy on teacher appraisal in Portugal. Two case studies were carried out and a combination of methods for data collection was used. Findings suggest that teachers' perceptions are marked by uncertainty and scepticism. Amongst the most…

Over the previous two decades, the era of accountability has amplified efforts to measure educational effectiveness more than Edward Thorndike, the father of educational measurement, likely would have imagined. Expressly, the measurement structure for evaluating educational effectiveness continues to rely increasingly on one sole…

We conducted a multiattribute utility (MAU) evaluation to assess the Parent-Implemented Communication Strategies (PiCS) project which was funded by the Institute of Education Sciences (IES). In the PiCS project parents of young children with developmental disabilities are trained and coached in their homes on naturalistic and visual teaching…

The purpose of this study was to examine the effect of pretest items on response time in an operational, fixed-length, time-limited computerized adaptive test (CAT). These pretest items are embedded within the CAT, but unlike the operational items, are not tailored to the examinee's ability level. If examinees with higher ability levels need less…

Assessment is a critical component of educational practices and thus impacts educational reform efforts. This article reviews and considers assessment from 2 perspectives: a focus on accountability and a focus on continuous improvement. A class of preservice and practicing science teachers explored notions of assessment while experiencing peer…

A series of 8 tests was administered to university students over 4 weeks for program assessment purposes. The stakes of these tests were low for students; they received course points based on test completion, not test performance. Tests were administered in a counterbalanced order across 2 administrations. Response time effort, a measure of the…

The accuracy of achievement test score inferences largely depends on the sensitivity of scores to instruction focused on tested objectives. Sensitivity requirements are particularly challenging for standards-based assessments because a variety of plausible instructional differences across classrooms must be detected. For this study, we developed a…

States have moved rapidly over the past 20 years to institute systems of standards and assessments. State assessments in particular take on added importance at the high school level as they are required for graduation by an increasing number of states. Federal legislation mandating testing in high school also serves to increase the stakes and…

This article describes the findings of studies conducted on a large-scale, classroom-based performance assessment of literacy for the early grades designed to provide information that is useful for reporting, as well as teaching. Technical studies found the assessment to be a promising instrument that is reliable and valid. Follow-up studies of…

We conducted generalizability studies to examine the extent to which ratings of language arts performance assignments, administered in a large, diverse, urban district to students in second through ninth grades, result in reliable and precise estimates of true student performance. The results highlight three important points when considering the…

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

To provide an accurate reading of students' and schools' rates of progress, and to provide cues for instruction, assessment at every level should be connected to explicit learning goals and standards. To show how this requirement can be fulfilled, and how research-based assessment can effectively support learning and instruction, this article…

Validation of assessments intended to improve instruction and learning should include evidence of instructional sensitivity. This study investigated the instructional sensitivity of a standards-based ninth-grade performance assessment that required students to write an essay about conflict in a literary work. Before administering the assessment,…

This article describes the history, evidence warrants, and evolution of the Center for Research on Evaluation, Standards, and Student Testing's (CRESST) model-based assessments. It considers alternative interpretations of scientific or practical models and illustrates how model-based assessment addresses both definitions. The components of the…

Teacher education programs help teachers gain knowledge and skills, develop "new" attitudes, and impact their beliefs about teaching, thereby favorably affecting teaching outcomes. In the absence of national standards and formal studies in Lebanon of existing teacher preparation programs, findings of this study could greatly contribute to needed…