In the United Kingdom, the majority of national assessments involve human raters. The processes by which raters determine the scores to award are central to the assessment process and affect the extent to which valid inferences can be made from assessment outcomes. Thus, understanding rater cognition has become a growing area of research in the…

The engagement of teachers as raters to score constructed response items on assessments of student learning is widely claimed to be a valuable vehicle for professional development. This paper examines the evidence behind those claims from several sources, including research and reports over the past two decades, information from a dozen state…

Using an argument-based approach to validation, this study examines the quality of teacher judgments in the context of a standards-based classroom assessment of English proficiency. Using Bachman's (2005) assessment use argument (AUA) as a framework for the investigation, this paper first articulates the claims, warrants, rebuttals, and backing…

Describes an approach to addressing issues of validity of inferences and the extrapolation of inferences to target domains beyond the assessment for alternative assessments. Makes the case that in both language testing and educational assessment the roles of language and content knowledge must be considered, and that the design and development of…

Outlines a series of security steps that might be taken by researchers or organizations that are contemplating Web-based tests and performance assessments. Focuses on what can be done to avoid the loss, compromising, or modification of data collected by or stored through the Internet. (SLD)

Introduces the articles of this theme issue focusing on the involvement of key stakeholder groups in the validation of large-scale high-stakes assessments. Each makes a unique but complementary contribution to the understanding of the demands of a comprehensive validation effort. (SLD)

Points out areas in which aspects of assessment practice remain resistant to change: (1) evaluation of student achievement; (2) appropriate application of assessment innovation; and (3) preparation of educators in educational assessment. (SLD)

Discusses extending research into differential item functioning (DIF) to performance assessment and considers some of the best options available at this time. The most effective strategy for assessing DIF is to use a combination of several methods, preferably one from each of the observed score nonparametric, latent score nonparametric, and…

Analyzes the three major inferences involved in interpretation of performance assessments: (1) scoring of the observed performances; (2) generalization to a domain of assessment performances like those included in the assessment; and (3) extrapolation to the large performance domain of interest. Suggests ways to improve the validity of performance…

Describes seven topics that should be included in a course for teachers on performance assessment and provides some ideas for teaching them. The topics range from assessment selection to recognizing inappropriate, unethical, or illegal assessment methods and uses. (SLD)

Describes educational assessment in Singapore and discusses changes planned to focus assessment on more real-life situations while taking into account research on learning and critical thinking. (SLD)

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

An analytic framework is presented for examining the properties and objectives of assessments and scoring systems piloted in a number of state and district testing programs. The article explores the application of this framework, which considers the cognitive components of competence described in studies of expertise, to the analysis of science…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

Discusses appropriate ways to prepare students for performance assessments and proposes a list of six guidelines for teaching to performance assessments. The focus is on elementary and secondary education. It is believed that these guidelines will help balance the domain and sample problem. (SLD)