Describes an approach to addressing issues of validity of inferences and the extrapolation of inferences to target domains beyond the assessment for alternative assessments. Makes the case that in both language testing and educational assessment the roles of language and content knowledge must be considered, and that the design and development of…

Discusses some practical issues in linking educational assessments, focusing on the importance of clarity of purpose when assessments are linked. Also stresses the importance of the design used to collect data for linking. Uses linking studies from a variety of situations to illustrate these points. (SLD)

Reviews the status of classroom assessment, focusing on the review of four key research summaries that describe the dismal state of classroom assessment in the past century. Cites four important developments as reasons for optimism about the future of classroom assessment and details a five-part action plan for achieving the untapped potential of…

Discusses the potential positive and negative effects computer-based testing could have on validity, reviews the literature on validation perspectives in computer-based testing, and suggests ways to evaluate the contributions of computer-based testing to more valid measurement practices. (SLD)

Presents a broad definition of "testlet" and suggests a framework for classifying types of testlets. Considers several issues that bear on the conceptualization of testlets and analyses of scores from tests composed of testlets. Suggests some research topics that seem particularly important to advancing the meaningful and appropriate use of…

Reviews some of the more salient conceptual features of generalizability (G) theory. Provides a framework for considering some misconceptions about G theory. Focuses on particularly prevalent or serious misconceptions. G theory provides a rich conceptual framework and tools for working with a defined universe, but it does not tell an investigator…

Discusses issues of validity in high-stakes testing, beginning with some purposes of a testing program and proceeding to some underlying assumptions about testing. Suggests four possible studies to address assumptions often ignored by asking various groups of people about testing. (SLD)

Presents suggestions for classroom-assessment courses regarding (1) communicating assessment results by assigning grades; (2) communicating assessment results in other ways; and (3) communicating the results of standardized testing. Discusses course content in the context of the "Standards for Teacher Competence in the Assessment of Students."…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

Explores how a program of strong construct validation could be applied to the assessment of the construct of test anxiety, paying special attention to substantive, structural, and external aspects of construct validation. A framework is proposed to pull together various statistical methods used in construct validation research into an organized…

The concept of consequential validity wrongly links the idea of the consequences of test use with the idea of validity, widely held to be rooted in the accuracy of inferences drawn from examinees' test performances. The reification of consequential validity can distract from a needed clarity about test use consequences. (SLD)

The accuracy of statistics based on performance assessments that represent percentages of students reaching standards is explored using data from a large-scale performance assessment, the Maryland School Performance Assessment Program. Results with students in grades 3, 5, and 8 support the accuracy of pooling results to produce the statistics.…

Gender-related differential item functioning (DIF) was examined in a context in which 3,946 middle school students received mathematics instruction focusing on problem solving. Reasons why four tasks on the performance assessment favored female students and two favored male students are discussed. (SLD)

Since the 1970s, policymakers have learned that test results can be used as an administrative mechanism to implement policy. A national system of external certification tests would involve several problems: (1) absence of independent examination boards; (2) negative impact on teaching; (3) tendency to elitism; (4) competition for RFP's; and (5)…

Technical problems in the assessment of learning disabilities (LD) are only a small part of the problems leading to the misidentification of children in this category of handicap. Given all the other motives and purposes served by labeling a child LD in school, apparently sound measurement advice may actually do more harm than good. (LC)