Instructionally supportive accountability tests (a) measure students' mastery of only a modest number of extraordinarily important curricular aims; (b) describe what is to be assessed in clear, teacher-palatable language; and (c) report each student's results for every curricular aim assessed. To determine the suitability of such assessments to…

This article presents a rejoinder to the commentaries on the authors' article titled, "Instructionally Supportive Accountability Tests in Science: A Viable Assessment Option?" The commentaries offer a series of well warranted cautions regarding the adoption of any form of large-scale accountability testing. However, the authors contend that,…

The last century was marked by dazzling changes in many areas, such as technology and communications. Predictions into the second century of testing are seemingly difficult in such a context. Yet, looking back to the turn of the last century, Kirkpatrick (1900), in his American Psychological Association presidential address, presented fundamental…

Standards-based score reports interpret test performance with reference to cut scores defining categories like "below basic," "proficient," or "master." This article first develops a conceptual framework for validity arguments supporting such interpretations, then presents three applications. Two of these serve to introduce new standard-setting…

The theories of validity developed over the past 60 years are quite sophisticated, but the methodology of validity is not generally very effective. The validity evidence for major testing programs is typically much weaker than the evidence for more technical characteristics such as reliability. In addition, most validation efforts have a strong…

The commentaries include a wealth of insightful and interesting observations and suggestions, and I appreciate each author taking the time to comment on my efforts. In responding to their suggestions, I am inclined to develop a few general points raised in the commentaries a bit further.

Psychology is focused on variation between cases (interindividual variation). Results thus obtained are considered to be generalizable to the understanding and explanation of variation within single cases (intraindividual variation). It is indicated, however, that the direct consequences of the classical ergodic theorems for psychology and…

"The Second Century of Ability Testing: Some Predictions and Speculations" did not include predictions about the ability construct or the role of fundamental measurement principles. All commentators raised issues about the nature of the ability construct. The diverse viewpoints represented in these comments highlight well the complexity of the…