Describing, explaining, and discussing various modern indices of scholarly impact as accomplished by Ruscio, Seaman, D'Oriano, Stremlo, and Mahalchik (this issue) is highly commendable, as such measures get increasingly important in hiring and promotion decisions. The author agrees with almost all points made in the target article, except the…

Ruscio, Seaman, D'Oriano, Stremlo, and Mahalchik (this issue) evaluate 22 bibliometric indicators, including conventional measures, like the number of publications, the "h" index, and many "h" index variants. To assess the quality of the indicators, their well-justified criteria encompass conceptual, empirical, and practical issues: ease of…

Ruscio and colleagues (Ruscio, Seaman, D'Oriano, Stremlo, & Mahalchik, this issue) provide a thoughtful empirical analysis of 22 different measures of individual scholarly impact. The simplest metric is number of publications, which Simonton (1997) found to be a reasonable predictor of career trajectories. Although the assessment of the scholarly…

Ruscio et al. (Ruscio, Seaman, D'Oriano, Stremlo, & Mahalchik, this issue) write of a thing with which scientists and scholars are all too familiar, the assessment of published research and of its authors. The author was startled to discover how little the agenda of the paper seems to engage with factors one relies on for salary and promotion…

Black, Wilson, and Yao (this issue) lay out a comprehensive vision for the way that learning progressions (or other "road maps") might be used to inform and coordinate formative and summative purposes of assessment. As Black, Wilson, and others have been arguing for over a decade, the effective use of formative assessment has great potential to…

Black, Wilson, and Yao (this issue) make a compelling case for a coherent model of curriculum, pedagogy, and assessment, all built around a well-specified theory of learning. Arguing that dominant assessment policies and practices tend to drive pedagogy and student attitudes toward learning in pernicious ways, Black et al. make an argument that is…

Ten years ago, the authors of Knowing What Students Know proposed that large-scale and classroom assessment should be created from the same underlying model of learning. They suggested that, ideally, a model of learning should provide a developmental perspective, "laying out one or more typical progressions from novice levels toward competence and…

Paul Black, Mark Wilson, and Shih-Ying Yao in "Road Maps for Learning: A Guide to the Navigation of Learning Progressions" provide a number of important ideas to consider regarding the development of assessments and curriculum materials to support development of core ideas. One major idea that the author found most valuable is the focus on student…

Cynthia Coburn and Erica Turner have made an important contribution by developing a framework to synthesize the various strands of research and theory related to data use in schools. The framework illustrates the complexity of the pathways between the adoption of a data-use intervention and the attainment of desired outcomes, and it clarifies the…

Coburn and Turner (this issue) present an intriguing framework for understanding how data has come to be used in the current high accountability environments in education. In this framework, they connect various processes of data use within organizational and political contexts. Data use is presented using an ecological perspective that deepens…

The focus article by Coburn and Turner (this issue) seeks to provide a comprehensive framework for understanding data use in the context of data-use interventions. This commentary focuses on what the authors see as a glaring omission in what is otherwise a valuable framework: the issue of "useful data." It is their contention that the usefulness…

In this commentary, the author asks the analogous question, "where's the psychology?" Not because the authors of the focus article "Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art" have not provided a solid review of the technical aspects of Diagnostic Classification Models (DCM),…

In "International approaches to Science Assessment" Paul Black and Dylan Wiliam describe eight major elements of assessment systems and contrast some of the differences among these elements across seven countries. Of particular interest to the author is an issue that cuts across many of these elements, namely, what gets assessed as part of these…

This article presents an overview of measuring science based on a bibliometric methodology. The 2 main lines of this methodology are discussed. First, the measurement of research performance is addressed, including aspects such as interdisciplinarity, collaboration, and knowledge users. It is demonstrated that advanced bibliometric methods are an…

This article presents the author's critique of Anthony F. J. van Raan's article titled, "Measurement of Central Aspects of Scientific Research: Performance, Interdisciplinarity, Structure." van Raan makes an excellent case for using bibliometric data to measure some central aspects of scientific research and to construct indicators of groups:…