This paper falls into two main sections: (1) an overview of contemporary research on effective professional learning for practicing educators; and (2) recommendations for action to promote effective learning for practicing educators. Three central questions guide the paper: (1) When does professional learning lead to improved learning outcomes for…

The most popular methods for setting passing scores and other standards on educational tests rely heavily on subjective judgment. This paper presents and evaluates a new procedure for setting and evaluating standards on tests based on cluster analysis of test data. The clustering procedure was applied to a statewide mathematics proficiency test…

This paper provides a historical review of the changes and improvements made in estimating numerical cutpoints for the National Assessment of Educational Progress (NAEP). While reviewing the various methodologies used for collecting judgment data, the paper discusses: (1) the incorporation of Item Response Theory for setting standards; (2)…

The primary objective of this research was to examine the effect of scoring items known to be multidimensional using a unidimensional model. Although several simulation studies have examined this, few studies have been conducted using data obtained from actual test administrations. In this study, open-ended mathematics items from a mandated state…

The effects of using recommended data collection procedures on median recommended test standards, variability of recommended test standards, and reliability of recommended standards for 7 subtests of the National Teacher Examinations Communications Skills and General Knowledge Tests were explored, using 236 evaluators (75 public school teachers…

This Louisiana System for Teaching and Learning Assessment and Review (STAR) illustrates conceptual, methodological, and social/political issues emerging when the decision-making model used to make teacher certification decisions does not fit the assumptions of the measurement system used to collect the data. (SLD)

This article provides a framework for the rest of the articles in this special issue comparing the utility of three standard-setting methods with complex performance assessments. The context of the standard setting study is described, and the methods are outlined. (SLD)

Methods for setting cutoff scores based on criterion performance, normative comparison, and absolute judgment were compared for scores on a multiple-choice psychology examination for 121 undergraduates and 251 undergraduates as a comparison group. All methods fell within the standard error of measurement. Implications of differences for decision…

Continuing medical education (CME) on the Internet has grown steadily over the past several years. However, the quality of Web-based CME has received limited attention in the medical literature, and there have been few attempts to articulate quality standards. This article describes five sets of standards published in the distance education…

The District of Columbia Public Schools has adopted new learning standards for core subjects, including reading/English language arts, mathematics, science, and social studies. The new standards show what students should know and be able to do: (1) in each subject; (2) at each grade level; and (3) in every school. This publication guides parents…

Representatives of business, industry, and education have long perceived a gap between students' existing skills and those needed in the workplace. To address this problem, a strong movement toward adopting voluntary skill standards is now seen within career and technical education (CTE). In this article, the author discusses how addressing skill…

In previous studies of educational systems, Markov chains have often been used in simulations in which history played no role because all events were described as independent of each other. Mono-level dynamics (i.e., the social context in which learning occurs is ignored) have also been applied to simulations. Educational theories, however, are…

Considerable evidence suggests that policy-makers, educators, the media, and the public do not understand national and state test results. The problems appear to be two-fold: the scales on which scores are reported seem confusing, and the report forms themselves are often too complex for the intended audiences. This paper addresses two topics. The…

Studies of the Angoff method of standard setting suggest that judges agree in their estimates of the relative difficulties of test questions for minimally competent examinees and that each judge's estimates correlate well with the observed item difficulties for examinees whose total test scores are near the judge's personal standard (G. E.…

The most important issue in education today is helping students reach high standards. These standards are changing American education from a system driven by inputs and regulations to one judged by results. This manual is intended for use with any set of standards. Followed step by step, it will take the teacher from the abstract statements of the…