Participatory evaluation approaches have a relatively long history of advocacy and application in the international development evaluation community. Despite widespread use and apparent resonance with practitioners and donors alike, very little empirical research exists on why and how participatory evaluation approaches are used in international…

Undergraduate students are a potential pool of future evaluators, but little is known about their level of interest in pursuing a career in program evaluation (PE). This two-stage study collected survey data on 249 undergraduate students' knowledge, interest, and attitudes toward various descriptions of PE. Qualitative analysis indicated…

In evaluating local policy implementation, workaround stories--accounts of deliberate efforts to evade, subvert, or even break rules or procedures in order to get the job done--are valuable evaluative indicators. By "backward mapping" (Elmore, 1979) from frequently mentioned workarounds, we can identify flawed elements of policy- or grant-making…

This study explores the use of citation analysis methods to assess the influence of program evaluations conducted within the area of science, technology, engineering, and mathematics (STEM) education. Citation analysis is widely used within scientific research communities to measure the relative influence of scientific research enterprises and/or…

This study addresses the central question "How do evaluators' background characteristics relate to their evaluation design choices?" Evaluators were provided with a fictitious description of a school-based program and asked to design an evaluation of that program. Relevant background characteristics such as level of experience, methodological…

This article explores the important role that past editors of the "American Journal of Evaluation" and its predecessors, "Evaluation Practice" and "Evaluation News," played in the development of the American Evaluation Association (AEA). In interviews presented here, the editors recount the history of the association, the journal, and the field as…

Racial minority evaluators increase the democratic capacity and potential of institutions to the extent that they draw on their experiences and those of other marginalized communities. Their reflection on these experiences helps to disclose institutional power dynamics that are often veiled in neutrality. Of course, this depends on sound…

This study provides an understanding of how the coursework required for attaining a Masters of Public Health (MPH) degree in epidemiology or health education from accredited schools or programs of public health prepares students to evaluate programs or interventions. Study data were generated using a content analysis of required coursework…

In the contentious debate over the use of randomized clinical trials (RCTs) in education research, little attention has been given to how methodological issues arise and/or are resolved in the implementation of random assignment. Following a review of the methodological-theoretical literature on RCTs and alternative research designs, this article…

Although scholars have proposed many steps to increase evaluation use, there has been little comparative empirical study of whether researchers follow these recommendations and whether specific steps are associated with greater utilization. This study of state legislative evaluators finds that those that regularly meet with stakeholders and…

The international community has identified a positive link between good governance and economic development. There is an increasing appreciation of the effective role that local policy research organizations (PROs) can play in providing evidence-based policy recommendations as the basis for sound legislation and in assessing the efficacy of…

Complex health problems such as chronic disease or pandemics require knowledge that transcends disciplinary boundaries to generate solutions. Such transdisciplinary discovery requires researchers to work and collaborate across boundaries, combining elements of basic and applied science. At the same time, calls for more interdisciplinary health…

This essay explores the contributions of "Evaluation Practice" and the "American Journal of Evaluation" to our understanding of evaluation ethics. The review is organized according to the five Guiding Principles for Evaluators (Systematic Inquiry, Competence, Integrity/Honesty, Respect for People, and Responsibilities for General and Public…

This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and…

Major advances in the number, capabilities, and quality of state, national, and transnational databases have opened up new opportunities for evaluators. Both large-scale data sets collected for administrative purposes and those collected by other researchers can provide data for a variety of evaluation-related activities. These include (a)…