Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

A synthesis of the state of the literature is discussed in this section of the Evaluation Capacity Building (ECB) forum organized around four critical questions: (1) What is ECB? (2) How can we make it happen? (3) How do we know it is happening? and (4) What is its impact? The authors argue that to move the field of ECB forward we need to envision…

There is a long-standing debate as to whether nonexperimental estimators of causal effects of social programs can overcome selection bias. Most existing reviews either are inconclusive or point to significant selection biases in nonexperimental studies. However, many of the reviews, the so-called "between-studies," do not make direct…

This essay explores the contributions of "Evaluation Practice" and the "American Journal of Evaluation" to our understanding of evaluation ethics. The review is organized according to the five Guiding Principles for Evaluators (Systematic Inquiry, Competence, Integrity/Honesty, Respect for People, and Responsibilities for General and Public…

As is the case with other fields, there is motivation for studying the impact that the body of evaluation theory literature has within and outside the field. The authors used journal articles written by theorists included on the evaluation theory tree by Alkin and Christie (2004; Christie & Alkin, 2008) and published in the Web of Science, an…

Considerable research has been conducted on the use of the findings of program evaluation, but little, if any, attention has been paid to the soundness of the methods of this research. If the methods are not sound or not well described in the research, the strength of the conclusions of the research is unknown. The authors examine the empirical…

As a fairly new and emergent construct, there remain many gaps in our knowledge about how to integrate notions of culture and cultural context into evaluation theory and practice, as well as gaps in our knowledge about how to conduct and implement evaluations in immigrant and indigenous communities. In this article, the authors provide a…

The current evaluation literature tends to conceptualize evaluator roles as a single, overarching orientation toward an evaluation, an orientation largely driven by evaluation methods, models, or stakeholder orientations. Roles identified range from a social transformer or a neutral social scientist to that of an educator or even a power merchant.…

This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood's 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The…

This article presents the state of practice of evaluability assessment (EA) as represented in the published literature from 1986 to 2006. Twenty-three EA studies were located, showing that EA was conducted in a wide variety of programs, disciplines, and settings. Most studies employed document reviews, site visits, and interviews, common…

This article provides a critical review of the quality of 12 recent large federal program evaluations. The review focused on elements of the evaluation design, inclusion of evaluation expertise among those who have oversight of the evaluation, and evaluation dissemination. Overall, the process analyses from these evaluations provide good models…

An important final step in the life cycles of programs and their evaluation involves assessing new programs' or innovations' sustainability. This review and synthesis of 19 empirical studies of the sustainability of American and Canadian health-related programs examines the extent of sustainability achieved and summarizes factors contributing to…

This paper provides the results of a literature review on the use of practical, hands-on training experiences in evaluation course work and training programs. The review spans the years 1965-2003. I identified 18 articles that encompass four basic approaches for practical evaluation training: simulation, role-play, single course projects, and…

Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the…

Presents results of a literature review, organized the Milstein and Cotton evaluation capacity (B. Milstein and D. Cotton, 2000) framework, detailing and analyzing the contextual factors and system features that impact the evaluation capacity of school counseling programs. Discusses implications for evaluation in other settings. (SLD)