In evaluation and applied social research, focus groups may be used to gather different kinds of evidence (e.g., opinion, tacit knowledge). In this article, we argue that making focus group design choices explicitly in relation to the type of evidence required would enhance the empirical value and rigor associated with focus group utilization. We…

The interest and effort in evaluation capacity building (ECB) continues to grow enormously among organizations, funders, and evaluators. Yet a research synthesis of the ECB literature (Labin, Duffy, Meyers, Wandersman, & Lesesne, 2012) revealed major limitations in the science and practice of ECB. This forum on ECB, which includes two past…

The Labin et al. logic model describes the why, how, what, and potential outcomes of evaluation capacity building (ECB). Getting To Outcomes offers a frame and empirical results for operationalizing the ECB logic model of Labin et al. and for deepening the science and practice of ECB.

In developing countries, an increasing number of civil society organizations (CSOs) engage in independent monitoring and evaluation (M&E) of government programs and policies. Most CSOs rely on a range of M&E tools in combination with advocacy strategies to hold government accountable and improve the implementation of programs and policies.…

This article synthesizes interview data from evaluation directors and top executives of philanthropic foundations on how evaluation might better advance their missions. In key informant interviews, respondents commented on the purposes of evaluation from the foundation's perspective, challenges to effective evaluation, and the means by which…

National Evaluation Societies (NES) are situated at the intersection between Monitoring and Evaluation (M&E) supply and demand. To date, little research has explored NES and their potential for strengthening national M&E. This study addresses this gap, examining perceived NES performance relevant to organizational and policy-oriented goals…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Jill Chouinard, in her article "The Case for Participatory Evaluation in an Era of Accountability" (this issue, p. 237), may be re-iterating what has often been claimed and arguably is infused already in much of our theory and practice: the value of participatory approaches in some, perhaps many situations. She summarizes these claims eloquently…

In "The Case for Participatory Evaluation in an Era of Accountability" (this issue), Jill Chouinard highlights seven tensions between the participatory and technocratic approaches to evaluation. She suggests that there is a need to create opportunities for more participatory approaches to evaluation. In this essay, I suggest that the era of…

In the original paper, it was argued that while there is an array of methods and methodologies available, their use is delimited by the culture of accountability that prevails in public sector institutions, a fact that is particularly problematic given the complexity and diversity of evaluation contexts today. This short rejoinder, to responses…

A key assumption in efforts to implement and improve cross-government public reporting systems is that legislators will make use of the performance information to enhance accountability and improve program and policy effectiveness. This five-year study is an assessment of expectations and actual uses of annual performance reports by elected…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…

The emergence of and the attention given to culture in the evaluation field over the last decade has created a heightened awareness of and need for evaluators to understand the complexity and multidimensionality of evaluations within multicultural, multiracial, and cross-cultural contexts. In this article, the authors discuss how cultural…

In evaluating local policy implementation, workaround stories--accounts of deliberate efforts to evade, subvert, or even break rules or procedures in order to get the job done--are valuable evaluative indicators. By "backward mapping" (Elmore, 1979) from frequently mentioned workarounds, we can identify flawed elements of policy- or grant-making…

The author enjoyed reading Katharine Hay's ambitious and humbling visions for evaluation field building in South Asia. She has successfully positioned herself on a high mountain with a wonderful set of binoculars that enable her to see the entire evaluation landscape of South Asia. She magically sees and describes significant historical forces and…