Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid…

The relationship between theory and practice, or between theoretical knowledge and practical knowledge, is not a simple one, and rarely is it the case that theory is "applied" to practice. This paper aims to clarify the relationship by briefly discussing the nature of practical problems and the role that theoretical knowledge plays in…

Both speakers at the Eleanor Chelimsky Forum on Theory and Practice in Evaluation pointed out the complexity and messiness of evaluation practice, and thus potential limits on theory and generalizable knowledge. The concept of reflective practice offers one way forward to build evaluation theory. Building generalizable knowledge about practice…

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

A synthesis of the state of the literature is discussed in this section of the Evaluation Capacity Building (ECB) forum organized around four critical questions: (1) What is ECB? (2) How can we make it happen? (3) How do we know it is happening? and (4) What is its impact? The authors argue that to move the field of ECB forward we need to envision…

There is a growing call for evaluation capacity building (ECB); although the area currently lacks a rich research base, there are few robust methods and practice through which to define it. The argument in this article is that the impact of evaluation is mediated by program stakeholders' engagement in evaluation activities. This mediation…

The interest and effort in evaluation capacity building (ECB) continues to grow enormously among organizations, funders, and evaluators. Yet a research synthesis of the ECB literature (Labin, Duffy, Meyers, Wandersman, & Lesesne, 2012) revealed major limitations in the science and practice of ECB. This forum on ECB, which includes two past…

A fundamental reason for doing evaluation capacity building (ECB) is to improve program outcomes. Developing common measures of outcomes and the activities, processes, and factors that lead to these outcomes is an important step in moving the science and the practice of ECB forward. This article identifies a number of existing ECB measurement…

Though several excellent literature reviews and research syntheses have been conducted, and thoughtful frameworks and models have been proposed, I believe it is time for the evaluation field to tackle the "hard stuff" of evaluation capacity building (ECB). This entails engaging staff in ECB activities, building the evaluation capacity of…

Evaluation capacity building (ECB) has progressed as a concept since it was the conference theme of the American Evaluation Association in the year 2000. This commentary poses some questions about underexamined issues in ECB about organizations, evaluators, and funders.

The Labin et al. logic model describes the why, how, what, and potential outcomes of evaluation capacity building (ECB). Getting To Outcomes offers a frame and empirical results for operationalizing the ECB logic model of Labin et al. and for deepening the science and practice of ECB.

What is different about the conduct of evaluations in conflict zones compared to nonconflict zones--and how do these differences affect (if at all) the ethical calculations and behavior of evaluators? When are ethical issues too risky, or too uncertain, for evaluators to accept--or to continue--an evaluation? These are the core questions guiding…

In many less developed democracies Voluntary Organizations for Professional Evaluation (VOPEs) face the challenges of low demand for evaluation and the resulting low economic capacity of national evaluation communities. The VOPE model that evolved in well-developed democracies is not directly applicable under these circumstances, so a new model…

National Evaluation Societies (NES) are situated at the intersection between Monitoring and Evaluation (M&E) supply and demand. To date, little research has explored NES and their potential for strengthening national M&E. This study addresses this gap, examining perceived NES performance relevant to organizational and policy-oriented goals…

In a world faced with unprecedented rising levels of inequality and injustice, is there a responsibility for our evaluation organizations to take on a leadership role in promoting inclusive, evaluative dialog and deliberation about the state of our democracies in relation to key democratic principles and ideals? In this forum, I question whether…