This study challenges persistent misrepresentations of evaluation as a value-neutral inquiry process by presenting an empirical study that deepens understanding of evaluators' values and how they "show up" in evaluation practice. Through semistructured interviews and inductive analysis, we examined the values advanced by a sample of…

Quality Assessment Frameworks (QAFs) are standardized templates that include pre-defined criteria, open questions, or a combination to assess the quality of evaluations. They support organizations to limit risks associated with poor-quality evaluation. Qualitative research focused on four QAFs shows that five dimensions of quality are assessed…

The importance of considering wider contexts when evaluating the success or failure of programs has been increasingly acknowledged with the shift towards culturally responsive evaluation. But one of the important advantages of contextual approaches has been mostly overlooked--that they can provide more "realist" evaluations for why…

This study analyzes evaluation influence theories to understand their unified contributions to a conceptual framework for research on evaluation influence in non-western contexts. Specifically, these theories are analyzed according to their usefulness for interpreting the consequences of the Annual Status of Education Report (ASER)--a cyclical,…

This article presents an analytic approach to assessing the relationship between policy advocacy activities and outcomes for discrete episodes of advocacy, using a holistic array of factors that affect the relationship between advocacy and policy change. The factors pertain to not only advocacy organizational structure and strategies, but also the…

This article reports research that examined the meaning of two broad evaluator competency domains. The first is "situational awareness" (SA) that focuses on understanding the unique contexts of evaluations and their users/stakeholders. The second is "interpersonal competence" (IC) that focuses on social skills needed for…

To progress as a field, evaluators must be able to describe their work to nonevaluators, and to persuade an audience they have something unique and valuable to offer. Yet anecdotal reports suggest many evaluators have difficulty describing their work. Through 42 interviews with practicing evaluators, we aimed to better understand evaluators'…

Culturally responsive evaluation contests that Western-derived evaluation methods represent a universal truth and promotes approaches that reflect the local context. Taking this approach, we examine how the method of contribution analysis may be modified to reflect a different worldview. We reframe contribution analysis using a Confucian lens as…

Evaluating initiatives implemented across multiple settings can elucidate how various contextual factors may influence both implementation and outcomes. Understanding context is especially critical when the same program has varying levels of success across settings. We present a framework for evaluating contextual factors affecting an initiative…

What is different about the conduct of evaluations in conflict zones compared to nonconflict zones--and how do these differences affect (if at all) the ethical calculations and behavior of evaluators? When are ethical issues too risky, or too uncertain, for evaluators to accept--or to continue--an evaluation? These are the core questions guiding…

This article sketches the growth and accompanying challenges that face development evaluation in the future, by showing that whilst the progress in expanding the geographical presence of evaluation has been impressive, much more needs to be done. Important work has been done in promoting guidance through agencies such as the (UNEG, OECD/DAC and…

National Evaluation Societies (NES) are situated at the intersection between Monitoring and Evaluation (M&E) supply and demand. To date, little research has explored NES and their potential for strengthening national M&E. This study addresses this gap, examining perceived NES performance relevant to organizational and policy-oriented goals…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

In the original paper, it was argued that while there is an array of methods and methodologies available, their use is delimited by the culture of accountability that prevails in public sector institutions, a fact that is particularly problematic given the complexity and diversity of evaluation contexts today. This short rejoinder, to responses…

Attention to evaluation quality is commonplace, even if sometimes implicit. Drawing on her 2010 Presidential Address to the American Evaluation Association, Leslie Cooksy suggests that evaluation quality depends, at least in part, on the intersection of three factors: (a) evaluator competency, (b) aspects of the evaluation environment or context,…