Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid…

The relationship between theory and practice, or between theoretical knowledge and practical knowledge, is not a simple one, and rarely is it the case that theory is "applied" to practice. This paper aims to clarify the relationship by briefly discussing the nature of practical problems and the role that theoretical knowledge plays in…

Eleven years ago, this author became the director of the Idaho State Legislature's Office of Performance Evaluations. As only the second person in that role, he considered the office and its function to be still evolving and because he understood legislative leadership to be interested in seeing evaluation work that could actually…

In this paper, the author argues that evaluation theory and practice interact insufficiently today, even though early evaluation theorists expected them to be closely intertwined. She views this limited connection as the result of differing interests on the part of theorists and practitioners, differing frequencies of dissemination, and differing…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Attention to evaluation quality is commonplace, even if sometimes implicit. Drawing on her 2010 Presidential Address to the American Evaluation Association, Leslie Cooksy suggests that evaluation quality depends, at least in part, on the intersection of three factors: (a) evaluator competency, (b) aspects of the evaluation environment or context,…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…

This paper presents the author's comment on "Evaluation Field Building in South Asia: Reflections, Anecdotes, and Questions" by Katherine Hay. Hay raises a number of extremely relevant issues relating to evaluation field building in South Asia. In this paper, the author aims to underscore the importance of three priorities for initiating public…

The author enjoyed reading Katharine Hay's ambitious and humbling visions for evaluation field building in South Asia. She has successfully positioned herself on a high mountain with a wonderful set of binoculars that enable her to see the entire evaluation landscape of South Asia. She magically sees and describes significant historical forces and…

The papers in this dialogue help develop evaluation as a field (both in South Asia and other regions). What comes through in all of the papers is both humility of where evaluation is as a field and imagination and ambition of where evaluators could be in the near future. Reading the papers in this forum makes them enthusiastic about being…

Today's public policy discussions increasingly focus on how "networks" of public and private actors collaborate across organizational, sectoral, and geographical boundaries to solve increasingly complex problems. Yet, many of evaluation's key concepts, including the evaluator's role, assume an evaluand that is programmatically or organizationally…

While participatory evaluation (PE) constitutes an important trend in the field of evaluation, its ontology has not been systematically analyzed. As a result, the concept of PE is ambiguous and inadequately theorized. Furthermore, no existing instrument accurately measures stakeholder participation. First, this article attempts to overcome these…

It is familiar in the world of systems building that funders start out saying they are not particularly interested in attribution, only to later begin using words like "prove" and "impact." Boards begin by asking for intelligent reflection from the 30,000-foot level and then suddenly want to know how many more children are ready for school.…

Drug studies are often cited as the best exemplars of evaluation design. However, many of these studies are seriously biased in favor of positive findings for the drugs evaluated, even to the point where dangerous effects are hidden. In spite of using randomized designs and double blinding, drug companies have found ways of producing the results…