In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

Considerable empirical research, along with a growing body of conceptual and theoretical literature, exists on the role of culture and context in evaluation. Less scholarship has examined culturally responsive surveys in the context of international evaluation. In this article, the authors present lessons learned from the development,…

There is a growing call for evaluation capacity building (ECB); although the area currently lacks a rich research base, there are few robust methods and practice through which to define it. The argument in this article is that the impact of evaluation is mediated by program stakeholders' engagement in evaluation activities. This mediation…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

In this Exemplars case, the fifth and final under the direction of the current coeditors, the authors present a reflective account of an ongoing, complex, multiyear, multinational monitoring and evaluation (M&E) system conducted for African Women in Agricultural Research and Development (AWARD), an international development program. The…

In developing countries, an increasing number of civil society organizations (CSOs) engage in independent monitoring and evaluation (M&E) of government programs and policies. Most CSOs rely on a range of M&E tools in combination with advocacy strategies to hold government accountable and improve the implementation of programs and policies.…

In many less developed democracies Voluntary Organizations for Professional Evaluation (VOPEs) face the challenges of low demand for evaluation and the resulting low economic capacity of national evaluation communities. The VOPE model that evolved in well-developed democracies is not directly applicable under these circumstances, so a new model…

National Evaluation Societies (NES) are situated at the intersection between Monitoring and Evaluation (M&E) supply and demand. To date, little research has explored NES and their potential for strengthening national M&E. This study addresses this gap, examining perceived NES performance relevant to organizational and policy-oriented goals…

In a world faced with unprecedented rising levels of inequality and injustice, is there a responsibility for our evaluation organizations to take on a leadership role in promoting inclusive, evaluative dialog and deliberation about the state of our democracies in relation to key democratic principles and ideals? In this forum, I question whether…

There is a long-standing debate as to whether nonexperimental estimators of causal effects of social programs can overcome selection bias. Most existing reviews either are inconclusive or point to significant selection biases in nonexperimental studies. However, many of the reviews, the so-called "between-studies," do not make direct…

This essay engages questions of evaluator role and indigenous peoples participation in evaluation within colonial and decolonization contexts. Specifically, I critique the Western emphasis on cultural competence and contrast the utility of "mainstream" evaluation approaches alongside three indigenous inquiry models (Te Kotahitanga,…

Organizational evaluation capacity building has been a topic of increasing interest in recent years. However, the actual dimensions of evaluation capacity have not been clearly articulated through empirical research. This study sought to address this gap by identifying the key dimensions of evaluation capacity in Canadian federal government…

In Canada, in-depth evaluations of federal programs are intended to occur every 5 years. As such, evaluation is a periodic retrospective (lag) indicator examining results achieved versus program objectives. In a Canadian context, stand-alone evaluations have proved challenging to implement, time consuming, and not well adapted to annual management…

Sweden has a low prevalence of bullying and Swedish schools are legally obliged to have anti-bullying policies. Many commercial programs are available. A mixed methods, quasi-experimental, concurrent evaluation of 8 programs, chosen from a pool of 21 widely used anti-bullying programs, was planned. Preliminary data, based on 835 stakeholder…

Research has identified a wide range of factors that affect evaluation use but continues to be inconclusive as to their relative importance. This article addresses the complex phenomenon of evaluation use in three ways: first, it draws on recent conceptual developments to delimitate the examined form of use; second, it aims at identifying…