Evaluation policies set an important frame of reference for how evaluations are implemented. Despite the central influence that policies play in how evaluations are conducted, little empirical work has been conducted to better understand how these policies are interpreted and implemented. This paper describes the findings of case study evaluation…

This sequential mixed methods study analyzed how program evaluation was used to assess educational administration and examined thematic trends in educational evaluation published over 10 years (2001-2010). First, qualitative content analysis examined the articles in eight peer-reviewed evaluation journals. This analysis revealed that numerous…

This paper compares and contrasts the program theory of the reenacted Supervision Act to the Supervision Act of 2003. We describe how the expectations about how schools should be inspected, the effect such inspections are expected to have, and how these effects should be realized have changed over the past years as a result of changing paradigms…

A sample of educational evaluators was asked to design an outcomes-focused evaluation of a school program that aims to improve the academic achievement and self-esteem of students. Evaluators provided detailed descriptions of their evaluation design and methodology in their responses. These descriptions were coded and analyzed to determine the…

An abundance of comprehensive school reform (CSR) literature exists illustrating CSRs are effective in improving student outcomes. However, much of this research reports on top-down reforms, focuses on academic outcomes, and uses quantitative methods alone. Many educational researchers have argued for the use of mixed methods for providing a…

In many European languages, the words "assessment" and "evaluation" are synonymous, but in English the two terms are used differently. Educational "assessment" is learner-focused and part of professional pedagogy, relating directly to the accountability of practitioners and schools to learners and their families. Educational "evaluation" is…

To what extent does the intense and direct involvement of internal stakeholders, such as program managers and staff members, play a significant role toward evaluation use? Stakeholder involvement is a key element in evaluation and evaluation use is considered within a broader sense that includes organizational knowledge, individual skills, and…

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to…

The aim of the present study is to examine the relation between stakeholders as internal evaluators and their systemic positions in light of construal level theory. The study examines the two samples of county representatives, teachers and principals who answered the questionnaire regarding evaluation of the Norwegian assessment program. In…

Using a cross-case analysis of three distinct participatory program evaluations, this paper contributes to current discourse on how evaluators create opportunities for learning. Although each team of evaluators intended to promote planned process use, post-evaluation discussions amongst them identified evidence where use emerged throughout the…

This chapter describes evaluator behaviors revealed by the case analysis of a participatory and developmental evaluation. The analysis revealed that the evaluator paid specific attention to individual stakeholder cues. These cues were related to three elements of the evaluation: negotiating the design, monitoring individual stakeholder needs, and…

This article describes the planning of a multi-agency and multi-stakeholder evaluation of the implementation of supportive housing. The Ottawa Housing"Plus" Collaborative Communities project is a collaboration between university-based evaluators and members of a local network of supportive housing providers. The objectives of the initiative are…

This article describes an effectiveness evaluation of an intensive case management intervention coordinated by a non-profit organization in a midsize Midwest City. As an effectiveness evaluation, the primary evaluation question was causal in nature; the key task of the evaluative study was to establish and probe connections between the…

This paper synthesizes the existing literature on stakeholder involvement in program evaluation, drawing a basic distinction between deep involvement of a few versus less active involvement of a broad range of stakeholders. The paper then comments on the case studies described in this special issue and integrates them with previously published…

In this essay, we describe our experiences working with a rebellious primary stakeholder, Sylvia, as evaluators of a district-wide safe schools program. Given the breadth of the program and its multiple target constituencies, we were confronted with the challenges of managing a large number of stakeholders, or those individuals and groups that…