The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

This study addresses validity issues in evaluation that stem from Ernest R. House's book, "Evaluating With Validity". The authors examine "American Journal of Evaluation" articles from 1980 to 2010 that report the results of policy and program evaluations. The authors classify these evaluations according to House's "major approaches" typology…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…

Collaboration is a widely utilized strategy for addressing complex social issues and for facilitating organizational innovation and performance. Evaluators are uniquely positioned to empirically examine the development and effects of interagency and interprofessional collaboration. In this article, the authors present the Collaboration Evaluation…

This article provides a frame for evaluation of natural resource interventions, which necessarily involves both human and natural systems. Two-system evaluands require us to adapt evaluation methods for comparison and attribution and to address differences in time and space occurring across the systems as well as potentially very different values…

Findings derived from self-reported, structured survey questionnaires are commonly used in evaluation and applied research to inform policy-making and program decisions. Although there are a variety of issues related to the quality of survey evidence (e.g., sampling precision), the validity of response processes--how respondents process thoughts…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…

Health promotion and social betterment program interventions are based on either formal theory from academia or stakeholder theory from stakeholders' observations and experiences in working with clients. Over time, formal theory-based interventions have acquired high prestige, while stakeholder theory-based interventions have been held in low…

Where do evaluators find resources on ethics and ethical practice? This article highlights a relatively new online resource, a centerpiece project of the National Center for Professional and Research Ethics (NCPRE), which brings together information on best practices in ethics in research, academia, and business in an online portal and center. It…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

No self-report measure of cultural competence currently exists in program evaluation. Adapting items from cultural competence measures in fields such as counseling and nursing, the researchers developed the Cultural Competence of Program Evaluators (CCPE) self-report scale. The goals of this study were to validate the CCPE and to assess…

Attention to cultural competence has significantly increased in the human services over the last two decades. Evaluators have long had similar concerns and have made a more concentrated effort in recent years to adapt evaluation methodology to varying cultural contexts. Little of this literature, however, has focused on the extent to which local…

Through a comparative study of the United Kingdom and Spain, this article addresses the effect of different research governance structures on the functioning and uses of research evaluation. It distinguishes three main evaluation uses: distributive, improvement, and controlling. Research evaluation in the United Kingdom plays important…

Despite 11,000 years of honing evaluation skills in order to thrive in some of the harshest climatic conditions on the planet, there are few Alaska Native program evaluators and until a recent exchange with New Zealand "Maori", there was no collective vision for building Alaska Native capacity in program evaluation. This article tells the story of…

All social and professional practices are historically situated, evolving forms of acting and interacting. Evaluation, as a practice, is shaped by and shapes the practice evaluated. This article contributes to responsive and values-engaged evaluation approaches by reflecting on the space where these two practices intersect. The evaluative task was…