In evaluation and applied social research, focus groups may be used to gather different kinds of evidence (e.g., opinion, tacit knowledge). In this article, we argue that making focus group design choices explicitly in relation to the type of evidence required would enhance the empirical value and rigor associated with focus group utilization. We…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Health promotion and social betterment program interventions are based on either formal theory from academia or stakeholder theory from stakeholders' observations and experiences in working with clients. Over time, formal theory-based interventions have acquired high prestige, while stakeholder theory-based interventions have been held in low…

Prior evaluations of evaluation theory have been problematic due in part to confusion about what exactly is being assessed. After drawing distinctions among evaluation theories, models, and approaches, the author examines three aspects of evaluation models and considers how the evaluation of a model depends on which aspect is being examined. The…

Evaluation scholars have long called for research on evaluation to provide an empirical basis for improving its theory and practice. Although calls to investigate evaluation have struck a chord in some quarters of the evaluation community, with the exception of research in the area of evaluation use, these calls have been infrequently answered.…

Examining evaluation theory in cultural context is an important component of evaluating theory; however, it is not the ultimate goal. The foundational element in good evaluation is validity, and appreciating the cultural location of evaluation theory is an important building block in the argument supporting multicultural validity. Multicultural…

This article introduces a new approach to program theory evaluation called theory-based stakeholder evaluation or the TSE model for short. Most theory-based approaches are program theory driven and some are stakeholder oriented as well. Practically, all of the latter fuse the program perceptions of the various stakeholder groups into one unitary…

There is growing interest in the concept of "mechanism" across many areas of the social sciences. In the field of program and policy evaluation, a number of scholars have also emphasized the importance of causal mechanisms for explaining how and why programs work. However, there appears to be some ambiguity about the meaning and uses of…

Over the past two decades, there has been tension underscoring the nature, role, and importance of theory in the evaluation field. Some notable evaluation scholars contend that there is little need for evaluation theory and that good evaluative practice can occur with little or no regard to evaluation theory. Yet, others maintain that evaluation…

This article demonstrates the value of theoretical ex-ante evaluation of policy programs. We show how a specific policy might not achieve its objectives and illustrate the elements of the policy, which need improvement. These conclusions are based on a reconstruction and evaluation of the theory behind a policy program that aims to increase…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…

This article reviews the literature and practice concerned with the evaluation of science, technology, and innovation (STI) policies and the way these relate to theories of the innovation process. Referring to the experience of the European Union (EU), the authors review the attempts to ensure that the STI policy theory is informed by advances in…

What is the relationship between theory and design in evaluation pretending to be "democratic?" When do we feel able to relinquish elements of intellectual control over evaluation? If not in qualitative versus quantitative tendencies, where lie key value divisions in evaluation? To elicit the views of two leading United Kingdom-based theorists of…

Program theory plays a prominent role in many evaluations, not only in theory-driven evaluations. This paper presents a case study of the process of developing and refining a program's theory within a user-oriented evaluation. In user-oriented (or utilization-focused) evaluations, primary users can play a role in defining their own program theory.…

Uses the framework of program theory evaluation to assess the operation of charter schools in Florida in the 1999-2000 school year. Data from a variety of sources suggest that school performance is not better than in regular public schools, and regular schools have not changed in response to their challenge. (SLD)