This classification study examines evaluators' coursework training as a way of understanding evaluation practice. Data regarding courses that span methods and evaluation topics were collected from evaluation practitioners. Using latent class analysis, we establish four distinct classes of evaluator course-taking patterns: quantitative,…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

In this paper we describe an evaluation training program sponsored by the Robert Wood Johnson Foundation and led by Duquesne University and OMG Center for Collaborative Learning designed to meet the challenge of developing a cadre of diverse evaluation professionals, specifically those from traditionally underrepresented or underserved…

This study provides an understanding of how the coursework required for attaining a Masters of Public Health (MPH) degree in epidemiology or health education from accredited schools or programs of public health prepares students to evaluate programs or interventions. Study data were generated using a content analysis of required coursework…

To describe the recent practice of evaluation, specifically method and design choices, the authors performed a content analysis on 117 evaluation studies published in eight North American evaluation-focused journals for a 3-year period (2004-2006). The authors chose this time span because it follows the scientifically based research (SBR)…

As is the case with other fields, there is motivation for studying the impact that the body of evaluation theory literature has within and outside the field. The authors used journal articles written by theorists included on the evaluation theory tree by Alkin and Christie (2004; Christie & Alkin, 2008) and published in the Web of Science, an…

This paper presents the results of a cross-sectional survey on evaluation use completed by 1,140 U.S. American Evaluation Association members. This study had three foci: evaluators' current attitudes, perceptions, and experiences related to evaluation use theory and practice, how these data are similar to those reported in a previous study…

This article presents an interview with Eric Barela, a K-12 school district internal evaluator who conducted the Title I Best Practices study for the Los Angeles Unified School District (LAUSD), Research and Planning Division (formerly known as the Program Evaluation and Research Branch). In this interview, the author focuses not only on the…

Using a set of scenarios derived from actual evaluation studies, this simulation study examines the reported influence of evaluation information on decision makers' potential actions. Each scenario described a context where one of three types of evaluation information (large-scale study data, case study data, or anecdotal accounts) is presented…

This interview with Dr. Hallie Preskill focuses on the organizational change method known as appreciative inquiry (AI), which is described as a process that builds on past successes (and peak experiences) in an effort to design and implement future actions. Preskill takes the philosophy and principles put forth by organizational change AI…

Listservs have become a popular computer-mediated method for communicating with others who share a common interest. They offer subscribers quick feedback and provide a forum for ideas and beliefs to be exchanged, discussed, and modified. Although rarely studied, in some practical fields listserves have been shown to increase communication of best…

Program theory plays a prominent role in many evaluations, not only in theory-driven evaluations. This paper presents a case study of the process of developing and refining a program's theory within a user-oriented evaluation. In user-oriented (or utilization-focused) evaluations, primary users can play a role in defining their own program theory.…

Describes the dialogue in an informal discussion group and asserts that because the group is interactive, dynamic, and applied it is an embodiment of the nature of evaluation knowledge. Discusses ways in which this group teaches about evaluation. (SLD)

Describes the use of role play in creating an experiential learning environment for graduate students enrolled in a comparative evaluation theory course or an evaluation procedures course. The exercises require students to learn by "doing" in a safe environment. (SLD)