This study explores the use of citation analysis methods to assess the influence of program evaluations conducted within the area of science, technology, engineering, and mathematics (STEM) education. Citation analysis is widely used within scientific research communities to measure the relative influence of scientific research enterprises and/or…

This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood's 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The…

Meta-evaluations reported in the literature, although rare, often have focused on retrospective assessment of completed evaluations. Conducting a meta-evaluation concurrently with the evaluation modifies this approach. This method provides the opportunity for the meta-evaluators to advise the evaluators and provides the basis for a summative…

The purpose of this article is to describe a new collaborative immersion approach for developing evaluation capacity that was used in kindergarten through Grade 12 (K-12) schools and to place this new approach on a continuum of existing capacity-building methods. The continuum extends from individualistic training-oriented methods to collaborative…

Use of evaluation findings is a valued outcome for most evaluators. However, to optimize use, the findings need to be disseminated to potential users in formats that facilitate use of the information. This reflective case narrative uses a national evaluation of a multisite National Science Foundation (NSF) program as the setting for describing the…

Site visits are a commonly employed, but little discussed, evaluation procedure. Our purpose is to review the state of the art regarding site visits, as well as to catalyze a discussion of site visits centering on the question of whether or not existing practices constitute a set of methods or a methodology. We define evaluative site visits and…

Multi-site evaluations are becoming increasingly common in federal funding portfolios. Although much thought has been given to multi-site evaluation, there has been little emphasis on how it might interact with participatory evaluation. Therefore, this paper reviews several National Science Foundation educational, multi-site evaluations for the…

Proposes a new metaphorical framework for understanding and using mixed methods evaluation. Uses the archipelago as a metaphor for resolving the challenges presented by a mixed methods approach, this allowing the simultaneous consideration of different methods and stances. (SLD)