Although collaboration is recognized as an effective means to address multifaceted community issues, successful collaboration is difficult to achieve and failure is prevalent. To effectively collaborate, collaborators must recognize the strengths and weaknesses within their own efforts. Using Mattessich and colleagues' work as a springboard,…

Qualitative data offer advantages to evaluators, including rich information about stakeholders' perspectives and experiences. However, qualitative data analysis is labor-intensive and slow, conflicting with evaluators' needs to provide punctual feedback to their clients. In this method note, we contribute to the literature on rapid…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

Considerable empirical research, along with a growing body of conceptual and theoretical literature, exists on the role of culture and context in evaluation. Less scholarship has examined culturally responsive surveys in the context of international evaluation. In this article, the authors present lessons learned from the development,…

Researchers have become increasingly interested in programs' main and interaction effects of two variables (A and B, e.g., two treatment variables or one treatment variable and one moderator) on outcomes. A challenge for estimating main and interaction effects is to eliminate selection bias across A-by-B groups. I introduce Rubin's…

Community psychology blends psychological science, a community-level perspective on social issues, and a social justice orientation. Despite important difference between community psychology and program evaluation, program evaluation is a key component of many community psychologists' practice and holds a central place in my own. In this…

In 2012, the American Evaluation Association (AEA) added community psychology (CP) to its roster of topical interests groups (TIG). One of the highlights of the CP TIG program at the 2012 AEA Conference and the genesis of this "American Journal of Evaluation" Forum was a panel of accomplished community psychologists and evaluation…

This essay explores the implications of the zeitgeist that emerged in the United States during the 1960s for the conceptualization of ethical issues in evaluation and community psychology, and how perspectives from the latter field might enhance ethical practice in the former. Special attention is paid to articulations of social justice,…

Program evaluation is generally viewed as a set of mechanisms for collecting and using information to learn about projects, policies and programs, to understand their effects as well as the manner in which they are implemented. AEA has espoused principles for evaluation that place emphasis on competent, honest inquiry that respects the security,…

Nonprofit organizations are under great pressure to use evaluations to show that their programs "work" and that they are "effective." However, empirical evidence indicates that nonprofits struggle to perform useful evaluations, especially when conducted under accountability pressures. An increasing body of evidence highlights…

Despite the claimed success of the 1996 Welfare Reform, little research using multivariate regression has examined changes in multiple public safety-net programs. Thus, we still do not know whether public safety-net programs for the poor have shrunk or increased nationwide, along with the sharp declines in cash assistance. Using state-level data…

Predictors of retention of participants in a longitudinal study and heterogeneity between communities were investigated using a multilevel logistic regression model. Data from the longitudinal outcome study of the national evaluation of the Comprehensive Community Mental Health Services for Children and Their Families program and information on…

The relationship between theory and practice, or between theoretical knowledge and practical knowledge, is not a simple one, and rarely is it the case that theory is "applied" to practice. This paper aims to clarify the relationship by briefly discussing the nature of practical problems and the role that theoretical knowledge plays in…

Theory and practice are integrated in the human brain. Situation recognition and response are key to this integration. Scholars of decision making and expertise have found that people with great expertise are more adept at situational recognition and intentional about their decision-making processes. Several interdisciplinary fields of inquiry…

Both speakers at the Eleanor Chelimsky Forum on Theory and Practice in Evaluation pointed out the complexity and messiness of evaluation practice, and thus potential limits on theory and generalizable knowledge. The concept of reflective practice offers one way forward to build evaluation theory. Building generalizable knowledge about practice…