Purpose: Growing emphasis on program and practice evaluation in social work education coalesces with a growing interest in evaluation capacity building (ECB) within the interdisciplinary field of evaluation. However, the literature on ECB, while recognizing the importance of imparting knowledge and skills to individuals, largely ignores the potential contribution of courses that are offered as part of academic degree-granting programs. Methods: This article describes a seminar on program evaluation within a postgraduate course leading to a master of social work degree attended by currently employed social workers. The students were required to plan the evaluation of a program conducted by their respective agencies and carry out the evaluation, if possible. A survey was conducted among the graduates. Results: Almost all respondents reported that the seminar had improved their own evaluation capacity, and about a third reported enhanced evaluation capacity of their respective agencies. The ECB effect was strongest when stakeholders were involved in the evaluation. Discussion: An academic seminar can contribute to ECB, this contribution could be enhanced by designing the seminar with this purpose in mind.