This manuscript shares lessons learned from conducting an action evaluation of the use of multimedia case studies in Management Information Systems (MIS) courses. Three undergraduate MIS classes took part in the study. The purpose for using case studies in these classes was to teach students about the role of MIS in business. An action evaluation approach, focusing on the establishment of goals, assessment for refinement of goals, and retrospective assessment (Rothman, 1999), was used; this process incorporates formative evaluation into an action research approach which enabled the external evaluators to provide feedback to instructors about students' perceptions of the use of the multimedia case studies in MIS classes. This study used open-ended qualitative survey questions to identify how students experienced the use of multimedia case studies in their learning course material. The findings of the study indicate that the use of case studies in teaching MIS is effective; however, as with any new teaching innovations, what is new quickly becomes boring when over-utilized. Findings also informed our selection of future data collection methods to yield deeper responses by students. (Contains 6 tables.)