Flipped pedagogy has become a popular approach in education. While preliminary research suggests that the flipped classroom has a positive effect on learning in Science, Technology, Engineering, and Mathematics and quantitative courses, the research on the flipped classroom in a content heavy social science course is minimal and contradictory. We flipped four class topics in an introduction to psychology course, evaluated resulting student attitudes, and compared students' performance on the flipped units to their performance on traditionally delivered content. We found mixed results for the effectiveness of the flipped classroom that were moderated by student characteristics and experiences with previous online or flipped courses. Students reported an overall preference for traditional classroom delivery but suggested retaining the flipped approach for some class periods.