Computational thinking and creative thinking are valuable tools both within and outside of computer science (CS). The goal of the project discussed here is to increase students' achievement in CS courses through a series of computational creativity exercises (CCEs). In this paper, the framework of CCEs is described, and the results of two separate studies on their impact on student achievement are presented. Students in introductory CS courses completed CCEs as part of those courses. Students in Study 1 came from a variety of programs, and students in Study 2 were engineering majors. A profiling approach was used to test whether the impact of the CCEs could be accounted for by differences in students' motivated and self-regulated engagement. Overall, CCEs had positive impacts on students' grades and knowledge test scores, and although there were differences in achievement across the profiles, the impact of the CCEs was generally consistent across profiles. The CCEs appear to be a promising way to increase student achievement in introductory CS courses. Implications and directions for future research are discussed.