Educators agree on the benefits of adaptive learning, but evidence-based research remains limited as the field of adaptive learning is still evolving within higher education. In this study, we investigated the impact of an adaptive learning intervention to provide remedial instruction in biology, chemistry, math, and information literacy to first-year students (n = 128) entering a pharmacy professional degree program. Using a mixed methods design, we examined students' learning in each of the four content areas, their experience using the adaptive system, and student characteristics as related to their choice of participating in the intervention. The findings showed the adaptive learning intervention helped address the knowledge gap for chemistry, but the same effect was not observed for the other three content areas. Math anxiety was the only student characteristic that showed a significant relationship with students' participation. While the students reported an overall positive experience, the results also revealed time factor and several design flaws that could have contributed to the lack of more student success. The findings highlight the importance of design in adaptive learning.