Metacognition is often described as knowledge and control over one's cognitive processes. Models of metacognition often include knowledge monitoring as the foundation of metacognitive skills. The current study was designed to determine whether the ability to accurately assess one's knowledge can increase throughout a semester long course, when students are provided knowledge monitoring practice. Undergraduates enrolled in an educational psychology course were administered 13 exams during the course of a semester and provided a number of opportunities to practice knowledge monitoring. Prior to each exam students were required to predict their exam scores. Calibration (the difference between predicted scores and actual performance) improved over the course of the semester. However, the data also revealed improved calibration might have been an artifact of the data. Put differently, calibration was poor at the beginning of the semester as students were on average overconfident. By the end of the semester, students predicted scores had not changed, but exam scores increased thus improving calibration.