Mentoring is an important aspect of mathematics teacher education, and in particular, pre-service teacher education. Faculty at a large Midwestern university developed and refined a mentoring program designed to help pre-service secondary mathematics teachers, called Scholars, become future leaders in mathematics education. This paper describes how faculty mentors leveraged challenges in the mentoring program's early stages based on their reflections and initial mentee outcomes to create a more effective mentoring program. Recommendations based on research and practice are provided for other university programs interested in mentoring future mathematics teachers.