We argue, based on a multi-year collaboration to develop a pedagogy course for physics majors by experts in physics, education, and the science of learning, that the process of teaching science majors about education and the science of learning, and evidence-based teaching methods in particular, requires conceptual change analogous to that encountered by students in introductory physics classes. Similar to students learning many natural science concepts, science majors default to naïve theories of learning based on their own experiences and preferences, even when in conflict with educational research. Their demonstrated ability to analyze research on teaching and learning in the framework of the scientific method ultimately does not translate into acceptance of the outcomes as valid. We suggest a number of contributing factors. Recognizing the need to target conceptual change is critical in informing how we educate science students who are interested in teaching, whether as a profession or in a shorter-term capacity such as a graduate teaching assistant. It also suggests that an approach different from the way we typically teach science-education students is needed.