Physics is often seen as an excellent introduction to science because it allows students to learn not only the laws governing the world around them, but also, through the problems students solve, a way of thinking which is conducive to solving problems outside of physics and even outside of science. In this article, we contest this latter idea and argue that in physics classes, students do not learn widely applicable problem-solving skills because physics education almost exclusively requires students to solve well-defined problems rather than the less-defined problems which better model problem solving outside of a formal class. Using personal, constructed, and the historical accounts of Schrödinger's development of the wave equation and Feynman's development of path integrals, we argue that what is missing in problem-solving education is practice in identifying gaps in knowledge and in framing these knowledge gaps as questions of the kind answerable using techniques students have learned. We discuss why these elements are typically not taught as part of the problem-solving curriculum and end with suggestions on how to incorporate these missing elements into physics classes.