In this paper I analyze students' conceptual understanding of the quality of polynomial approximation. In particular, I analyze to what extent the interactive play with various methods of interpolation enables the students to build visual pictures that help understanding the formal mathematical statements. The role of the Mathematica software in enabling the students to visualize the theory is investigated as well as the importance of accompanying visual intuitions with the formal statement of the theory.