Taylor series play a ubiquitous role in calculus courses, and their applications as approximants to functions are widely taught and used everywhere. However, it is not common to present the students with other types of approximations besides Taylor polynomials. These notes show that polynomials construed to satisfy certain boundary conditions at an interval of definition can be represented by rapidly converging Fourier series. These polynomials are shifted and re-scaled versions of the Bernoulli polynomials. From this construction, an argument to 'invert' the Fourier series to obtain an approximation to sines and cosines in terms of the Bernoulli polynomials is presented. We then show that approximating sines and cosines by the Bernoulli polynomials might be much better than using the truncated Taylor series, especially in problems where global proprieties are desired. These contents can be taught in advanced Calculus classes approaching series of functions and their applications.