We assessed the impact of music videos with science-based lyrics on content knowledge and attitudes in a three-part experimental research study of over 1000 participants (mostly K-12 students). In Study A, 13 of 15 music videos were followed by statistically significant improvements on questions about material covered in the videos, while performance on "bonus questions" not covered by the videos did not improve. Video-specific improvement was observed in both basic knowledge and genuine comprehension (levels 1 and 2 of Bloom's taxonomy, respectively) and after both lyrics-only and visually rich versions of some videos. In Study B, musical versions of additional science videos were not superior to non-musical ones in their immediate impact on content knowledge, though musical versions were significantly more enjoyable. In Study C, a non-musical video on fossils elicited greater immediate test improvement than the musical version ("Fossil Rock Anthem"); however, viewers of the music video enjoyed a modest advantage on a delayed post-test administered 28 days later. Music video viewers more frequently rated their video as "fun", and seemed more likely to revisit and/or share the video. Our findings contribute to a broader dialogue on promising new pedagogical strategies in science education.