Despite improved spam filtering technology, phishing continues to be a prevalent threat for college students. The current study found that approximately 4-in-10 of the students surveyed (N = 462) indicate they do not know what phishing is and the threat it poses. Students also report initially overestimating their confidence to successfully recognize phishing attempts, and underestimating their susceptibility to being the victim of an attack. By completing an interactive online phishing quiz, which explained what to look for in both counterfeit and legitimate email messages, students' self-efficacy to identify phishing attempts increased, as did their perceived susceptibility to phishing attacks, their perceptions of the severity of phishing, their intentions to learn more about the topic, and their intentions to discuss phishing with others. These results indicate that a simple, interactive online phishing quiz could be used as an effective teaching tool to supplement existing educational attempts regarding phishing on college campuses.