The persistence of undergraduate students in science, technology, engineering, and mathematics (STEM) disciplines is a national issue based on STEM workforce projections. We implemented a weeklong pre-college engagement STEM Academy (SA) program aimed at addressing several areas related to STEM retention. We validated an instrument that was developed based on existing, validated measures and examined several psychosocial constructs related to STEM (science identity, self-efficacy, sense of belonging to the university and to STEM, career expectancies, and intention to leave STEM majors) before and after the program. We also compared students in the SA program with a matched comparison group of first-year students. Results show that SA students significantly increased in science identity and sense of belonging to STEM and to the university, all predictive of increased STEM retention and a primary aim of the program. Relative to the matched comparison group, SA students began their first semester with higher STEM self-efficacy, sense of belonging, and science identity, positive career expectancies, and lower intention to leave STEM. The SA cohort showed 98% first-year retention and 92% STEM major retention. The SA program serves as a model of a scalable, first-level, cocurricular engagement experience to enhance psychosocial factors that impact undergraduate persistence in STEM.