The Education and Human Resources (EHR) Directorate at the National Science Foundation has been examining its role in supporting the development of new approaches to science, technology, engineering and mathematics (STEM) education. This article explores what it means to be scientifically literate, what it takes to become a learning organization, how the EHR Directorate is working towards becoming such an organization through rigorous self-study, and how EHR can best manage its large portfolio of awards that support investigations in STEM education to enhance their collective value to researchers, policymakers and educators. Several elements of the self-study process are described, and the implications for the Directorate as well as for the field of researchers in science education are explored.