In this paper the authors review the validity claims of a survey published in 2003, "A Survey Measuring Elementary Teachers' Implementation of Standards-Based Mathematics Teaching." Though the original survey received widespread attention and use, little formal review had been performed beyond the original estimates of reliability and validity. A content analysis was performed as well as exploratory and confirmatory factor analyses in order to understand the continued validity of the interpretations and uses of the instrument results. Although the content the survey measures aligns with contemporary conceptualizations of high-quality teaching practices and was originally published with a reliability estimate and evidence of its overall validity, its use should be modified to some degree in order to align with the further validity analyses described in this paper.