Standardized, well-established paper-and-pencil tests, which measure spatial abilities or which measure reasoning abilities, have long been found to be predictive of success in the STEM (science, technology, engineering, and mathematics) fields. Instructors can use these tests for prediction of success and to inform instruction. A comparative administration of spatial visualization and cognitive reasoning tests, between in-class (proctored paper and pencil) and on-line (unproctored Internet) (N = 457), was used to investigate and to determine whether the differing instrument formats yielded equal measures of spatial ability and reasoning ability in large first-semester general chemistry sections. Although some gender differences were found, findings suggest that some differences across administration formats, but that on-line administration had similar properties of predicting chemistry performance as the in-class version. Therefore, on-line administration is a viable option for instructors to consider especially when dealing with large classes.