In learning management systems, tools for online homework assessments include a number of alternatives for the assessment settings, including the ability to permit students to attempt an assessment multiple times, with options for how the multiple attempts are administered. A specific implementation of online assessments in an introductory operations management course, where students were allowed up to two attempts, found that assessment performance was better for students who attempted only once, even when comparing between students of similar ability in the course. A discussion of why this may have been, and how minor modifications to specific assessment settings could change student behaviors, is provided.