Interest in measuring and evaluating student learning in higher education is growing. There are many tools available to assess student learning. However, the use of such tools may be more or less appropriate under various conditions. This study provides some evidence related to the appropriate use of pre/post-tests. The question of whether graded tests elicit a higher level of performance (better representation of actual learning gains) than ungraded post-tests is examined. We examine whether the difficulty level of the questions asked (knowledge/comprehension vs. analysis/application) affects this difference. We test whether the student's level in the degree programme affects this difference. Results indicate that post-tests may not demonstrate the full level of student mastery of learning objectives and that both the difficulty level of the questions asked and the level of students in their degree programme affect the difference between graded and ungraded assessments. Some of these differences may be due to causes other than grades on the assessments. Students may have benefited from the post-test, as a review of the material, or from additional studying between the post-test and the final examination. Results also indicate that pre-tests can be useful in identifying appropriate changes in course materials over time. (Contains 5 tables.)