The Major Field Test in Psychology (MFT) is a standardised test designed to assess subject mastery at the conclusion of an undergraduate career. Eighty-one graduating majors completed the MFT and 56 of them also took a multiple-choice exam of questions drawn randomly from an introductory psychology test bank. Like the MFT, the constructed exam was divided into four subscales. A second sample of 29 novice majors also completed the MFT. For the advanced majors, total and subscale scores from the two tests were highly correlated (all p<0.01). Advanced majors scored above national norms and were significantly better than the novices. However, few courses could be linked to performance in the associated MFT subscales but general academic indices like grade point average were highly predictive. The novice MFT scores were similar to the norms for advanced majors. We conclude that the MFT measures broad, basic understanding, not advanced mastery.