Three attributes of faculty competence--teaching, research, and service--were each measured by three different instruments--department chair evaluation, self-evaluation, and one other measure (student evaluations, number of publications, or number of committees). The data were analyzed through a multitrait-multimethod matrix (MTMMM) to ascertain convergent and divergent validity. Data were obtained from 57 faculty members, all of whom held the doctorate. Because the required conditions were not fully met for each criterion, applying the MTMMM approach led to somewhat ambiguous results. While the limitations (e.g., small sample size, questionable properties of the instrument, and uni-dimensional assumption of traits) should be considered in interpreting the results, the fact that confidential data are difficult to obtain suggests both that the tentative conclusions may be of value to other researchers and that further investigations are warranted. The results indicate that the evidence for validity is relatively weak; it was concluded that the results from these measures should be interpreted with considerable caution. (Author/PN)