Test data generated according to two different multidimensional item response theory (IRT) models were compared at both the item response level and the test score level to determine whether measurable differences between the models could be detected when the data sets were constrained to be equivalent in terms of item "p"-values. The models chosen were the multiplicative multidimensional IRT model (non-compensatory) and a linear multidimensional IRT model (compensatory). Data on a 20-item test for 2,000 examinees were used. Although differences could be detected at the item level, these differences decreased as the correlation between examinee abilities increased. Furthermore, these item differences were small and could be considered unimportant or insignificant from a practical standpoint. No differences were found at the total test score level, and it was concluded that, at least for the data used in this study, the models were indistinguishable. Nine tables and eight figures present study data. (Author/SLD)