Discusses the ongoing debate in the field of language assessment concerning the relative strengths of analytic versus holistic composition rating scales. Uses multiple regression analysis and exploratory factor analysis to evaluate both methods, and finds that because different rating scales measure different constructs, they cause the meaning of the test score to vary with the rating scale used. (Author/VWL)