This paper makes a study of the rater reliability in scoring composition in the test of English as a foreign language (EFL) and focuses on the inter-rater reliability as well as several interactions between raters and the other facets involved (that is examinees, rating criteria and rating methods). Results showed that raters were fairly consistent in their overall ratings. This finding has the great implications for controlling and assuring the quality of the rater-mediated assessment system