This article presents the author's response to Arend Flick. The author states that Flick is correct that the issue of rubrics is broader than interrater reliability, though it is the assessment practitioner's primary armament against what the author has heard dubbed "refried bean counting" (insinuating that assessment statistics are not just bean…

A persistent conflict between assessment professionals and faculty members in the humanities seems to focus inevitably on resistance to the concept of interrater reliability. While humanities faculty are often willing to engage in course-embedded assessment that uses some type of scoring rubric, when the demand for agreement in scoring is…