ERIC Number: EJ1044039
Record Type: Journal
Publication Date: 2014
Abstractor: As Provided
Reference Count: 64
Immodest Witnesses: Reliability and Writing Assessment
Gallagher, Chris W.
Composition Studies, v42 n2 p73-95 Fall 2014
This article offers a survey of three reliability theories in writing assessment: positivist, hermeneutic, and rhetorical. Drawing on an interdisciplinary investigation of the notion of "witnessing," this survey emphasizes the kinds of readers and readings each theory of reliability produces and the epistemological grounds on which it rests. Positivist reliability, positing an "a priori" reality and objective truth, produces "modest witnesses" (Haraway) who generate consistent, "true" scores. Hermeneutic reliability, which views "truth" as socially constructed though dialogue, produces communal witnesses who generate consensus, agreed upon readings. Rhetorical reliability, which views "truth" as a rhetorical effect of testimony, produces embodied witnesses who generate a range of perspectives, including articulated differences. While many writing assessment scholars, both in composition studies and in educational measurement, reject positivist reliability and embrace hermeneutic reliability, I suggest that the challenge for our field and our writing programs is to articulate a rhetorical theory of reliability and to design writing assessment systems that align with our prevailing conceptions of writing and reading as rhetorical activities.
Descriptors: Writing Evaluation, Reliability, Rhetoric, Reader Text Relationship, Psychometrics, Scores, Hermeneutics
University of Cincinnati. Department of English, P.O. Box 210069, Cincinnati, OH 45221. Tel: 513-556-6519; Fax: 513-556-5960; e-mail: email@example.com; Web site: http://www.uc.edu/journals/composition-studies.html
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A