ERIC Number: EJ1200822
Record Type: Journal
Publication Date: 2019-Jan
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
Advancing the Validity Argument for Standardized Writing Tests Using Quantitative Rhetorical Analysis
Beigman Klebanov, Beata; Ramineni, Chaitanya; Kaufer, David; Yeoh, Paul; Ishizaki, Suguru
Language Testing, v36 n1 p125-144 Jan 2019
Essay writing is a common type of constructed-response task used frequently in standardized writing assessments. However, the impromptu timed nature of the essay writing tests has drawn increasing criticism for the lack of authenticity for real-world writing in classroom and workplace settings. The goal of this paper is to contribute evidence to a validity argument for standardized writing tests. Using measurements of distances between rhetorical profiles in the corpora of interest, we examined connections between argumentative writing on standardized assessments and in external writing situations; namely, opinionated writing in academic and real-life settings. The results show that test corpora, focusing on argumentation in two standardized tests, are rhetorically similar to academic argumentative writing in a graduate-school setting, and about as similar as a corpus of civic writing in the same genre. The proximity between the test corpora and corpora representing external criteria of interest support the assessment use argument. The argumentative writing skills employed on the test are similar to the skills employed in academic and civic settings, despite the differences in the nature of the settings under which the writing samples for these different corpora are produced.
Descriptors: Test Validity, Writing Tests, Writing Skills, Persuasive Discourse, Standardized Tests, Correlation, Essay Tests, Criticism, Academic Discourse, Writing (Composition), College Entrance Examinations, Graduate Study, English (Second Language), Language Tests, Second Language Learning, Advanced Courses, Graduate Students, English, Literary Genres, Computational Linguistics, Interdisciplinary Approach, Civics, Rhetoric, Profiles
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Pennsylvania (Pittsburgh)
Identifiers - Assessments and Surveys: Graduate Record Examinations; Test of English as a Foreign Language
Grant or Contract Numbers: N/A