ERIC Number: EJ1216247
Record Type: Journal
Publication Date: 2019-Jun
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0922-4777
EISSN: N/A
The Case for Scenario-Based Assessment of Written Argumentation
Deane, Paul; Song, Yi; van Rijn, Peter; O'Reilly, Tenaha; Fowles, Mary; Bennett, Randy; Sabatini, John; Zhang, Mo
Reading and Writing: An Interdisciplinary Journal, v32 n6 p1575-1606 Jun 2019
This paper presents a theoretical and empirical case for the value of scenario-based assessment (SBA) in the measurement of students' written argumentation skills. First, we frame the problem in terms of creating a reasonably efficient method of evaluating written argumentation skills, including for students at relatively low levels of competency. We next present a proposed solution in the form of an SBA and lay out the design for such an assessment. We then describe the results of prior research done within our group using this design. Fourth, we present the results of two new analyses of prior data that extend our previous results. These analyses concern whether the test items behave in ways consistent with the learning progressions underlying the design, how items measuring reading and writing component skills relate to essay performance, how measures of transcription fluency and proficiency in oral and academic language relate to writing skill, and whether the scenario-based design affects the fluency and vocabulary used in an essay. Results suggest that students can be differentiated by learning progression level, with variance in writing scores accounted for by a combination of performance on earlier tasks in the scenario and automated linguistic features measuring general literacy skills. The SBA structure, with preliminary tasks leading up to the final written performance, appears to result in more fluent (and also more efficient) writing behavior, compared to students' performances when they write an essay in isolation.
Descriptors: Vignettes, Writing Skills, Persuasive Discourse, Writing Evaluation, Measurement, Evaluation Methods, Test Items, Writing Tests, Essays, Academic Language, Language Proficiency, Vocabulary Skills, Language Fluency, Language Usage, Scores, Behavior Patterns, Writing Processes, Literacy, Item Analysis, Writing Instruction
Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A