ERIC Number: EJ1260076
Record Type: Journal
Publication Date: 2020
Pages: 27
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2157-2100
EISSN: N/A
Effects of Scenario-Based Assessment on Students' Writing Processes
Guo, Hongwen; Zhang, Mo; Deane, Paul; Bennett, Randy E.
Journal of Educational Data Mining, v12 n1 p19-45 2020
This study investigates the effects of a scenario-based assessment design on students' writing processes. An experimental data set consisting of four design conditions was used in which the number of scenarios (one or two) and the placement of the essay task with respect to the lead-in tasks (first vs. last) were varied. Students' writing processes on the essay task were recorded using keystroke logs. Each keystroke action was classified into one of four writing states: planning, text production, local edit, or jump edit, and a semi-Markov model was fit to the data. Results showed that the single-scenario and essay-last design encouraged fewer but longer editing states compared to the alternative designs. Additionally, this task ordering appeared to have enabled more fluent and efficient text production when paired with a single scenario. These results seem explainable from cognitive writing theory, particularly with respect to working memory load. Limitations and future directions for research are also discussed.
Descriptors: Instructional Effectiveness, Vignettes, Writing Processes, Learning Analytics, Keyboarding (Data Entry), Essays, Editing, Short Term Memory, Writing Instruction, Summative Evaluation, Writing Evaluation, Middle School Students, Grade 8, Scores, Psychometrics, Cognitive Processes, Test Construction, Data Collection
International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: http://jedm.educationaldatamining.org/index.php/JEDM
Publication Type: Journal Articles; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education; Elementary Education; Grade 8
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: New Jersey; Delaware; West Virginia; South Carolina; Alabama; Minnesota; South Dakota; Utah
Grant or Contract Numbers: N/A