ERIC Number: EJ1257136
Record Type: Journal
Publication Date: 2020
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0163-853X
EISSN: N/A
Machine-Learned Computational Models Can Enhance the Study of Text and Discourse: A Case Study Using Eye Tracking to Model Reading Comprehension
D'Mello, Sidney K.; Southwell, Rosy; Gregg, Julie
Discourse Processes: A Multidisciplinary Journal, v57 n5-6 p420-440 2020
We propose that machine-learned computational models (MLCMs), in which the model parameters and perhaps even structure are learned from data, can complement extant approaches to the study of text and discourse. Such models are particularly useful when theoretical understanding is insufficient, when the data are rife with nonlinearities and interactivity, and when researchers aspire to take advantage of "big data." Being fully instantiated computer programs, MLCMs can also be used for autonomous assessment and real-time intervention. We illustrate these ideas in the context of an eye movement-based MLCM of textbase comprehension during reading along connected text. Using a dataset where 104 participants read a 6,500-word text, we trained Random Forests models to predict comprehension scores from six eye movement features. The models were highly accurate (area under the receiver operating characteristic curve = 0.902; r = 0.661), robust, and generalized across participants, suggesting possible use in future studies. We conclude by arguing for an increased role of MLCMs in the future of discourse research.
Descriptors: Discourse Analysis, Computer Software, Intervention, Computational Linguistics, Eye Movements, Reading Comprehension, Models, Prediction, Scores, Case Studies, Comparative Analysis, Correlation, Private Colleges, College Students, Reading Processes, Classification, Accuracy, Measurement
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Grant or Contract Numbers: DRL1235958; IIS1523091; DRL1920510