NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1153520
Record Type: Journal
Publication Date: 2017-Sep
Pages: 18
Abstractor: As Provided
ISSN: ISSN-0266-4909
Using Eye Movements to Model the Sequence of Text-Picture Processing for Multimedia Comprehension
Mason, L.; Scheiter, K.; Tornatora, M. C.
Journal of Computer Assisted Learning, v33 n5 p443-460 Sep 2017
This study used eye movement modeling examples (EMME) to support students' integrative processing of verbal and graphical information during the reading of an illustrated text. EMME consists of a replay of eye movements of a model superimposed onto the materials that are processed for accomplishing the task. Specifically, the study investigated the effects of modeling the temporal sequence of text and picture processing as shown in various replays of a model's gazes. Eighty-four 7th graders were randomly assigned to one of the four experimental conditions: text-first processing sequence (text-first EMME), picture-first processing sequence (picture-first EMME), picture-last processing sequence (picture-last EMME) and no-EMME (control). Online and offline measures were used. Eye movement indices indicate that only readers in the picture-first EMME condition spent significantly longer processing the picture and showed stronger integrative processing of verbal and graphical information than students in the no-EMME condition. Moreover, readers in all EMME conditions outperformed those in the control condition for recall. However, for learning and transfer, only readers in the picture-first EMME condition were significantly superior to readers of the control condition. Furthermore, both the frequency and duration of integrative processing of verbal and graphical information mediated the effect of condition on learning outcomes.
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 7
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A