Multi-modal discourse comprehension requires speakers to combine information from speech and gestures. To date, little research has addressed the cognitive resources that underlie these processes. Here we used a dual-task paradigm to test the relative importance of verbal and visuospatial working memory in speech-gesture comprehension. Healthy,…

Research has shown that gesture production supports learning across a number of tasks. It is unclear, however, whether gesture production during encoding can support narrative recall, who gesture production benefits most, and whether certain types of gestures are more beneficial than others. This study, therefore, investigated the effect of…

Although children learn more when teachers gesture, it is not clear "how" gesture supports learning. Here, we sought to investigate the nature of the memory processes that underlie the observed benefits of gesture on lasting learning. We hypothesized that instruction with gesture might create memory representations that are particularly…

The researchers conducted a qualitative case study to describe the experiences of two seventh grade students with mild intellectual disability as they engaged in mathematics word problems involving proportions. The researchers analyzed student performance in large group settings and with individualized instruction to gain perspective on the…

Children and adult learners benefit from viewing hand gestures at instruction across domains (Cook, Duffy, & Fenn, 2013; Huang, Kim, & Christianson, 2019; Ping & Goldin-Meadow, 2008). Within the domain of mathematical learning, gesture at instruction has been shown to benefit children and adults in laboratory and classroom settings…

Previous research has shown a strong positive association between right-handed gesturing and vocabulary development. However, the causal nature of this relationship remains unclear. In the current study, we tested whether gesturing with the right hand enhances linguistic processing in the left hemisphere, which is contralateral to the right hand.…

Taken together, the Coherence Principle of Multimedia Learning Theory and the Integrated Systems Hypothesis propose that co-occurring and semantically congruent verbal and visual information should be integrated into one mental representation that enhances memory. The purpose of this paper was to examine how learning pseudowords with matching…

In face-to-face interaction, speakers spontaneously produce manual gestures that can facilitate listeners' comprehension of spoken language. The present study explores the factors affecting the uptake and influence of gesture cues in situations where a speaker is referring to objects visible to the listener. In this context, the listener's…

Auditory speech appears to be linked to visual articulatory gestures and orthography through different mechanisms. Yet, both types of visual information have a strong influence on speech processing. The present study directly compared their contributions to speech processing using a novel word learning paradigm. Native speakers of French, who were…

Our most moving experiences, the ones that "stick," are hardly ever static but are dynamic, like a conversation, a gesture, or a dance. Previous work has shown robust memory for simple actions (e.g., jumping or turning), but it remains an open question how we remember more dynamic sequences of complex and expressive actions. Separately,…

Cues to prominence such as beat gesture and contrastive pitch accent play an important role in constraining what is remembered. However, it is currently unclear how beat gesture affects online discourse processing alone and in combination with contrastive accenting. Using an adaptation of the visual world eye-tracking paradigm, we orthogonally…

TPR (Total Physical Response) is a methodology for teaching foreign languages. In traditional TPR, teachers need to spend a considerable amount of time confirming the accuracy of students' movements, which results in a low-efficiency teaching process and affects the fairness of student learning. A motion sensing system can assess the accuracy of…

The researchers conducted a qualitative case study to describe the teaching and learning of a third grade student with a learning disability as he worked on multiplicative tasks with a tutor. The student's strategies, at participatory and anticipatory levels of understanding, were analyzed to inform instructional decisions we made to support the…

Autism spectrum disorder (ASD) is a complex pathology that includes impaired social interaction abilities. Insufficient attention has been paid to programs specifically devoted to improving communicative-pragmatic skills. Moreover, the majority of studies have focused on children, while programs specifically developed for the adolescents are…

Learning part names, such as hands of a clock, can be a challenge for children because of the whole object assumption; that is, a child will assume that a given label refers to the whole object (e.g., a clock) rather than the object part (e.g., hands of a clock). We examined the effect of gaze shifting and deliberate pointing on learning part…