NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1180809
Record Type: Journal
Publication Date: 2018-May
Pages: 20
Abstractor: As Provided
ISSN: ISSN-0364-0213
The Bursts and Lulls of Multimodal Interaction: Temporal Distributions of Behavior Reveal Differences between Verbal and Non-Verbal Communication
Abney, Drew H.; Dale, Rick; Louwerse, Max M.; Kello, Christopher T.
Cognitive Science, v42 n4 p1297-1316 May 2018
Recent studies of naturalistic face-to-face communication have demonstrated coordination patterns such as the temporal matching of verbal and non-verbal behavior, which provides evidence for the proposal that verbal and non-verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non-verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, [Louwerse, M. M., 2012]), we focus on measuring the temporal patterns of specific communicative behaviors in terms of their "burstiness." We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non-verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non-verbal channels. We propose a "temporal heterogeneity" hypothesis to explain how the language system adapts to the demands of dialog.
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A