ERIC Number: EJ730189
Record Type: Journal
Publication Date: 2004-Apr
Pages: 8
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0093-934X
EISSN: N/A
Neural Correlates of Bimodal Speech and Gesture Comprehension
Kelly, Spencer D.; Kravitz, Corinne; Hopkins, Michael
Brain and Language, v89 n1 p253-260 Apr 2004
The present study examined the neural correlates of speech and hand gesture comprehension in a naturalistic context. Fifteen participants watched audiovisual segments of speech and gesture while event-related potentials (ERPs) were recorded to the speech. Gesture influenced the ERPs to the speech. Specifically, there was a right-lateralized N400 effect--reflecting semantic integration--when gestures mismatched versus matched the speech. In addition, early sensory components in bilateral occipital and frontal sites differentiated speech accompanied by matching versus non-matching gestures. These results suggest that hand gestures may be integrated with speech at early and late stages of language processing.
Descriptors: Semantics, Language Processing, Nonverbal Communication, Articulation (Speech), Comprehension, Correlation, Sensory Integration, Speech Communication, Brain Hemisphere Functions
Elsevier Customer Service Department, 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126 (Toll Free); Fax: 407-363-1354; e-mail: usjcs@elsevier.com.
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A