NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ872690
Record Type: Journal
Publication Date: 2010-Feb
Pages: 8
Abstractor: As Provided
Reference Count: 0
ISSN: ISSN-0898-929X
Audiovisual Matching in Speech and Nonspeech Sounds: A Neurodynamical Model
Loh, Marco; Schmid, Gabriele; Deco, Gustavo; Ziegler, Wolfram
Journal of Cognitive Neuroscience, v22 n2 p240-247 Feb 2010
Audiovisual speech perception provides an opportunity to investigate the mechanisms underlying multimodal processing. By using nonspeech stimuli, it is possible to investigate the degree to which audiovisual processing is specific to the speech domain. It has been shown in a match-to-sample design that matching across modalities is more difficult in the nonspeech domain as compared to the speech domain. We constructed a biophysically realistic neural network model simulating this experimental evidence. We propose that a stronger connection between modalities in speech underlies the behavioral difference between the speech and the nonspeech domain. This could be the result of more extensive experience with speech stimuli. Because the match-to-sample paradigm does not allow us to draw conclusions concerning the integration of auditory and visual information, we also simulated two further conditions based on the same paradigm, which tested the integration of auditory and visual information within a single stimulus. New experimental data for these two conditions support the simulation results and suggest that audiovisual integration of discordant stimuli is stronger in speech than in nonspeech stimuli. According to the simulations, the connection strength between auditory and visual information, on the one hand, determines how well auditory information can be assigned to visual information, and on the other hand, it influences the magnitude of multimodal integration.
MIT Press. Circulation Department, Five Cambridge Center, Cambridge, MA 02142. Tel: 617-253-2889; Fax: 617-577-1545; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A