NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ730252
Record Type: Journal
Publication Date: 2004-Sep
Pages: 10
Abstractor: Author
ISBN: N/A
ISSN: ISSN-0010-0277
EISSN: N/A
Seeing to Hear Better: Evidence for Early Audio-Visual Interactions in Speech Identification
Schwartz, Jean-Luc; Berthommier, Frederic; Savariaux, Christophe
Cognition, v93 n2 pB69-B78 Sep 2004
Lip reading is the ability to partially understand speech by looking at the speaker's lips. It improves the intelligibility of speech in noise when audio-visual perception is compared with audio-only perception. A recent set of experiments showed that seeing the speaker's lips also enhances "sensitivity" to acoustic information, decreasing the auditory detection threshold of speech embedded in noise [J. Acoust. Soc. Am. 109 (2001) 2272; J. Acoust. Soc. Am. 108 (2000) 1197]. However, detection is different from comprehension, and it remains to be seen whether improved sensitivity also results in an "intelligibility" gain in audio-visual speech perception. In this work, we use an original paradigm to show that seeing the speaker's lips enables the listener to hear better "and hence to understand better." The audio-visual stimuli used here could not be differentiated by lip reading per se since they contained exactly the same lip gesture matched with different compatible speech sounds. Nevertheless, the noise-masked stimuli were more intelligible in the audio-visual condition than in the audio-only condition due to the contribution of visual information to the extraction of acoustic cues. Replacing the lip gesture by a non-speech visual input with exactly the same time course, providing the same temporal cues for extraction, removed the intelligibility benefit. This early contribution to audio-visual speech identification is discussed in relationships with recent neurophysiological data on audio-visual perception.
Elsevier Customer Service Department, 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126 (Toll Free); Fax: 407-363-1354; e-mail: usjcs@elsevier.com.
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: France
Grant or Contract Numbers: N/A