Audiovisual Perception of Congruent and Incongruent Dutch Front Vowels

Autor/inn/en	Valkenier, Bea; Duyne, Jurriaan Y.; Andringa, Tjeerd C.; Baskent, Deniz
Titel	Audiovisual Perception of Congruent and Incongruent Dutch Front Vowels
Quelle	In: Journal of Speech, Language, and Hearing Research, 55 (2012) 6, S.1788-1801 (14 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1092-4388
DOI	10.1044/1092-4388(2012/11-0227)
Schlagwörter	Auditory Perception; Visual Perception; Speech; Indo European Languages; Vowels; Visual Stimuli + Suchen Sie Ihr Suchwort? Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Visuelle Wahrnehmung; Speaking; Sprechen; Indoeuropäisch
Abstract	Purpose: Auditory perception of vowels in background noise is enhanced when combined with visually perceived speech features. The objective of this study was to investigate whether the influence of visual cues on vowel perception extends to incongruent vowels, in a manner similar to the McGurk effect observed with consonants. Method: Identification of Dutch front vowels /i, y, e, Y/ that share all features other than height and lip-rounding was measured for congruent and incongruent audiovisual conditions. The audio channel was systematically degraded by adding noise, increasing the reliance on visual cues. Results: The height feature was more robustly carried over through the auditory channel and the lip-rounding feature through the visual channel. Hence, congruent audiovisual presentation enhanced identification, while incongruent presentation led to perceptual fusions and thus decreased identification. Conclusions: Visual cues influence the identification of congruent as well as incongruent audiovisual vowels. Incongruent visual information results in perceptual fusions, demonstrating that the McGurk effect can be instigated by long phonemes such as vowels. This result extends to the incongruent presentation of the visually less reliably perceived height. The findings stress the importance of audiovisual congruency in communication devices, such as cochlear implants and videoconferencing tools, where the auditory signal could be degraded. (As Provided).
Anmerkungen	American Speech-Language-Hearing Association (ASHA). 10801 Rockville Pike, Rockville, MD 20852. Tel: 800-638-8255; Fax: 301-571-0457; e-mail: subscribe@asha.org; Web site: http://jslhr.asha.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10