Eye Gaze and Perceptual Adaptation to Audiovisual Degraded Speech

Autor/inn/en	Banks, Briony; Gowen, Emma; Munro, Kevin J.; Adank, Patti
Titel	Eye Gaze and Perceptual Adaptation to Audiovisual Degraded Speech
Quelle	In: Journal of Speech, Language, and Hearing Research, 64 (2021) 9, S.3432-3445 (14 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Banks, Briony) ORCID (Gowen, Emma) ORCID (Munro, Kevin J.) ORCID (Adank, Patti)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1092-4388
Schlagwörter	Eye Movements; Speech; Cues; Auditory Stimuli; Visual Stimuli; Auditory Perception; Recognition (Psychology); Replication (Evaluation); Young Adults; Foreign Countries; United Kingdom (Manchester) + Suchen Sie Ihr Suchwort? Augenbewegung; Speaking; Sprechen; Stichwort; Auditive Stimulation; Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Recognition; Wiedererkennen; Young adult; Junger Erwachsener; Ausland
Abstract	Purpose: Visual cues from a speaker's face may benefit perceptual adaptation to degraded speech, but current evidence is limited. We aimed to replicate results from previous studies to establish the extent to which visual speech cues can lead to greater adaptation over time, extending existing results to a real-time adaptation paradigm (i.e., without a separate training period). A second aim was to investigate whether eye gaze patterns toward the speaker's mouth were related to better perception, hypothesizing that listeners who looked more at the speaker's mouth would show greater adaptation. Method: A group of listeners (n = 30) was presented with 90 noise-vocoded sentences in audiovisual format, whereas a control group (n = 29) was presented with the audio signal only. Recognition accuracy was measured throughout and eye tracking was used to measure fixations toward the speaker's eyes and mouth in the audiovisual group. Results: Previous studies were partially replicated: The audiovisual group had better recognition throughout and adapted slightly more rapidly, but both groups showed an equal amount of improvement overall. Longer fixations on the speaker's mouth in the audiovisual group were related to better overall accuracy. An exploratory analysis further demonstrated that the duration of fixations to the speaker's mouth decreased over time. Conclusions: The results suggest that visual cues may not benefit adaptation to degraded speech as much as previously thought. Longer fixations on a speaker's mouth may play a role in successfully decoding visual speech cues; however, this will need to be confirmed in future research to fully understand how patterns of eye gaze are related to audiovisual speech recognition. (ERIC).
Anmerkungen	American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01