The Relevance of the Availability of Visual Speech Cues during Adaptation to Noise-Vocoded Speech

Autor/inn/en	Trotter, Antony S.; Banks, Briony; Adank, Patti
Titel	The Relevance of the Availability of Visual Speech Cues during Adaptation to Noise-Vocoded Speech
Quelle	In: Journal of Speech, Language, and Hearing Research, 64 (2021) 7, S.2513-2528 (16 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Adank, Patti)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1092-4388
Schlagwörter	Visual Stimuli; Cues; Speech; Adjustment (to Environment); Acoustics; Recognition (Psychology); Accuracy; Sentences; Foreign Countries; United Kingdom + Suchen Sie Ihr Suchwort? Stichwort; Speaking; Sprechen; Akustik; Recognition; Wiedererkennen; Sentence analysis; Satzanalyse; Ausland; Großbritannien
Abstract	Purpose: This study first aimed to establish whether viewing specific parts of the speaker's face (eyes or mouth), compared to viewing the whole face, affected adaptation to distorted noise-vocoded sentences. Second, this study also aimed to replicate results on processing of distorted speech from lab-based experiments in an online setup. Method: We monitored recognition accuracy online while participants were listening to noise-vocoded sentences. We first established if participants were able to perceive and adapt to audiovisual four-band noise-vocoded sentences when the entire moving face was visible (AV Full). Four further groups were then tested: a group in which participants viewed the moving lower part of the speaker's face (AV Mouth), a group in which participants only see the moving upper part of the face (AV Eyes), a group in which participants could not see the moving lower or upper face (AV Blocked), and a group in which participants saw an image of a still face (AV Still). Results: Participants repeated around 40% of the key words correctly and adapted during the experiment, but only when the moving mouth was visible. In contrast, performance was at floor level, and no adaptation took place, in conditions when the moving mouth was occluded. Conclusions: The results show the importance of being able to observe relevant visual speech information from the speaker's mouth region, but not the eyes/upper face region, when listening and adapting to distorted sentences online. Second, the results also demonstrated that it is feasible to run speech perception and adaptation studies online, but that not all findings reported for lab studies replicate. (As Provided).
Anmerkungen	American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01