Audiovisual Mandarin Lexical Tone Perception in Quiet and Noisy Contexts: The Influence of Visual Cues and Speech Rate

Autor/inn/en	Li, Manhong; Chen, Xiaoxiang; Zhu, Jiaqiang; Chen, Fei
Titel	Audiovisual Mandarin Lexical Tone Perception in Quiet and Noisy Contexts: The Influence of Visual Cues and Speech Rate
Quelle	In: Journal of Speech, Language, and Hearing Research, 65 (2022) 11, S.4385-4403 (19 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Chen, Xiaoxiang) ORCID (Chen, Fei)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1092-4388
Schlagwörter	Mandarin Chinese; Auditory Perception; Speech Skills; Visual Stimuli; Cues; Cognitive Processes; Tone Languages; Articulation (Speech); Foreign Countries; China + Suchen Sie Ihr Suchwort? Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Mündliche Leistung; Sprachfertigkeit; Stichwort; Cognitive process; Kognitiver Prozess; Tonsprache; Ausland
Abstract	Purpose: Armed with the theory of embodied cognition proposing tight interactions between perception, motor, and cognition, this study aimed to test the hypothesis that speech rate-altered Mandarin lexical tone perception in quiet and noisy environments could be affected by the bodily dynamic cross-modal information. Method: Fifty-three adult listeners completed a Mandarin tone perception task with 720 tone stimuli in auditory-only (AO), auditory-facial (AF), and auditory-facial-plus-gestural (AFG) modalities, at fast, normal, and slow speech rates under quiet and noisy conditions. In AF and AFG modalities, both congruent and incongruent audiovisual information were designed and presented. Generalized linear mixed-effects models were constructed to analyze the accuracy of tone perception across different conditions. Results: In Mandarin tone perception, the magnitude of enhancement of AF and AFG cues across three speech rates was significantly higher than that of the AO cue in the adverse context of noise, yet additional metaphoric gestures did not show significant differences from the facial information. Furthermore, the performance of auditory tone perception at the fast speech rate was significantly better than that at the normal speech rate when the inputs were incongruent between auditory and visual channels in quiet. Conclusions: This study provided compelling evidence showing that integrated audiovisual information plays a vital role not only in improving lexical tone perception in noise but also in modulating the effects of speech rate on Mandarin tone perception in quiet for native listeners. Our findings, supporting the theory of embodied cognition, are implicational for speech and hearing rehabilitation among both young and old clinical populations. (As Provided).
Anmerkungen	American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01