The Effects of Iconic Gestures and Babble Language on Word Intelligibility in Sentence Context

Autor/inn/en	Wilms, Veerle; Drijvers, Linda; Brouwer, Susanne
Titel	The Effects of Iconic Gestures and Babble Language on Word Intelligibility in Sentence Context
Quelle	In: Journal of Speech, Language, and Hearing Research, 65 (2022) 5, S.1822-1838 (17 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wilms, Veerle) ORCID (Drijvers, Linda) ORCID (Brouwer, Susanne)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1092-4388
Schlagwörter	Foreign Countries; Indo European Languages; Nonverbal Communication; Comprehension; Speech Communication; Sentences; Second Languages; Native Language; Acoustics; French; Verbs; Netherlands + Suchen Sie Ihr Suchwort? Ausland; Indoeuropäisch; Non-verbal communication; Nonverbale Kommunikation; Verstehen; Verständnis; Sentence analysis; Satzanalyse; Second language; Zweitsprache; Akustik; Französisch; Niederlande
Abstract	Purpose: This study investigated to what extent iconic co-speech gestures help word intelligibility in sentence context in two different linguistic maskers (native vs. foreign). It was hypothesized that sentence recognition improves with the presence of iconic co-speech gestures and with foreign compared to native babble. Method: Thirty-two native Dutch participants performed a Dutch word recognition task in context in which they were presented with videos in which an actress uttered short Dutch sentences (e.g., Ze begint te openen, "She starts to open"). Participants were presented with a total of six audiovisual conditions: no background noise (i.e., clear condition) without gesture, no background noise with gesture, French babble without gesture, French babble with gesture, Dutch babble without gesture, and Dutch babble with gesture; and they were asked to type down what was said by the Dutch actress. The accurate identification of the action verbs at the end of the target sentences was measured. Results: The results demonstrated that performance on the task was better in the gesture compared to the nongesture conditions (i.e., gesture enhancement effect). In addition, performance was better in French babble than in Dutch babble. Conclusions: Listeners benefit from iconic co-speech gestures during communication and from foreign background speech compared to native. These insights into multimodal communication may be valuable to everyone who engages in multimodal communication and especially to a public who often works in public places where competing speech is present in the background. (As Provided).
Anmerkungen	American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01