Audiovisual Matching in Speech and Nonspeech Sounds: A Neurodynamical Model

Autor/inn/en	Loh, Marco; Schmid, Gabriele; Deco, Gustavo; Ziegler, Wolfram
Titel	Audiovisual Matching in Speech and Nonspeech Sounds: A Neurodynamical Model
Quelle	In: Journal of Cognitive Neuroscience, 22 (2010) 2, S.240-247 (8 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0898-929X
DOI	10.1162/jocn.2009.21202
Schlagwörter	Stimuli; Models; Auditory Perception; Speech Communication; Cognitive Processes; Comparative Analysis; Nonverbal Ability; Multisensory Learning; Evaluation Methods; Nonverbal Communication + Suchen Sie Ihr Suchwort? Anreizsystem; Analogiemodell; Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Cognitive process; Kognitiver Prozess; Sensorische Stimulation; Non-verbal communication; Nonverbale Kommunikation
Abstract	Audiovisual speech perception provides an opportunity to investigate the mechanisms underlying multimodal processing. By using nonspeech stimuli, it is possible to investigate the degree to which audiovisual processing is specific to the speech domain. It has been shown in a match-to-sample design that matching across modalities is more difficult in the nonspeech domain as compared to the speech domain. We constructed a biophysically realistic neural network model simulating this experimental evidence. We propose that a stronger connection between modalities in speech underlies the behavioral difference between the speech and the nonspeech domain. This could be the result of more extensive experience with speech stimuli. Because the match-to-sample paradigm does not allow us to draw conclusions concerning the integration of auditory and visual information, we also simulated two further conditions based on the same paradigm, which tested the integration of auditory and visual information within a single stimulus. New experimental data for these two conditions support the simulation results and suggest that audiovisual integration of discordant stimuli is stronger in speech than in nonspeech stimuli. According to the simulations, the connection strength between auditory and visual information, on the one hand, determines how well auditory information can be assigned to visual information, and on the other hand, it influences the magnitude of multimodal integration. (As Provided).
Anmerkungen	MIT Press. Circulation Department, Five Cambridge Center, Cambridge, MA 02142. Tel: 617-253-2889; Fax: 617-577-1545; e-mail: journals-orders@mit.edu; Web site: http://www.mitpressjournals.org/loi/jocn
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10