Audiovisual Asynchrony Detection in Human Speech

Autor/inn/en	Maier, Joost X.; Di Luca, Massimiliano; Noppeney, Uta
Titel	Audiovisual Asynchrony Detection in Human Speech
Quelle	In: Journal of Experimental Psychology: Human Perception and Performance, 37 (2011) 1, S.245-256 (12 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0096-1523
DOI	10.1037/a0019952
Schlagwörter	Visual Stimuli; Articulation (Speech); Auditory Perception; Auditory Stimuli; Acoustics; Experiments; Correlation; Cues + Suchen Sie Ihr Suchwort? Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Auditive Stimulation; Erprobung; Korrelation; Stichwort
Abstract	Combining information from the visual and auditory senses can greatly enhance intelligibility of natural speech. Integration of audiovisual speech signals is robust even when temporal offsets are present between the component signals. In the present study, we characterized the temporal integration window for speech and nonspeech stimuli with similar spectrotemporal structure to investigate to what extent humans have adapted to the specific characteristics of natural audiovisual speech. We manipulated spectrotemporal structure of the auditory signal, stimulus length, and task context. Results indicate that the temporal integration window is narrower and more asymmetric for speech than for nonspeech signals. When perceiving audiovisual speech, subjects tolerate visual leading asynchronies, but are nevertheless very sensitive to auditory leading asynchronies that are less likely to occur in natural speech. Thus, speech perception may be fine-tuned to the natural statistics of audiovisual speech, where facial movements always occur before acoustic speech articulation. (Contains 4 tables and 4 figures.) (As Provided).
Anmerkungen	American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002-4242. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: order@apa.org; Web site: http://www.apa.org/publications
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10