Cross-Modal Facilitation in Speech Prosody

Autor/inn/en	Foxton, Jessica M.; Riviere, Louis-David; Barone, Pascal
Titel	Cross-Modal Facilitation in Speech Prosody
Quelle	In: Cognition, 115 (2010) 1, S.71-78 (8 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0010-0277
DOI	10.1016/j.cognition.2009.11.009
Schlagwörter	Visual Stimuli; Speech Communication; Suprasegmentals; Human Body; Motion; Auditory Perception; Video Technology; Evaluation Methods; Language Processing + Suchen Sie Ihr Suchwort? Menschlicher Körper; Bewegungsablauf; Auditive Wahrnehmung; Akustische Wahrnehmung; Akustik; Sprachverarbeitung
Abstract	Speech prosody has traditionally been considered solely in terms of its auditory features, yet correlated visual features exist, such as head and eyebrow movements. This study investigated the extent to which visual prosodic features are able to affect the perception of the auditory features. Participants were presented with videos of a speaker pronouncing two words, with visual features of emphasis on one of these words. For each trial, participants saw one video where the two words were identical in both pitch and amplitude, and another video where there was a difference in either pitch or amplitude that was congruent or incongruent with the visual changes. Participants were asked to decide which video contained the sound difference. Thresholds were obtained for the congruent and incongruent videos, and for an auditory-alone condition. It was found that the congruent thresholds were better than the incongruent thresholds for both pitch and amplitude changes. Interestingly, the congruent thresholds for amplitude were better than for the auditory-alone condition, which implies that the visual features improve sensitivity to loudness changes. These results demonstrate that visual stimuli can affect auditory thresholds for changes in pitch and amplitude, and furthermore support the view that visual prosodic features enhance speech processing. (Contains 1 table and 3 figures.) (As Provided).
Anmerkungen	Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10