Situated Sentence Processing: The Coordinated Interplay Account and a Neurobehavioral Model

Autor/inn/en	Crocker, Matthew W.; Knoeferle, Pia; Mayberry, Marshall R.
Titel	Situated Sentence Processing: The Coordinated Interplay Account and a Neurobehavioral Model
Quelle	In: Brain and Language, 112 (2010) 3, S.189-201 (13 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0093-934X
DOI	10.1016/j.bandl.2009.03.004
Schlagwörter	Comprehension; Sentences; Eye Movements; Linguistics; Attention; Language Processing; Cognitive Psychology; Visual Environment; Visual Perception; Simulation; Visual Stimuli; Brain Hemisphere Functions; Cognitive Processes + Suchen Sie Ihr Suchwort? Verstehen; Verständnis; Sentence analysis; Satzanalyse; Augenbewegung; Linguistik; Aufmerksamkeit; Sprachverarbeitung; Kognitive Psychologie; Visuelle Wahrnehmung; Simulation program; Simulationsprogramm; Cognitive process; Kognitiver Prozess
Abstract	Empirical evidence demonstrating that sentence meaning is rapidly reconciled with the visual environment has been broadly construed as supporting the seamless interaction of visual and linguistic representations during situated comprehension. Based on recent behavioral and neuroscientific findings, however, we argue for the more deeply rooted coordination of the mechanisms underlying visual and linguistic processing, and for jointly considering the behavioral and neural correlates of scene-sentence reconciliation during situated comprehension. The "Coordinated Interplay Account" (CIA; Knoeferle, P., & Crocker, M. W. (2007). The influence of recent scene events on spoken comprehension: Evidence from eye movements. "Journal of Memory and Language, 57"(4), 519-543) asserts that incremental linguistic interpretation actively directs attention in the visual environment, thereby increasing the salience of attended scene information for comprehension. We review behavioral and neuroscientific findings in support of the CIA's three processing stages: (i) incremental sentence interpretation, (ii) language-mediated visual attention, and (iii) the on-line influence of non-linguistic visual context. We then describe a recently developed connectionist model which both embodies the central CIA proposals and has been successfully applied in modeling a range of behavioral findings from the visual world paradigm (Mayberry, M. R., Crocker, M. W., & Knoeferle, P. (2009). Learning to attend: A connectionist model of situated language comprehension. "Cognitive Science"). Results from a new simulation suggest the model also correlates with event-related brain potentials elicited by the immediate use of visual context for linguistic disambiguation (Knoeferle, P., Habets, B., Crocker, M. W., & Munte, T. F. (2008). Visual scenes trigger immediate syntactic reanalysis: Evidence from ERPs during situated spoken comprehension. "Cerebral Cortex, 18"(4), 789-795). Finally, we argue that the mechanisms underlying interpretation, visual attention, and scene apprehension are not only in close temporal synchronization, but have co-adapted to optimize real-time visual grounding of situated spoken language, thus facilitating the association of linguistic, visual and motor representations that emerge during the course of our embodied linguistic experience in the world. (Contains 3 figures.) (As Provided).
Anmerkungen	Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10