Dynamic Response-by-Response Models of Matching Behavior in Rhesus Monkeys

Autor/inn/en	Lau, Brian; Glimcher, Paul W.
Titel	Dynamic Response-by-Response Models of Matching Behavior in Rhesus Monkeys
Quelle	In: Journal of the Experimental Analysis of Behavior, 84 (2005) 3, S.555-579 (25 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-5002
Schlagwörter	Item Response Theory; Reinforcement; Animals; Animal Behavior; Behavioral Science Research; Models; Contingency Management; Responses; Eye Movements; Visual Stimuli; Probability + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Positive Verstärkung; Animal; Tier; Tiere; Tierverhalten; Analogiemodell; Krisenbewältigung; Augenbewegung; Wahrscheinlichkeitsrechnung; Wahrscheinlichkeitstheorie
Abstract	We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalled transitions between the blocks. Steady-state data following adjustment to each transition were well characterized by the generalized matching law; response ratios undermatched reinforcer frequency ratios but matched reinforcer magnitude ratios. We modelled response-by-response behavior with linear models that used past reinforcers as well as past choices to predict the monkeys' choices on each trial. We found that more recently obtained reinforcers more strongly influenced choice behavior. Perhaps surprisingly, we also found that the monkeys' actions were influenced by the pattern of their own past choices. It was necessary to incorporate both past reinforcers "and" past choices in order to accurately capture steady-state behavior as well as the fluctuations during block transitions and the response-by-response patterns of behavior. Our results suggest that simple reinforcement learning models must account for the effects of past choices to accurately characterize behavior in this task, and that models with these properties provide a conceptual tool for studying how both past reinforcers and past choices are integrated by the neural systems that generate behavior. (Contains 11 figures and 3 tables.) (As Provided).
Anmerkungen	Society for the Experimental Analysis of Behavior. Available from: Indiana University Department of Psychology. Bloomington, IN 47405. Tel: 812-334-0395; Fax: 812-855-4691; e-mail: jeab@indiana.edu; Web site: http://seab.envmed.rochester.edu/jeab/index.html
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10