A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior
- Creators
-
Pérez, Omar D.
- Dickinson, Anthony
Abstract
Contemporary theories of instrumental performance assume that responding can be controlled by 2 behavioral systems, 1 goal-directed that encodes the outcome of an action, and 1 habitual that reinforces the response strength of the same action. Here we present a model of free-operant behavior in which goal-directed control is determined by the correlation between the rates of the action and the outcome whereas the total prediction error generated by contiguous reinforcement by the outcome controls habitual response strength. The outputs of these two systems summate to generate a total response strength. This cooperative model addresses the difference in the behavioral impact of ratio and interval schedules, the transition from goal-directed to habitual control with extended training, the persistence of goal-directed control under choice procedures and following extinction, among other phenomena. In these respects, this dual-system model is unique in its account of free-operant behavior.
Additional Information
© 2020 American Psychological Association. This work was part of OP's Ph.D. work in the Department of Psychology and the Behavioural and Clinical Neuroscience Institute at the University of Cambridge, funded by CONICYT. OP thanks Mike Aitken and Amy Milton for supervision, and Nathan Holmes, John O'Doherty, Fabian Soto, Tor Tarantola, Gonzalo Urcelay and Fred Westbrook for insightful discussions and comments on this work. We also thank Yutaka Kosaki for providing us with valuable data to inform our simulations. OP would also like to thank the NHS for all the support provided to him and his family during his Ph.D. studies.Attached Files
Submitted - 807800v3.full.pdf
Supplemental Material - media-1.pdf
Files
| Name | Size | Download all |
|---|---|---|
|
md5:e6d5014aa037a9112fdee885fff8c852
|
2.3 MB | Preview Download |
|
md5:ed3a48d1234d67f56d3055a30f5c081a
|
330.9 kB | Preview Download |
Additional details
- Alternative title
- A theory of actions and habits in free-operant behavior: The interaction of rate correlation and contiguity systems
- Eprint ID
- 99401
- Resolver ID
- CaltechAUTHORS:20191022-161302005
- Comisión Nacional de Investigación Científica y Tecnológica (CONICYT)
- Created
-
2019-10-23Created from EPrint's datestamp field
- Updated
-
2023-06-01Created from EPrint's last_modified field