Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published August 15, 2019 | Published + Supplemental Material
Journal Article Open

The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons

Abstract

Midbrain dopamine neurons are known to encode reward prediction errors (RPE) used to update value predictions. Here, we examine whether RPE signals coded by midbrain dopamine neurons are modulated by the cost paid to obtain rewards, by recording from dopamine neurons in awake behaving monkeys during performance of an effortful saccade task. Dopamine neuron responses to cues predicting reward and to the delivery of rewards were increased after the performance of a costly action compared to a less costly action, suggesting that RPEs are enhanced following the performance of a costly action. At the behavioral level, stimulus-reward associations are learned faster after performing a costly action compared to a less costly action. Thus, information about action cost is processed in the dopamine reward system in a manner that amplifies the following dopamine RPE signal, which in turn promotes more rapid learning under situations of high cost.

Additional Information

© 2019 The Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. Received 22 November 2018; Accepted 09 July 2019; Published 15 August 2019. This work was supported by MEXT/JSPS Grants-in-Aid for Scientific Research (Kakenhi) Grant numbers JP16H06571 and JP18H03662 to M.S. This research was partially supported by the Strategic Research Program for Brain Sciences supported by Japan Agency for Medical Research and Development (AMED) and the Japan-U.S. Brain Research Cooperation Program. This research was supported by the National Bio-Resource Project at National Institute of Physiological Science (NBRP at NIPS) from Japan Agency for Medical Research and Development, AMED. We thank Bernard W. Balleine and Andrew R. Delamater for their help on writing the paper. Author Contributions: S.T., J.P.O. and M.S. designed the experiments. S.T. performed the experiments, and analyzed the data. J.P.O. and M.S. refined the experiments and the data analyses. S.T., J.P.O. and M.S. wrote the manuscript. The authors declare no competing interests.

Attached Files

Published - s41467-019-11334-2.pdf

Supplemental Material - 41467_2019_11334_MOESM1_ESM.docx

Supplemental Material - 41467_2019_11334_MOESM2_ESM.pdf

Supplemental Material - 41467_2019_11334_MOESM3_ESM.pdf

Supplemental Material - 41467_2019_11334_MOESM4_ESM.xlsx

Files

41467_2019_11334_MOESM2_ESM.pdf
Files (7.1 MB)
Name Size Download all
md5:bea216d2cb07626e7d79e6ef32d54096
4.7 MB Download
md5:8753ae1f04e1e1335871e10c14eb30d7
291.5 kB Preview Download
md5:a5011cee4c99273dc5d6cf30aaa7d785
69.2 kB Preview Download
md5:5e13f56656d7f0a046f072e658b0d15a
349.6 kB Download
md5:6492b14a3e748b11529a78bdc2fdcd9b
1.7 MB Preview Download

Additional details

Created:
August 22, 2023
Modified:
October 18, 2023