Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published July 28, 2021 | Supplemental Material + Published
Journal Article Open

Model-based aversive learning in humans is supported by preferential task state reactivation

Abstract

Harm avoidance is critical for survival, yet little is known regarding the neural mechanisms supporting avoidance in the absence of trial-and-error experience. Flexible avoidance may be supported by a mental model (i.e., model-based), a process for which neural reactivation and sequential replay have emerged as candidate mechanisms. During an aversive learning task, combined with magnetoencephalography, we show prospective and retrospective reactivation during planning and learning, respectively, coupled to evidence for sequential replay. Specifically, when individuals plan in an aversive context, we find preferential reactivation of subsequently chosen goal states. Stronger reactivation is associated with greater hippocampal theta power. At outcome receipt, unchosen goal states are reactivated regardless of outcome valence. Replay of paths leading to goal states was modulated by outcome valence, with aversive outcomes associated with stronger reverse replay than safe outcomes. Our findings are suggestive of avoidance involving simulation of unexperienced states through hippocampally mediated reactivation and replay.

Additional Information

© 2021 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution License 4.0 (CC BY). Submitted 1 December 2020; Accepted 10 June 2021; Published 28 July 2021. We thank H. Schmidt and D. Bates for assistance with piloting and data collection. T.W. is supported by a Wellcome Trust Sir Henry Wellcome Fellowship (206460/Z/17/Z). R.J.D. holds a Wellcome Trust Investigator Award (098362/Z/12/Z). Y.L. is supported by the Open Research Fund of the State Key Laboratory of Cognitive Neuroscience and Learning. The Max Planck UCL Centre is a joint initiative supported by UCL and the Max Planck Society. The Wellcome Centre for Human Neuroimaging is supported by core funding from the Wellcome Trust (203147/Z/16/Z). Author contributions: Design: T.W., Y.L., F.C., and R.J.D. Data collection: T.W., F.C., and Y.L. Analysis: T.W. and Y.L. Writing: T.W., Y.L., F.C., and R.J.D. The authors declare that they have no competing interests. Data and materials availability: All data needed to evaluate the conclusions in the paper are present in the paper or are freely available online. MEG and behavioral data are available at https://openneuro.org/datasets/ds003682, and analysis code is available at https://github.com/tobywise/aversive_state_reactivation.

Attached Files

Published - eabf9616.full.pdf

Supplemental Material - abf9616_SM.pdf

Files

eabf9616.full.pdf
Files (3.0 MB)
Name Size Download all
md5:2d49fab4b45b5c1f198ff1a7b7f88e9a
1.5 MB Preview Download
md5:7a403c37a4cef5b7aa05ab187a6fbf01
1.5 MB Preview Download

Additional details

Created:
August 20, 2023
Modified:
October 20, 2023