Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex
Colin W. HoyiD, David Ricardo Quiroga‐MartineziD, Eduardo SandovaliD, David King‐StephensiD, Kenneth D. LaxeriD, Peter B. WeberiD, Jack J. LiniD, Robert Thomas KnightiD
Abstract
The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to competing proposals for the nature of RPE representations in these brain areas. Recently, the distributional RL theory (dRL) has been used to explain RPE coding diversity in the rodent midbrain by proposing that dopaminergic neurons have differential sensitivity to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to show that this asymmetric scaling strategy captures RPE coding diversity in human dMPFC and INS. We found neural populations responding to valence-specific positive and negative RPEs, as well as unsigned RPE salience, which are spatially interleaved within each region. Furthermore, directional connectivity estimates suggest a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric scaling across distinct but intermingled neural populations as a core principle in RPE coding, expand the scope of dRL, and reconcile longstanding theoretical debates on the role of dMPFC and INS in RL and cognitive control.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 30
- FWCI
- 4.48
- Field percentile
- top 4%
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A history-derived reward prediction error signal in ventral pallidum
David J. Ottenheimer, Bilal A. Bari, … Patricia H. Janak·Nature NeurosciencePeer-reviewed·Aug 10, 2020
- Population coding of reward prediction errors through opponent organization in the fronto parietal network
Nicholas C. Foley, Michael Cohanpour, … Jacqueline P. Gottlieb·bioRxiv·May 25, 2020
- Reward prediction error neurons implement an efficient code for reward
Heiko H. Schütt, Dongjae Kim, Wei Ji Ma·Nature NeurosciencePeer-reviewed·Jun 19, 2024
- Value representations do not explain movement selectivity in DMS-projecting dopamine neurons
Rachel S Lee, Marcelo Gomes Mattar, … Nathaniel D. Daw·eLifePeer-reviewed·Apr 4, 2019
- Precision weighting of cortical unsigned prediction errors is mediated by dopamine and benefits learning
Joost Haarsma, Paul Charles Fletcher, … Graham K. Murray·bioRxiv·May 10, 2018
- Distributional reinforcement learning in prefrontal cortex
Timothy Müller, James L. Butler, … Steven Wayne Kennerley·Nature NeurosciencePeer-reviewed·Jan 10, 2024