Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference
Lorenz DesernoiD, Rani MoraniD, Jochen MichelyiD, Ying LeeiD, Peter DayaniD, Raymond J. DolaniD
Abstract
Dopamine is implicated in signalling model-free (MF) reward prediction errors and various aspects of model-based (MB) credit assignment and choice. Recently, we showed that cooperative interactions between MB and MF systems include guidance of MF credit assignment by MB inference. Here, we used a double-blind, placebo-controlled, within-subjects design to test the hypothesis that enhancing dopamine levels, using levodopa, boosts the guidance of MF credit assignment by MB inference. We found that levodopa enhanced retrospective guidance of MF credit assignment by MB inference, without impacting on MF and MB influences per se. This drug effect positively correlated with working memory, but only in a context where reward needed to be recalled for MF credit assignment. The dopaminergic enhancement in MB-MF interactions correlated negatively with a dopamine-dependent change in MB credit assignment, possibly reflecting a potential trade-off between these two components of behavioural control. Thus, our findings demonstrate that dopamine boosts MB inference during guidance of MF learning, supported in part by working memory, but trading-off with a dopaminergic enhancement of MB credit assignment. The findings highlight a novel role for a DA influence on MB-MF interactions.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 16
- FWCI
- 1.27
- Field percentile
- top 23%
- Organism
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Individual differences in dopamine function underlying the balance between model-based and model-free control
Ying Lee, Lorenz Deserno, … Michael N. Smolka·bioRxiv·Dec 3, 2019
- L-DOPA reduces model-free control of behavior by attenuating the transfer of value to action
Nils B. Kroemer, Ying Lee, … Michael N. Smolka·NeuroImagePeer-reviewed·Oct 28, 2018
- Dopamine role in learning and action inference
Rafał Bogacz·eLifePeer-reviewed·Jul 7, 2020
- The Role of State Uncertainty in the Dynamics of Dopamine
John G. Mikhael, HyungGoo R. Kim, … Samuel Joseph Gershman·Current BiologyPeer-reviewed·Feb 2, 2022
- Dopamine regulates decision thresholds in human reinforcement learning.
Karima Chakroun, Antonius Wiehler, … Jan Peters·bioRxiv·Sep 29, 2022
- Dual credit assignment processes underlie dopamine signals in a complex spatial environment
Timothy A. Krausz, Alison E. Comrie, … Joshua D. Berke·NeuronPeer-reviewed·Aug 22, 2023