Nature NeuroscienceNeurosciencePeer-reviewed journal article
Distributional reinforcement learning in prefrontal cortex
Timothy MülleriD, James L. ButleriD, Sebastijan VeseličiD, Bruno MirandaiD, Joni D. WallisiD, Peter DayaniD, Timothy E.J. BehrensiD, Zeb L. Kurth-NelsoniD, Steven Wayne KennerleyiD
Abstract
Prefrontal cortex is crucial for learning and decision-making. Classic reinforcement learning (RL) theories centre on learning the expectation of potential rewarding outcomes and explain a wealth of neural data in prefrontal cortex. Distributional RL, on the other hand, learns the full distribution of rewarding outcomes and better explains dopamine responses. Here we show distributional RL also better explains prefrontal cortical responses, suggesting it is a ubiquitous mechanism for reward-guided learning.
- Citations
- 50
- FWCI
- 10.91
- Field percentile
- top 1%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Prefrontal cortex as a meta-reinforcement learning system
Jane X. Wang, Zeb L. Kurth-Nelson, … Matthew Botvinick·Nature NeurosciencePeer-reviewed·May 11, 2018
- The neural circuit implementation of distributional reinforcement learning
Sara Matias, Camille Rullán Buxó, … Naoshige Uchida·bioRxiv·Nov 10, 2026
- An opponent striatal circuit for distributional reinforcement learning
Adam S. Lowet, Zheng Qiao, … Naoshige Uchida·NaturePeer-reviewed·Feb 19, 2025
- Coordinated human prefrontal dynamics sustain task-state representations during learning
C. Maher, Salman E. Qasim, … Ignacio Sáez·bioRxiv·May 8, 2026
- Neural interactions in the human frontal cortex dissociate reward and punishment learning
Etienne Combrisson, Ruggero Basanisi, … Andrea Brovelli·eLifePeer-reviewed·Nov 9, 2023
- Reward prediction error neurons implement an efficient code for reward
Heiko H. Schütt, Dongjae Kim, Wei Ji Ma·Nature NeurosciencePeer-reviewed·Jun 19, 2024