A Cortical Microcircuit for Region-Specific Credit Assignment in Reinforcement Learning
Quentin ChevyiD, Zoltán SzadaiiD, Loreen HertägiD, Morgan MolliD, Elizabeth T GibsoniD, Rui Ponte CostaiD, Ádám KepecsiD
Abstract
The distributed architecture of the cortex poses a fundamental challenge for reinforcement learning: how to assign credit specifically to regions that contribute to successful behavior? Cortical neurons can be driven by both global reinforcers, like rewards, and local sensory features, making it difficult to disentangle these influences. To address this, we investigated cortical reinforcement learning by manipulating the reward-predictive sensory modality during learning tasks, while monitoring key regulators of cortical activity--local inhibitory neurons, and cholinergic inputs. We found that VIP interneurons are broadly recruited by reward-predictive cues via a modality-independent cholinergic signal. However, when task demands aligned with local computation, SST interneurons suppressed VIP recruitment through an inhibitory feedback loop. A computational model demonstrates that this cholinergic-VIP-SST interneuron circuit motif enables targeted reinforcement learning and region-specific credit assignment in the cortex. These results offer a neurobiologically-grounded framework for how the cortex uses global reinforcement signals to direct plasticity to task-relevant regions, enabling those regions to adapt and fine-tune their responses.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 2
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Cortex-wide fast activation of VIP-expressing inhibitory neurons by reward and punishment
Zoltán Szadai, Hyun-Jae Pi, … Balázs József Rózsa·eLifePeer-reviewed·Oct 24, 2022
- Two types of locus coeruleus norepinephrine neurons drive reinforcement learning
Zhixiao Su, Jeremiah Y. Cohen·bioRxiv·Dec 8, 2022
- Cell-type-specific cortical feedback coordinates hierarchical credit assignment
Will Greedy, Heng Wei Zhu, … Rui Ponte Costa·bioRxiv·Aug 11, 2026
- Independent representations of reward-predicting cues and reward history in frontal cortical neurons
Masashi Kondo, M Matsuzaki·Cell ReportsPeer-reviewed·Feb 1, 2021
- Inhibitory microcircuits for top-down plasticity of sensory representations
Katharina Anna Wilmes, Claudia Clopath A·Nature CommunicationsPeer-reviewed·Nov 7, 2019
- A neural model of proximity to reward
Paul Botros, Nuria Vendrell-Llopis, … Jose M. Carmena·bioRxiv·Oct 3, 2022