Sign in
NeurosciencebioRxiv
Preprint

A Cortical Microcircuit for Region-Specific Credit Assignment in Reinforcement Learning

Quentin ChevyiD, Zoltán SzadaiiD, Loreen HertägiD, Morgan MolliD, Elizabeth T GibsoniD, Rui Ponte CostaiD, Ádám KepecsiD

Abstract

The distributed architecture of the cortex poses a fundamental challenge for reinforcement learning: how to assign credit specifically to regions that contribute to successful behavior? Cortical neurons can be driven by both global reinforcers, like rewards, and local sensory features, making it difficult to disentangle these influences. To address this, we investigated cortical reinforcement learning by manipulating the reward-predictive sensory modality during learning tasks, while monitoring key regulators of cortical activity--local inhibitory neurons, and cholinergic inputs. We found that VIP interneurons are broadly recruited by reward-predictive cues via a modality-independent cholinergic signal. However, when task demands aligned with local computation, SST interneurons suppressed VIP recruitment through an inhibitory feedback loop. A computational model demonstrates that this cholinergic-VIP-SST interneuron circuit motif enables targeted reinforcement learning and region-specific credit assignment in the cortex. These results offer a neurobiologically-grounded framework for how the cortex uses global reinforcement signals to direct plasticity to task-relevant regions, enabling those regions to adapt and fine-tune their responses.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISSzadai '22Su '22Greedy '26Kondo '21Wilmes '19Botros '22
82% semantic matchNeuroscience
Zoltán Szadai, Hyun-Jae Pi, Quentin Chevy+7 more·eLife·Oct 24, 2022· 49 citations