Topological basal ganglia model with dopamine-modulated spike-timing-dependent plasticity reproduces reinforcement learning, discriminatory learning, and neuropsychiatric disorders
Carlos Enrique GutierreziD, Jean LiénardiD, Benoît GirardiD, Hidetoshi UrakuboiD, Kenji DoyaiD
Abstract
The basal ganglia (BG) are central to action selection and reinforcement learning, yet how the topological organization of the BG circuit with dopamine (DA) D1- and D2-receptors shape learning remains unclear. We present a topologically organized spiking model of macaque BG with cortico-striatal inputs organized into competing channels, D1/D2 medium spiny neurons (MSNs), three-factor DA-modulated STDP for cortical synapses, asymmetric intra-striatal collaterals, and partially overlapping direct/indirect pathways. We validate resting activity and action selection, then study conditioning and generalization-discrimination learning using DA bursts (CS+) and dips (CS). Two structural determinants emerged. First, pathway overlap ({lambda}) trades off selection efficiency and learning speed: higher overlap degrades GPi-based selection efficiency during conditioning, yet accelerates convergence during discrimination by strengthening D2 influence on GPi. Second, lateral inhibition from MSN-D2 to MSNs ({kappa}) helps constrain competing actions but is not sufficient alone; robust discrimination requires DA-dip-dependent up-modulation of D2 collateral efficacy (), which speeds and, at low overlap, enables convergence. Simulations under Parkinsonian and schizophrenia-like settings showed different deficits. A hypodopaminergic "Parkinsonian" STDP regime (D1 LTP loss, D2 LTD loss) impaired conditioning and failed to enhance discrimination. In contrast, attenuated D2 plasticity during DA dips (modeling methamphetamine-induced changes/schizophrenia-related dysregulation) selectively disrupted discrimination while sparing conditioning. Finally, we demonstrate efficient scaling on the Fugaku supercomputer to rodent and non-human primate-relevant sizes, supporting large-scale, biologically grounded BG simulations. Together, the results highlight how pathway overlap and D2 collateral dynamics jointly regulate the speed and reliability of discrimination learning, and how specific DA perturbations map to distinct learning impairments.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Basal Ganglia role in learning rewarded actions and executing previously learned choices: healthy and diseased states
Garrett Mulcahy, Brady K. Atwood, Alexey S. Kuznetsov·PLoS ONEPeer-reviewed·Feb 10, 2020
- Tonic dopamine and biases in value learning linked through a biologically inspired reinforcement learning model
Sandra Romero Pinto, Naoshige Uchida·Nature CommunicationsPeer-reviewed·Aug 13, 2025
- Differential dopamine receptor-dependent sensitivity improves action selection in the basal ganglia
Olivier Codol, Paul L. Gribble, KEVIN N. GURNEY·bioRxiv·Nov 12, 2020
- Biologically Plausible Dopamine-Modulated STDP Model of Pavlovian Learning in Spiking Neural Networks
Woojun Park, Kyoung J. Lee·bioRxiv·Jul 22, 2026
- Learning the payoffs and costs of actions
Moritz Möller, Rafał Bogacz·PLoS Computational BiologyPeer-reviewed·Feb 28, 2019
- On the normative advantages of dopamine and striatal opponency for learning and choice
Alana Jaskir, Michael J. Frank·eLifePeer-reviewed·Mar 15, 2023