Emergence of Value and Action Codes in Bimodular Spiking Actor-Critic Networks
Carlos Antolín, Joan Falcó-RogetiD, Luis Serrano-Fernández, Néstor PargaiD
Abstract
Decision-making depends on coordinated computations distributed across dorsal and ventral circuits, often described as actor-critic systems. We examined how this division of labor gives rise to value- and decision-related representations by training a bimodular recurrent network on an economic choice task and transferring it to an expanded gated spiking model that preserved its latent dynamics while stabilizing the underlying neural representations. The two modules assumed complementary roles: the actor encoded action-value differences and spatial contingencies required for selecting between actions, whereas the critic represented object values predictive of reward. Neurons across modules were selective for object, action, total, and difference values, supporting decision- and confidence-related activity. Low-dimensional analyses revealed structured trajectories reflecting temporal evolution, spatial configuration, and value-dependent divergence. These results clarify how distributed circuits can jointly implement valuation and action selection, providing a foundation for linking reinforcement-trained recurrent models with anatomically inspired dorsal-ventral frameworks.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Training a spiking neuronal network model of visual-motor cortex to play a virtual racket-ball game using reinforcement learning
Haroon Anwar, Simon Caby, … Samuel A. Neymotin·PLoS ONEPeer-reviewed·May 11, 2022
- DeltaQ: Value-Guided Hebbian Learning in Spiking Neuronal Networks for Multi-Goal Navigation
Christopher Earl, Gözde Ünal, … Samuel A. Neymotin·bioRxiv·Jun 16, 2026
- A neural circuit framework for economic choice: from building blocks of valuation to compositionality in multitasking
Aldo Battista, Camillo Padoa‐Schioppa, Xiao-Jing Wang·NeuronPeer-reviewed·Feb 4, 2026
- Striatal action-value neurons reconsidered
Lotem Elber‐Dorozko, Yonatan Loewenstein·eLifePeer-reviewed·May 31, 2018
- Choice-selective sequences dominate in cortical relative to thalamic inputs to the nucleus accumbens, providing a potential substrate for credit assignment
Nathan F. Parker, Avinash Baidya, … Ilana B. Witten·bioRxiv·Sep 2, 2021
- Embodied reinforcement learning in the primate cortico-basal ganglia system
Franco Giarrocco, Bruno B. Averbeck·bioRxiv·Jul 23, 2026