A Spectrum of Time Horizons for Dopamine Signals
Abstract
Dopamine input to striatum can encode reward prediction error, a critical signal for updating predictions of future rewards. However, it is unclear how this mechanism handles the need to make predictions, and provide feedback, over multiple time horizons: from seconds or less (if singing a song) to potentially hours or more (if hunting for food). Here we report that dopamine pulses in distinct striatal subregions convey reward prediction errors over distinct temporal scales. Dopamine dynamics systematically accelerated from ventral to dorsal-medial to dorsal-lateral striatum, in the tempo of their spontaneous fluctuations, their integration of prior rewards, and their discounting of future rewards. This spectrum of time scales for value computations can help achieve efficient learning and adaptive motivation for a wide range of behaviors.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Dopamine mediates the bidirectional update of interval timing
Anthony M.V. Jakob, John G. Mikhael, … Samuel Joseph Gershman·Behavioral NeurosciencePeer-reviewed·Oct 1, 2022
- Dopamine waves as a mechanism for spatiotemporal credit assignment
Arif Hamid, Michael J. Frank, Christopher I. Moore·CellPeer-reviewed·Apr 15, 2021
- Internal timing-related dopaminergic dynamics can be explained by reward-prediction errors
A. E. Hamilos, J. A. Assad·bioRxiv·Jun 3, 2020
- Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task
Iku Tsutsui‐Kimura, Hideyuki Matsumoto, … Mitsuko Watabe‐Uchida·eLifePeer-reviewed·Dec 21, 2020
- Dopamine role in learning and action inference
Rafał Bogacz·eLifePeer-reviewed·Jul 7, 2020
- Sub-second fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans
L. Paul Sands, Angela Jiang, … Kenneth T. Kishida·Science AdvancesPeer-reviewed·Dec 1, 2023