Athar N. Malik

This paper shows that dopamine neurons in mice use multiple time scales to encode reward prediction errors, suggesting cell-specific temporal discounting and implications for reinforcement learning algorithms.

This study demonstrates that ramping dopamine signals correspond to reward prediction errors rather than state values, unifying rapid phasic and slow ramping signals as derivative-like computations.