Malcolm G. Campbell

The neural circuit implementation of distributional reinforcement learning

This study investigates how distributional reinforcement learning is implemented in the basal ganglia by analyzing dopamine neuron activity and striatal representations.

A hardwired neural circuit for temporal difference learning

The paper demonstrates that TD learning computations are hardwired into a dopamine circuit by showing optogenetic stimulation of NAc D1 neurons drives dopamine neuron spiking according to TD error.

Competitive integration of time and reward explains value-sensitive foraging decisions and frontal cortex ramping dynamics

The paper develops a model integrating time and reward to explain foraging decisions and identifies frontal cortex ramping dynamics as a mechanism for solving patch foraging problems.

Dynamical management of potential threats regulated by dopamine and direct- and indirect-pathway neurons in the tail of the striatum

The paper shows that dopamine and direct/indirect pathway neurons in the tail of the striatum regulate threat avoidance at different stages of learning.

Improved dual-color GRAB sensors for monitoring dopaminergic activity in vivo

The paper develops improved GRABDA sensors to monitor dopaminergic activity in vivo, showing high sensitivity and spatially resolved DA release in mice during behaviors.

Explaining heterogeneity in medial entorhinal cortex with task-driven neural networks

This study uses task-driven neural networks to show that heterogeneous MEC cells are functionally significant and that reward-modulated models better capture MEC response profiles than traditional models.

Dynamic and reversible remapping of network representations in an unchanging environment

The paper shows that the medial entorhinal cortex can spontaneously switch between spatial maps in an unchanging environment, with population-level features preserved despite individual neuron changes.

Distinct algorithms for combining landmarks and path integration in medial entorhinal, visual andretrosplenial cortex

The paper shows that medial entorhinal cortex uses Kalman filtering to integrate path integration and landmarks, while visual cortex codes position retrospectively and retrosplenial cortex is intermediate.