Temporally distinct reward and action prediction error signals during value learning and habit formation
Yuhao Wang, Lauren M. Burgeno, Juan-Carlos Cerpa…·Mark E. Walton
Author
University of OxfordORCID 0000-0003-0117-2894Unclaimed ORCID profile · follow to get notified of new preprints
23 papers
Recent·Most cited
Yuhao Wang, Lauren M. Burgeno, Juan-Carlos Cerpa…·Mark E. Walton
Mao Yasueda, Masakazu Taira, Thomas E. Akam…·Kenji Doya
This study shows mice shift from model-free to structure-informed reinforcement learning strategies during early training in a dynamic decision-making task.
Peter Thomas Doohan, Kristopher Torp Jensen, Yaqing Chen…·Thomas E. Akam
This study identifies two distinct neural representations in mouse medial frontal cortex during flexible navigation, showing how they encode position and goal distance to guide behavior.
Katherine R. Brimblecombe, Adam Loyd Harris, Nora Bengoa‐Vergniory…·Stephanie Jane Cragg
This study shows gabapentinoids enhance dopamine release in a Parkinson's mouse model and improve movement deficits by modulating calcium and GABAergic signaling.
Victor Ajuwon, Tiago Monteiro, Mark E. Walton, Alex Kacelnik
The paper tests whether goldfish prefer informative over non-informative choices in a reinforcement learning task, finding they do not, unlike mammals and birds.
Mohamady El-Gaby, Adam Loyd Harris, James C. R. Whittington…·Timothy E.J. Behrens
The paper identifies a neuronal mechanism in mice that maps abstract behavioural structure, enabling zero-shot learning of new tasks through goal-progress cells in the medial frontal cortex.
Oliver Härmson, Isaac Grennan, Brook A. L. Perry…·Andrew Sharott
The paper investigates how reward, effort, and choice are encoded hierarchically across the cortex and basal ganglia during cost-benefit decisions in rats.
Beren Millidge, Yuhang Song, Armin Lak…·Rafał Bogacz
The paper proposes a temporal difference model that explains how dopamine neurons encode different reward dimensions and adapts behavior based on physiological needs.
Caroline I. Jahn, Jan Grohn, Steven F. Cuell…·Jérôme Sallet
This study investigates strategic exploration in macaques, showing distinct neural circuits in ACC/MCC-dlPFC and OFC that support strategic decision-making and counterfactual learning.
Marios C. Panayi, Thomas Boerner, Thomas Jahans-Price…·David M. Bannerman
This study shows that GluA1 dysfunction leads to impaired short-term habituation, resulting in a hyper-dopaminergic phenotype in the nucleus accumbens, which may contribute to aberrant salience in schizophrenia.
Laura L. Grima, Marios C. Panayi, Oliver Härmson…·Mark E. Walton
This study investigates the role of D1 receptors in the nucleus accumbens core in regulating reward-seeking behavior during Go/No-Go tasks in rats.
Beren Millidge, Mark E. Walton, Rafał Bogacz
The paper introduces an extension to temporal difference learning that enables instantaneous adaptation to changing reward functions without retraining.
Thomas E. Akam, Andy Lustig, James M Rowland…·Mark E. Walton
pyControl provides open-source hardware and software for designing and running complex behavioural experiments with improved reproducibility and scalability.
Oliver Härmson, Laura L. Grima, Marios C. Panayi…·Mark E. Walton
This study examines how 5-HT2C receptor perturbation affects instrumental vigour and restraint in rats, finding that systemic activation boosts performance and reduces restraint, while dopamine enhances restraint and action initiation.
Clio Korn, Thomas E. Akam, Kristian H. R. Jensen…·Mark E. Walton
This study investigates how dopamine clearance mechanisms, DAT and COMT, affect behavioral flexibility in mice using pharmacological modulation and behavioral tasks.
Marta Blanco-Pozo, Thomas E. Akam, Mark E. Walton
The paper shows that dopamine-independent state inference and dopamine-mediated reinforcement learning interact to guide reward-based decisions in mice.
Veronika Samborska, James L. Butler, Mark E. Walton…·Thomas E. Akam
The paper shows that prefrontal cortex abstracts problem structure while hippocampus maps it to specific situations in mice during reversal learning.
Ines V. Barreiros, Marios C. Panayi, Mark E. Walton
This study identifies distinct anatomical projection patterns into different subregions of the rat OFC along both anterior-posterior and medial-lateral axes.
Jérôme Sallet, MaryAnn P. Noonan, Adam G. Thomas…·Matthew F. S. Rushworth
The paper identifies a distributed frontal cortical circuit associated with behavioral flexibility in macaques through structural and functional imaging analyses of discrimination reversal learning.
Caroline I. Jahn, Chiara Varazzani, Jérôme Sallet…·Sébastien Bouret
This study compares noradrenergic and dopaminergic neuron activity in monkeys during task performance, finding that noradrenergic neurons predict re-engagement after failure and respond to task state changes.
Emilie Werlen, S.-L. Shin, François Gastambide…·Mark E. Walton
This study shows amphetamine disrupts prediction error signals in nucleus accumbens and orbitofrontal cortex in rats during learning tasks.
Thomas E. Akam, Mark E. Walton
pyPhotometry provides open-source hardware and software for fiber photometry data acquisition, offering better signal-to-noise ratio and lower cost than commercial alternatives.
Caroline I. Jahn, Sophie Gilardeau, Chiara Varazzani…·Sébastien Bouret
This study investigates the role of noradrenaline in behavioural flexibility and motivation using a cost/benefit decision task and clonidine manipulation, finding distinct effects on choice volatility and force production.