bioRxivAnimal Behavior & CognitionPreprint
Environmental volatility amplifies Pavlovian control in decision-making
Claudio DantiiD, Luigi DegniiD, Lorenzo MattioniiD, Marco BadioliiD, Francesca StaritaiD, Emilio CartoniiD, Sara GarofaloiD, Giuseppe di PellegrinoiD
Abstract
Volatile environments require continuous updating of action values, making instrumental knowledge less informative. Under such conditions, Pavlovian control may offer a more stable alternative, since the value attributed to reward-predictive cues is not altered by continuously updated instrumental predictions. Using a modified Pavlovian-to-Instrumental Transfer paradigm in two preregistered experiments, we test the hypothesis that increased volatility promotes the recruitment of Pavlovian control, whereby reward-predictive cues bias choice to the predicted outcome, simplifying (and possibly overcoming) the high computational cost of the instrumental prediction. Crucially, using entropy-based metrics we demonstrate that Pavlovian control is not unitary, but can instead respectively increase or reduce entropy depending on whether the choice outcome is present or not. Together, these findings show that volatility redirects control in Pavlovian-instrumental arbitration toward the cues, rather than merely adding noise to behaviour.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Controllability Governs the Balance Between Pavlovian and Instrumental Action Selection
Hayley M. Dorfman, Samuel Joseph Gershman·Nature CommunicationsPeer-reviewed·Dec 20, 2019
- Goal-directed recruitment of Pavlovian biases through selective visual attention
Johannes Algermissen, Hanneke E.M. den Ouden·bioRxiv·Apr 5, 2022
- Neural signatures of arbitration between Pavlovian and instrumental action selection
Samuel Joseph Gershman, Marc Guitart‐Masip, James F. Cavanagh·PLoS Computational BiologyPeer-reviewed·Feb 10, 2021
- Flexible control of Pavlovian-instrumental transfer based on expected reward value
A. T. Marshall, S. B. Ostlund, … C. Hutson·bioRxiv·Apr 8, 2021
- Testing the possibility of model-based Pavlovian control of attention to threat
Deborah Talmi, Martina Slapkova, Matthias J. Wieser·Journal of Cognitive NeurosciencePeer-reviewed·Aug 29, 2018
- The neurocognitive role of working memory load when Pavlovian motivational control affects instrumental learning
Heesun Park, Hoyoung Doh, … Woo‐Young Ahn·PLoS Computational BiologyPeer-reviewed·Dec 8, 2023