Robust Pavlovian to Instrumental and Pavlovian to Metacognitive Transfers in human reinforcementlearning.
Abstract
In simple instrumental-learning tasks, humans learn to seek gains and to avoid losses equally well. Yet, two effects of valence are observed. First, decisions in loss-contexts are slower, which is consistent with the Pavlovian-instrumental transfer (PIT) hypothesis. Second, loss contexts decrease individuals confidence in their choices - a bias akin to a Pavlovian-to-metacognitive transfer (PMT). Whether these two effects are two manifestations of a single mechanism or whether they can be partially dissociated is unknown. Here, across six experiments, we attempted to disrupt the PIT effects by manipulating the mapping between decisions and actions and imposing constraints on response times (RTs). Our goal was to assess the presence of the metacognitive bias in the absence of the RT bias. Were observed both PIT and PMT despite our disruption attempts, establishing that the effects of valence on motor and metacognitive responses are very robust and replicable. Nonetheless, within- and between-individual inferences reveal that the confidence bias resists the disruption of the RT bias. Therefore, although concomitant in most cases, PMT and PIT seem to be - partly - dissociable. These results highlight new important mechanistic constraints that should be incorporated in learning models to jointly explain choice, reaction times and confidence.
02 /Specification & Classification
Click any tag to browse matching papers- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Contextual influence on confidence judgments in human reinforcement learning.
M. Lebreton, K. Bacily, … J. B. Engelmann·bioRxiv·Jun 7, 2018
- Removal of reinforcement improves instrumental performance in humans by decreasing a general action bias rather than unmasking learnt associations
Hannah Kurtenbach, Eduard Ort, … Gerhard Jocham·PLoS Computational BiologyPeer-reviewed·Dec 8, 2022
- Flexible control of Pavlovian-instrumental transfer based on expected reward value
A. T. Marshall, S. B. Ostlund, … C. Hutson·bioRxiv·Apr 8, 2021
- The neurocognitive role of working memory load when Pavlovian motivational control affects instrumental learning
Heesun Park, Hoyoung Doh, … Woo‐Young Ahn·PLoS Computational BiologyPeer-reviewed·Dec 8, 2023
- Beyond model-free Pavlovian responding: a two-stage Pavlovian-instrumental transfer paradigm
Laura Ann Wirth, Nassim Sadedin, … Daniel J. Schad·bioRxiv·Mar 9, 2026
- Instrumental-Motor Transfer: The Relative Value of Competing Movement Goals Modulates Implicit Motor Learning
Naser Al-Fawakhiri, Vikram S. Chib, Samuel D. McDougle·bioRxiv·Sep 24, 2026