Integrating reward information for prospective behaviour
Abstract
Value-based decision-making is often studied in a static context, where participants decide which option to select from those currently available. However, everyday life often involves an additional dimension: deciding when to select to maximise reward. Recent evidence suggests that agents track the latent reward of an option, updating changes in their latent reward estimate, to achieve appropriate selection timing (latent reward tracking). However, this strategy can be difficult to distinguish from one in which the optimal selection time is estimated in advance, allowing an agent to wait a pre-determined amount of time before selecting, without needing to monitor an options latent reward (distance-to-goal tracking). Here we show that these strategies can in principle be dissociated. Human brain activity was recorded using electroencephalography (EEG) while female and male participants performed a novel decision task. Participants were shown an option and decided when to select it, as its latent reward changed from trial-to-trial. While the latent reward was uncued, it could be estimated using cued information about the options starting value and value growth rate. We then used representational similarity analysis to assess whether EEG signals more closely resembled latent reward tracking or distance-to-goal tracking. This approach successfully dissociated the strategies in this task. Starting value and growth rate were translated into a distance-to-goal signal, far in advance of selecting the option. Latent reward could not be independently decoded. These results demonstrate the feasibility of using high temporal resolution neural recordings to identify internally computed decision variables in the human brain. Significance StatementReward-seeking behaviour involves acting at the right time. However, the external world does not always tell us when an action is most rewarding, necessitating internal representations that guide action timing. Specifying this internal neural representation is challenging because it might stem from a variety of strategies, many of which make similar predictions about brain activity. This study used a novel approach to test whether alternative strategies could be dissociated in principle. Using representational similarity analysis, we were able to distinguish between candidate internal representations for selection timing. This shows how pattern analysis methods can be used to measure latent decision information in non-invasive neural data.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 1
- FWCI
- 0.00
- Field percentile
- 2th percentile
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Temporally organized representations of reward and risk in the human brain
Vincent Y. Man, Jeffrey Cockburn, … John P. O’Doherty·bioRxiv·May 9, 2023
- Multi-areal neural dynamics encode human decision making
Jacqueline A. Overton, Karen Anne Moxon, … Ignacio Sáez·bioRxiv·Aug 5, 2022
- Enhanced neural representation of reach target direction for high reward magnitude but not high target probability.
Brendan Keane, Eva‐Maria Reuter, … Timothy J. Carroll·bioRxiv·Dec 13, 2023
- Reward certainty and preference bias selectively shape voluntary decisions
Wojciech Kossut Zajkowski, Dominik Krzemiński, … Jiaxiang Zhang·bioRxiv·Nov 7, 2019
- Selective integration during sequential sampling in posterior neural signals
Fabrice Luyckx, Bernhard Spitzer, … Christopher Summerfield·Cerebral CortexPeer-reviewed·Feb 6, 2020
- Abstract neural choice signals during action-linked decisions
Florian Sandhaeger, Nina Omejc, … Markus Siegel·bioRxiv·Oct 2, 2020