bioRxivNeurosciencePreprint
Identifying Model-Based and Model-Free Patterns in Behavior on Multi-Step Tasks
Abstract
Recent years have seen a surge of research into the neuroscience of planning. Much of this work has taken advantage of a two-step sequential decision task developed by Daw et al. (2011), which gives the ability to diagnose whether or not subjects behavior is the result of planning. Here, we present simulations which suggest that the techniques most commonly used to analyze data from this task may be confounded in important ways. We introduce a new analysis technique, which suffers from fewer of these issues. This technique also presents a richer view of behavior, making it useful for characterizing patterns in behavior in a theory-neutral manner. This allows it to provide an important check on the assumptions of more theory-driven analysis such as agent-based model-fitting.
- Citations
- 20
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-step Task.
Thomas Akam, Rui Costa, Peter Dayan·bioRxiv·Jun 24, 2015
- A note on the analysis of two-stage task results: how changes in task structure affect what model-free and model-based strategies predict about the effects of reward and transition on the stay probability
Carolina Feher da Silva, Todd Anthony Hare·PLoS ONEPeer-reviewed·Apr 3, 2018
- Computational cognitive neuroscience: Model fitting should not replace model simulation.
Stefano Palminteri, Valentin Wyart, Étienne Koechlin·Trends in Cognitive SciencesPeer-reviewed·May 2, 2017
- Humans are primarily model-based learners in the two-stage task
Carolina Feher da Silva, Todd Anthony Hare·Nature Human BehaviourPeer-reviewed·Jul 6, 2020
- A spiking neural-network model of goal-directed behaviour
R. Basanisi, A. Brovelli, … G. Baldassarre·bioRxiv·Dec 6, 2019
- Decoding behavior with minimal and interpretable agent models
Giorgio Nicoletti, Antonio Celani·PLoS Computational BiologyPeer-reviewed·Aug 7, 2026