Bayesian Modeling of Context-Specific Goal-Directed and Habitual Control in Sequential Decision Making
Willi Hieke, Sarah Schwoebel, Sia Hranova, Arvid Pietsch, Stefan J Kiebel, Michael N Smolka
Abstract
It is an open question how context-specific habits develop alongside goal-directed planning. We examined action sequence repetition, contingency change, and context switching using a three-step optimization task with interleaved planning and habit contexts. During an initial acquisition phase, optimal sequences varied in the planning context but remained constant in the habit context. When contingencies changed, the original habit sequence became suboptimal and another became optimal. Action sequence repetition improved response speed and optimal-choice performance in the habit context relative to the planning context. Following the contingency change, both advantages initially reversed. Optimal-choice performance in the habit context subsequently recovered but did not significantly exceed that in the planning context, while responses remained slower in the habit context. Context switches reduced optimal-choice performance in both directions, with additional slowing when switching from habit to planning. The Bayesian contextual control model captured choice patterns through learned action sequence priors, goal-directed evaluation, and context inference. Allowing a context-stability bias to vary across participants did not improve model performance. These findings suggest that sequence repetition facilitates performance under stable contingencies while impairing adaptation to change.
02 /Specification & Classification
Click any tag to browse matching papers- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Balancing control: a Bayesian interpretation of habitual and goal-directed behavior
Sarah Schwöbel, Dimitrije Marković, … Stefan J. Kiebel·Journal of Mathematical PsychologyPeer-reviewed·Dec 13, 2020
- Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans
J. J. Lee, M. Keramati·PLOS Computational BiologyPeer-reviewed·Sep 28, 2017
- Nonparametric Bayesian Contextual Control: Integrating Automatisation and Prior Knowledge for Stable Adaptive Behaviour
Sia Hranova, Stefan J. Kiebel, … Sarah Schwöbel·bioRxiv·Feb 28, 2026
- Context-Dependent Interaction Between Goal-Directed and Habitual Control Under Time Pressure
Sascha Frölich, Ben Wagner, … Stefan J. Kiebel·bioRxiv·Sep 28, 2024
- Joint modeling of choices and reaction times based on Bayesian contextual behavioral control
Sarah Schwöbel, Dimitrije Marković, … Stefan J. Kiebel·PLoS Computational BiologyPeer-reviewed·Jul 5, 2024
- Explaining decision biases through context-dependent repetition
Ben Wagner, H. Benedikt Wolf, Stefan J. Kiebel·bioRxiv·Oct 9, 2024