Model-based aversive learning in humans is supported by preferential task state reactivation

Abstract

Harm avoidance is critical for survival, yet little is known regarding the underlying neural mechanisms supporting avoidance when we cannot rely on direct trial and error experience. Neural reactivation, and sequential replay, have emerged as potential candidate mechanisms. Here, during an aversive learning task, in conjunction with magnetoencephalography, we show prospective and retrospective reactivation for planning and learning respectively, coupled to evidence for sequential replay. Specifically, when subjects plan in an aversive context, we find preferential reactivation of subsequently chosen goal states and sequential replay of the preceding path. This reactivation was associated with greater hippocampal theta power. At outcome receipt, unchosen goal states are reactivated regardless of outcome valence. However, replay of paths leading to goal states was directionally modulated by outcome valence, with aversive outcomes leading to stronger reverse replay compared to safe outcomes. Our findings suggest that avoidance behaviour involves simulation of alternative future and past outcome states through hippocampally-mediated reactivation and replay.