Novel model combining intrinsic and learned behaviours captures divergent effects of dopaminergic drugs on different types of motivation

Abstract

Motivation-based symptoms occur in an array of neurological and neurodegenerative disorders, including Schizophrenia and Parkinsons Disease. Unfortunately, there is, as yet, no agreed treatment approach. To establish a better understanding of motivation, and so highlight potential avenues for treatment, motivation is often investigated using operant behavioural paradigms such as the Effort for Reward (EfR) task. Performance on these tasks is thought to be influenced by reinforcement learning (RL) mechanisms, such that disorders of motivation can be described in terms of altered interactions with RL processes. Recently, foraging behaviour has been increasingly adopted as an ethologically valid approach to investigating cognitive mechanisms, including motivation. One example of this is the recently developed Effort Based Foraging task (EBF). Foraging behaviour, unlike the strictly controlled and contrived operant behavioural paradigms, involves a series of complex behavioural processes, each potentially driven by different cognitive processes. It is therefore important to identify which portion of the foraging behavioural sequence is driven by the same RL mechanisms as classical operant behavioural paradigms, and therefore can be used to investigate motivation. In this work we set out to establish whether the same RL mechanisms could be used to account for behaviours observed in both EfR and EBF tasks. We identified where, within the EBF task, RL mechanisms were no long sufficient and developed a novel hybrid model of the behaviour. This model successfully accounted for external influences on motivation, including previously unpredicted effects of clinically used dopaminergic drugs. This work reveals that motivation in complex, naturalistic tasks cannot be fully explained by learning-based models alone. Incorporating intrinsic behavioural drives may be needed as neuroscience moves toward more ethological behavioural assays.