Doing what's not wanted: Conflict in incentives and misallocation of behavioural control lead to drug-seeking despite adverse outcomes

Abstract

Despite being aware of negative consequences and wanting to quit, long-term addicts find it difficult to quit seeking and consuming drugs. This inconsistency between the (often compulsive) behavioural patterns and the explicit knowledge of negative consequences represents a cognitive conflict which is a central characteristic of addiction. Neurobiologically, differential cue-induced activity in distinct striatal subregions, as well as the dopamine connectivity spiraling from ventral striatal regions to the dorsal regions, play critical roles in compulsive drug seeking. The focus of this work is to illustrate the mechanisms that lead to a cognitive conflict and its impact on actions taken i.e. addictive choices. We propose an algorithmic model that captures how the action choices that the agent makes when reinforced with drug-rewards become incongruent with the presence of negative consequences that often follow those choices. We advance the understanding of having a decision hierarchy in representing "cognitive control" and how lack of such control at higher-level in the hierarchy could potentially lead to consolidated drug-seeking habits. We further propose a cost-benefit based arbitration scheme, which mediates the allocation of control across different levels of the decision-making hierarchy. Lastly, we discuss how our work on extending a computational model to an algorithmic one, could in turn also helps us improve the understanding of how drugs hijack the dopamine-spiralling circuit at an implementation level.