Two types of locus coeruleus norepinephrine neurons drive reinforcement learning

Abstract

The cerebral cortex generates flexible behavior by learning. Reinforcement learning is thought to be driven by error signals in midbrain dopamine neurons. However, they project more densely to basal ganglia than cortex, leaving open the possibility of another source of learning signals for cortex. The locus coeruleus (LC) contains most of the brains norepinephrine (NE) neurons and project broadly to cortex. We measured activity from identified mouse LC-NE neurons during a behavioral task requiring ongoing learning from reward prediction errors (RPEs). We found two types of LC-NE neurons: neurons with wide action potentials (type I) were excited by positive RPE and showed an increasing relationship with change of choice likelihood. Neurons with thin action potentials (type II) were excited by lack of reward and showed a decreasing relationship with change of choice likelihood. Silencing LC-NE neurons changed future choices, as predicted from the electrophysiological recordings and a model of how RPEs are used to guide learning. We reveal functional heterogeneity of a neuromodulatory system in the brain and show that NE inputs to cortex act as a quantitative learning signal for flexible behavior.