Neural Signatures of Reward and Sensory Prediction Error in Motor Learning

Abstract

At least two distinct processes have been identified by which motor commands are adapted according to movement-related feedback: reward based learning and sensory error based learning. In sensory error based learning, mappings between sensory targets and motor commands are recalibrated according to sensory error feedback. In reward based learning, motor commands are associated with subjective value, such that successful actions are reinforced. We designed two tasks to isolate reward and sensory error based motor adaptation, and recorded electroencephalography (EEG) from humans to identify and dissociate the neural correlates of reward and sensory error processing. We designed a visuomotor rotation task to isolate sensory error based learning which was induced by altered visual feedback of hand position. In a reward learning task, we isolated reward based learning induced by binary reward feedback that was decoupled from the visual target. We found that a fronto-central event related potential called the feedback related negativity (FRN) was elicited specifically by reward feedback but not sensory error feedback. A more posterior component called the P300 was evoked by feedback in both tasks. In the visuomotor rotation task, P300 amplitude was increased by sensory error induced by perturbed visual feedback, and was correlated with learning rate. In the reward learning task, P300 amplitude was increased by reward relative to non reward and by surprise regardless of feedback valence. We propose that during motor adaptation, the FRN might specifically mark reward prediction error while the P300 might reflect processing which is modulated more generally by prediction error.\n\nNew and NoteworthyWe studied the event related potentials evoked by feedback stimuli during motor adaptation tasks that isolate reward and sensory error learning mechanisms. We found that the feedback related negativity was specifically elicited by reward feedback, while the P300 was observed in both tasks. These results reveal neural processes associated with different learning mechanisms and elucidate which classes of errors, from a computational standpoint, elicit the FRN and P300.