The minimal behavioral time window for reward conditioning in the nucleus accumbens of mice

Abstract

The temporal precision of reward-reinforcement learning is determined by the minimal time window of the reward action--theoretically known as the eligibility trace. In animal studies, however, such a minimal time window and its origin have not been well understood. Here, we used head-restrained mice to accurately control the timing of sucrose water as an unconditioned stimulus (US); we found that the reinforcement effect of the US occurred only within 1 s after a short tone of a conditioned stimulus (CS). The conditioning required the dopamine D1 receptor and CaMKII signaling in the nucleus accumbens (NAc). The time window was not reduced by replacing CS with optogenetic stimulation of the synaptic inputs to the NAc, which is in agreement with previous reports on the effective dopamine timing of NAc synapses. Thus, our data suggest that the minimal reward time window is 1 s, and is formed in the NAc.