Dopamine error signal to actively cope with lack of expected reward
Seiya Ishino, Taisuke Kamada, Gideon A. Sarpong, Julia Kitano, Reo Tsukasa, Hisa Mukohira, Fangmiao Sun, Yulong Li, Kenta Kobayashi, Honda Naoki, Naoya Oishi, Masaaki Ogawa
Abstract
To obtain more of a particular uncertain reward, animals must learn to actively overcome the lack of reward and adjust behavior to obtain it again. The neural mechanisms underlying such coping with reward omission remain unclear. Here, we developed a task in rats to monitor active behavioral switch toward the next reward after no reward. We found that some dopamine neurons in the ventral tegmental area exhibited increased responses to unexpected reward omission and decreased responses to unexpected reward, following the opposite responses of the well-known dopamine neurons that signal reward prediction error (RPE). The dopamine increase reflected in the nucleus accumbens correlated with behavioral adjustment to actively overcome unexpected no reward. We propose that these responses signal error to actively cope with lack of expected reward. The dopamine error signal thus cooperates with the RPE signal, enabling adaptive and robust pursuit of uncertain reward to ultimately obtain more reward.