多巴胺
多巴胺能
神经科学
纹状体
时差学习
中脑
心理学
计算机科学
人工智能
中枢神经系统
强化学习
作者
Ryunosuke Amo,Sara Matias,Akihiro Yamanaka,Kenji F. Tanaka,Naoshige Uchida,Mitsuko Watabe-Uchida
标识
DOI:10.1038/s41593-022-01109-2
摘要
A large body of evidence has indicated that the phasic responses of midbrain dopamine neurons show a remarkable similarity to a type of teaching signal (temporal difference (TD) error) used in machine learning. However, previous studies failed to observe a key prediction of this algorithm: that when an agent associates a cue and a reward that are separated in time, the timing of dopamine signals should gradually move backward in time from the time of the reward to the time of the cue over multiple trials. Here we demonstrate that such a gradual shift occurs both at the level of dopaminergic cellular activity and dopamine release in the ventral striatum in mice. Our results establish a long-sought link between dopaminergic activity and the TD learning algorithm, providing fundamental insights into how the brain associates cues and rewards that are separated in time.
科研通智能强力驱动
Strongly Powered by AbleSci AI