强化学习
计算机科学
遗忘
循环神经网络
人工智能
人工神经网络
机器人
机器学习
歧管(流体力学)
工程类
认知心理学
心理学
机械工程
作者
Jiahao Chen,Ziyu Chen,Chaojing Yao,Hong Qiao
出处
期刊:IEEE Transactions on Cognitive and Developmental Systems
[Institute of Electrical and Electronics Engineers]
日期:2022-12-21
卷期号:16 (1): 86-99
被引量:28
标识
DOI:10.1109/tcds.2022.3231055
摘要
The continual learning and development are significant for robots to learn multiple tasks sequentially. The difficulty lies in balancing the efficient learning of new tasks and overcoming catastrophic forgetting of old tasks. Although many continual learning methods have been proposed for pattern recognition, continual reinforcement learning methods for redundant musculoskeletal and robotic systems are few and have limitations. Therefore, inspired by the developmental mechanisms in motor cortex, this article proposes a neural manifold modulated continual reinforcement learning method for musculoskeletal and robotic systems. First, a recurrent neural network (RNN) with an expected neural manifold is designed and conditions of weights are derived. Second, the ability of projectors for characterizing the neural manifold within RNN is analyzed. Furthermore, a continual reinforcement learning method of RNN is proposed with the modulation of a neural manifold. The method is validated by redundant musculoskeletal and robotic systems in simulation. The results suggest that it can realize continual reinforcement learning of multiple tasks in different movements and environments. Furthermore, compared with related works, the proposed method achieves better performance.
科研通智能强力驱动
Strongly Powered by AbleSci AI