Incremental Purposive Behavior Acquisition based on Modular Learning System.

作者
Tomoki Nishi,Yasutake Takahashi,Minoru Asada
摘要

Abstract. A simple and straightforward application of reinforcement learning methods to real robot tasks is considerably difficult due to a huge exploration space that easily scales up exponentially since recent robots tend to have many kinds of sensors. One of the potential solutions might be application of so-called “mixture of experts” proposed by Jacobs et al.[1]; it decomposes a whole state space to a number of areas so that each expert module can produce good performance in the assigned small area. This idea is very general and has a wide range of applications, however, we have to consider how to decompose the space to a number of small regions, assign each of them to a learning module or an expert, and define a goal for each of them. In order to cope with the issue, this paper presents a method of self task decomposition for modular learning system based on self-interpretation of instructions given by a coach. Unlike the conventional approaches, the system decomposes a long-term task into short-term subtasks so that one learning module with limited computational resources can acquire a purposive behavior for one of these subtasks. Since instructions are given from a viewpoint of coach who has no idea how the system learns, they are interpreted by the learner to find the candidates for subgoals. Finally, the top layer of the hierarchical reinforcement learning system coordinates the lower learning modules to accomplish the whole task. The method is applied to a simple soccer situation in the context of RoboCup.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
1秒前
1秒前
1秒前
1秒前
1秒前
1秒前
1秒前
1秒前
1秒前
1秒前
2秒前
顺利舟完成签到,获得积分10
2秒前
3秒前
小二郎的应助被叶问采纳,获得10
3秒前
When完成签到 ,获得积分10
4秒前
123发布了新的文献求助10
5秒前
wq完成签到 ,获得积分10
5秒前
传奇3的应助被大知闲闲采纳,获得10
6秒前
Wwww发布了新的文献求助10
7秒前
7秒前
7秒前
7秒前
7秒前
7秒前
7秒前
7秒前
7秒前
7秒前
7秒前
隐形曼青的应助被拼搏的似狮采纳,获得10
8秒前
JOJO完成签到,获得积分10
8秒前
8秒前
皮卡布完成签到 ,获得积分10
9秒前
YPL完成签到,获得积分10
9秒前
喜悦发卡发布了新的文献求助10
9秒前
10秒前
天天向上的应助被LOTUS采纳,获得10
13秒前
Noor发布了新的文献求助10
13秒前
深情水之发布了新的文献求助10
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8186629
求助须知:如何正确求助?哪些是违规求助? 9574913
关于积分的说明 21838832
捐赠科研通 7784206
什么是DOI,文献DOI怎么找? 3434808
关于科研通互助平台的介绍 2559183
邀请新用户注册赠送积分活动 2481582