Characterization of continuum robot arms under reinforcement learning and derived improvements

机器人 强化学习 计算机科学 机械臂 机器人末端执行器 人工智能 机器人控制 Arm解决方案 机器人学 机器人运动学 机器人学习 冗余(工程) 投掷 模拟 移动机器人 工程类 机械工程 操作系统
作者
Ryota Morimoto,Masahiro Ikeda,Ryuma Niiyama,Yasuo Kuniyoshi
出处
期刊:Frontiers in Robotics and AI [Frontiers Media]
卷期号:9: 895388-895388 被引量:5
标识
DOI:10.3389/frobt.2022.895388
摘要

In robotics, soft continuum robot arms are a promising prospect owing to their redundancy and passivity; however, no comprehensive study exists that examines their characteristics compared to rigid manipulators. In this study, we examined the advantages of a continuum robot arm as compared to a typical and rigid seven-degree-of-freedom (7-DoF) robot manipulator in terms of performing various tasks through reinforcement learning. We conducted simulations for tasks with different characteristics that require control over position and force. Common tasks in robot manipulators, such as reaching, crank rotation, object throwing, and peg-in-hole were considered. The initial conditions of the robot and environment were randomized, aiming for evaluations including robustness. The results indicate that the continuum robot arm excels in the crank-rotation task, which is characterized by uncertainty in environmental conditions and cumulative rewards. However, the rigid robot arm learned better motions for the peg-in-hole task than the other tasks, which requires fine motion control of the end-effector. In the throwing task, the continuum robot arm scored well owing to its good handling of anisotropy. Moreover, we developed a reinforcement-learning method based on the comprehensive experimental results. The proposed method successfully improved the motion learning of a continuum robot arm by adding a technique to regulate the initial state of the robot. To the best of our knowledge, ours is the first reinforcement-learning experiment with multiple tasks on a single continuum robot arm and is the first report of a comparison between a single continuum robot arm and rigid manipulator on a wide range of tasks. This simulation study can make a significant contribution to the design of continuum arms and specification of their applications, and development of control and reinforcement learning methods.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
刚刚
czzlancer完成签到,获得积分0
1秒前
阡陌完成签到,获得积分10
2秒前
苏苏苏发布了新的文献求助10
3秒前
大将军发布了新的文献求助10
4秒前
温暖秋蝶发布了新的文献求助10
5秒前
AdAstra完成签到,获得积分10
7秒前
熊风完成签到,获得积分10
7秒前
8秒前
张颖涛发布了新的文献求助10
8秒前
小马甲的应助被竟文采纳,获得10
9秒前
sunny完成签到 ,获得积分10
10秒前
10秒前
lu7完成签到 ,获得积分10
11秒前
星野的应助被予诺采纳,获得10
12秒前
回锅肉完成签到 ,获得积分10
14秒前
胖球球完成签到,获得积分10
14秒前
Hsy驳回了Lucas的应助
14秒前
好名发布了新的文献求助10
15秒前
ZY发布了新的文献求助10
16秒前
17秒前
20秒前
张颖涛完成签到,获得积分10
20秒前
领导范儿的应助被灭建国采纳,获得10
20秒前
21秒前
隐形曼青的应助被FUTURE采纳,获得30
22秒前
orixero的应助被Joy采纳,获得10
22秒前
Jingxue_ZX的应助被武宁采纳,获得10
25秒前
25秒前
我是谁的应助被朴实归尘采纳,获得50
26秒前
桐桐的应助被孟宇采纳,获得10
26秒前
柚子完成签到,获得积分10
26秒前
领导范儿的应助被大将军采纳,获得10
27秒前
哈哈哈哈发布了新的文献求助10
28秒前
29秒前
29秒前
30秒前
weiqiliang完成签到,获得积分10
30秒前
jason完成签到,获得积分0
30秒前
栖梧砚客完成签到,获得积分10
32秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
Sex, Aging, and Death in a Medieval Medical Compendium: Trinity College Cambridge MS R.14.52, Its Texts, Language, and Scribe 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8188371
求助须知:如何正确求助?哪些是违规求助? 9576179
关于积分的说明 21845965
捐赠科研通 7786421
什么是DOI,文献DOI怎么找? 3435292
关于科研通互助平台的介绍 2559601
邀请新用户注册赠送积分活动 2482276