视觉伺服
单眼
计算机视觉
人工智能
关节式人体姿态估计
计算机科学
运动学
分割
集合(抽象数据类型)
单目视觉
三维姿态估计
姿势
机器人运动学
机械臂
视觉控制
数据集
主动感知
机器人学
正向运动学
感知
方案(数学)
图像分割
机器人控制
视觉感受
光流
机器人
作者
Ze’an Liu,Xuanyin Wang,Ziyue Hao,Jiaqi Sun
摘要
Precise robotic manipulation driven by visual perception is essential for a robot arm to autonomously execute tasks in unstructured environments. Nevertheless, uncertainties including inaccurate calibration, imperfect kinematic modeling, and dynamic environmental disturbances pose significant challenges to existing manipulation strategies. Considering that a robot arm finally performs tasks through the end‐effector, we propose a monocular end‐effector pose estimation‐based visual servoing (EEVS) method. Our method first uses a lightweight detection network to obtain a coarse pose and a mask of the end‐effector, and then refines the pose according to an optimal segmentation model. The visual servoing control of the robot arm is realized based on the relative pose between the end‐effector and the target. We theoretically demonstrate that this end‐to‐end control scheme can effectively mitigate the impact of the uncertainties. Experiments on data set demonstrate that our method achieves more accurate end‐effector pose estimation than state‐of‐the‐art approaches, especially in the scenes with significant occlusion. Moreover, real‐world robotic experiments prove that our method provides higher manipulation accuracy compared with traditional methods even in the presence of substantial kinematic errors and environmental changes.
科研通智能强力驱动
Strongly Powered by AbleSci AI