可卷曲的尾巴
杂乱
计算机科学
计算机视觉
人工智能
跟踪(教育)
生物
心理学
古生物学
电信
雷达
教育学
作者
Zisong Xu,Rafael Papallas,Jaina Modisett,Markus Billeter,Mehmet R. Doğar
标识
DOI:10.1109/tro.2025.3577437
摘要
This paper introduces a method for 6D pose tracking and control of multiple objects during non-prehensile manipulation by a robot. The tracking system estimates objects' poses by integrating physics predictions, derived from robotic joint state information, with visual inputs from an RGB-D camera. Specifically, the methodology is based on particle filtering, which fuses control information from the robot as an input for each particle movement and with real-time camera observations to track the pose of objects. Comparative analyses reveal that this physics-based approach substantially improves pose tracking accuracy over baseline methods that rely solely on visual data, particularly during manipulation in clutter, where occlusions are a frequent problem. The tracking system is integrated with a model predictive control approach which shows that the probabilistic nature of our tracking system can help robust manipulation planning and control of multiple objects in clutter, even under heavy occlusions. Associated code and data available at:https://github.com/ZisongXu/PBPF.
科研通智能强力驱动
Strongly Powered by AbleSci AI