无人机
计算机科学
障碍物
人工智能
避障
计算机视觉
强化学习
编码(集合论)
机器人
光学(聚焦)
代表(政治)
移动机器人
弹道
跟踪(教育)
任务(项目管理)
移动机器人导航
机器人学
控制(管理)
火车
控制工程
更安全的
实时计算
图像(数学)
自主机器人
人机交互
机器人运动学
机器人控制
避碰
面子(社会学概念)
自主系统(数学)
组分(热力学)
跟踪系统
作者
Zichen Yan,Rui Huang,Lei He,Shao Guo,Lin Zhao
标识
DOI:10.1109/lra.2025.3645668
摘要
Image-goal navigation (ImageNav) tasks a robot with autonomously exploring an unknown environment and reaching a location that visually matches a given target image. While prior works primarily study ImageNav for ground robots, enabling this capability for autonomous drones is substantially more challenging due to their need for high-frequency feedback control and global localization for stable flight. In this paper, we propose a novel sim-to-real framework that leverages reinforcement learning (RL) to achieve ImageNav for drones. To enhance visual representation ability, our approach trains the vision backbone with auxiliary tasks, including image perturbations and future transition prediction, which results in more effective policy training. The proposed algorithm enables end-to-end ImageNav with direct velocity control, eliminating the need for external localization. Furthermore, we integrate a depth-based safety module for real-time obstacle avoidance, allowing the drone to safely navigate in cluttered environments. Unlike most existing drone navigation methods that focus solely on reference tracking or obstacle avoidance, our framework supports comprehensive navigation behaviors, including autonomous exploration, obstacle avoidance, and image-goal seeking, without requiring explicit global mapping. Code and model checkpoints are available at https://github.com/Zichen-Yan/SIGN.
科研通智能强力驱动
Strongly Powered by AbleSci AI