计算机科学
人工智能
强化学习
机器人
地形
桥接(联网)
软件部署
组分(热力学)
运动规划
空间智能
自动化
人机交互
移动机器人
移动机器人导航
控制(管理)
分割
敏捷软件开发
机器人学
导航系统
位于
计算机视觉
语义学(计算机科学)
自主系统(数学)
口译(哲学)
可靠性(半导体)
运动(物理)
作者
Takahiro Miki,Robin Schmid,Manthan Patel,Turcan Tuna,Julia Richter,Julian Nubert,Joonho Lee,Matthias F. Mueller,Marco Hutter
出处
期刊:Science robotics
[American Association for the Advancement of Science]
日期:2026-11-18
卷期号:11 (120)
标识
DOI:10.1126/scirobotics.aee1549
摘要
Autonomous navigation in diverse real-world environments remains one of the greatest challenges in robotics. It demands both robust low-level motion control to handle diverse terrain and high-level reasoning to interpret environmental cues. We present ROAM (Robust Open-world Autonomous Mobility), a system that enables legged robots to perform kilometer-scale navigation in complex alpine and urban settings. ROAM combines the world knowledge of a vision-language model (VLM), pretrained on internet-scale data, with robust locomotion and local planning policies learned in simulation via reinforcement learning (RL). The VLM provides common-sense reasoning and semantic interpretation of the scene, assessing risks, interpreting signs, and producing semantic labels with associated navigation costs. An open-vocabulary segmentation module converts these labels into a dense, real-time risk map, which conditions two pretrained RL policies responsible for agile locomotion and local navigation: effectively coupling high-level VLM reasoning with low-level physical control. Real-world experiments showed the system’s ability to autonomously navigate a wide range of complex real-world environments. The robot completed kilometer-long hikes with minimal intervention, interpreted signs to avoid danger, and evaluated its environment to identify safe areas on which to step. This work represents a step toward the reliable deployment of systems in unstructured environments. However, it also underscores the challenges that remain in VLM reliability and spatial reasoning, indicating that foundational models are a crucial component but not yet a complete solution for navigation in the wild.
科研通智能强力驱动
Strongly Powered by AbleSci AI