强化学习
计算机科学
效率低下
图形
人工智能
嵌入
冲突解决
特征(语言学)
机器学习
可视化
遥控水下航行器
实时计算
极限(数学)
避碰
作者
Yumeng Li,Jiaqi Li,Jingjing Wang,Xin Zhang,Hui Ding,Wenbo Du
标识
DOI:10.1109/jiot.2025.3608865
摘要
Effective conflict resolution is crucial to ensure the safety of unmanned aerial vehicles (UAVs) in increasingly congested low-altitude airspace. However, the inefficiency in representing large-scale UAV information hinders the performance of existing learning-based methods. To overcome this challenge, we propose an enhanced graph-based reinforcement learning (GRL) approach that models multi-agent interactions relationships. Specifically, a novel multi-scale graph reinforcement learning (MS-GRL) approach is utilized to learn UAV avoidance strategies in a dense environment. MS-GRL utilizes the time-evolving intensity of local conflicts to evaluate the global attention weights for UAVs in conflict, while aggregating UAV observation data through graph embedding and requisite feature refinement. In addition, to adaptively limit the safety region of the action space while minimize deviations from the original trajectory, a safety-constrained maneuver strategy is proposed. Experimental results demonstrate that MS-GRL outperforms state-of-the-art GRL methods when there are up to 100 UAVs and multiple obstacles.
科研通智能强力驱动
Strongly Powered by AbleSci AI