概率逻辑
计算机科学
强化学习
路径(计算)
运动规划
弹道
数学优化
功能(生物学)
事后诸葛亮
贝尔曼方程
边界(拓扑)
动作(物理)
人工智能
控制(管理)
最优控制
轨迹优化
相对价值
还原(数学)
高级驾驶员辅助系统
概率路线图
机器学习
最优化问题
利用
价值(数学)
作者
Yuyue Liu,Shuzhi Liu,Zhongyi Wang,Chengshi Yuan,Xinyu Guo,Yujian Liu,Jixiang Wang
标识
DOI:10.1016/j.aej.2026.02.024
摘要
This paper addresses the uncertainties arising from dynamic environments in autonomous path planning tasks for unmanned aerial vehicles (UAVs). Existing Deep Reinforcement Learning (DRL) methods struggle to represent multiple feasible trajectories and often neglect failure experiences. To overcome these limitations, we propose a novel framework termed GRPO-MDP (Group Relative Policy Optimization with a Multimodal Diffusion Strategy). The framework leverages a Denoising Diffusion Probabilistic Model (DDPM) to generate diverse action samples during training. By integrating DRL with multimodal diffusion strategies, GRPO-MDP enables UAVs to explore multiple feasible trajectories from the same state, enhancing exploration flexibility. The proposed Group Relative Policy Optimization (GRPO) method constructs advantage functions through relative comparisons within groups of trajectories, thereby eliminating the need for a value network and improving training stability. In addition, a hindsight trajectory relabeling mechanism is introduced to convert failure experiences into informative learning signals by incorporating virtual target and safety boundary modes. To guarantee real-time safety, a Control Barrier Function (CBF) is employed as a safety filter, ensuring that hard safety constraints are strictly enforced during path planning. Experimental results demonstrate that the proposed GRPO-MDP framework outperforms existing methods in terms of success rate, path efficiency, and safety in dynamic environments.
科研通智能强力驱动
Strongly Powered by AbleSci AI