计算机科学
强化学习
基站
维数之咒
分布式计算
弹道
高效能源利用
轨迹优化
实时计算
微电网
软件部署
计算机网络
人工智能
控制(管理)
操作系统
电气工程
天文
物理
工程类
作者
Tianyong Ao,Kaixin Zhang,Huaguang Shi,Zhanqi Jin,Yi Fan Zhou,Fuqiang Liu
出处
期刊:Remote Sensing
[Multidisciplinary Digital Publishing Institute]
日期:2023-01-11
卷期号:15 (2): 429-429
被引量:32
摘要
Unmanned Aerial Vehicles (UAVs) can be deployed as aerial wireless base stations which dynamically cover the wireless communication networks for Ground Users (GUs). The most challenging problem is how to control multi-UAVs to achieve on-demand coverage of wireless communication networks while maintaining connectivity among them. In this paper, the cooperative trajectory optimization of UAVs is studied to maximize the communication efficiency in the dynamic deployment of UAVs for emergency communication scenarios. We transform the problem into a Markov game problem and propose a distributed trajectory optimization algorithm, Double-Stream Attention multi-agent Actor-Critic (DSAAC), based on Multi-Agent Deep Reinforcement Learning (MADRL). The throughput, safety distance, and power consumption of UAVs are comprehensively taken into account for designing a practical reward function. For complex emergency communication scenarios, we design a double data stream network structure that provides a capacity for the Actor network to process state changes. Thus, UAVs can sense the movement trends of the GUs as well as other UAVs. To establish effective cooperation strategies for UAVs, we develop a hierarchical multi-head attention encoder in the Critic network. This encoder can reduce the redundant information through the attention mechanism, which resolves the problem of the curse of dimensionality as the number of both UAVs and GUs increases. We construct a simulation environment for emergency networks with multi-UAVs and compare the effects of the different numbers of GUs and UAVs on algorithms. The DSAAC algorithm improves communication efficiency by 56.7%, throughput by 71.2%, energy saving by 19.8%, and reduces the number of crashes by 57.7%.
科研通智能强力驱动
Strongly Powered by AbleSci AI