计算机科学
马尔可夫决策过程
强化学习
分布式计算
服务质量
任务(项目管理)
资源管理(计算)
马尔可夫过程
过程(计算)
马尔可夫链
资源配置
动态网络分析
动态需求
方案(数学)
资源(消歧)
网络拓扑
网络动力学
动态规划
概率逻辑
部分可观测马尔可夫决策过程
任务分析
计算机网络
实时计算
最优化问题
服务(商务)
服务器
云朵
编码
马尔可夫模型
作者
Zou Xin,Renchao Xie,Zehui Xiong,Gaochang Xie,Qinqin Tang,Tao Huang,Chau Yuen,Zhu Han
标识
DOI:10.1109/tccn.2025.3628477
摘要
Driven by the increasing demand from emerging applications for wide coverage, low latency, and powerful computing capabilities in networks, the satellite-terrestrial integrated computing power network (ST-CPN) has emerged as a promising solution. However, the dynamic nature of the ST-CPN and the limited resources of individual nodes present significant challenges to the efficient execution of complex applications with multiple interdependent subtasks. This paper investigates the dependent task offloading problem in dynamic ST-CPNs. To tackle the challenges associated with satellite mobility, uneven service distribution, and spatial uncertainty, we propose a Time–Space-Varying Resource Model (TSVRM) to capture the dynamic variations of communication, computation, and storage resources. Spatially, TSVRM predicts link establishment and switching based on satellite trajectories, visibility constraints, and polar region recognition, thereby modeling topology evolution driven by orbital motion. Temporally, a Markov process is used to represent the stochastic evolution of resource states. Building on TSVRM, we develop a Time–Space-Aware Deep Reinforcement Learning (TS-DRL) offloading scheme to determine subtask execution placement. It employs an upward-ranking mechanism for subtask prioritization and a Long Short-Term Memory (LSTM)-based Sequence-to-Sequence (S2S) network to encode structured task features. The network is trained via Proximal Policy Optimization (PPO) to approximate the policy and value functions of the Markov Decision Process, enabling optimized offloading. Simulation results show that our scheme converges effectively and achieves superior QoS compared to baselines, reaching between 94.10% and 98.27% of the optimal performance.
科研通智能强力驱动
Strongly Powered by AbleSci AI