计算机科学
强化学习
分布式计算
供应
杠杆(统计)
利用
计算机网络
软件部署
切片
无线接入网
基站
人工智能
计算机安全
万维网
操作系统
移动台
作者
Mohammad Zangooei,Morteza Golkarifard,Mohamed Rouili,Niloy Saha,Raouf Boutaba
标识
DOI:10.1109/jsac.2023.3336156
摘要
Network slicing enables the provision of customized services in next-generation mobile networks. Accordingly, the network is divided into logically isolated networks that share underlying resources but are tailored to meet the distinct service requirements of their users. However, allocating the minimum necessary resources to satisfy slices’ requirements is challenging, particularly when the number of slices is variable or too large which is envisioned in Open RAN. State-of-the-art proposals leverage reinforcement learning (RL) algorithms; however, they suffer from over-provisioning and/or frequent violations of service-level agreement (SLA) due to the large and changing state and action spaces. This paper introduces a novel cooperative multi-agent RL algorithm for RAN slicing in Open RAN, designed to adapt to variable slice numbers and effectively scale as they grow. To train this model, we exploit a novel constrained RL algorithm that explicitly considers SLA constraints to maintain a decreasing SLA violation ratio during training. Our approach is compatible with the Open RAN architecture, allowing for feasible deployment in future mobile networks. CMARS surpasses RL methods in SLA satisfaction by 50% in large-scale slicing, using only 9% more resources. It has 8% fewer SLA violations and 19% lower resource consumption for a flexible number of slices.
科研通智能强力驱动
Strongly Powered by AbleSci AI