计算机科学
推论
GSM演进的增强数据速率
算法
人工智能
序列(生物学)
数学优化
数学
生产(经济)
特征(语言学)
作者
Zichuan Zheng,Shan Zhang,Naixin Lu,Zhiyuan Wang,Hongbin Luo
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2026-05-18
卷期号:: 1-10
标识
DOI:10.1109/infocom59046.2026.11571396
摘要
Batching is a critical technique for improving energy efficiency (EE) when dealing with edge-based inference tasks. While existing batching policies achieve significant energy savings by exploiting short-timescale arrival patterns, they largely overlook long-timescale load fluctuations—leading to severe EE degradation during lightly-loaded periods, as confirmed by prototype measurements. To overcome this limitation, we propose Long-Short-Timescale Cooperative Batching (LSTCB), a novel framework that enhances EE without sacrificing latency. LSTCB dynamically deactivates servers in response to load variations while intelligently coordinating batched inference tasks. To achieve this, we first develop a measurement-based EE model for edge servers that accurately characterizes the relationship among batch size, workload, and energy consumption. At the short timescale, we devise a dynamic batching policy through Lyapunov optimization that simultaneously minimizes both energy consumption and latency under varying traffic conditions. For long-timescale optimization, we implement an intelligent server deactivation scheme that employs dynamic programming combined with bipartite graph matching to steer inter-server traffic, thereby minimizing overall system-level energy costs while maintaining service quality. Real-world prototype experiments demonstrate that LSTCB achieves 24.48%-46.12% energy savings over baseline methods while maintaining competitive latency performance.
科研通智能强力驱动
Strongly Powered by AbleSci AI