计算机科学
工作量
弹性(物理)
分布式计算
毫秒
延迟(音频)
缩放比例
实时计算
操作系统
电信
天文
几何学
数学
物理
复合材料
材料科学
作者
Yannis Sfakianakis,Manolis Marazakis,Christos Kozanitis,Angelos Bilas
标识
DOI:10.1109/ccgrid54584.2022.00105
摘要
Current state-of-the-art serverless frameworks can-not execute functions within a few milliseconds for bursty work-loads. The reason for that is that typically they rely on horizontal elasticity to cope with the varying demand for resources, which induces high overhead in the event of a cold -start. Recent literature has focused on minimizing the overhead of horizontal elasticity using mechanisms such as snapshots. However, the spawning of new function instances still requires several tens of milliseconds. This paper proposes vertical elasticity to scale resources of serverless functions to cope with bursting workloads. We design LatEst, a controller for serverless frameworks that adapts the allocated resources of active function instances. U sing vertical scaling, LatEst can adjust to bursts of function invocations within a few milliseconds. LatEst implements a feed-back control loop to: (1) predict the required resources during workload changes and (2) react rapidly and accurately to such changes. Moreover, LatEst spawns new instances for functions when the resources of the underlying server are reaching their limit. We evaluate LatEst as an extension of vHive [1] and find that LatEst can improve tail latency of serverless functions up to 25x compared to vHive.
科研通智能强力驱动
Strongly Powered by AbleSci AI