计算机科学
加速度
分析
人工智能
推论
计算机视觉
信号处理
视频处理
录像
实时计算
视频跟踪
图像处理
模式识别(心理学)
数字视频
卡尔曼滤波器
机器学习
可视化
作者
Haosong Peng,Wei Feng,Hui Li,Yufeng Zhan,Ren Jin,Yuanqing Xia
标识
DOI:10.1109/tc.2026.3699450
摘要
The advent of edge computing has made real-time intelligent video analytics feasible. Previous works, based on traditional model architecture (e.g., CNN, RNN, etc.), employ various strategies to filter out non-region-of-interest content to minimize bandwidth and computation consumption but show inferior performance in adverse environments. Recently, visual foundation models based on transformers have shown great performance in adverse environments due to their amazing generalization capability. However, they require a large amount of computation power, which limits their applications in realtime intelligent video analytics. In this paper, we find visual foundation models like Vision Transformer (ViT) also have a dedicated acceleration mechanism for video analytics. To this end, we introduce Arena, an end-to-end edge-assisted video inference acceleration system based on ViT. We leverage the capability of ViT that can be accelerated through token pruning by only offloading and feeding Patches-of-Interest to the downstream models. Additionally, we design an adaptive keyframe inference switching algorithm tailored to different videos, capable of adapting to the current video content to jointly optimize accuracy and bandwidth. Through extensive experiments, our findings reveal that Arena can boost inference speeds by up to 1.58×, 1.82× and 1.98× on average while consuming only 47%, 31% and 27% of the bandwidth, respectively, all with high inference accuracy.
科研通智能强力驱动
Strongly Powered by AbleSci AI