计算机科学
自动汇总
情态动词
人工智能
安全性令牌
利用
BitTorrent跟踪器
过程(计算)
帧(网络)
模棱两可
编码器
计算机视觉
跟踪(教育)
自然语言处理
眼动
操作系统
化学
计算机安全
高分子化学
电信
程序设计语言
教育学
心理学
作者
Zhongjie Mao,Yucheng Wang,Xi Chen,Jia Yan
标识
DOI:10.1109/icassp48485.2024.10446122
摘要
Most vision-language (VL) trackers rely on coarse-grained information from sentences to achieve multi-modal alignment. However, this information is insufficient for accurately describing the target in each frame due to the inherent ambiguity, summarization, and invariance of sentences, thereby making multi-modal alignment challenging. This paper introduces TTCTrack, a novel VL tracker that employs textual token classification to address this challenge. Specifically, we exploit the multi-modal cross-relations to classify textual tokens into various types and employ diverse operations on them, enabling multi-modal alignment in the tracking process. This enables the textual tokens to accurately describe the target and dynamically reflect the scene changes. Moreover, we introduce a dual-encoder structure that effectively handles the multi-modal input and fusion. Extensive experiments on four datasets demonstrate the effectiveness of our proposed tracking method.
科研通智能强力驱动
Strongly Powered by AbleSci AI