模态(人机交互)
鉴定(生物学)
计算机科学
分离(统计)
红外线的
人工智能
模式识别(心理学)
机器学习
光学
植物
物理
生物
作者
Xi Yang,Wenjiao Dong,Meijie Li,Ziyu Wei,Nannan Wang,Xinbo Gao
标识
DOI:10.1109/tmm.2024.3377139
摘要
Visible-infrared person re-identification (VI-ReID) is a challenging task because the different imaging principles of visible and infrared images bring about huge modality discrepancy. Existing methods primarily address this issue by generating intermediate images to align modality features and establish connections between the visible and infrared modalities. However, the quality of these generated images is often unstable, limiting the effectiveness of such approaches. To overcome this limitation, we propose a novel method called modality shared-specific features cooperative separation. It consists of two key modules: the saliency response module and the cooperative separation module, aimed at alleviating the modality gap. The saliency response module incorporates a location attention mechanism and local features to construct contextual connections and extract local saliency information. Then, the cooperative separation module employs a more concise dual-MLPs as generator to effectively separate shared-specific features. Additionally, we introduce a shared feature refinement mechanism in both the generator and discriminator. By coordinating the shared-specific features, our method achieves secondary separation and extracts purer modality-shared features without specific information. Extensive experiments conducted on the SYSU-MM01 and RegDB public datasets demonstrate that our proposed method performs excellently in VI-ReID.
科研通智能强力驱动
Strongly Powered by AbleSci AI