融合
计算机科学
人工智能
图像融合
背景(考古学)
计算机视觉
传感器融合
模式识别(心理学)
图像复原
特征提取
图像(数学)
特征(语言学)
秩(图论)
空间语境意识
上下文模型
融合机制
语义学(计算机科学)
图像处理
可视化
信息融合
图像分割
目标检测
语义鸿沟
作者
Ran Jing,Quanxue Gao,Yu Duan,Xinbo Gao
标识
DOI:10.1109/tip.2026.3727130
摘要
Mamba, a global context modeling paradigm with a selective scanning mechanism, has recently attracted increasing attention in multimodal image fusion. Multimodal fusion aims to preserve and enhance cross-modal complementary information to produce high-quality fused images. Despite its suitability, existing Mamba-based fusion methods often blur modality-specific feature boundaries, mine complementary cues insufficiently, and lack explicit modal-specific modeling. To address these limitations, inspired by cross-attention, we extend Mamba to a multimodal setting and propose a Cross-Mamba architecture. As a plug-and-play module, Cross-Mamba adaptively mines inter-modal complementary information via cross-modal screening, thereby strengthening cross-modal interactions. Moreover, to emphasize complementary cues, reduce redundancy, and lower aggregation complexity, we impose rank constraints to preserve the spatial low-rank structure of features, retaining more informative components and improving fusion quality. Finally, we introduce a masked semantic guidance mechanism to narrow the semantic gap between fusion and downstream tasks, enhancing downstream adaptability. Extensive experiments on multiple fusion datasets, including qualitative, quantitative, and ablation studies, demonstrate that our method achieves state-of-the-art performance.
科研通智能强力驱动
Strongly Powered by AbleSci AI