计算机科学
人工智能
卷积神经网络
块(置换群论)
水准点(测量)
计算机视觉
融合
钥匙(锁)
模式识别(心理学)
熵(时间箭头)
图像融合
视图合成
深度学习
变压器
图像(数学)
二次方程
任务(项目管理)
特征提取
空间分析
图像质量
作者
Jinsong He,Jianghua Cheng,Tong Liu,Bang Cheng,Xiaoyi Pan,Yahui Cai
出处
期刊:Remote Sensing
[Multidisciplinary Digital Publishing Institute]
日期:2026-02-18
卷期号:18 (4): 636-636
摘要
Visible-infrared image fusion is crucial for applications like autonomous driving and nighttime surveillance, yet it remains challenging due to the inherent limitations of existing deep learning models. Convolutional Neural Networks (CNNs) are constrained by their local receptive fields, while Transformers suffer from quadratic computational complexity. To address these issues, this paper investigates the application of the Mamba model—a novel State Space Model (SSM) with linear-complexity global modeling and selective scanning capabilities—to the task of visible-infrared image fusion. Building upon Mamba, we propose a novel fusion framework featuring two key designs: (1) A Multi-Path Mamba (MPMamba) module that orchestrates parallel Mamba blocks with convolutional streams to extract multi-scale, modality-specific features; and (2) a Dual-path Mamba Attention Fusion (DMAF) module that explicitly decouples and processes shared and complementary features via dual Mamba paths, followed by dynamic calibration with a Convolutional Block Attention Module (CBAM). Extensive experiments on the MSRS benchmark demonstrate that our framework achieves state-of-the-art performance, outperforming strong baselines such as U2Fusion and SwinFusion across key metrics including Information Entropy (EN), Spatial Frequency (SF), Mutual Information (MI), and edge-based fusion quality (Qabf). Visual results confirm its ability to produce fused images that saliently preserve thermal targets while retaining rich texture details.
科研通智能强力驱动
Strongly Powered by AbleSci AI