图像融合
计算机科学
人工智能
融合
频域
计算机视觉
杠杆(统计)
模式识别(心理学)
提取器
特征提取
传感器融合
空间频率
图像(数学)
稳健性(进化)
图像处理
领域(数学分析)
频率分析
源代码
图像纹理
简单(哲学)
时频分析
编码(集合论)
图像分辨率
可视化
变换编码
作者
Yixin Zhu,Long Lv,Pingping Zhang,Xiaojing Liu,Tongdan Tang,Feng Tian,Weibing Sun,Huchuan Lu
标识
DOI:10.1109/tip.2026.3662596
摘要
Multi-Modal Image Fusion (MMIF) aims to combine images from different modalities to produce fused images, retaining texture details and preserving significant information. Recently, some MMIF methods incorporate frequency domain information to enhance spatial features. However, these methods typically rely on simple serial or parallel spatial-frequency fusion without interaction. In this paper, we propose a novel Interactive Spatial-Frequency Fusion Mamba (ISFM) framework for MMIF. Specifically, we begin with a Modality-Specific Extractor (MSE) to extract features from different modalities. It models long-range dependencies across the image with linear computational complexity. To effectively leverage frequency information, we then propose a Multi-scale Frequency Fusion (MFF). It adaptively integrates low-frequency and high-frequency components across multiple scales, enabling robust representations of frequency features. More importantly, we further propose an Interactive Spatial-Frequency Fusion (ISF). It incorporates frequency features to guide spatial features across modalities, enhancing complementary representations. Extensive experiments are conducted on six MMIF datasets. The experimental results demonstrate that our ISFM can achieve better performances than other state-of-the-art methods. The source code is available at https://github.com/Namn23/ISFM.
科研通智能强力驱动
Strongly Powered by AbleSci AI