计算机科学
人工智能
规范化(社会学)
计算机视觉
特征(语言学)
架空(工程)
特征提取
高光谱成像
图像融合
领域(数学)
残余物
空间分析
目标检测
模式识别(心理学)
稳健性(进化)
感知
融合
面子(社会学概念)
直方图
传感器融合
图像(数学)
卷积神经网络
冗余(工程)
视野
光流
特征检测(计算机视觉)
作者
Yu Zhang,Hao Cha,HanRui Zhang,XiongHui Li,Zhuo Chen,JiaMing Bai,TingTing Fu,Yong Cheng Du,Xian Zhang
标识
DOI:10.1007/s00530-025-02080-1
摘要
Visible and infrared image fusion (VIF) is essential for unmanned aerial vehicle (UAV) perception by integrating complementary information from heterogeneous sensors to enhance understanding in complex environments. Existing deep learning-based VIF methods often face a trade-off between the limited receptive fields of CNNs and the high computational overhead of Transformers. Although Mamba shows great potential in modeling long-range dependencies with linear complexity, it struggles to preserve spatial information in complex spatial correlations. Moreover, most VIF methods lack effective multimodal feature disentanglement, which is particularly challenging in low-light and cluttered backgrounds. To address these challenges, we propose MCDFuse, a novel Mamba-CNN-driven VIF framework that synergistically combines the strengths of Mamba and CNN architectures. We introduce a dynamic feature activation module to improve spatial modeling and facilitate high-quality image reconstruction. A dual-branch architecture integrates ConvNeXt modules to expand the receptive field and inverted residual blocks to enhance detail representation. Furthermore, a feature decomposition loss with normalization constraints is designed to optimize feature disentanglement during training. Comparative experiments on multiple datasets, including newly constructed ones, against 12 state-of-the-art methods demonstrate that our approach achieves superior fusion quality and improves performance on downstream object detection tasks. The dataset can be downloaded from https://github.com/MCDFuse/UAVScene .
科研通智能强力驱动
Strongly Powered by AbleSci AI