计算机科学
人工智能
杠杆(统计)
图像融合
卷积神经网络
特征(语言学)
背景(考古学)
计算机视觉
特征提取
编码器
融合
可视化
传感器融合
深度学习
一致性(知识库)
卷积(计算机科学)
模式识别(心理学)
语义学(计算机科学)
任务(项目管理)
目标检测
分割
语义鸿沟
人工神经网络
图像分割
融合机制
质量(理念)
任务分析
作者
Qinghua Wang,Ziwei Li,Tianyun Wang,Shuqi Zhang,Yuhong Luo,Feng Bao,Nan Chi,Qionghai Dai
标识
DOI:10.1109/tcsvt.2025.3625990
摘要
Infrared-visible image fusion (IVF) aims to integrate complementary information from infrared and visible sensors into a single, more informative representation. However, achieving both visual clarity and semantic consistency in the fused results remains a critical challenge, particularly for real-world applications like scene understanding. To address this, we propose DICFusion, a deep integrated and semantic-coordinated network, tailored for perceptually and semantically enriched infrared-visible fusion tasks. Firstly, the DICFusion employs a novel modality-aware fusion strategy to integrate infrared and visible modalities into a cohesive feature embedding. Secondly, the framework incorporates hybrid mamba-convolution blocks, which leverage the combined strengths of mamba and convolution neural networks to accurately capture both global context and localized details while maintaining computational efficiency. To mitigate the feature heterogeneity between fusion and downstream tasks, DICFusion adopts a comprehensive framework of deep integration and collaborative optimization. This design utilizes a unified multi-scale encoder to harmonize feature representations, followed by parallel fusion and segmentation branches to enhance both visual quality and task performance. Moreover, a semantic guidance module leveraging cross-attention mechanism is incorporated to refine the semantic consistency of the fused outcomes. Comprehensive experimental evaluations validate the performance and efficiency of DICFusion, demonstrating its superiority over contemporary state-of-the-art methods, both in terms of fusion visual quality and downstream task precision. The code is available at https://github.com/fd-qhwang/DICFusion.
科研通智能强力驱动
Strongly Powered by AbleSci AI