对抗制
概率逻辑
人工智能
计算机科学
嵌入
稳健性(进化)
编码(社会科学)
模式识别(心理学)
算法
融合
计算机视觉
图像融合
图像(数学)
钥匙(锁)
传感器融合
数学
编码(内存)
图像处理
作者
Hao Zhang,Meiqi Gong,Douyu Wu,Jiayi Ma
标识
DOI:10.1016/j.fmre.2026.03.024
摘要
Multimodal image fusion aims to integrate complementary information from heterogeneous sensors, yet existing methods remain vulnerable to composite degradations and inherent modality bias. On the one hand, representations become unreliable under composite degradations; on the other hand, fusion strategies often directly enforce cross-modal consistency, inevitably forcing the fused results into inter-modal compromises and leading to unstable representations. To address these issues, we propose DPAFuse, a dual-space probabilistic adversarial image fusion framework with robust coding embedding. Firstly, a robust coding embedding mechanism projects heterogeneous inputs into a unified latent space, contracting the distributional discrepancies among diverse composite degradations and aligning them closer to the underlying clean representation, while effectively suppressing degradation-related components and preserving modality-invariant structural and semantic features. Moreover, to alleviate modality bias, we design a dual-space probabilistic adversarial fusion mechanism that enforces distribution-level consistency across latent and image domains, enabling adaptive global fusion without local compromises. Extensive experiments on public datasets demonstrate that DPAFuse achieves superior robustness and fusion fidelity compared with state-of-the-art methods. The code is publicly available at https://github.com/HaoZhang1018/DPAFuse.
科研通智能强力驱动
Strongly Powered by AbleSci AI