虚假关系
人工智能
计算机科学
特征(语言学)
模式识别(心理学)
遮罩(插图)
情态动词
辍学(神经网络)
模式
机器学习
图像融合
匹配(统计)
图像(数学)
不相交集
特征匹配
特征学习
传感器融合
条件独立性
特征提取
生物识别
融合
概率分布
积分器
图像处理
模态(人机交互)
稳健性(进化)
联营
作者
Xue Wang,Zheng Guan,Wenhua Qian,Chengchao Wang,Runzhuo Ma
标识
DOI:10.48550/arxiv.2603.23272
摘要
Multi-modal image fusion integrates complementary information from different modalities into a unified representation. Current methods predominantly optimize statistical correlations between modalities, often capturing dataset-induced spurious associations that degrade under distribution shifts. In this paper, we propose an intervention-based framework inspired by causal principles to identify robust cross-modal dependencies. Drawing insights from Pearl's causal hierarchy, we design three principled intervention strategies to probe different aspects of modal relationships: i) complementary masking with spatially disjoint perturbations tests whether modalities can genuinely compensate for each other's missing information, ii) random masking of identical regions identifies feature subsets that remain informative under partial observability, and iii) modality dropout evaluates the irreplaceable contribution of each modality. Based on these interventions, we introduce a Causal Feature Integrator (CFI) that learns to identify and prioritize intervention-stable features maintaining importance across different perturbation patterns through adaptive invariance gating, thereby capturing robust modal dependencies rather than spurious correlations. Extensive experiments demonstrate that our method achieves SOTA performance on both public benchmarks and downstream high-level vision tasks.
科研通智能强力驱动
Strongly Powered by AbleSci AI