人工智能
计算机视觉
图像融合
计算机科学
融合
红外线的
图像处理
传感器融合
图像(数学)
模式识别(心理学)
特征提取
光学
图像分割
图像配准
迭代重建
目标检测
遥感
自动目标识别
上下文图像分类
可见光谱
机器视觉
光学成像
作者
Chunyang Cheng,Tianyang Xu,Xiao-Jun Wu,Tao Zhou,Hui Li,Zhangyong Tang,Josef Kittler
标识
DOI:10.1109/tpami.2026.3681958
摘要
Evaluation is essential in image fusion research, yet most existing metrics are directly borrowed from other vision tasks without proper adaptation. These traditional metrics, often based on complex image transformations, not only fail to capture the true quality of the fusion results but also are computationally demanding. To address these issues, we propose a unified evaluation framework specifically tailored for image fusion. At its core is a lightweight network designed efficiently to approximate widely used metrics, following a divide-and-conquer strategy. Unlike conventional approaches that directly assess similarity between fused and source images, we first decompose the fusion result into infrared and visible components. The evaluation model is then used to measure the degree of information preservation in these separated components, effectively disentangling the fusion evaluation process. During training, we incorporate a contrastive learning strategy and inform our evaluation model by perceptual scene assessment provided by a large language model. Last, we propose the first consistency evaluation framework, which measures the alignment between image fusion metrics and human visual perception, using both independent no-reference scores and downstream tasks performance as objective references. Extensive experiments show that our learning-based evaluation paradigm delivers both superior efficiency (up to 1,000 times faster) and greater consistency across a range of standard image fusion benchmarks.
科研通智能强力驱动
Strongly Powered by AbleSci AI