嵌入
计算机科学
人工智能
特征(语言学)
图像(数学)
模式识别(心理学)
特征提取
融合
图像融合
机器学习
哲学
语言学
作者
Fan Zhao,Wenda Zhao,Huchuan Lu
标识
DOI:10.1109/tnnls.2023.3264911
摘要
General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI