图像融合
计算机科学
人工智能
模式
水准点(测量)
深度学习
融合
图像(数学)
机器学习
过程(计算)
领域(数学)
多模式学习
光学(聚焦)
数学
地理
光学
纯数学
社会学
哲学
物理
操作系统
语言学
社会科学
大地测量学
作者
Shrida Kalamkar,Geetha Mary Amalanathan
标识
DOI:10.1016/j.dajour.2023.100327
摘要
Multimodal image fusion combines information from multiple modalities to generate a composite image containing complementary information. Multimodal image fusion is challenging due to the heterogeneous nature of data, misalignment and nonlinear relationships between input data, or incomplete data during the fusion process. In recent years, several attention mechanisms have been introduced to enhance the performance of deep learning models. However, little literature is available on multimodal image fusion using attention mechanisms. This paper aims to study and analyze the latest deep-learning approaches, including attention mechanisms for multimodal image fusion. As a result of this study, the graphical taxonomy based on the different image modalities, various fusion strategies, fusion levels, and metrics for fusion tasks has been put forth. The focus has been on various Multimodal image fusion frameworks based on deep-learning techniques as their core methodology. This paper also sheds light on the challenges and future research directions in this field, application domains, and benchmark datasets used for multimodal fusion tasks. This paper contributes to the research on Multimodal image fusion and can help researchers select a suitable methodology for their applications.
科研通智能强力驱动
Strongly Powered by AbleSci AI