MFIFusion: An infrared and visible image enhanced fusion network based on multi-level feature injection

人工智能 特征(语言学) 计算机视觉 突出 特征提取 融合 图像(数学) 过程(计算) 图像融合 计算机科学 模式识别(心理学) 编码器 融合规则 哲学 语言学 操作系统
作者
Aimei Dong,Long Wang,Jian Liu,Guohua Lv,Guixin Zhao,Jinyong Cheng
出处
期刊:Pattern Recognition [Elsevier BV]
卷期号:152: 110445-110445 被引量:17
标识
DOI:10.1016/j.patcog.2024.110445
摘要

Infrared and visible image fusion aims to integrate complementary information from both types of images. Existing deep learning-based fusion methods rely solely on the final output of the feature extraction network, which may overlook valuable information presented in the middle layers of the network, ultimately reducing the richness of the fusion results, i.e., detailed texture information might not be fully extracted and integrated into the fused image. This study proposes a multi-level feature injection method based on an image decomposition model for infrared and visible image fusion, termed as MFIFusion. On the one hand, we introduce an attention-guided multi-level feature injection module designed to mitigate information loss during the feature extraction stage of the image scale decomposition process. More specifically, the proposed method integrates multiple fusion branches in the encoder network and employs an attention mechanism to guide the feature fusion process. On the other hand, based on the characteristics that superficial features retain image detail information and profound features are more suitable for extracting semantic information from images, we use distinct fusion strategies in these two phases to adaptively control the intensity distribution of the salient targets and to preserve the texture information in the background region. Qualitative and quantitative results demonstrate that our proposed approach produces fused images that are more visually salient to the target and contain richly detailed textures.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
2秒前
科研通AI6.1应助杜宇采纳,获得10
3秒前
张大锤发布了新的文献求助10
3秒前
橘络发布了新的文献求助10
3秒前
xiaomi完成签到,获得积分10
3秒前
风格化橙发布了新的文献求助10
3秒前
jachin完成签到 ,获得积分10
3秒前
4秒前
乐空思应助蓝天采纳,获得30
4秒前
好心情发布了新的文献求助10
5秒前
现代的绿真完成签到,获得积分10
6秒前
车间我发布了新的文献求助10
6秒前
6秒前
彭于晏应助dde采纳,获得10
6秒前
领导范儿应助科研通管家采纳,获得10
7秒前
tiptip应助科研通管家采纳,获得10
7秒前
思源应助科研通管家采纳,获得30
7秒前
7秒前
天天快乐应助科研通管家采纳,获得10
7秒前
molihuakai应助科研通管家采纳,获得10
7秒前
7秒前
8秒前
8秒前
Orange应助科研通管家采纳,获得10
8秒前
8秒前
打打应助科研通管家采纳,获得10
8秒前
8秒前
8秒前
JamesPei应助科研通管家采纳,获得10
8秒前
8秒前
9秒前
搜集达人应助nkr采纳,获得10
9秒前
海贵完成签到,获得积分10
10秒前
10秒前
科研通AI6.3应助陈宝玉采纳,获得30
10秒前
橘络完成签到,获得积分10
10秒前
风趣咖啡发布了新的文献求助10
11秒前
研友_VZG7GZ应助光亮的幻波采纳,获得10
11秒前
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Salmon nasal cartilage-derived proteoglycan complexes influence the gut microbiota and bacterial metabolites in mice 2000
The Composition and Relative Chronology of Dynasties 16 and 17 in Egypt 1500
Cowries - A Guide to the Gastropod Family Cypraeidae 1200
Hemispherical Resonator Gyro: Status Report and Test Results 800
ON THE THEORY OF BIRATIONAL BLOWING-UP 666
Signals, Systems, and Signal Processing 610
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 物理 内科学 复合材料 催化作用 物理化学 光电子学 电极 细胞生物学 基因 无机化学
热门帖子
关注 科研通微信公众号,转发送积分 6383223
求助须知:如何正确求助?哪些是违规求助? 8195469
关于积分的说明 17327739
捐赠科研通 5436876
什么是DOI,文献DOI怎么找? 2875358
邀请新用户注册赠送积分活动 1852160
关于科研通互助平台的介绍 1696598