An Infrared-Visible Image Fusion Network with Channel-Switching for Low-Light Object Detection

计算机视觉 人工智能 红外线的 融合 频道(广播) 计算机科学 目标检测 图像融合 可见光谱 对象(语法) 图像(数学) 模式识别(心理学) 光电子学 光学 材料科学 物理 电信 哲学 语言学
作者
Tianzhe Jiao,Yumin Chen,Xiaoyue Feng,Chaopeng Guo,Jie Guang Song
出处
期刊:Computers, materials & continua 卷期号:85 (2): 2681-2700 被引量:1
标识
DOI:10.32604/cmc.2025.069235
摘要

Visible-infrared object detection leverages the day-night stable object perception capability of infrared images to enhance detection robustness in low-light environments by fusing the complementary information of visible and infrared images. However, the inherent differences in the imaging mechanisms of visible and infrared modalities make effective cross-modal fusion challenging. Furthermore, constrained by the physical characteristics of sensors and thermal diffusion effects, infrared images generally suffer from blurred object contours and missing details, making it difficult to extract object features effectively. To address these issues, we propose an infrared-visible image fusion network that realizes multimodal information fusion of infrared and visible images through a carefully designed multi-scale fusion strategy. First, we design an adaptive gray-radiance enhancement (AGRE) module to strengthen the detail representation in infrared images, improving their usability in complex lighting scenarios. Next, we introduce a channel-spatial feature interaction (CSFI) module, which achieves efficient complementarity between the RGB and infrared (IR) modalities via dynamic channel switching and a spatial attention mechanism. Finally, we propose a multi-scale enhanced cross-attention fusion (MSECA) module, which optimizes the fusion of multi-level features through dynamic convolution and gating mechanisms and captures long-range complementary relationships of cross-modal features on a global scale, thereby enhancing the expressiveness of the fused features. Experiments on the KAIST, M3FD, and FLIR datasets demonstrate that our method delivers outstanding performance in daytime and nighttime scenarios. On the KAIST dataset, the miss rate drops to 5.99%, and further to 4.26% in night scenes. On the FLIR and M3FD datasets, it achieves scores of 79.4% and 88.9%, respectively.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
英姑应助QQQQL采纳,获得10
刚刚
yingtiao完成签到 ,获得积分10
刚刚
刚刚
贪玩的猕猴桃完成签到,获得积分10
1秒前
空勒应助小半采纳,获得10
1秒前
2秒前
whn发布了新的文献求助10
2秒前
3秒前
沈君序完成签到,获得积分10
4秒前
5秒前
5秒前
7秒前
7秒前
赖氨酸完成签到,获得积分20
7秒前
8秒前
LYTYamede发布了新的文献求助10
8秒前
8秒前
ybdst发布了新的文献求助10
9秒前
唐清羽应助100e01采纳,获得10
10秒前
Akim应助绒绒采纳,获得10
11秒前
11秒前
守护星发布了新的文献求助10
12秒前
13秒前
whn完成签到,获得积分20
14秒前
16秒前
Rida302完成签到,获得积分10
17秒前
上官若男应助赖氨酸采纳,获得10
18秒前
19秒前
hehehaha完成签到,获得积分10
19秒前
xiaoxue完成签到,获得积分10
20秒前
玮玮完成签到,获得积分10
20秒前
犹豫晓啸发布了新的文献求助10
20秒前
仁爱的尔蓝完成签到,获得积分20
20秒前
21秒前
21秒前
王sy完成签到 ,获得积分10
22秒前
Join发布了新的文献求助10
22秒前
fei关闭了fei文献求助
23秒前
23秒前
SciGPT应助土豆丝炒姜丝采纳,获得20
23秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Gründe der Seele:Die Wiener Psychatrie im 20.Jahrhundert 1000
Development of a Bridge Weigh-In-Motion System: A technology to convert the bridge response to the passage of traffic into data on vehicle configurations, speeds, times of travel and weights 1000
Organic Reactions, Volume 116 1000
Current concepts in cutaneous toxicity : proceedings of the Fourth Conference on Cutaneous Toxicity, Washington, D.C., May 9-11, 1979 1000
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7268048
求助须知:如何正确求助?哪些是违规求助? 8888796
关于积分的说明 18788978
捐赠科研通 6944645
什么是DOI,文献DOI怎么找? 3203461
关于科研通互助平台的介绍 2376304
邀请新用户注册赠送积分活动 2179298