YOLOv11-DCFNet: A Robust Dual-Modal Fusion Method for Infrared and Visible Road Crack Detection in Weak- or No-Light Illumination Environments

人工智能 计算机视觉 计算机科学 红外线的 RGB颜色模型 融合 特征提取 热成像 材料科学 鉴定(生物学) 可见光谱 特征(语言学) 精确性和召回率 图像融合 热的 模式识别(心理学) 纹理(宇宙学) 传感器融合 热红外 遥感 变压器 目标检测 机器视觉
作者
Xinbao Chen,Yaohui Zhang,Junqi Lei,Lelin Li,Lifang Liu,Dongshui Zhang
出处
期刊:Remote Sensing [Multidisciplinary Digital Publishing Institute]
卷期号:17 (20): 3488-3488 被引量:9
标识
DOI:10.3390/rs17203488
摘要

Road cracks represent a significant challenge that impacts the long-term performance and safety of transportation infrastructure. Early identification of these cracks is crucial for effective road maintenance management. However, traditional crack recognition methods that rely on visible light images often experience substantial performance degradation in weak-light environments, such as at night or within tunnels. This degradation is characterized by blurred or deficient image textures, indistinct target edges, and reduced detection accuracy, which hinders the ability to achieve reliable all-weather target detection. To address these challenges, this study introduces a dual-modal crack detection method named YOLOv11-DCFNet. This method is based on an enhanced YOLOv11 architecture and incorporates a Cross-Modality Fusion Transformer (CFT) module. It establishes a dual-branch feature extraction structure that utilizes both infrared and visible light within the original YOLOv11 framework, effectively leveraging the high contrast capabilities of thermal infrared images to detect cracks under weak- or no-light conditions. The experimental results demonstrate that the proposed YOLOv11-DCFNet method significantly outperforms the single-modal model (YOLOv11-RGB) in both weak-light and no-light scenarios. Under weak-light conditions, the fusion model effectively utilizes the weak texture features of RGB images alongside the thermal radiation information from infrared (IR) images. This leads to an improvement in Precision from 83.8% to 95.3%, Recall from 81.5% to 90.5%, mAP@0.5 from 84.9% to 92.9%, and mAP@0.5:0.95 from 41.7% to 56.3%, thereby enhancing both detection accuracy and quality. In no-light conditions, the RGB single modality performs poorly due to the absence of visible light information, with an mAP@0.5 of only 67.5%. However, by incorporating IR thermal radiation features, the fusion model enhances Precision, Recall, and mAP@0.5 to 95.3%, 90.5%, and 92.9%, respectively, maintaining high detection accuracy and stability even in extreme no-light environments. The results of this study indicate that YOLOv11-DCFNet exhibits strong robustness and generalization ability across various low illumination conditions, providing effective technical support for night-time road maintenance and crack monitoring systems.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
传奇3的应助被科研通管家采纳,获得10
刚刚
852的应助被科研通管家采纳,获得10
刚刚
英俊的铭的应助被科研通管家采纳,获得10
刚刚
FashionBoy的应助被科研通管家采纳,获得10
1秒前
映海发布了新的文献求助10
1秒前
忆寒的应助被科研通管家采纳,获得30
1秒前
ww的应助被科研通管家采纳,获得10
1秒前
sjdove发布了新的文献求助10
1秒前
秀丽羽毛完成签到,获得积分10
2秒前
大模型的应助被蘑菇采纳,获得30
2秒前
追逐123发布了新的文献求助10
3秒前
怕黑鲂发布了新的文献求助30
3秒前
Yuri发布了新的文献求助10
4秒前
FashionBoy的应助被华无剑采纳,获得10
4秒前
lixiangrui110完成签到,获得积分10
4秒前
4秒前
Franklin发布了新的文献求助100
5秒前
小凡同学完成签到,获得积分10
5秒前
5秒前
Akim的应助被朴实向卉采纳,获得10
6秒前
6秒前
王笛发布了新的文献求助10
6秒前
丁鹏笑完成签到 ,获得积分0
7秒前
7秒前
Baldwin完成签到 ,获得积分10
7秒前
辛勤的念真完成签到,获得积分10
7秒前
7秒前
9秒前
9秒前
英姑的应助被leegawei采纳,获得10
9秒前
9秒前
桐桐的应助被sd3004采纳,获得10
10秒前
风吹麦浪的应助被温阳采纳,获得10
10秒前
www发布了新的文献求助10
10秒前
10秒前
11秒前
11秒前
龙仁发布了新的文献求助10
12秒前
12秒前
michael发布了新的文献求助10
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Encyclopedia of Modern Artificial Intelligence 1000
Особенности технологий и методов информационно-психологических войн СССР с Великобританией и США в период 1939-1953 гг 1000
Das Matthäusevangelium: Kapitel 1:1–17 1000
IRTSD: Open-Source Data and Toolset for Electromagnetic Transient Analysis of Disturbances and IBR Control Malfunctions in Transmission Systems 1000
Challenging Attachment Theory 600
Analyses de reconnaissances de dettes passées devant les échevins d'Ypres (1249-1291) 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8140347
求助须知:如何正确求助?哪些是违规求助? 9540672
关于积分的说明 21641346
捐赠科研通 7724383
什么是DOI,文献DOI怎么找? 3421086
关于科研通互助平台的介绍 2546303
邀请新用户注册赠送积分活动 2463147