C 2 DFF-Net for Object Detection in Multimodal Remote Sensing Images

遥感 稳健性(进化) 目标检测 计算机科学 计算机视觉 图像融合 背景(考古学) 人工智能 传感器融合 光学(聚焦) 特征(语言学) 软件部署 融合 融合机制 合成孔径雷达 聚类分析 领域(数学分析) 差速器(机械装置) 图像传感器 特征提取 实时计算 无线传感器网络 杂乱
作者
Yue Zhang,Jinbao Chen,Jianyuan Wang,Donghao Shi,Shu Han,Lixiao Deng
出处
期刊:IEEE Transactions on Geoscience and Remote Sensing [Institute of Electrical and Electronics Engineers]
卷期号:63: 1-16 被引量:10
标识
DOI:10.1109/tgrs.2025.3614295
摘要

Multimodal fusion detection has proven to be a practical approach for improving small target perception in remote sensing. Existing studies primarily focus on the fusion of multimodal spatial-domain features, while paying insufficient attention to cross-domain differential features. Furthermore, exploration of lightweight fusion mechanisms tailored for deployment on edge devices such as UAVs remains relatively limited.To address these issues, we propose an extremely lightweight cross-modal and cross-domain differential feature fusion network (C²DFF-Net). The network includes three innovative plug-and-play modules. Specifically, we propose a cross-modal differential feature interaction (CDFIM) module to facilitate inter-modal information interaction by enhancing differential features between visible and infrared modalities. To improve the adaptive fusion of multimodal complementary features, we propose a cross-domain gated self-attention (CGSA) module. The global context information of the image is explored from a frequency-domain perspective, and a polarized self-attention mechanism is introduced to establish long-range dependencies on spatial-frequency domain differential features while filtering redundant information. Additionally, we design an adaptive light-aware mask (ALM) module to enable the network to learn effective multimodal complementary features without bias, improving its robustness in complex lighting environments such as exposure and glare. Comprehensive experiments demonstrate that C2DFF-Net not only achieves state-of-the-art (SOTA) performance but also maintains a lightweight design, achieving 85.7% mAP50 with 6.58M parameters and 14.6 GFLOPs on the DroneVehicle dataset. Furthermore, it shows a favorable accuracy-computation tradeoff compared to SOTA models on the VEDAI and FLIR datasets. Finally, we conduct real-world deployment experiments, and C2DFF-Net achieves satisfactory results under various lighting conditions, clearly demonstrating its practical applicability. Code will be available at https://github.com/FPGAzzy/C2DFF-Net.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
完美世界的应助被时丶倾采纳,获得10
刚刚
明芷蝶发布了新的文献求助10
1秒前
长安完成签到,获得积分0
1秒前
烂漫伟祺完成签到,获得积分10
1秒前
Roy完成签到,获得积分20
1秒前
1秒前
czq完成签到,获得积分20
1秒前
1秒前
2秒前
Samuel发布了新的文献求助10
2秒前
芙蕖星星完成签到,获得积分10
2秒前
lei发布了新的文献求助10
2秒前
鼠大帅发布了新的文献求助10
2秒前
黑包包大人完成签到,获得积分10
2秒前
流水落花完成签到 ,获得积分20
2秒前
FashionBoy的应助被ufo采纳,获得10
2秒前
white完成签到 ,获得积分10
2秒前
充电宝的应助被xty采纳,获得10
2秒前
ocean完成签到,获得积分10
3秒前
3秒前
ghshen的应助被xueerbx采纳,获得10
3秒前
happyeveryday发布了新的文献求助10
3秒前
3秒前
4秒前
wxm的应助被Hua采纳,获得10
4秒前
纯真的丝完成签到,获得积分10
4秒前
5秒前
减肥摸鱼发布了新的文献求助10
5秒前
5秒前
honor完成签到,获得积分10
5秒前
平淡青烟完成签到,获得积分10
5秒前
黑猫黑猫完成签到,获得积分10
5秒前
lyj发布了新的文献求助10
5秒前
5秒前
李梦晓发布了新的文献求助10
6秒前
6秒前
6秒前
7秒前
和平发展发布了新的文献求助200
7秒前
漫漫完成签到 ,获得积分10
7秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1500
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
Analyses de reconnaissances de dettes passées devant les échevins d'Ypres (1249-1291) 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8159929
求助须知:如何正确求助?哪些是违规求助? 9555266
关于积分的说明 21726335
捐赠科研通 7749807
什么是DOI,文献DOI怎么找? 3427310
关于科研通互助平台的介绍 2552391
邀请新用户注册赠送积分活动 2471654