计算机视觉
计算机科学
目标检测
人工智能
传感器融合
融合
对象(语法)
图像融合
遥感
雷达跟踪器
迭代重建
雷达探测
特征提取
噪音(视频)
可视化
图像分割
图像配准
图像处理
作者
Fei Cai,Zhong Qu,Xuehui Yin,Yuhong Pan
标识
DOI:10.1109/tgrs.2026.3752829
摘要
Cross-modal fusion detection utilizing visible (RGB) and infrared (IR) images has emerged as a promising solution for unmanned aerial vehicle (UAV) perception, especially in complex or low-light environments. To alleviate the adverse effects of residual cross-modal feature misalignment, enhance multi-scale representation, and the reduce computational overhead of fusion, this paper proposes a novel collaboration cross-modal fusion (CCMFusion) framework that integrates three key components. Specifically, the Dual-Domain Enhancement (DDE) module employs separate enhancement branches to improve feature discriminability along the channel and spatial dimensions respectively, thereby highlighting object features while effectively suppressing background noise. The Cross-Modal Interaction Fusion (CIF) module integrates spatially aligned gated interaction and frequency-aligned guidance methods to align and exchange complementary information across different modalities, thereby capturing modality-specific cues and bridging semantic gaps. The Cross-Reconstruction and Fusion (CRF) module further refines fused features via a reconstruction-based learning paradigm, combining a cross-modal guided reconstruction loss to preserve both shared and unique characteristics with a frequency-aware pooling strategy for global-local context integration. Extensive experiments on the DroneVehicle and FLIR datasets demonstrate that our method achieves state-of-the-art performance, with anmAP50of 82.9% and anmAPof 56.8% on the DroneVehicle, and anmAP50of 80.9% and anmAPof 45.8% on the FLIR, significantly surpassing all compared approaches. The proposed framework provides a promising foundation for multi-modal UAV perception and lays a solid foundation for future research, while practical edge deployment still requires further lightweight optimization. https://github.com/Caifei123/.
科研通智能强力驱动
Strongly Powered by AbleSci AI