稳健性(进化)
计算机科学
人工智能
恶劣天气
计算机视觉
目标检测
传感器融合
点云
激光雷达
钥匙(锁)
变更检测
降噪
对象(语法)
融合
数据挖掘
噪音(视频)
机器人学
图像融合
机器学习
遥感
云计算
机器人
基于对象
作者
Zhijian He,Feifei Liu,Yuwei Li,Zhanpeng Luo,Jintao Cheng,Xieyuanli Chen,Xiaoyu Tang
标识
DOI:10.1109/lra.2026.3692085
摘要
Multi-modal 3D object detection is important for reliable perception in robotics and autonomous driving. However, its effectiveness remains limited under adverse weather conditions due to weather-induced distortions and misalignment between different data modalities. In this work, we propose DiffFusion, a novel framework designed to enhance robustness in challenging weather through diffusion-based restoration and adaptive cross-modal fusion. Our key insight is that diffusion models possess strong capabilities for denoising and generating data that can adapt to various weather conditions. Building on this, DiffFusion introduces Diffusion-IR restoring images degraded by weather effects and Point Cloud Restoration (PCR) compensating for corrupted LiDAR data using image object cues. To tackle misalignments between two modalities, we develop Bidirectional Adaptive Fusion and Alignment Module (BAFAM). It enables dynamic multi-modal fusion and bidirectional bird's-eye view (BEV) alignment to maintain consistent spatial correspondence. Extensive experiments on three public datasets show that DiffFusion achieves state-of-the-art robustness under adverse weather while preserving strong clean-data performance. Zero-shot results on the real-world DENSE dataset further validate its generalization. The implementation of our DiffFusion has been released athttps://github.com/SCNU-RISLAB/DiffFusion.
科研通智能强力驱动
Strongly Powered by AbleSci AI