人工智能
计算机科学
目标检测
计算机视觉
特征(语言学)
异步通信
模式识别(心理学)
联想(心理学)
对象(语法)
数据关联
对象类检测
特征检测(计算机视觉)
特征提取
变更检测
作者
Hang Zhang,Wenquan Zhang,Ao Li
标识
DOI:10.1016/j.visinf.2026.100372
摘要
Multi-modal 3D object detection typically assumes strict temporal synchronization between cameras and LiDAR. However, sensor streams are often asynchronous in practice, causing cross-modal observations to correspond to different physical states of dynamic objects. Existing fusion methods either ignore this misalignment or rely on implicit warping, both of which degrade significantly under realistic temporal offsets. To address this challenge, we propose MADFA, a motion-aware framework for asynchronous multi-modal 3D detection. Specifically, we introduce Confidence-Adaptive Motion Bias (CAMB), a cross-attention mechanism whose spatial support is adaptively governed by a motion reliability score to handle unreliable motion cues. Furthermore, we derive an identifiability bound for cross-modal recoverability under asynchronous sensing, which directly guides the design of CAMB. In tandem, a self-supervised Motion Cue Reliability (MCR) score is formulated to jointly model LiDAR sparsity and image tracking consistency. Comprehensive experiments on nuScenes and Waymo under multiple asynchrony protocols demonstrate that MADFA consistently outperforms competitive baselines. Moreover, our framework exhibits graceful degradation as offsets increase, fully corroborating the theoretical recoverability condition.
科研通智能强力驱动
Strongly Powered by AbleSci AI