激光雷达
计算机科学
人工智能
计算机视觉
融合
变压器
模态(人机交互)
对象(语法)
遥感
物理
地理
电压
语言学
哲学
量子力学
作者
Ming Wei,Jiachen Li,Hyunmo Kang,Yalin Huang,Jun‐Guo Lu
标识
DOI:10.1016/j.neucom.2024.127527
摘要
The BEV-CFKT proposed in this paper leverages knowledge transfer through transformers for LiDAR-Camera fusion in the Bird's-Eye-View (BEV) space, aiming to achieve accurate and robust 3D object detection. BEV-CFKT comprises three main components, which include the generation of BEV features from images and point clouds, cross-modality interaction, and hybrid object queries using a monocular detection head. By unifying features from both point clouds and images into the BEV space, we simplify modal interaction, facilitate knowledge transfer, and extract richer structural and semantic information from multimodal data. This effectively enhances the network's performance. To further improve detection performance, BEV-CFKT incorporates a temporal fusion module. Additionally, a hybrid object queries module based on a monocular detection head accelerates the convergence of our model. We demonstrate the effectiveness of our approach through an extensive set of experiments.
科研通智能强力驱动
Strongly Powered by AbleSci AI