Multi-Modal 3D Object Detection in Autonomous Driving: A Survey

保险丝(电气) 计算机科学 传感器融合 情态动词 人工智能 任务(项目管理) 目标检测 计算机视觉 一套 测距 分割 工程类 系统工程 历史 电气工程 考古 化学 高分子化学 电信
作者
Yingjie Wang,Qiuyu Mao,Hanqi Zhu,Jiajun Deng,Yu Zhang,Jianmin Ji,Houqiang Li,Yanyong Zhang
出处
期刊:International Journal of Computer Vision [Springer Science+Business Media]
卷期号:131 (8): 2122-2152 被引量:275
标识
DOI:10.1007/s11263-023-01784-z
摘要

The past decade has witnessed the rapid development of autonomous driving systems. However, it remains a daunting task to achieve full autonomy, especially when it comes to understanding the ever-changing, complex driving scenes. To alleviate the difficulty of perception, self-driving vehicles are usually equipped with a suite of sensors (e.g., cameras, LiDARs), hoping to capture the scenes with overlapping perspectives to minimize blind spots. Fusing these data streams and exploiting their complementary properties is thus rapidly becoming the current trend. Nonetheless, combining data that are captured by different sensors with drastically different ranging/ima-ging mechanisms is not a trivial task; instead, many factors need to be considered and optimized. If not careful, data from one sensor may act as noises to data from another sensor, with even poorer results by fusing them. Thus far, there has been no in-depth guidelines to designing the multi-modal fusion based 3D perception algorithms. To fill in the void and motivate further investigation, this survey conducts a thorough study of tens of recent deep learning based multi-modal 3D detection networks (with a special emphasis on LiDAR-camera fusion), focusing on their fusion stage (i.e., when to fuse), fusion inputs (i.e., what to fuse), and fusion granularity (i.e., how to fuse). These important design choices play a critical role in determining the performance of the fusion algorithm. In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating multi-modal 3D object detection algorithms. Then we present a review of multi-modal fusion based 3D detection networks, taking a close look at their fusion stage, fusion input and fusion granularity, and how these design choices evolve with time and technology. After the review, we discuss open challenges as well as possible solutions. We hope that this survey can help researchers to get familiar with the field and embark on investigations in the area of multi-modal 3D object detection.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
molihuakai的应助被科研通管家采纳,获得10
刚刚
思源的应助被MH采纳,获得10
刚刚
大个的应助被科研通管家采纳,获得10
1秒前
彭于晏的应助被周一采纳,获得30
1秒前
Hello的应助被科研通管家采纳,获得10
1秒前
完美世界的应助被周一采纳,获得10
1秒前
英姑的应助被科研通管家采纳,获得10
1秒前
桐桐的应助被周一采纳,获得10
1秒前
1秒前
脑洞疼的应助被周一采纳,获得10
1秒前
丘比特的应助被科研通管家采纳,获得20
1秒前
大模型的应助被周一采纳,获得10
1秒前
今后的应助被科研通管家采纳,获得10
1秒前
可爱的函函的应助被周一采纳,获得200
1秒前
情怀的应助被周一采纳,获得10
1秒前
1秒前
乐乐的应助被周一采纳,获得10
1秒前
赘婿的应助被科研通管家采纳,获得10
1秒前
小竹笋完成签到,获得积分10
1秒前
1秒前
追风少年的应助被科研通管家采纳,获得30
1秒前
1秒前
领导范儿的应助被周一采纳,获得10
1秒前
香蕉觅云的应助被科研通管家采纳,获得10
2秒前
2秒前
2秒前
2秒前
zzz完成签到 ,获得积分10
2秒前
程文抒完成签到,获得积分10
3秒前
神勇的又槐完成签到,获得积分10
4秒前
木木发布了新的文献求助10
4秒前
4秒前
马叉完成签到,获得积分20
5秒前
玩家666发布了新的文献求助10
5秒前
5秒前
珺儿完成签到,获得积分10
5秒前
5秒前
6秒前
科研通AI6.2的应助被洁洁采纳,获得10
7秒前
7秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Handbook of Sport Coaching Research 1000
Orthognathic Surgery - 2 Volume Set 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8193599
求助须知:如何正确求助?哪些是违规求助? 9579723
关于积分的说明 21867157
捐赠科研通 7793198
什么是DOI,文献DOI怎么找? 3437314
关于科研通互助平台的介绍 2560725
邀请新用户注册赠送积分活动 2484193