计算机科学
人工智能
计算机视觉
稳健性(进化)
惯性测量装置
条件随机场
单眼
水准点(测量)
RGB颜色模型
激光雷达
遥感
地理
地图学
生物化学
基因
化学
作者
Ukcheol Shin,Jinsun Park,In So Kweon
出处
期刊:Proceedings
[Institute of Electrical and Electronics Engineers]
日期:2023-06-01
卷期号:: 1043-1053
被引量:115
标识
DOI:10.1109/cvpr52729.2023.00107
摘要
Robust and accurate geometric understanding against adverse weather conditions is one top prioritized conditions to achieve a high-level autonomy of self-driving cars. However, autonomous driving algorithms relying on the visible spectrum band are easily impacted by weather and lighting conditions. A long-wave infrared camera, also known as a thermal imaging camera, is a potential rescue to achieve high-level robustness. However, the missing necessities are the well-established large-scale dataset and public benchmark results. To this end, in this paper, we first built a large-scale Multi-Spectral Stereo (MS2) dataset, including stereo RGB, stereo NIR, stereo thermal, and stereo LiDAR data along with GNSS/IMU information. The collected dataset provides about 195K synchronized data pairs taken from city, residential, road, campus, and suburban areas in the morning, daytime, and nighttime under clear-sky, cloudy, and rainy conditions. Secondly, we conduct an exhaustive validation process of monocular and stereo depth estimation algorithms designed on visible spectrum bands to benchmark their performance in the thermal image domain. Lastly, we propose a unified depth network that effectively bridges monocular depth and stereo depth tasks from a conditional random field approach perspective. Our dataset and source code are available at https://github.com/UkcheolShin/MS2-MultiSpectralStereoDataset.
科研通智能强力驱动
Strongly Powered by AbleSci AI