融合机制
计算机科学
稳健性(进化)
RGB颜色模型
人工智能
计算机视觉
融合
水准点(测量)
目标检测
模式识别(心理学)
脂质双层融合
语言学
大地测量学
化学
哲学
生物化学
地理
基因
作者
Wassim El Ahmar,Yahya Massoud,Dhanvin Kolhatkar,Hamzah AlGhamdi,Mohammad Alja’afreh,Robert Laganière,Riad Ibrahim Hammoud
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2023-06-01
卷期号:: 365-374
被引量:33
标识
DOI:10.1109/cvprw59228.2023.00042
摘要
Thermal imaging has seen rapid development in the last few years due to its robustness in different weather and lighting conditions and its reduced production cost. In this paper, we study the performance of different RGB-Thermal fusion methods in the task of object detection, and introduce a new RGB-Thermal fusion approach that enhances the performance by up to 9% using a sigmoid-activated gating mechanism for early fusion. We conduct our experiments on an enhanced version of the City Scene RGB-Thermal MOT Dataset where we register the RGB and corresponding thermal images in order to conduct fusion experiments. Finally, we benchmark the speed of our proposed fusion method and show that it adds negligible overhead to the model processing time. Our work would be useful for autonomous systems and any multi-model machine vision system. The improved version of the dataset, our trained models, and source code are available at https://github.com/wassimea/rgb-thermalfusion.
科研通智能强力驱动
Strongly Powered by AbleSci AI