Asphalt pavement crack detection based on infrared thermography and deep learning

The current intelligent detection of asphalt pavement cracks relies on visible images, which are ineffective in handling temporary shadow and reflection. In contrast, infrared images reflect thermal radiation intensity, making them suitable for crack detection by mitigating environmental interference. The GSkYOLOv5 method is proposed in this study for accurate crack detection in infrared images of asphalt pavement. Firstly, an infrared dataset consisting of 2400 images of asphalt pavement cracks was captured and produced, including three types of cracks – strip cracks, cross cracks and reticular cracks. And the imbalanced samples were balanced using generative adversarial networks. Secondly, GhostNet and Selective Kernel Networks were added to enhance crack information perception, and the SPPF module was replaced to improve feature learning for different scale cracks. Lastly, GSkYOLOv5 was tested with a self-built infrared dataset of asphalt pavement cracks. GSkYOLOv5 improved detection accuracy by 4.7% and recall rate by 1.3% compared to YOLOv5s, outperforming the other tested algorithms. This method can be combined with visible image-based crack detection for comprehensive intelligent detection of asphalt pavement cracks using dual lenses for visible and infrared images.