点云
人工智能
分割
计算机视觉
由运动产生的结构
云计算
计算机科学
运动(物理)
点(几何)
图像分割
图像(数学)
数学
几何学
操作系统
作者
Natthapol Saovana,Nobuyoshi Yabuki,Tomohiro Fukuda
标识
DOI:10.1016/j.autcon.2021.103804
摘要
Point cloud constantly gains popularity as a visualization tool in numerous fields including civil infrastructure scope. However, automatic point cloud classification for civil infrastructures such as piers is challenging due to untidy scenes, gigantic sizes, and image feature-rich objects that can generate many cloud points. Moreover, the lack of training point clouds and unrealistic synthetic data preventing deep learning to fully support the three-dimensional point cloud classification. This paper proposes Point cloud Classification based on image-based Instance Segmentation (PCIS), an automated point cloud classification based on two-dimensional digital images from a daily work basis. These images are processed into the pre-trained network in PCIS to generate mask images, which are later used to create three-dimensional masks based on the projection from the solved camera parameters. The cloud points located inside these masks are classified as the cloud point of interest. The experiment result showed that PCIS correctly classified the point cloud and achieved up to 0.96 F1-score from a one-class classification sample and 0.83 F1-score from a six-class classification sample in our validation process. Our study has proved that normal digital images can also be used to train deep learning to classify the three-dimensional point cloud. • A point cloud classification based on image-based instance segmentation is proposed. • The classification used an automated mask projection from construction site images. • The inputs are segmented images and camera poses from structure from motion. • The validation results showed that our system achieved an F1-score of up to 0.96.
科研通智能强力驱动
Strongly Powered by AbleSci AI