ForestSemantic: a dataset for semantic learning of forest from close-range sensing

Information about trees in forest is essential for the assessment of the quantity and the quality of forest ecosystem services. Recently, Deep Learning (DL) methods were regarded as a new cornerstone of algorithm development. Semantic annotations of 3D forest scenes are fundamental for DL algorithm developments. Its necessity has become more urgent as DL is data-driven and requires large amount of training and verification data. However, high-quality annotated forest datasets are still rare, as trees comprise of irregular structures and small components and pose significantly greater challenges even for manual recognition in comparison with artificial objects. This paper introduces a new open point cloud dataset ForestSemantic for forest semantic studies at both individual tree- and plot-levels. The dataset is based on TLS data with different forest conditions. Manual annotation was carried out to a level of detail 4, i.e., until all visible branches. Semantic information is provided at both plot- and tree-levels, as well as at both object- and point-level. Thus, the dataset supports both instance and semantic studies, such as objects detection and segmentation and classification at both tree- and plot-levels. In addition, the dataset also provides comprehensive structural tree traits as reference for further methodological development and verification. This dataset is expected to facilitate research in new dimensions and benchmarks of different systems and solutions. A few examples are demonstrated in this paper to unveil the potentials of the dataset for various applications. In future, it is also possible to simulate other types of point clouds by down-sampling and deforming, and to transfer the dataset for training and verification of other close-range sensing systems, as the dataset was generated using TLS point clouds that represent the highest spatial resolution and geometric accuracy in all close-range point clouds.