AUTOMATIC SEGMENTATION AND INDICATORS MEASUREMENT OF THE VOCAL FOLDS AND GLOTTAL IN LARYNGEAL ENDOSCOPY IMAGES USING MASK R-CNN

In present clinic practice of otolaryngology, otolaryngologists utilized laryngoscopy to diagnose the larynx lesion of patients preliminarily. Nevertheless, it was challenging for otolaryngologists to interpret the detailed information from laryngoscopy videos comprehensively. In this paper, we proposed Mask R-CNN deep learning algorithm to segment the regions of the vocal folds and glottal from laryngoscopy videos, and self-built algorithm to calculate measured indicators including the length and curvature of vocal folds, the angle of glottal, the area of vocal folds and glottal, and the triangle type composed of vocal folds and glottal. Moreover, in order to provide otolaryngologists critical and immediate medical information during diagnosis, we also provided visualized information, which is labeled on the laryngoscopy images to meet all the needs in clinical practice. From the result of this research, the precision of segmentation has reached a high rate of 90.4% on average. It shows that the model not only achieves great performance in segmentation, but also further proved the indicators are accurate enough to be considered in practical diagnosis. In the future, it is possible for the proposed model to be applied in more kinds of laryngoscopy analyses for more comprehensive diagnosis, which would make a positive influence toward the clinical practice of otolaryngology.