Variability in Manual Segmentation of Temporal Bone Structures in Cone Beam CT Images

Purpose Manual segmentation of anatomical structures is the accepted “gold standard” for labeling structures in clinical images. However, the variability in manual segmentation of temporal bone structures in CBCT images of the temporal bone has not been systematically evaluated using multiple reviewers. Therefore, we evaluated the intravariability and intervariability of manual segmentation of inner ear structures in CBCT images of the temporal bone. Methods Preoperative CBCTs scans of the inner ear were obtained from 10 patients who had undergone cochlear implant surgery. The cochlea, facial nerve, chorda tympani, mid-modiolar (MM) axis, and round window (RW) were manually segmented by five reviewers in two separate sessions that were at least 1 month apart. Interreviewer and intrareviewer variabilities were assessed using the Dice coefficient (DICE), volume similarity, mean Hausdorff Distance metrics, and visual review. Results Manual segmentation of the cochlea was the most consistent within and across reviewers with a mean DICE of 0.91 (SD = 0.02) and 0.89 (SD = 0.01) respectively, followed by the facial nerve with a mean DICE of 0.83 (SD = 0.02) and 0.80 (SD = 0.03), respectively. The chorda tympani had the greatest amount of reviewer variability due to its thin size, and the location of the centroid of the RW and the MM axis were also quite variable between and within reviewers. Conclusions We observed significant variability in manual segmentation of some of the temporal bone structures across reviewers. This variability needs to be considered when interpreting the results in studies using one manual reviewer.