ClusterNet: a clustering distributed prior embedded detection network for early‐stage esophageal squamous cell carcinoma diagnosis

Early and accurate diagnosis of esophageal squamous cell carcinoma (ESCC) is important for reducing mortality. Analyzing intrapapillary capillary loops' (IPCLs) patterns on magnification endoscopy with narrow band imaging (ME-NBI) has been demonstrated effective in the diagnosis of early-stage ESCC. However, even experienced endoscopists may face difficulty in finding and classifying countless IPCLs on ME-NBI.We propose a novel clustering prior embedded detection network: ClusterNet. ClusterNet is capable of analyzing the distribution of IPCLs on ME-NBI automatically and enables endoscopists to overview multiple types of visualization. With ClusterNet assisting, endoscopists may observe ME-NBI images more efficiently, thus they may also predict the pathology and make medical decisions more easily.We propose the first large-scale ME-NBI dataset with fine-grained annotations by consensus of expert endoscopists. The dataset is splitted into a training set and an independent testing set based on patients. With two strategies for embedding, ClusterNet can automatically take the clustering effect into consideration. Prior to this work, none of the existing approaches take the clustering effect, which is rather important in classifying the IPCLs, into account.ClusterNet achieves an average precision of 81.2% and an average recall of 90.0% for the detection of IPCLs patterns on each patient of the independent testing set. We also compare ClusterNet with other state-of-the-art detection approaches. The performance of ClusterNet with embedding strategies is consistently superior to that of other approaches in terms of average precision, recall and F2-Score.Experiments demonstrate that our proposed method is able to detect almost all the IPCLs patterns on ME-NBI and classify them according to the Japanese Endoscopic Society (JES) classification accurately.