Assessment of Helicobacter pylori infection by deep learning based on endoscopic videos in real time

Background and aims Endoscopic assessment of Helicobacter pylori infection is a simple and effective method. Here, we aimed to develop a deep learning-based system named Intelligent Detection Endoscopic Assistant-Helicobacter pylori (IDEA-HP) to assess H. pylori infection by using endoscopic videos in real time. Methods Endoscopic data were retrospectively obtained from Zhejiang Cancer Hospital (ZJCH) for the development, validation, and testing of the system. Stored videos from ZJCH were used for assessing and comparing the performance of IDEA-HP with that of endoscopists. Prospective consecutive patients undergoing esophagogastroduodenoscopy were enrolled to assess the applicability of clinical practice. The urea breath test was used as the gold standard for diagnosing H. pylori infection. Results In 100 videos, IDEA-HP achieved a similar overall accuracy of assessing H. pylori infection to that of experts (84.0% vs. 83.6% [P = 0.729]). Nevertheless, the diagnostic accuracy (84.0% vs. 74.0% [P<0.001]) and sensitivity (82.0% vs. 67.2% [P<0.001]) of IDEA-HP were significantly higher than those of the beginners. In 191 prospective consecutive patients, IDEA-HP achieved accuracy, sensitivity, and specificity of 85.3% (95% CI: 79.0%–89.3%), 83.3% (95% CI: 72.8%–90.5%), and 85.8% (95% CI: 77.7%–91.4%), respectively. Conclusions Our results show that IDEA-HP has great potential for assisting endoscopists in assessing H. pylori infection status during actual clinical work.