Deep learning-extracted CT imaging phenotypes predict response to total resection in colorectal cancer

Background Deep learning surpasses many traditional methods for many vision tasks, allowing the transformation of hierarchical features into more abstract, high-level features. Purpose To evaluate the prognostic value of preoperative computed tomography (CT) image texture features and deep learning self-learning high-throughput features (SHF) on postoperative overall survival in the treatment of patients with colorectal cancer (CRC). Material and Methods The dataset consisted of 810 enrolled patients with CRC confirmed from 10 November 2011 to 10 February 2018. In contrast, SHF extracted by deep learning with multi-task training mechanism and texture features were extracted from the CT with tumor volume region of interest, respectively, and combined with the Cox proportional hazard (CoxPH) model for initial validation to obtain a RAD score to classify patients into high- and low-risk groups. The SHF stability was further validated in combination with Neural Multi-Task Logistic Regression (N-MTLR) model. The overall recognition ability and accuracy of CoxPH and N-MTLR model were evaluated by C-index and Integrated Brier Score (IBS). Results SHF had a more significant degree of differentiation than texture features. The result is (SHF vs. texture features: C-index: 0.884 vs. 0.611; IBS: 0.025 vs. 0.073) in the CoxPH model, and (SHF vs. texture features: C-index: 0.861 vs. 0.630; IBS: 0.024 vs. 0.065) in N-MTLR. Conclusion SHF is superior to texture features and has potential application for the preoperative prediction of the individualized treatment of CRC.