Survival Prediction of Stomach Cancer Using Expression Data and Deep Learning Models with Histopathological Image

Accurately predicting patient survival is essential for cancer treatment decision. However, the prognostic prediction model based on histopathological image of stomach cancer patients is still yet to be developed. We propose a deep learning-based model (MultiDeepCox-SC) that predicts overall survival in patients with stomach cancer by integrating histopathological images, clinical data, and gene expression data. The MultiDeepCox-SC not only automatedly selects patches with more information for survival prediction, without manual label for histopathological images, but also identifies genetic and clinical risk factors associated with survival in stomach cancer. The prognostic accuracy of the MultiDeepCox-SC (C-index=0.744) surpasses the result only based on histopathological image (C-index=0.660). The risk score of our model was still an independent predictor of survival outcome after adjustment for potential confounders, including pathologic stage, grade, age, race, and gender on the TCGA dataset (hazard ratio = 1.555, =3.53e-08) and the external test set (hazard ratio = 2.912, P=9.42e-4). Our fully automated online prognostic tool based on histopathological images, clinical data, and gene expression data could be utilized to improve pathologists' efficiency and accuracy (https://yu.life.sjtu.edu.cn/DeepCoxSC).