Image-Based Subtype Classification for Glioblastoma Using Deep Learning: Prognostic Significance and Biologic Relevance

PURPOSE To apply deep learning algorithms to histopathology images, construct image-based subtypes independent of known clinical and molecular classifications for glioblastoma, and produce novel insights into molecular and immune characteristics of the glioblastoma tumor microenvironment. MATERIALS AND METHODS Using whole-slide hematoxylin and eosin images from 214 patients with glioblastoma in The Cancer Genome Atlas (TCGA), a fine-tuned convolutional neural network model extracted deep learning features. Biclustering was used to identify subtypes and image feature modules. Prognostic value of image subtypes was assessed via Cox regression on survival outcomes and validated with 189 samples from the Clinical Proteomic Tumor Analysis Consortium (CPTAC) data set. Morphological, molecular, and immune characteristics of glioblastoma image subtypes were analyzed. RESULTS Four distinct subtypes and modules (imClust1-4) were identified for the TCGA patients with glioblastoma on the basis of the image feature data. The glioblastoma image subtypes were significantly associated with overall survival (OS; P = .028) and progression-free survival ( P = .003). Apparent association was also observed for disease-specific survival ( P = .096). imClust2 had the best prognosis for all three survival end points (eg, after 25 months, imClust2 had >7% surviving patients than the other subtypes). Examination of OS in the external validation using the unseen CPTAC data set showed consistent patterns. Multivariable Cox analyses confirmed that the image subtypes carry unique prognostic information independent of known clinical and molecular predictors. Molecular and immune profiling revealed distinct immune compositions of the tumor microenvironment in different image subtypes and may provide biologic explanations for the patterns in patients' outcomes. CONCLUSION Our image-based subtype classification on the basis of deep learning models is a novel tool to refine risk stratification in cancers. The image subtypes detected for glioblastoma represent a promising prognostic biomarker with distinct molecular and immune characteristics and may facilitate developing novel, individualized immunotherapies for glioblastoma.