A radiomics-incorporated deep ensemble learning model for multi-parametric MRI-based glioma segmentation

Objective.To develop a deep ensemble learning (DEL) model with radiomics spatial encoding execution for improved glioma segmentation accuracy using multi-parametric magnetic resonance imaging (mp-MRI).Approach.This model was developed using 369 glioma patients with a four-modality mp-MRI protocol: T1, contrast-enhanced T1 (T1-Ce), T2, and FLAIR. In each modality volume, a 3D sliding kernel was implemented across the brain to capture image heterogeneity: 56 radiomic features were extracted within the kernel, resulting in a fourth-order tensor. Each radiomic feature can then be encoded as a 3D image volume, namely a radiomic feature map (RFM). For each patient, all RFMs extracted from all four modalities were processed using principal component analysis for dimension reduction, and the first four principal components (PCs) were selected. Next, a DEL model comprised of four U-Net sub-models was trained for the segmentation of a region-of-interest: each sub-model utilizes the mp-MRI and one of the four PCs as a five-channel input for 2D execution. Last, four softmax probability results given by the DEL model were superimposed and binarized using Otsu's method as the segmentation results. Three DEL models were trained to segment the enhancing tumor (ET), tumor core (TC), and whole tumor (WT), respectively. The segmentation results given by the proposed ensemble were compared to the mp-MRI-only U-Net results.Main Results.All three radiomics-incorporated DEL models were successfully implemented: compared to the mp-MRI-only U-net results, the dice coefficients of ET (0.777 → 0.817), TC (0.742 → 0.757), and WT (0.823 → 0.854) demonstrated improvement. The accuracy, sensitivity, and specificity results demonstrated similar patterns.Significance.The adopted radiomics spatial encoding execution enriches the image heterogeneity information that leads to the successful demonstration of the proposed DEL model, which offers a new tool for mp-MRI-based medical image segmentation.