An uncertainty-aware deep learning-based registration model for adaptive lung cancer radiotherapy

Abstract Objective . To develop a deep learning (DL) based probabilistic 3D deformable image registration framework for uncertainty-aware dose accumulation in magnetic resonance imaging-guided radiotherapy of lung cancer. Approach . We propose TransMorph-prob (TM-prob), a variational Bayesian model that predicts the voxel-wise mean and variance of dense displacement fields (DDFs). Two TM-prob models were trained on an internal computed tomography dataset (725 patients) and a low-field MR-linac dataset (102 patients), and benchmarked against Monte Carlo dropout TransMorph (TM-MCD) and DIRUncertainty with B-spline initialization (ASDIR) on the deformable image registration laboratory (DIRLAB) 4DCT dataset (10 patients, 3000 landmarks), and an annotated MR-linac dataset (16 patients, 107 image pairs, 227 landmarks) with target and seven organ-at-risk contours. Both datasets contained an additional 1239/13 289 algorithm-generated landmarks. Performance was evaluated using target registration error (TRE), Dice similarity coefficient (DSC), landmark- and voxel-wise expected calibration errors (LECE/ECE), and dose distributions derived from 2000 DDF samples per patient. Main results . On the DIRLAB dataset, TM-prob achieved a median TRE of 1.8 mm/2.8 mm on manual/algorithm-generated landmarks, versus 1.3 mm/2.4 mm for ASDIR and 2.1 mm/3.0 mm for TM-MCD. On the MRI dataset, TM-prob achieved the median TRE of 3.9 mm/2.6 mm and a mean DSC of 0.87, matching ASDIR (3.3 mm/2.7 mm, and DSC of 0.87) while outperforming TM-MCD (4.4 mm/2.9 mm, and 0.84). In uncertainty calibration, TM-prob achieved a LECE of 1.74 mm/0.30 mm on MRI manual/algorithm-generated landmarks versus 2.41 mm/0.56 mm for ASDIR and 6.65 mm/3.92 mm for TM-MCD, and an average contour ECE of 5.8% versus 7.0% and 21.2%. Two patients with indistinct gross tumor volume boundaries exhibited substantially wider target D95 distributions, demonstrating that calibrated DDF uncertainty translates into clinically relevant dose-coverage uncertainty. Significance . TM-prob is an end-to-end DL model, achieving fast, well-calibrated, uncertainty-aware registration for lung cancer patients, enabling reliable DDF uncertainty propagation into dose accumulation for clinical decision-making in online adaptive radiotherapy.