Lung Cancer Screening Classification by Sequential Multi-Instance Learning (SMILE) Framework with Multiple CT Scans

Lung cancer screening with computed tomography (CT) scans can effectively improve the survival rate through the early detection of lung cancer, which typically identified in the form of pulmonary nodules. Multiple sequential CT images are helpful to determine nodule malignancy and play a significant role to detect lung cancers. It is crucial to develop effective lung cancer classification algorithms to achieve accurate results from multiple images without nodule location annotations, which can free radiologists from the burden of labeling nodule locations before predicting malignancy. In this study, we proposed the sequential multi-instance learning (SMILE) framework to predict high-risk lung cancer patients with multiple CT scans. SMILE included two steps. The first step was nodule instance generation. We employed the nodule detection algorithm with image category transformation to identify nodule instance locations within the entire lung images. The second step was nodule malignancy prediction. Models were supervised by patient-level annotations, without the exact locations of nodules.We embedded multi-instance learning with temporal feature extraction into a fusion framework, which effectively promoted the classification performance. SMILE was evaluated by five-fold cross-validation on a 925-patient dataset (182 malignant, 743 benign). Every patient had three CT scans, of which the interval period was about one year. Experimental results showed the potential of SMILE to free radiologists from labeling nodule locations. The source code will be available at https://github.com/wyzhao27/SMILE.