Sacroiliitis diagnosis based on interpretable features and multi-task learning

Abstract Objective. Sacroiliitis is an early pathological manifestation of ankylosing spondylitis (AS), and a positive sacroiliitis test on imaging may help clinical practitioners diagnose AS early. Deep learning based automatic diagnosis algorithms can deliver grading findings for sacroiliitis, however, it requires a large amount of data with precise labels to train the model and lacks grading features visualization. In this paper, we aimed to propose a radiomics and deep learning based deep feature visualization positive diagnosis algorithm for sacroiliitis on CT scans. Visualization of grading features can enhance clinical interpretability with visual grading features, which assist doctors in diagnosis and treatment more effectively. Approach. The region of interest (ROI) is identified by segmenting the sacroiliac joint (SIJ) 3D CT images using a combination of the U-net model and certain statistical approaches. Then, in addition to extracting spatial and frequency domain features from ROI according to the radiographic manifestations of sacroiliitis, the radiomics features have also been integrated into the proposed encoder module to obtain a powerful encoder and extract features effectively. Finally, a multi-task learning technique and five-class labels are utilized to help with performing positive tests to reduce discrepancies in the evaluation of several radiologists. Main results. On our private dataset, proposed methods have obtained an accuracy rate of 87.3%, which is 9.8% higher than the baseline and consistent with assessments made by qualified medical professionals. Significance. The results of the ablation experiment and interpreting analysis demonstrated that the proposed methods are applied in automatic CT scan sacroiliitis diagnosis due to their excellently interpretable and portable advantages.