DA-Res2UNet: Explainable blood vessel segmentation from fundus images

Blood vessel segmentation in fundus images is necessary for the diagnosis of ophthalmic diseases. In recent years, deep learning has achieved eminent performance in blood vessel segmentation, and there still exist challenges to reduce misidentification and improve microvascular segmentation accuracy. One reason is that traditional Convolutional Neural Network (CNN) can not effectively extract multiscale information and discard the unnecessary information. Another reason is we can’t explain why some blood vessels fail to be identified. On the one hand, this paper proposes a Dual Attention Res2UNet (DA-Res2UNet) model. The DA-Res2UNet model uses Res2block rather than CNN to obtain more multiscale information and adds Dual Attention to help the model focus on important information and discard unnecessary information. On the other hand, the explainable method based on a pre-trained fundus image generator is adopted to explore how the model identifies blood vessels. We deduce several special situations that lead to the misidentification based on the model’s explanation and adjust the dataset for these special cases. The adjusted datasets significantly reduce the misidentification in the CHASE_DB1 dataset. Finally, the model trained by the adjusted datasets achieves the state-of-the-art F1-score of 81.88%, 82.77%, and 83.96% on the CHASE_DB1, DRIVE and STARE datasets, respectively.