Brain tumor image segmentation based on prior knowledge via transformer

Abstract Many researchers use AI to improve the accuracy of early diagnostic techniques. However, as a result of the tumor's uneven shape, fuzzy borders and too few data, existing tumor segmentation methods do not propose accurate segmentation results. We innovative introduces the prior knowledge learned to filter the noise information and guide the final network to generate a more accurate segmentation model. First, we introduce a classification network with an attention block to highlight the potential location of the brain tumor and also obtain the rough diagnosis result as the prior knowledge. Second, we provide a novel image fusion network consisting of a transformer with cross attention to merge tumor localization information with brain MRI images. Third, we propose a novel multilayer transformer experience information fusion network to combine the classic U‐Net network to handle the guiding of prior knowledge. The higher performance of the suggested method is demonstrated by comparison with contemporary methods.