Breast cancer classification based on convolutional neural network and image fusion approaches using ultrasound images

Deep learning and image processing are used to classify and segment breast tumor images, specifically in ultrasound (US) modalities, to support clinical decisions and improve healthcare quality. However, directly using US images can be challenging due to noise and diverse imaging modalities. In this study, we developed a three-step image processing scheme involving speckle noise filtering using a block-matching three-dimensional filtering technique, region of interest highlighting, and RGB fusion. This method enhances the generalization of deep-learning models and achieves better performance. We used a deep learning model (VGG19) to perform transfer learning on three datasets: BUSI (780 images), Dataset B (162 images), and KAIMRC (5693 images). When tested on the BUSI and KAIMRC datasets using a fivefold cross-validation mechanism, the model with the proposed preprocessing step performed better than without preprocessing for each dataset. The proposed image processing approach improves the performance of the breast cancer deep learning classification model. Multiple diverse datasets (private and public) were used to generalize the model for clinical application.