Classification of intrinsic subtypes and histological grade for breast cancers by multimodality images

Success of breast cancer treatment is subject to various factors, including cancer stage and cancer grade. The best treatment is selected based on the characteristic of cancer. It is desirable to predict the cancer characteristics and prognostic factors accurately and promptly by diagnostic imaging. The purpose of the study is to investigate the use of multimodality diagnostic images in predicting breast cancer subtypes to assist diagnosis and treatment planning. In this study, we classify lesions into molecular subtypes and simultaneously predict histological grades and invasiveness of the cancers by mammography and breast ultrasound images. Models with different architectures including single input and multi-input layers with single head and multiple head models are compared. The results indicate that use of multimodality images is more predictive than using single modalities. The automatic subtype classification using multimodality images may support a prompt treatment planning and proper patient care.