Cross-Modal Transfer Learning Methods for Alzheimer's Disease Diagnosis

In this paper we propose cross-modal transfer learning for Alzheimer's disease detection. We use positron emission tomography (PET) and magnetic resonance imaging (MRI) brain scans from ADNI to train convolutional neural networks (CNNs) on one modality and fine-tune it on the other modality. We start by showing that cross-modal transfer learning approaches outperform CNNs trained from scratch on a single modality. We then show that cross-modal transfer-learning also outperforms multimodal approaches using the same data.