Multimodal multiview bilinear graph convolutional network for mild cognitive impairment diagnosis

Abstract Mild cognitive impairment (MCI) is a significant predictor of the early progression of Alzheimer's disease, and it can be used as an important indicator of disease progression. However, many existing methods focus mainly on the image itself when processing brain imaging data, ignoring other non-imaging data (e.g., genetic, clinical information, etc.) that may have underlying disease information. In addition, imaging data acquired from different devices may exhibit varying degrees of heterogeneity, potentially resulting in numerous noisy connections during network construction. To address these challenges, this study proposes a Multimodal Multiview Bilinear Graph Convolution (MMBGCN) framework for disease risk prediction. Firstly, grey matter (GM), white matter (WM) and cerebrospinal fluid (CSF) features are extracted from magnetic resonance imaging (MRI), and non-imaging information is combined with the features extracted from MRI to construct a multimodal shared adjacency matrix. The shared adjacency matrix is then used to construct the multiview network so that the effect of potential disease information in the non-imaging information on the model can be considered. Finally, the MRI features extracted by the multiview network are weighted to reduce noise, and then the spatial pattern is restored by bilinear convolution. The features of the recovered spatial patterns are then combined with the genetic information for disease prediction. The proposed method is tested on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Extensive experiments demonstrate the superior performance of the proposed framework and its ability to outperform other related algorithms. The average classification accuracy in the binary classification task in this study is 89.6%. The experimental results demonstrate that the method proposed in this study facilitates research on MCI diagnosis using multimodal data.