人工智能
计算机科学
插补(统计学)
模式识别(心理学)
卷积(计算机科学)
深度学习
缺少数据
医学影像学
学习迁移
生成对抗网络
机器学习
基本事实
卷积神经网络
特征提取
神经影像学
上下文图像分类
棱锥(几何)
生成模型
生成语法
正电子发射断层摄影术
样品(材料)
图像(数学)
作者
Xingyu Gao,Feng Shi,Dinggang G. Shen,Manhua Liu
标识
DOI:10.1109/jbhi.2021.3097721
摘要
With the advance of medical imaging technologies, multimodal images such as magnetic resonance images (MRI) and positron emission tomography (PET) can capture subtle structural and functional changes of brain, facilitating the diagnosis of brain diseases such as Alzheimer's disease (AD). In practice, multimodal images may be incomplete since PET is often missing due to high financial costs or availability. Most of the existing methods simply excluded subjects with missing data, which unfortunately reduced the sample size. In addition, how to extract and combine multimodal features is still challenging. To address these problems, we propose a deep learning framework to integrate a task-induced pyramid and attention generative adversarial network (TPA-GAN) with a pathwise transfer dense convolution network (PT-DCN) for imputation and classification of multimodal brain images. First, we propose a TPA-GAN to integrate pyramid convolution and attention module as well as disease classification task into GAN for generating the missing PET data with their MRI. Then, with the imputed multimodal images, we build a dense convolution network with pathwise transfer blocks to gradually learn and combine multimodal features for final disease classification. Experiments are performed on ADNI-1/2 datasets to evaluate our method, achieving superior performance in image imputation and brain disease diagnosis compared to state-of-the-art methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI