计算机科学
快照(计算机存储)
变压器
人工智能
人工神经网络
深度学习
机器学习
模式识别(心理学)
工程类
操作系统
电气工程
电压
作者
Jinlong Hu,Yangmin Huang,Yi Zhuo,Shoubin Dong
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2023-12-05
卷期号:: 3020-3028
被引量:1
标识
DOI:10.1109/bibm58861.2023.10385467
摘要
Deep learning methods have been applied for dynamic brain functional network analysis recently. However, they are usually restricted by the complex spatio-temporal dynamics and the limited labeled data. In this paper, we proposed a stacked Transformer neural network, namely BrainPST, to capture spatio-temporal patterns for dynamic brain functional network classification. BrainPST model integrated spatial and temporal information by stacking two Transformers: one for learning snapshot networks and the other for learning sequence of functional connections. Unlike recent models, BrainPST was designed to pre-train the stacked Transformer network by leveraging unlabeled existing brain imaging data. A pre-training framework with designed pre-training strategies was proposed to learn general spatio-temporal representations from the unlabeled brain networks, and to fine-tune the pre-trained model in downstream tasks. BrainPST is a conceptually simple and effective model. The results of experiments showed the BrainPST model without pre-training achieved comparative performance with the recent models, and the pre-trained BrainPST obtained new state-of-the-art performance. The pre-trained BrainPST improved 3.92% of AUC compared with the model without pre-training.
科研通智能强力驱动
Strongly Powered by AbleSci AI