计算机科学
脑电图
人工智能
稳健性(进化)
模式识别(心理学)
特征学习
变压器
卷积神经网络
机器学习
深度学习
生物化学
量子力学
基因
精神科
物理
电压
化学
心理学
作者
Zhiwei Deng,Chang Li,Rencheng Song,Xiang Liu,Ruobing Qian,Rencheng Song
标识
DOI:10.1016/j.engappai.2023.106401
摘要
Feature embeddings derived from continuous mapping using the deep neural network are critical for accurate classification in seizure prediction tasks. However, the embeddings of individual electroencephalogram (EEG) samples learned through modern decoding algorithms may contain ambiguous and noisy representations, owing to the susceptibility of weak EEG signals to interference from other signals unrelated to EEG activity. To address this issue, we consider data uncertainty learning (DUL), which models each representation of the EEG sample as a Gaussian or Laplacian distribution to mitigate potential noise interference and enhance model robustness. Moreover, data uncertainty learning for transformer architectures is seldom explored due to the limitation of multi-headed self-attention mechanisms in processing local features and the vanishing of potential top-level gradients. In this study, we introduce a novel hybrid visual transformer (HViT) architecture, which enhances the processing capability of localized features in the transformer through the convolutional neural network (CNN). Concretely, we learn the mean of the distribution using the HViT, and an additional branch is designed to capture the variance of the Gaussian distribution or the scale of the Laplacian distribution during training. We also propose a learnable manner to learn constraint coefficients in the loss functions for different patients, resulting in better optimization across patients. In addition, we introduce a simple uncertainty quantification method for each alarm of the k-of-n continuous prediction strategy by utilizing the continuity of the EEG signals. Empirical evaluations on two publicly available epilepsy datasets demonstrate the superiority of our DUL method and the effectiveness of the proposed HViT architecture.
科研通智能强力驱动
Strongly Powered by AbleSci AI