计算机科学
稳健性(进化)
人工智能
模式识别(心理学)
预处理器
卷积神经网络
特征提取
解码方法
脑-机接口
黎曼流形
算法
数学
心理学
脑电图
数学分析
生物化学
化学
精神科
基因
作者
Xingfu Wang,Wenjie Yang,Wenxia Qi,Yu Wang,Xiaojun Ma,Wei Wang
出处
期刊:Neural Networks
[Elsevier BV]
日期:2024-06-26
卷期号:178: 106471-106471
被引量:25
标识
DOI:10.1016/j.neunet.2024.106471
摘要
Brain-computer interfaces (BCIs), representing a transformative form of human–computer interaction, empower users to interact directly with external environments through brain signals. In response to the demands for high accuracy, robustness, and end-to-end capabilities within BCIs based on motor imagery (MI), this paper introduces STaRNet, a novel model that integrates multi-scale spatio-temporal convolutional neural networks (CNNs) with Riemannian geometry. Initially, STaRNet integrates a multi-scale spatio-temporal feature extraction module that captures both global and local features, facilitating the construction of Riemannian manifolds from these comprehensive spatio-temporal features. Subsequently, a matrix logarithm operation transforms the manifold-based features into the tangent space, followed by a dense layer for classification. Without preprocessing, STaRNet surpasses state-of-the-art (SOTA) models by achieving an average decoding accuracy of 83.29% and a kappa value of 0.777 on the BCI Competition IV 2a dataset, and 95.45% accuracy with a kappa value of 0.939 on the High Gamma Dataset. Additionally, a comparative analysis between STaRNet and several SOTA models, focusing on the most challenging subjects from both datasets, highlights exceptional robustness of STaRNet. Finally, the visualizations of learned frequency bands demonstrate that temporal convolutions have learned MI-related frequency bands, and the t-SNE analyses of features across multiple layers of STaRNet exhibit strong feature extraction capabilities. We believe that the accurate, robust, and end-to-end capabilities of the STaRNet will facilitate the advancement of BCIs.
科研通智能强力驱动
Strongly Powered by AbleSci AI