脑电图
计算机科学
语音识别
脑-机接口
解码方法
人工神经网络
延迟(音频)
人工智能
可视化
机器学习
模式识别(心理学)
神经科学
心理学
电信
作者
Peiwen Li,Siqi Cai,Enze Su,Longhan Xie
标识
DOI:10.1109/lsp.2021.3134563
摘要
Decoding auditory attention in a cocktail party from neural activities is crucial in the brain-computer interfaces (BCIs). Given that the speech-electroencephalography (EEG) relationships are informative about attentional focus, we propose a novel framework called the biologically inspired attention network (BIAnet) to capture the interactions between EEG and speech. With the neural attention mechanism, the BIAnet can model how each EEG frequency band is related to the subband envelopes of speech by dynamically assigning weights to individual frequency bands at run-time. Results show that the proposed BIAnet outperforms state-of-the-art AAD methods on two publicly available datasets. We also analyze how the BIAnet works and the frequency-specific interactions between EEG and speech signals through data visualization. Overall, the proposed BIAnet provides an accurate, low-latency, and interpretable AAD approach, which has the potential to be extended to general problems in BCIs.
科研通智能强力驱动
Strongly Powered by AbleSci AI