手势
解码方法
计算机科学
语音识别
非语言交际
脑-机接口
阿凡达
接口(物质)
限制
神经解码
自然(考古学)
编码(内存)
控制(管理)
皮质电图
心理学
节奏
语音处理
人机交互
手势识别
沟通
作者
Samantha Brosler,Jessie R. Liu,Alexander B. Silva,Irina P Hallinan,Cady M Kurtz-Miott,Jonah Dunkel Wilker,Adelyn Tu-Chan,Karunesh Ganguly,Edward F. Chang
标识
DOI:10.1038/s41593-026-02446-2
摘要
Stroke and neurodegenerative diseases can impair speech and nonverbal gestures, limiting natural communication. Brain-computer interfaces (BCIs) aim to restore these functions by translating neural activity into commands for external devices, although prior work has primarily focused on decoding speech or gestures in isolation. Here we show that neural signals recorded with a single high-density electrocorticography implant can support simultaneous decoding of speech and gestures in people with paralysis. We first show that isolated upper-limb and orofacial movements can be reliably decoded among three participants. Using parallel speech and gesture decoders, we then enabled participants to control a personalized virtual avatar by attempting speech and gestures simultaneously or in isolation. Training models on both isolated and simultaneous data improved performance across behavioral contexts. These findings demonstrate that one cortical implant can support multi-effector control and provide a step toward BCIs that enable more natural communication for people with paralysis.
科研通智能强力驱动
Strongly Powered by AbleSci AI