手势
计算机科学
计算机视觉
接口(物质)
信号(编程语言)
手势识别
人工智能
钥匙(锁)
运动(物理)
加速度计
信号处理
数字信号处理
用户界面
虚拟机
自由度(物理和化学)
数据采集
人机交互
同时定位和映射
实时计算
运动捕捉
虚拟现实
加速度
移动设备
作者
Pu‐En Zhou,Jiagui Li,Wei‐Ye He,Zhong‐Kun Wang,Jia‐Wei Zhang,Yuan‐Zheng Zhang,Zi‐Fa Wang,Fang‐Qi Chen,Hai‐Wu Zheng
出处
期刊:
日期:2025-12-01
卷期号:1 (4)
被引量:14
摘要
ABSTRACT As humanity advances into the virtual world and the era of mixed reality, high‐fidelity gesture mapping has become a key interface connecting the physical world and the digital space. However, the existing solutions are limited by the bottlenecks of active sensors in terms of information richness and structure and have insufficient precise reconstruction capabilities for high‐degree‐of‐freedom hand movements, making it difficult to achieve a natural and seamless interaction experience. Here, a dynamic gesture mapping system (DGMS) has been developed, which combines a lightweight and efficient hand motion signal acquisition device (HSAD) with an efficient signal processing algorithm (SPA). HSAD captures the motion information on 17° of freedom for the hand through sensor clusters and wirelessly transmits the data to the signal processing platform. On this platform, SPA converts electrical signals into bending angle information, with an error below 1°. DGMS synchronously and accurately maps the hand movement information output by SPA to the virtual environment, achieving real‐time interaction with objects in the virtual space. This study has for the first time achieved such a high‐degree‐of‐freedom and high‐fidelity gesture mapping using passive sensors and explored the application of gesture mapping in the virtual–real coexisting intelligent enhancement platform, offering a novel technical route for digital twin applications.
科研通智能强力驱动
Strongly Powered by AbleSci AI