可穿戴计算机
手腕
运动学
功率(物理)
可穿戴技术
计算机科学
超低功耗
跟踪(教育)
超声波
电气工程
电子工程
声学
工程类
物理
医学
嵌入式系统
心理学
解剖
经典力学
量子力学
功率消耗
教育学
作者
Giusy Spacone,Sergei Vostrikov,Victor Kartsch,Simone Benatti,Luca Benini C,Andrea Cossettini
标识
DOI:10.1109/tbcas.2024.3465239
摘要
Ultrasound-based Hand Gesture Recognition has gained significant attention in recent years. While static gesture recognition has been extensively explored, only a few works have tackled the task of movement regression for real-time tracking, despite its importance for the development of natural and smooth interaction strategies. In this paper, we demonstrate the regression of 3 hand-wrist Degrees of Freedom (DoFs) using a lightweight, A-mode-based, truly wearable US armband featuring four transducers and WULPUS, an ultra-low-power acquisition device. We collect US data, synchronized with an optical motion capture system to establish a ground truth, from 5 subjects. We achieve state-of-the-art performance with an average root-mean-squared-error (RMSE) of $7.32^{\circ}$ $\pm$ $1.97^{\circ}$ and mean-absolute-error (MAE) of $5.31^{\circ}$ $\pm$ $1.42^{\circ}$. Additionally, we demonstrate, for the first time, robustness with respect to transducer repositioning between acquisition sessions, achieving an average RMSE value of $11.11^{\circ}$ $\pm$ $4.14^{\circ}$ and a MAE of $8.46^{\circ}$ $\pm$ $3.58^{\circ}$. Finally, we deploy our pipeline on a real-time low-power microcontroller, showcasing the first instance of multi-DoF regression based on A-mode US data on an embedded device, with a power consumption lower than $30 \mathrm{mW}$ and end-to-end latency of $\approx$ $80 \mathrm{ms}$.
科研通智能强力驱动
Strongly Powered by AbleSci AI