计算机科学
卷积神经网络
水准点(测量)
人工智能
特征(语言学)
特征提取
动作(物理)
模式识别(心理学)
机器学习
过程(计算)
代表(政治)
骨料(复合)
政治
量子力学
大地测量学
材料科学
物理
哲学
语言学
操作系统
地理
复合材料
法学
政治学
作者
Tianming Xie,Jing Tian,Lihong Ma
标识
DOI:10.1016/j.bspc.2022.103651
摘要
• We build a new benchmark handwashing action dataset. • We apply self-attention convolutional neural network for handwashing recognition. • The proposed approach is able to achieve more accurate recognition results. Automatic hand hygiene monitoring is an effective and necessary practice in healthcare. The main objective is to automate the quality control of the hand hygiene process by recognizing handwashing actions. This paper proposes a new computer vision-based hand hygiene monitoring approach, with the aim to recognize handwashing actions from the input videos. The proposed approach consists of the following three modules. First, in the feature extraction module , a backbone convolutional neural network (CNN) model (i.e., a ResNet model) is used to extract features from each frame of the input video. Second, in the feature aggregation module , the self-attention mechanism is introduced to form six masked self-attention blocks that are stacked to aggregate features from multiple frames. Third, in the feature classification module, the self-attentive aggregated feature representation is used for handwashing action recognition. The proposed approach outperforms a few state-of-the-art handwashing action recognition approaches. The proposed approach is able to perform effective and accurate handwashing action recognition for automatic hand hygiene monitoring, as verified by three benchmark datasets.
科研通智能强力驱动
Strongly Powered by AbleSci AI