计算机科学
人工智能
面部表情
模态(人机交互)
卷积神经网络
模式识别(心理学)
局部二进制模式
计算机视觉
面部表情识别
面部识别系统
图像(数学)
直方图
作者
Rongrong Ni,Biao Yang,Xu Zhou,Angelo Cangelosi,Xiaofeng Liu
出处
期刊:IEEE Transactions on Cognitive and Developmental Systems
[Institute of Electrical and Electronics Engineers]
日期:2022-02-09
卷期号:15 (1): 175-185
被引量:43
标识
DOI:10.1109/tcds.2022.3150019
摘要
Facial expressions are generally recognized based on handcrafted and deep-learning-based features extracted from RGB facial images. However, such recognition methods suffer from illumination/pose variations. In particular, they fail to recognize these expressions with weak emotion intensities. In this work, we propose a cross-modality attention-based convolutional neural network (CM-CNN) for facial expression recognition. We extract expression-related features from complementary facial images (gray-scale, local binary pattern, and depth images) to handle the illumination/pose variations and to capture appearance details that describe expressions with weak emotion intensities. Rather than directly concatenating the complementary features, we propose a novel cross-modality attention fusion network to enhance spatial correlations between any two types of facial images. Finally, the CM-CNN is optimized with an improved focal loss, which pays more attention to facial expressions with weak emotion intensities. The average classification accuracies on VT-KFER, BU-3DFE(P1), BU-3DFE(P2), and Bosphorus are 93.86%, 88.91%, 87.28%, and 85.16%, respectively. Evaluations on these databases demonstrate that our approach is competitive to state-of-the-art algorithms.
科研通智能强力驱动
Strongly Powered by AbleSci AI