Toward Children's Empathy Ability Analysis: Joint Facial Expression Recognition and Intensity Estimation Using Label Distribution Learning

面部表情 表达式(计算机科学) 计算机科学 移情 人工智能 帧(网络) 卷积神经网络 模式识别(心理学) 强度(物理) 机器学习 语音识别 心理学 物理 精神科 量子力学 程序设计语言 电信
作者
Jingying Chen,Chen Guo,Ruyi Xu,Kun Zhang,Zongkai Yang,Honghai Liu
出处
期刊:IEEE Transactions on Industrial Informatics [Institute of Electrical and Electronics Engineers]
卷期号:18 (1): 16-25 被引量:58
标识
DOI:10.1109/tii.2021.3075989
摘要

Empathy ability is one of the most important social communication skills in early childhood development. To analyze the children's empathy ability, facial expression analysis (FEA) is an effective way due to its ability to understand children's emotional states. Previous works mainly focus on recognizing the facial expression categories yet fail to estimate expression intensity, the latter of which is more important for fine-grained emotion analysis. To this end, this article first proposes to analyze children's empathy ability with both the categories and the intensities of facial expressions. A novel FEA method based on intensity label distribution learning is presented, which aims to recognize expression categories and estimate their intensity levels in an end-to-end framework. First, the intensity label distribution is generated for each frame in the expression sequence using a linear interpolation estimation and a Gaussian function to address the lack of reasonable annotations for expression intensity. Then, the extended intensity label distribution is presented to automatically encode the expression intensity in a multidimensional expression space, which aims to integrate the expression recognition and intensity estimation into a unified framework as well as boost the expression recognition performance by suppressing the variations in appearance caused by intensity and by emphasizing those variations among weak expressions. Finally, a Siamese-like convolutional neural network is presented to learn the expression model from a pair of frames that includes an expressive frame and its corresponding neutral frame using the extended intensity label distribution as the supervised information, thus effectively eliminating the expression-unrelated information's influence on FEA. Numerous experiments validate that the proposed method is promising in analysis of the differences in empathy ability between typically developing children and children with autism spectrum disorder.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
1秒前
赘婿的应助被蒋泓波采纳,获得10
1秒前
yx完成签到,获得积分10
1秒前
three发布了新的文献求助10
1秒前
1秒前
葭月十七完成签到,获得积分10
2秒前
zizi完成签到 ,获得积分20
2秒前
2秒前
热爱学习发布了新的文献求助10
3秒前
4秒前
独特的馒头完成签到,获得积分10
5秒前
张某发布了新的文献求助10
7秒前
在水一方ll完成签到,获得积分10
7秒前
e00ec发布了新的文献求助10
8秒前
田様的应助被小李采纳,获得10
8秒前
8秒前
开心鬼完成签到 ,获得积分20
8秒前
安详靖巧完成签到,获得积分10
9秒前
9秒前
9秒前
9秒前
LIUDAN完成签到,获得积分10
9秒前
迷你的以莲完成签到,获得积分10
9秒前
万能图书馆的应助被川西大王采纳,获得10
9秒前
9秒前
PP的应助被111采纳,获得30
10秒前
123完成签到,获得积分10
10秒前
嘿嘿发布了新的文献求助10
10秒前
10秒前
五花肉完成签到 ,获得积分10
10秒前
风中的醉香完成签到,获得积分10
11秒前
YINVIDA发布了新的文献求助10
11秒前
爱you完成签到,获得积分10
11秒前
LIUDAN发布了新的文献求助10
12秒前
一度停车完成签到,获得积分10
12秒前
传奇3的应助被图图采纳,获得30
12秒前
12秒前
always完成签到,获得积分10
12秒前
王乐乐发布了新的文献求助10
12秒前
连钧发布了新的文献求助10
13秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 2000
Agyptische Geschichte der 21.30. Dynastie 510
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
基于界面调控的高效湿气发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8192020
求助须知:如何正确求助?哪些是违规求助? 9578648
关于积分的说明 21861105
捐赠科研通 7791458
什么是DOI,文献DOI怎么找? 3436765
关于科研通互助平台的介绍 2560502
邀请新用户注册赠送积分活动 2483544