AMGSN: Adaptive mask-guide supervised network for debiased facial expression recognition

人工智能 计算机科学 模式识别(心理学) 面部表情识别 面部表情 计算机视觉 语音识别 面部识别系统
作者
Tianlong Gu,Hao Li,Xuan Feng,Yiqin Luo
出处
期刊:Pattern Recognition [Elsevier BV]
卷期号:170: 112023-112023 被引量:1
标识
DOI:10.1016/j.patcog.2025.112023
摘要

Facial expression recognition plays a crucial role in understanding human emotions and behavior. However, existing models often exhibit biases and imbalance towards diverse expression classes. To address this problem, we propose an Adaptive Mask-Guide Supervised Network (AMGSN) to enhance the uniform performance of the facial expression recognition models. We propose an adaptive mask guidance mechanism to mitigate bias and ensure uniform performance across different expression classes. AMGSN focuses on learning the ability to distinguish facial features with under-expressed expressions by dynamically generating masks during pre-training. Specifically, we employ an asymmetric encoder–decoder architecture, where the encoder encodes only the unmasked visible regions, while the lightweight decoder reconstructs the original image using latent representations and mask markers. By utilizing dynamically generated masks and focusing on informative regions, these models effectively reduce the interference of confounding factors, thus enhancing the discriminative power of the learned representation. In the pre-training stage, we introduce the Attention-Based Mask Generator (ABMG) to identify salient regions of expressions. Additionally, we advance the Mask Ratio Update Strategy (MRUS), which utilizes image reconstruction loss, to adjust the mask ratio for each image during pre-training. In the finetune stage, debiased center loss and contrastive loss are introduced to optimize the network to ensure the overall performance of expression recognition. Extensive experimental results on several standard datasets demonstrate that the proposed AMGSN significantly improves both balance and accuracy compared to state-of-the-art methods. For example, AMGSN reached 89.34% on RAF-DB, and 62.83% on AffectNet, respectively, with a standard deviation of only 0.0746 and 0.0484. This demonstrates the effectiveness of our improvements 1 1 Source code can be found at: https://github.com/fenffef/AMGSN/tree/main . .
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
无极微光的应助被珂珂采纳,获得20
刚刚
2秒前
kakaxi完成签到,获得积分10
3秒前
yangyang完成签到,获得积分10
3秒前
3秒前
Akim的应助被ally采纳,获得10
3秒前
第一作者发布了新的文献求助10
4秒前
5秒前
Cherish完成签到,获得积分10
5秒前
斯文败类的应助被WangJ1018采纳,获得10
6秒前
6秒前
T_T完成签到 ,获得积分10
6秒前
7秒前
同心源完成签到 ,获得积分20
7秒前
daomaihu发布了新的文献求助100
7秒前
7秒前
星辰完成签到,获得积分10
8秒前
8秒前
8秒前
强强的朱呀完成签到,获得积分10
8秒前
ZJJ完成签到,获得积分10
8秒前
欣慰元蝶发布了新的文献求助10
8秒前
wangzhewwe发布了新的文献求助10
9秒前
明亮的新筠完成签到,获得积分20
10秒前
mm完成签到,获得积分10
11秒前
11秒前
Hello的应助被yy采纳,获得10
11秒前
领导范儿的应助被学术智子采纳,获得10
11秒前
Owen的应助被曲凯采纳,获得10
12秒前
Hello的应助被just采纳,获得10
12秒前
12秒前
12秒前
mmmm发布了新的文献求助10
12秒前
Away完成签到,获得积分10
13秒前
搞论文小白完成签到 ,获得积分10
13秒前
13秒前
13秒前
13秒前
简单千琴完成签到,获得积分10
14秒前
Akim的应助被江漓采纳,获得30
14秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8187707
求助须知:如何正确求助?哪些是违规求助? 9575782
关于积分的说明 21843037
捐赠科研通 7785576
什么是DOI,文献DOI怎么找? 3435097
关于科研通互助平台的介绍 2559495
邀请新用户注册赠送积分活动 2481986