Perception and Structure Association Network for Micro-Expression Recognition

作者
Zhihao Wang,Yuanyuan Zhang,Bofan Yu,Yang Yu
标识
DOI:10.1145/3707292.3707371
摘要

Micro-expression recognition (MER) poses a formidable challenge due to the fleeting and subtle nature of micro-expressions (MEs). Current approaches predominantly focus on either motion features or facial structure, yet fail to effectively integrate both perspectives. This paper introduces a novel Perception and Structure Association Network (PSA-Net) for MER, aiming to effectively extract key features in MEs by performing multi-scale perception of motion features and constructing adaptive facial structure association. Specifically, to perceive fine-grained ME features and achieve multi-scale key feature extraction, we have designed the Multi-scale Micro-motion Perception module. This module extracts motion features by dividing windows and performing self-attention calculations within each window. The motion features of each window are then fused layer by layer using shifted window attention and spatial attention. Simultaneously, to effectively construct the structure association of facial ME regions, we have designed the Adaptive Facial Structure Association module. This module employs graph attention mechanisms and global adaptive attention maps to achieve the adaptive structure association of facial regions of interest, enabling the constructed facial graph structure to effectively extract global ME information and the relationships between nodes. Additionally, to effectively fuse these two key ME features, we propose the Fusion Loss, which can effectively learn the similarities between them, promoting the model to learn more discriminative feature representations, thus achieving effective feature fusion. Extensive experiments conducted on four public ME datasets (CASME, CASME II, SAMM, CAS(ME)3) have achieved recognition accuracy/F1 scores of 81.87%/79.26%, 87.80%/88.08%, 82.35%/76.76%, and 63.10%/49.47% respectively, surpassing most existing methods, which indicates that our method can effectively improve MER performance.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
香蕉不惜发布了新的文献求助10
刚刚
youxin完成签到,获得积分10
刚刚
搜集达人的应助被lulu采纳,获得10
1秒前
精明依云发布了新的文献求助10
1秒前
2秒前
lml发布了新的文献求助10
2秒前
3秒前
3秒前
3秒前
why发布了新的文献求助10
3秒前
why发布了新的文献求助30
3秒前
3秒前
爆米花的应助被受伤白安采纳,获得10
3秒前
3秒前
4秒前
千秋凌完成签到,获得积分10
4秒前
康康完成签到,获得积分10
4秒前
漫漫发布了新的文献求助10
4秒前
专一的弱发布了新的文献求助10
4秒前
5秒前
Howard完成签到,获得积分10
5秒前
5秒前
5秒前
RetchieLi完成签到,获得积分10
6秒前
6秒前
Gzl发布了新的文献求助10
6秒前
why发布了新的文献求助10
6秒前
why发布了新的文献求助10
7秒前
yanyue完成签到 ,获得积分10
7秒前
why发布了新的文献求助10
7秒前
why发布了新的文献求助10
7秒前
天天快乐的应助被涂鹏辉采纳,获得10
7秒前
7秒前
Jasper的应助被诚心的万宝路采纳,获得10
8秒前
8秒前
youxin发布了新的文献求助10
8秒前
8秒前
hualuo13发布了新的文献求助10
8秒前
ZZXX发布了新的文献求助10
9秒前
9秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
八旗制度の研究 600
Boundaries and Bodhisattvas 500
高分子基功能界面水蒸发材料与应用研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8181892
求助须知:如何正确求助?哪些是违规求助? 9571628
关于积分的说明 21818984
捐赠科研通 7778258
什么是DOI,文献DOI怎么找? 3433556
关于科研通互助平台的介绍 2557720
邀请新用户注册赠送积分活动 2479621