Structure Representation With Adaptive and Compact Facial Graph for Micro-Expression Recognition

面部表情识别 图形 代表(政治) 面部表情 计算机科学 模式识别(心理学) 面部识别系统 人工智能 理论计算机科学 政治学 政治 法学
作者
Chunlei Li,Renwei Ba,Xueping Wang,Miao Yu,Xiao Li,Di Huang
出处
期刊:IEEE transactions on biometrics, behavior, and identity science [Institute of Electrical and Electronics Engineers]
卷期号:7 (2): 256-269 被引量:4
标识
DOI:10.1109/tbiom.2024.3479333
摘要

The subtle and slight motions of micro-expressions (MEs) leave few effective features to micro-expression recognition (MER), making MER a challenging task. Existing works mainly focus on constructing strong representations from entire videos, individual frames, or redundant structural graphs, however, spatial structure feature learning of MEs leaves much space for further improvement. To solve the issue, this paper introduces a novel two-stream network for MER without any prior knowledge called Focusing on Few Discriminative Information Network (FFDIN). Specifically, in the temporal stream, the difference between the Apex and Onset frames is utilized as input to reduce redundant information and aggregate temporal information. Meanwhile, spatial attention is incorporated into the CNN stream to encourage the network to focus on salient features. In the structural stream, the Adaptively Select Strategy (ADSS) is proposed to automatically locate few effective regions of MEs by selecting the strong long-term dependent cropped patches and corresponding adjacency matrix. Then, the Graph Nodes Generation (GNG) module is designed to capture local and global information in tiny cropped patches and project the feature maps into graph nodes. Extensive experiments conducted on the CASME II, SAMM, and SMIC datasets demonstrate that the proposed network can achieve superior performance than the state-of-the-art methods.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
小二郎应助猪猪hero采纳,获得10
1秒前
2秒前
2秒前
2秒前
陈小宇kk完成签到,获得积分10
2秒前
xlanister完成签到,获得积分10
3秒前
zln完成签到,获得积分10
3秒前
水123发布了新的文献求助10
3秒前
3秒前
rrrr发布了新的文献求助10
3秒前
xlanister发布了新的文献求助30
5秒前
DrJzz发布了新的文献求助10
6秒前
虚幻的豁完成签到 ,获得积分10
6秒前
顾矜应助乔乔采纳,获得10
7秒前
7秒前
8秒前
李健应助凶狠的牛排采纳,获得10
9秒前
9秒前
9秒前
烟花应助默默采纳,获得10
10秒前
tang发布了新的文献求助10
10秒前
顾矜应助科研小白Z采纳,获得10
11秒前
11秒前
11秒前
小郭完成签到,获得积分10
12秒前
hhhh发布了新的文献求助10
12秒前
科研通AI6.2应助JY采纳,获得10
13秒前
鸽鸽唏完成签到,获得积分10
13秒前
陌未茗完成签到 ,获得积分10
15秒前
李爱国应助tang采纳,获得10
15秒前
脑洞疼应助迪奥哒采纳,获得10
16秒前
16秒前
初十应助zf2023采纳,获得10
17秒前
帅123完成签到 ,获得积分10
17秒前
共享精神应助Jiangxining采纳,获得10
17秒前
Good完成签到 ,获得积分10
17秒前
17秒前
suai发布了新的文献求助10
17秒前
研友_VZG7GZ应助科研通管家采纳,获得80
17秒前
17秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Matrix Methods in Data Mining and Pattern Recognition 510
Reading and Understanding Health Research 500
Social Skills Improvement System-Rating Scales--Chinese Version 500
Dynamische Polarisation von H-1 und B-11 in (CH-3)-3NBH-3 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7251827
求助须知:如何正确求助?哪些是违规求助? 8874283
关于积分的说明 18731408
捐赠科研通 6931697
什么是DOI,文献DOI怎么找? 3199529
关于科研通互助平台的介绍 2374331
邀请新用户注册赠送积分活动 2174074