SFTNet: A microexpression-based method for depression detection

计算机科学 萧条(经济学) 人工智能 经济 宏观经济学
作者
Xingyun Li,Xinyu Yi,Jiayu Ye,Yunshao Zheng,Qingxiang Wang
出处
期刊:Computer Methods and Programs in Biomedicine [Elsevier]
卷期号:243: 107923-107923 被引量:1
标识
DOI:10.1016/j.cmpb.2023.107923
摘要

Depression is a typical mental illness, and early screening can effectively prevent exacerbation of the condition. Many studies have found that the expressions of depressed patients are different from those of other subjects, and microexpressions have been used in the clinical detection of mental illness. However, there are few methods for the automatic detection of depression based on microexpressions. A new dataset of 156 participants (76 in the case group and 80 in the control group) was created. All data were collected in the context of a new emotional stimulation experiment and doctor-patient conversation. We first analyzed the Average Number of Occurrences (ANO) and Average Duration (AD) of facial expressions in the case group and the control group. Then, we proposed a two-stream model SFTNet for identifying depression based on microexpressions, which consists of a single-temporal network (STNet) and a full-temporal network (FTNet). STNet is used to extract features from facial images at a single time node, FTNet is used to extract features from all-time nodes, and the decision network combines the two features to identify depression through decision fusion. The code for SFTNet is available at https://github.com/muzixingyun/SFTNet. We found that the AD of all subjects was less than 20 frames (2/3 seconds) and that the facial expressions of the control group were richer. SFTNet achieved excellent results on the emotional stimulus experimental dataset, with Accuracy, Precision and Recall of 0.873, 0.888 and 0.846, respectively. We also conducted experiments on the doctor-patient conversation dataset, and the Accuracy, Precision and Recall were 0.829, 0.817 and 0.837, respectively. SFTNet can also be applied to microexpression detection task with more accuracy than SOTA models. In the emotional stimulation experiment, the subjects in the case group are more likely to show negative emotions. Compared to SOTA models, our depression detection method is more accurate and can assist doctors in the diagnosis of depression.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
更新
大幅提高文件上传限制,最高150M (2024-4-1)

科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Okpooko完成签到,获得积分10
刚刚
3秒前
Yiran完成签到,获得积分10
3秒前
4秒前
不会学术的羊完成签到,获得积分10
5秒前
5秒前
fish发布了新的文献求助10
5秒前
情怀应助酷酷河马采纳,获得10
6秒前
ajing完成签到,获得积分10
7秒前
yang完成签到 ,获得积分10
8秒前
8秒前
8秒前
皮卡丘完成签到 ,获得积分10
8秒前
微笑向彤完成签到,获得积分10
9秒前
我爱亲柠檬完成签到,获得积分10
10秒前
fish完成签到,获得积分10
12秒前
内向的芸发布了新的文献求助10
13秒前
科研路上的干饭桶完成签到,获得积分10
15秒前
geopotter完成签到 ,获得积分10
17秒前
SciGPT应助不会打预防针采纳,获得10
17秒前
TFBoys发布了新的文献求助10
17秒前
silence完成签到,获得积分20
20秒前
21秒前
陶醉的钢笔完成签到 ,获得积分10
23秒前
Starry发布了新的文献求助20
25秒前
机智的紫丝完成签到,获得积分10
26秒前
TFBoys完成签到,获得积分10
27秒前
寻道图强应助清醒采纳,获得30
27秒前
柠檬九分酸完成签到,获得积分10
30秒前
随心完成签到,获得积分10
30秒前
mkbk完成签到,获得积分10
31秒前
azzkmj完成签到,获得积分20
32秒前
rocky15应助acc采纳,获得10
33秒前
高跟鞋陈煋完成签到,获得积分10
34秒前
暗生崎乐完成签到 ,获得积分10
36秒前
Stella完成签到,获得积分10
37秒前
清醒完成签到,获得积分10
39秒前
39秒前
tangying8642完成签到,获得积分10
40秒前
鞋子亮完成签到,获得积分10
41秒前
高分求助中
Sustainable Land Management: Strategies to Cope with the Marginalisation of Agriculture 1000
Corrosion and Oxygen Control 600
Python Programming for Linguistics and Digital Humanities: Applications for Text-Focused Fields 500
Heterocyclic Stilbene and Bibenzyl Derivatives in Liverworts: Distribution, Structures, Total Synthesis and Biological Activity 500
重庆市新能源汽车产业大数据招商指南(两链两图两池两库两平台两清单两报告) 400
Division and square root. Digit-recurrence algorithms and implementations 400
行動データの計算論モデリング 強化学習モデルを例として 400
热门求助领域 (近24小时)
化学 材料科学 医学 生物 有机化学 工程类 生物化学 纳米技术 物理 内科学 计算机科学 化学工程 复合材料 遗传学 基因 物理化学 催化作用 电极 光电子学 量子力学
热门帖子
关注 科研通微信公众号,转发送积分 2546821
求助须知:如何正确求助?哪些是违规求助? 2175898
关于积分的说明 5601647
捐赠科研通 1896706
什么是DOI,文献DOI怎么找? 946398
版权声明 565379
科研通“疑难数据库(出版商)”最低求助积分说明 503569