Sparse Emotion Dictionary and CWT Spectrogram Fusion With Multi-Head Self-Attention for Depression Recognition in Parkinson's Disease Patients

光谱图 帕金森病 人工智能 心理学 语音识别 认知心理学 萧条(经济学) 模式识别(心理学) 情绪识别 计算机科学 听力学 疾病 医学 内科学 经济 宏观经济学
作者
Jian Li,Yuliang Zhao,Yinghao Liu,Huawei Zhang,Peng Shan,Yuanyi Wu,Wanyue Wang,Yulin Wang
出处
期刊:IEEE Transactions on Affective Computing [Institute of Electrical and Electronics Engineers]
卷期号:16 (2): 1159-1176
标识
DOI:10.1109/taffc.2024.3498009
摘要

Depression is prevalent in patients with Parkinson's disease (PD), due to the dramatic negative impact that behavioral disorders have on daily life. Regrettably, most researchers in the past ignored the study of depression in PD patients, especially when depressive symptoms and PD symptoms are coupled together, it is difficult for researchers to recognize depression from the macro physiological signs of PD patients. Researchers are increasingly turning their attention to the subtle phenomena of emotional expression in conversation, using the textual and spectral features extracted from the audio of interviews as the primary support for understanding emotional states. However, there is still a lack of effective technical means to fuse these two features to recognize depression in PD patients. In this study, we proposed an innovative image fusion approach, fusing a sparse emotion dictionary with textual features and a Continuous Wavelet Transform (CWT) spectrogram with spectral features for the precise recognition of depression in PD patients. The fusion process integrates low-dimensional emotion-related textual cues, contributing to a more comprehensive extraction of emotionally relevant information. Subsequently, we introduce a High and Low Frequency Feature Fusion Multi-headed Self-Attention (HL-MSA) mechanism within a high and low frequency feature fusion network to amalgamate information across different frequency features within the images. The results underscore the efficacy of this novel fusion approach in effectively extracting depressive features in PD patients, attaining advanced recognition performance. Notably, this endeavor represents a pioneering stride in seamlessly fusing a sparse emotion dictionary and CWT spectrogram, exemplifying a promising and effective initiative for recognizing depression in PD patients.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
Orange的应助被开心德地采纳,获得10
1秒前
如风随水的应助被aaaaaaaa采纳,获得10
1秒前
雪白萤完成签到 ,获得积分10
2秒前
2秒前
徐小帅完成签到,获得积分10
2秒前
可爱的函函的应助被单薄冰安采纳,获得10
2秒前
2秒前
东方不败完成签到 ,获得积分20
2秒前
3秒前
承承的应助被敏静采纳,获得10
3秒前
科研通AI6.4的应助被Asuka采纳,获得30
4秒前
舒心的灵枫完成签到,获得积分10
5秒前
Leo发布了新的文献求助10
5秒前
5秒前
yu发布了新的文献求助30
6秒前
cdercder的应助被谋勇兼备采纳,获得30
6秒前
Atlantis30发布了新的文献求助10
6秒前
汉堡包的应助被小Q采纳,获得10
7秒前
gao完成签到 ,获得积分10
7秒前
9秒前
Hanayu完成签到 ,获得积分0
10秒前
10秒前
啵子发布了新的文献求助10
11秒前
鲨鱼辣椒完成签到,获得积分10
11秒前
小熊波比完成签到,获得积分10
11秒前
CipherSage的应助被喵喵呜喵喵采纳,获得10
13秒前
zhouzhou完成签到,获得积分10
13秒前
肽聚糖完成签到,获得积分10
14秒前
单薄冰安发布了新的文献求助10
14秒前
14秒前
33发布了新的文献求助10
14秒前
CodeCraft的应助被等待的博采纳,获得10
15秒前
17秒前
18秒前
上官若男的应助被wg采纳,获得10
19秒前
吕玉宁发布了新的文献求助10
19秒前
WEI完成签到,获得积分10
20秒前
贾贡献的应助被啵子采纳,获得20
20秒前
22秒前
传奇3的应助被开心德地采纳,获得10
23秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
Sex, Aging, and Death in a Medieval Medical Compendium: Trinity College Cambridge MS R.14.52, Its Texts, Language, and Scribe 500
高分子基功能界面水蒸发材料与应用研究 500
外场增强的水汽发电研究 500
基于结构调控的功能化水诱导发电材料与器件研究 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8188654
求助须知:如何正确求助?哪些是违规求助? 9576372
关于积分的说明 21847161
捐赠科研通 7786741
什么是DOI,文献DOI怎么找? 3435402
关于科研通互助平台的介绍 2559632
邀请新用户注册赠送积分活动 2482360