计算机科学
水准点(测量)
凝视
边距(机器学习)
情态动词
模式
萧条(经济学)
面子(社会学概念)
人工智能
认知心理学
人机交互
机器学习
心理学
语言学
社会科学
化学
哲学
大地测量学
社会学
高分子化学
经济
宏观经济学
地理
作者
David Gimeno-Gómez,Ana-Maria Bucur,Adrian Cosma,Carlos D. Martínez-Hinarejos,Paolo Rosso
出处
期刊:Cornell University - arXiv
日期:2024-01-01
标识
DOI:10.48550/arxiv.2401.02746
摘要
Depression, a prominent contributor to global disability, affects a substantial portion of the population. Efforts to detect depression from social media texts have been prevalent, yet only a few works explored depression detection from user-generated video content. In this work, we address this research gap by proposing a simple and flexible multi-modal temporal model capable of discerning non-verbal depression cues from diverse modalities in noisy, real-world videos. We show that, for in-the-wild videos, using additional high-level non-verbal cues is crucial to achieving good performance, and we extracted and processed audio speech embeddings, face emotion embeddings, face, body and hand landmarks, and gaze and blinking information. Through extensive experiments, we show that our model achieves state-of-the-art results on three key benchmark datasets for depression detection from video by a substantial margin. Our code is publicly available on GitHub.
科研通智能强力驱动
Strongly Powered by AbleSci AI