水准点(测量)
计算机科学
人工智能
情绪识别
情绪分类
机器学习
自然语言处理
数据挖掘
情报检索
情感计算
情绪检测
特征(语言学)
特征提取
模式识别(心理学)
语音识别
作者
Wenhao Li,Kai Li,Ziqian Bai,Yixuan Zeng,Haolun Li,Xuecheng Wu,Guanchu Chen,Jiyuan Xie,Shibo Zhang,Fengchun Wu,Jing Zhou,Kai Wu
标识
DOI:10.1109/taffc.2026.3733456
摘要
We present FEEL, a multimodal EEG– fNIRS dataset and benchmark library for emotion recognition. Specifically, the FEEL dataset contains synchronized EEG and fNIRS recordings from 34 participants while they listened to 38 affective music clips, and it also provides rich annotations including discrete emotion labels, dimensional ratings, and liking scores. Based on this dataset, we systematically evaluate representative fusion strategies at the signal-level, feature-level, and decision-level, and we conduct these evaluations using both traditional machine learning methods and deep learning models under subject-dependent, cross-subject, and cross-music evaluation settings. The experimental results show that neurovascular coupling features derived from EEG and fNIRS achieve the highest classification accuracy in subject-dependent evaluations, whereas multimodal fusion approaches do not consistently outperform single-modal methods across all evaluation scenarios, and different fusion strategies exhibit distinct performance characteristics across evaluation scenarios. Finally, we integrate FEEL into the LibEER benchmark framework with extended support for fNIRS and EEG–fNIRS multimodal inputs, providing a standardized benchmark with baseline results for reproducible and systematic multimodal emotion recognition research.
科研通智能强力驱动
Strongly Powered by AbleSci AI