MeCM-EDNet: An EEG Decision Prediction Model Incorporating Emotional Information Based on Multi-task Learning

While emotions have proven to play a crucial role in decision-making process, the influence of emotions is often overlooked in current decision prediction models. To compensate for the lack of emotional integration, this paper proposes a single trial decision prediction model, MeCM-EDNet, an emotional decision network (EDNet) that incorporates meiosis data augmentation (Me), contrastive learning (C), and multi-task learning (M). It consists of four blocks: data augmentation block, time learning block, graph learning block, and multi-task learning block. Among them, the multi-task learning block integrates decision prediction, emotion recognition, and supervised contrast learning tasks, effectively achieving the emotional integration of decision model. Moreover, we embed the neural mechanisms of emotion-driven decision-making into our graph learning module to overcome the limitations of decision models lacking neuroscientific knowledge. To validate our model, the paper designs an experiment to investigate how emotions influence spatial decision making and constructs a dataset. Comparative experiments in our dataset and Emoback dataset demonstrate that MeCM EDNet achieves state-of-the-art performance. The ablation studies confirm the effectiveness of each block of our model, particularly highlighting the important role of the integration of emotional information and neuroscience knowledge. MeCM-EDNet underscores the importance of considering emotional influence in decision research, addressing the current lack of emotional integration in most decision prediction models. The code of our paper is freely available at https://github.com/qimingzitainanla/MECM.