Visual Feature Learning from Randomized EEG Trials for Object Recognition
作者
Xiaoya Fan,Haixiao Xue,Yufan Feng,Qi Zhao,Zheng Zhao,Zhong Wang
出处
期刊: [Institute of Electrical and Electronics Engineers] 日期:2025-06-30卷期号:: 1-6
标识
DOI:10.1109/icme59968.2025.11210210
摘要
Object recognition from electroencephalography (EEG) responses to visual stimuli has received growing attention but has remained challenging, with prior methods achieving only marginally above-chance accuracy for randomized EEG trials. This paper introduces GVFL-EEG (Guided Visual Feature Learning from EEG), a novel framework that leverages well-trained computer vision models to enhance EEG object decoding. Specifically, a pre-trained image encoder is used to guide EEG feature learning via contrastive learning, aligning EEG embeddings with image representations. We present EEGMambaformer, a custom EEG encoder incorporating a residual Mamba block to capture temporal dynamics, an inverted transformer encoder to extract spatial dependencies, a temporal-spatial convolution block for feature fusion, and a projection layer for dimension alignment with the image encoder. Evaluation on the EEG40000 dataset show that our framework achieves 60.94% accuracy in 40-way classification, outperforming existing state-of-the-art methods. This work advances neural decoding and provides insights into brain-computer interface development. The code is available at https://github.com/xuehaixiao/GVFL_EEG/tree/main/GVFL.