癫痫
脑电图
癫痫发作
心理学
计算机科学
神经科学
作者
Jiuwen Cao,Yuan Fang,Xiaonan Cui,Runze Zheng,Tiejia Jiang,Feng Gao
标识
DOI:10.1109/tetci.2024.3372387
摘要
Childhood epilepsy seriously affects the nervous system development of children. Electroencephalogram (EEG) based epilepsy analysis is common in the past, but the inconvenient acquisition of EEG is the main challenge. In this paper, we firstly explored seizure detection performance of multi-modal synchronized video and EEG method. Further, we explore seizure detection only using video modal data. A novel childhood multi-modal epilepsy seizure detection algorithm using YOLO $_{v3}$ for object detection, hybrid discriminate video and EEG feature representation is developed in the paper. After screening out interferences in video sequence by YOLO $_{v3}$ , the space-time interest points (STIPs) are extracted to characterize the body movement. The space-time interest points (STIPs) are extracted to characterize the body movement. Then, 4 popular features, Histogram of Oriented Gradient (HOG), Histograms of Oriented Optical Flow (HOF), Local Binary Pattern (LBP), and Motion Boundary Histogram (MBH) around STIPs are extracted. The Histograms of Word Frequency (HWF) features derived from a bag of words (BOW) model on HOG, HOF, LBP and MBH are developed for video representation. Meanwhile, the MelFrequency Cepstral Coefficients (MFCC) and Linear Predictive Cepstral Coefficients (LPCC) are extracted for EEG characterization. Multi-modal data of 13 childhood epilepsy patients from the Children's Hospital, Zhejiang University School of Medicine (CHZU) are studied. The fused EEG+Video feature based method could achieve an overall accuracy of 98.33%. Moreover, only using video feature, the method can achieve an overall accuracy of 93.30%.
科研通智能强力驱动
Strongly Powered by AbleSci AI