Stress Assessment Based on Decision Fusion of EEG and fNIRS Signals

emergingFusion of electroencephalography (EEG) and functional near infrared spectroscopy (fNIRS) is an emerging approach in the field of psychological and neurological studies. We developed a decision fusion technique to combine the output probabilities of the EEG and fNIRS classifiers. The fusion explored support vector machine as classifier for each modality, and optimized the classifiers based on their receiver operating characteristic curve values. EEG and fNIRS signal were acquired simultaneously while performing mental arithmetic task under control and stress conditions. Experiment results from 20 subjects demonstrated significant improvement in the detection rate of mental stress by +7.76% (p <; 0.001) and +10.57% (p <; 0.0005), compared with sole modality of EEG and fNIRS, respectively.