A physiological signal-based emotion recognition system was designed. The system was developed to operate as a use r-independent system, based on three physiological signals databases obtained from multiple ethnic objections. The input signals were EEG, eye activity and facial expressions, all of which were acquired synchronous. The whole system will be comfort from the subjects' body surface, and can reflect the influence of emotion on the autonomic nervous system. The system consisted of preprocessing, feature extraction and pattern classification stages. Preprocessing and feature extraction methods were devised so that emotion-specific characteristics could be extracted.