In this paper we propose a novel approach for facial feature detection in color image sequences using Haar-like classifiers. The feature extraction is initialized without manual input and has the capability to fulfill the real time requirement. For facial expression recognition, we use geometrical measurement and simple texture analysis in detecting facial regions based on the prior detected facial feature points. For expression classification we used a three layer feed forward artificial neural network. The efficiency of the suggested approach is demonstrated under real world conditions.