In this paper, we present a face detection for gesture recognition using a stereo camera. The face gesture recognition is to measure the direction of a face by extracting the face region in the input image. In this paper, we detect an apparent foreground object region in a certain distance using a stereo camera. We then remove background region, and extract the object’s face region using color information. Finally, the face gesture can be recognized by analyzing the face distribution ratio. Unlike various existing gesture recognition methods, the proposed technique does not require any training algorithms, which makes real-time applications possible.