In optical deformation measurement, how to remove the speckle noise from a speckle interferometry fringe pattern, and observe the fringe phase information high-accurately and automatically is a difficult problem. In this paper, a simple method for estimating fringe orientation is presented, and a method of picking up the fringe skeletons of speckle pattern from fringe orientation is discussed. These methods are tested by real speckle fringe pattern. The results show that the method is very effective for the speckle fringe patterns with high noise level.