Block matching technique has been widely used in video compression. A lot of algorithms have been proposed to accelerate the estimation speed, among those algorithms, block sum pyramid algorithm (BSPA) is widely used. In this correspondence, a new block sum pyramid algorithm (NBPSA) to motion estimation is presented. Compared with BSPA, NBSPA estimate the vector of the minimum mean absolute difference (MADmin). In the mean time, instead of the value updated level by level, the estimation of MAD is updated row by row from top to bottom. Experimental results showed that compared with exhaustive search approach in BSPA, NBSPA algorithm can be used to arrive at the same result with much less computational complexity.