Following a brief discussion on traditional LMS and its improved algorithm ,a new LMS algorithm of variable step size is proposed. The new algorithm make use of the square of average grads to produce the new variable step size. Computer simulations demonstrate that the proposed algorithm accomplishes faster convergence ,tracing speed and steady smaller MSE than the traditional LMS and VSS-LMS algorithm proposed in literature.