A Survey on Learning Theory (I): Stability and Generalization

The recent developments and achievements on the learning theory: stability and generalization of learning algorithm are reviewed in this paper. The similarities and differences among the existing stability theory such as hypothesis stability, pointwise stability, uniform stability, almost everywhere stability and CVEEEloo stability are compared. Furthermore, a series of open questions on stability and generalization are also discussed.