Cumulative Step-Size Adaptation on Linear Functions

Alexandre Chotard, Anne Auger, and Nikolaus Hansen

TAO team, INRIA Saclay-Ile-de-France, LRI, Paris-Sud University, France
Alexandre.Chotard__AT__lri.fr
Anne.Auger__AT__lri.fr
Nikolaus.Hansen__AT__lri.fr

Abstract. The CSA-ES is an Evolution Strategy with Cumulative Step size Adaptation, where the step size is adapted measuring the length of a so-called cumulative path. The cumulative path is a combination of the previous steps realized by the algorithm, where the importance of each step decreases with time. This article studies the CSA-ES on composites of strictly increasing functions with affine linear functions through the investigation of its underlying Markov chains. Rigorous results on the change and the variation of the step size are derived with and without cumulation. The step-size diverges geometrically fast in most cases. Furthermore, the influence of the cumulation parameter is studied.

Keywords: CSA, cumulative path, evolution path, evolution strategies, step-size adaptation

LNCS 7491, p. 72 ff.

Full article in PDF | BibTeX



© Springer-Verlag Berlin Heidelberg 2012