Global linear convergence of Evolution Strategies with recombination on scaling-invariant functions - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Journal of Global Optimization Year : 2023

Global linear convergence of Evolution Strategies with recombination on scaling-invariant functions

Cheikh Touré
  • Function : Author
  • PersonId : 1039895
Anne Auger
  • Function : Author
  • PersonId : 751513
  • IdHAL : anne-auger
Nikolaus Hansen

Abstract

Evolution Strategies (ES) are stochastic derivative-free optimization algorithms whose most prominent representative, the CMA-ES algorithm, is widely used to solve difficult numerical optimization problems. We provide the first rigorous investigation of the linear convergence of step-size adaptive ES involving a population and recombination, two ingredients crucially important in practice to be robust to local irregularities or multimodality. We investigate convergence of step-size adaptive ES with weighted recombination on composites of strictly increasing functions with continuously differentiable scaling-invariant functions with a global optimum. This function class includes functions with non-convex sublevel sets and discontinuous functions. We prove the existence of a constant r such that the logarithm of the distance to the optimum divided by the number of iterations converges to r. The constant is given as an expectation with respect to the stationary distribution of a Markov chain—its sign allows to infer linear convergence or divergence of the ES and is found numerically. Our main condition for convergence is the increase of the expected log step-size on linear functions. In contrast to previous results, our condition is equivalent to the almost sure geometric divergence of the step-size on linear functions.
Fichier principal
Vignette du fichier
saes.pdf (3.86 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03286037 , version 1 (13-07-2021)
hal-03286037 , version 2 (24-06-2022)
hal-03286037 , version 3 (22-10-2022)

Licence

Identifiers

Cite

Cheikh Touré, Anne Auger, Nikolaus Hansen. Global linear convergence of Evolution Strategies with recombination on scaling-invariant functions. Journal of Global Optimization, 2023, 86 (1), pp.163-203. ⟨10.1007/s10898-022-01249-6⟩. ⟨hal-03286037v3⟩
144 View
187 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More