BI-population CMA-ES Algorithms with Surrogate Models and Line Searches - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2013

BI-population CMA-ES Algorithms with Surrogate Models and Line Searches

Abstract

In this paper, three extensions of the BI-population Covariance Matrix Adaptation Evolution Strategy with weighted active covariance matrix update (BIPOP-aCMA-ES) are investigated. First, to address expensive optimization, we benchmark a recently proposed extension of the self-adaptive surrogate-assisted CMA-ES which benefits from more intensive surrogate model exploitation (BIPOP-saACM-k). Second, to address separable optimization, we propose a hybrid of BIPOP-aCMA-ES and STEP algorithm with coordinate-wise line search (BIPOP-aCMA-STEP). Third, we propose HCMA, a hybrid of BIPOP-saACM-k, STEP and NEWUOA to benefit both from surrogate models and line searches. All algorithms were tested on the noiseless BBOB testbed using restarts till a total number of function evaluations of $10^6n$ was reached, where $n$ is the dimension of the function search space. The comparison shows that BIPOP-saACM-k outperforms its predecessor BIPOP-saACM up to a factor of 2 on ill-conditioned problems, while BIPOP-aCMA-STEP outperforms the original BIPOP-based algorithms on separable functions. The hybrid HCMA algorithm demonstrates the best overall performance compared to the best algorithms of the BBOB-2009, BBOB-2010 and BBOB-2012 when running for more than $100n$ function evaluations.
Fichier principal
Vignette du fichier
w0306-loshchilov.pdf (930.8 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-00818596 , version 1 (28-04-2013)
hal-00818596 , version 2 (04-05-2013)

Identifiers

  • HAL Id : hal-00818596 , version 2

Cite

Ilya Loshchilov, Marc Schoenauer, Michèle Sebag. BI-population CMA-ES Algorithms with Surrogate Models and Line Searches. Workshop Proceedings of the (GECCO) Genetic and Evolutionary Computation Conference, Jul 2013, Amsterdam, Netherlands. pp.8. ⟨hal-00818596v2⟩
286 View
1954 Download

Share

Gmail Mastodon Facebook X LinkedIn More