Benchmarking large-scale continuous optimizers: the bbob-largescale testbed, a COCO software guide and beyond - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Applied Soft Computing Year : 2020

Benchmarking large-scale continuous optimizers: the bbob-largescale testbed, a COCO software guide and beyond

Dimo Brockhoff
Nikolaus Hansen
Anne Auger
  • Function : Author
  • PersonId : 751513
  • IdHAL : anne-auger

Abstract

Benchmarking of optimization solvers is an important and compulsory task for performance assessment that in turn can help in improving the design of algorithms. It is a repetitive and tedious task. Yet, this task has been greatly automatized in the past ten years with the development of the Comparing Continuous Optimizers platform (COCO). In this context, this paper presents a new testbed, called bbob-largescale, that contains functions ranging from dimension 20 to 640, compatible with and extending the well-known single-objective noiseless bbob test suite to larger dimensions. The test suite contains 24 single-objective functions in continuous domain, built to model well-known difficulties in continuous optimization and to test the scaling behavior of algorithms. To reduce the computational demand of the orthogonal search space transformations that appear in the bbob test suite, while retaining some desired properties, we use permuted block diagonal orthogonal matrices. The paper discusses implementation technicalities and presents a guide for using the test suite within the COCO platform and for interpreting the postprocessed output. The source code of the new test suite is available on GitHub as part of the open source COCO benchmarking platform.
Fichier principal
Vignette du fichier
AppliedSoftComputing_paper.pdf (4.45 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02960253 , version 1 (07-10-2020)

Identifiers

Cite

Konstantinos Varelas, Ouassim Ait El Hara, Dimo Brockhoff, Nikolaus Hansen, Duc Manh Nguyen, et al.. Benchmarking large-scale continuous optimizers: the bbob-largescale testbed, a COCO software guide and beyond. Applied Soft Computing, 2020, 97 (A), pp.106737. ⟨10.1016/j.asoc.2020.106737⟩. ⟨hal-02960253⟩
135 View
248 Download

Altmetric

Share

Gmail Facebook X LinkedIn More