Bayesian Optimization using Deep Gaussian Processes - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Preprints, Working Papers, ... Year :

Bayesian Optimization using Deep Gaussian Processes


Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian Processes, this method may not be adapted for non-stationary functions involved in the optimization problem. To overcome this issue, a new Bayesian Optimization approach is proposed. It is based on Deep Gaussian Processes as surrogate models instead of classic Gaussian Processes. This modeling technique increases the power of representation to capture the non-stationarity by simply considering a functional composition of stationary Gaussian Processes, providing a multiple layer structure. This paper proposes a new algorithm for Global Optimization by coupling Deep Gaussian Processes and Bayesian Optimization. The specificities of this optimization method are discussed and highlighted with academic test cases. The performance of the proposed algorithm is assessed on analytical test cases and an aerospace design optimization problem and compared to the state-of-the-art stationary and non-stationary Bayesian Optimization approaches.
Fichier principal
Vignette du fichier
BO_DGP.pdf (2.4 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02924230 , version 1 (27-08-2020)



Ali Hebbal, Loic Brevault, Mathieu Balesdent, El-Ghazali Talbi, Nouredine Melab. Bayesian Optimization using Deep Gaussian Processes. 2020. ⟨hal-02924230⟩
124 View
297 Download



Gmail Facebook Twitter LinkedIn More