Large-scale nonconvex optimization: randomization, gap estimation, and numerical resolution - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles SIAM Journal on Optimization Year : 2023

Large-scale nonconvex optimization: randomization, gap estimation, and numerical resolution

Abstract

We address a large-scale and nonconvex optimization problem, involving an aggregative term. This term can be interpreted as the sum of the contributions of N agents to some common good, with N large. We investigate a relaxation of this problem, obtained by randomization. The relaxation gap is proved to converge to zeros as N goes to infinity, independently of the dimension of the aggregate. We propose a stochastic method to construct an approximate minimizer of the original problem, given an approximate solution of the randomized problem. McDiarmid's concentration inequality is used to quantify the probability of success of the method. We consider the Frank-Wolfe (FW) algorithm for the resolution of the randomized problem. Each iteration of the algorithm requires to solve a subproblem which can be decomposed into N independent optimization problems. A sublinear convergence rate is obtained for the FW algorithm. In order to handle the memory overflow problem possibly caused by the FW algorithm, we propose a stochastic Frank-Wolfe (SFW) algorithm, which ensures the convergence in both expectation and probability senses. Numerical experiments on a mixed-integer quadratic program illustrate the efficiency of the method.
Fichier principal
Vignette du fichier
hal_2023.pdf (2.71 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03631702 , version 1 (05-04-2022)
hal-03631702 , version 2 (03-02-2023)
hal-03631702 , version 3 (16-06-2023)

Identifiers

Cite

J. Frédéric Bonnans, Kang Liu, Nadia Oudjane, Laurent Pfeiffer, Cheng Wan. Large-scale nonconvex optimization: randomization, gap estimation, and numerical resolution. SIAM Journal on Optimization, 2023, 33 (4), pp.3083-3113. ⟨10.1137/22M1488892⟩. ⟨hal-03631702v3⟩
195 View
92 Download

Altmetric

Share

Gmail Facebook X LinkedIn More