A stochastic multiple gradient descent algorithm - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles European Journal of Operational Research Year : 2018

A stochastic multiple gradient descent algorithm

Abstract

In this article, we propose a new method for multiobjective optimization problems in which the objective functions are expressed as expectations of random functions. The present method is based on an extension of the classical stochastic gradient algorithm and a deterministic multiobjective algorithm, the Multiple Gradient Descent Algorithm (MGDA). In MGDA a descent direction common to all specified objective functions is identified through a result of convex geometry. The use of this common descent vector and the Pareto stationarity definition into the stochastic gradient algorithm makes the algorithm able to solve multiobjective problems. The mean square and almost sure convergence of this new algorithm are proven considering the classical stochastic gradient algorithm hypothesis. The algorithm efficiency is illustrated on a set of benchmarks with diverse complexity and assessed in comparison with two classical algorithms (NSGA-II, DMS) coupled with a Monte Carlo expectation estimator.
Fichier principal
Vignette du fichier
DMAS18110.1529998080_postprint.pdf (1.64 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01833165 , version 1 (09-07-2018)

Identifiers

Cite

Quentin Mercier, Fabrice Poirion, Jean-Antoine Desideri. A stochastic multiple gradient descent algorithm. European Journal of Operational Research, 2018, pp.10. ⟨10.1016/j.ejor.2018.05.064⟩. ⟨hal-01833165⟩
249 View
606 Download

Altmetric

Share

Gmail Facebook X LinkedIn More