A Mean Field Approach for Optimization in Particle Systems and Applications - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2009

A Mean Field Approach for Optimization in Particle Systems and Applications

Nicolas Gast
Bruno Gaujal

Résumé

This paper investigates the limit behavior of Markov decision processes made of independent particles evolving in a common environment, when the number of particles goes to infnity. In the fnite horizon case or with a discounted cost and an infnite horizon, we show that when the number of particles becomes large, the optimal cost of the system converges to the optimal cost of a deterministic system. Convergence also holds for optimal policies. We further provide insights on the speed of convergence by proving several central limits theorems for the cost and the state of the Markov decision process with explicit formulas for the limit. Then, our framework is applied to a brokering problem in grid computing. Several simulations with growing numbers of processors are reported. They compare the performance of the optimal policy of the limit system used in the fnite case with classical policies by measuring its asymptotic gain.

Dates et versions

hal-00788908 , version 1 (15-02-2013)

Identifiants

Citer

Nicolas Gast, Bruno Gaujal. A Mean Field Approach for Optimization in Particle Systems and Applications. Fourth International Conference on Performance Evaluation Methodologies and Tools, Valuetools, 2009, Pisa, Italy. pp.10, ⟨10.4108/ICST.VALUETOOLS2009.7477⟩. ⟨hal-00788908⟩
98 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More