Learning in Games with Lossy Feedback - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Learning in Games with Lossy Feedback


We consider a game-theoretical multi-agent learning problem where the feedback information can be lost during the learning process and rewards are given by a broad class of games known as variationally stable games. We propose a simple variant of the classical online gradient descent algorithm, called reweighted online gradient descent (ROGD) and show that in variationally stable games, if each agent adopts ROGD, then almost sure convergence to the set of Nash equilibria is guaranteed, even when the feedback loss is asynchronous and arbitrarily corrrelated among agents. We then extend the framework to deal with unknown feedback loss probabilities by using an estimator (constructed from past data) in its replacement. Finally, we further extend the framework to accomodate both asynchronous loss and stochastic rewards and establish that multi-agent ROGD learning still converges to the set of Nash equilibria in such settings. Together, these results contribute to the broad lanscape of multi-agent online learning by significantly relaxing the feedback information that is required to achieve desirable outcomes.
Fichier principal
Vignette du fichier
FeedbackLoss-NIPS.pdf (334 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01904461 , version 1 (25-10-2018)


  • HAL Id : hal-01904461 , version 1


Zhengyuan Zhou, Panayotis Mertikopoulos, Susan Athey, Nicholas Bambos, Peter Glynn, et al.. Learning in Games with Lossy Feedback. NIPS 2018 - Thirty-second Conference on Neural Information Processing Systems, Dec 2018, Montreal, Canada. pp.1-11. ⟨hal-01904461⟩
330 View
226 Download


Gmail Facebook X LinkedIn More