Actor-Critic Fictitious Play in Simultaneous Move Multistage Games - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Actor-Critic Fictitious Play in Simultaneous Move Multistage Games


Fictitious play is a game theoretic iterative procedure meant to learn an equilibrium in normal form games. However, this algorithm requires that each player has full knowledge of other players' strategies. Using an architecture inspired by actor-critic algorithms, we build a stochastic approximation of the fictitious play process. This procedure is on-line, decentralized (an agent has no information of others' strategies and rewards) and applies to multistage games (a generalization of normal form games). In addition, we prove convergence of our method towards a Nash equilibrium in both the cases of zero-sum two-player multistage games and cooperative multistage games. We also provide empirical evidence of the soundness of our approach on the game of Alesia with and without function approximation.
Fichier principal
Vignette du fichier
AISTATS2018 (13).pdf (523.16 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01724227 , version 1 (06-03-2018)


  • HAL Id : hal-01724227 , version 1


Julien Pérolat, Bilal Piot, Olivier Pietquin. Actor-Critic Fictitious Play in Simultaneous Move Multistage Games. AISTATS 2018 - 21st International Conference on Artificial Intelligence and Statistics, Apr 2018, Playa Blanca, Lanzarote, Canary Islands, Spain. ⟨hal-01724227⟩
420 View
1182 Download


Gmail Facebook X LinkedIn More