Anderson acceleration for reinforcement learning - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Anderson acceleration for reinforcement learning


Anderson (1965) acceleration is an old and simple method for accelerating the computation of a fixed point. However, as far as we know and quite surprisingly, it has never been applied to dynamic programming or reinforcement learning. In this paper, we explain briefly what Anderson acceleration is and how it can be applied to value iteration, this being supported by preliminary experiments showing a significant speed up of convergence, that we critically discuss. We also discuss how this idea could be applied more generally to (deep) reinforcement learning.
Fichier principal
Vignette du fichier
ewrl_14_2018_paper_1.pdf (345.54 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01928142 , version 1 (20-11-2018)



Matthieu Geist, Bruno Scherrer. Anderson acceleration for reinforcement learning. EWRL 2018 - 4th European workshop on Reinforcement Learning, Oct 2018, Lille, France. ⟨hal-01928142⟩
179 View
223 Download



Gmail Facebook X LinkedIn More