Max-Plus Linear Approximations for Deterministic Continuous-State Markov Decision Processes
Abstract
We consider deterministic continuous-state Markov decision processes (MDPs). We apply a max-plus linear method to approximate the value function with a specific dictionary of functions that leads to an adequate state-discretization of the MDP. This is more efficient than a direct discretization of the state space, typically intractable in high dimension. We propose a simple strategy to adapt the discretization to a problem instance, thus mitigating the curse of dimensionality. We provide numerical examples showing that the method works well on simple MDPs.
Fichier principal
max-plus-linear-approximations-for-deterministic-mdps.pdf (1.25 Mo)
Télécharger le fichier
Origin : Files produced by the author(s)
Loading...