SULFR: Simulation of Urban Logistic For Reinforcement - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

SULFR: Simulation of Urban Logistic For Reinforcement


In urban logistics, various sources of uncertainty can invalidate pre-planned routes. In this context, a routing strategy that uses available information from the environment could help improve the overall performance of the routing process by dynamically choosing the next client at the online execution time. While static and deterministic testbeds for vehicle routing exist, their stochastic and dynamic counterparts are still missing. This paper proposes an interface to the microtraffic simulation package SUMO that implement a generative model of stochastic and dynamic vehicle routing problems. We formalize the latter using a reinforcement learning framework for semi-Markov decision processes. The resulting testbeds make it possible to compare single- and multi-agent reinforcement learning algorithms in customizable routing environments. We report our preliminary tests to evaluate a hand-crafted policy on some basic scenarios.
Fichier principal
Vignette du fichier
gbono_pgmrl18.pdf (323.75 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01847773 , version 1 (07-09-2018)
hal-01847773 , version 2 (07-09-2018)


  • HAL Id : hal-01847773 , version 2


Guillaume Bono, Jilles Dibangoye, Laëtitia Matignon, Florian Pereyron, Olivier Simonin. SULFR: Simulation of Urban Logistic For Reinforcement. Workshop on Prediction and Generative Modeling in Reinforcement Learning, Jul 2018, Stockholm, Sweden. pp.1-5. ⟨hal-01847773v2⟩
677 View
279 Download


Gmail Facebook X LinkedIn More