Smart Sampling for Lightweight Verification of Markov Decision Processes - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles International Journal on Software Tools for Technology Transfer Year : 2015

Smart Sampling for Lightweight Verification of Markov Decision Processes

Abstract

Markov decision processes (MDP) are useful to model optimisation problems in concurrent systems. To verify MDPs with efficient Monte Carlo techniques requires that their nondeterminism be resolved by a scheduler. Recent work has introduced the elements of lightweight techniques to sample directly from scheduler space, but finding optimal schedulers by simple sampling may be inefficient. Here we describe "smart" sampling algorithms that can make substantial improvements in performance.
Fichier principal
Vignette du fichier
SmartSampling.pdf (428.28 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01088633 , version 1 (28-11-2014)
hal-01088633 , version 2 (07-12-2015)

Identifiers

Cite

Pedro d'Argenio, Axel Legay, Sean Sedwards, Louis-Marie Traonouez. Smart Sampling for Lightweight Verification of Markov Decision Processes. International Journal on Software Tools for Technology Transfer, 2015, 17 (4), pp.469-484. ⟨10.1007/s10009-015-0383-0⟩. ⟨hal-01088633v2⟩
542 View
369 Download

Altmetric

Share

Gmail Facebook X LinkedIn More