Global PAC Bounds for Learning Discrete Time Markov Chains - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Global PAC Bounds for Learning Discrete Time Markov Chains

Jun Sun
  • Fonction : Auteur
  • PersonId : 1085966

Résumé

Learning models from observations of a system is a powerful tool with many applications. In this paper, we consider learning Discrete Time Markov Chains (DTMC), with different methods such as frequency estimation or Laplace smoothing. While models learnt with such methods converge asymptotically towards the exact system, a more practical question in the realm of trusted machine learning is how accurate a model learnt with a limited time budget is. Existing approaches provide bounds on how close the model is to the original system, in terms of bounds on local (transition) probabilities, which has unclear implication on the global behavior. In this work, we provide global bounds on the error made by such a learning process, in terms of global behaviors formalized using temporal logic. More precisely, we propose a learning process ensuring a bound on the error in the probabilities of these properties. While such learning process cannot exist for the full LTL logic, we provide one ensuring a bound that is uniform over all the formulas of CTL. Further, given one time-to-failure property, we provide an improved learning algorithm. Interestingly, frequency estimation is sufficient for the latter, while Laplace smoothing is needed to ensure non-trivial uniform bounds for the full CTL logic.

Domaines

Autre [cs.OH]
Fichier principal
Vignette du fichier
BGJS20.pdf (433.85 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03065571 , version 1 (14-12-2020)

Identifiants

  • HAL Id : hal-03065571 , version 1

Citer

Hugo Bazille, Blaise Genest, Cyrille Jegourel, Jun Sun. Global PAC Bounds for Learning Discrete Time Markov Chains. CAV 2020 - 32nd International Conference on Computer-Aided Verification, Jul 2020, Los Angeles, United States. pp.304-326. ⟨hal-03065571⟩
65 Consultations
91 Téléchargements

Partager

Gmail Facebook X LinkedIn More