Localizing the latent structure canonical uncertainty: entropy profiles for hidden Markov models - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Statistics and Computing Year : 2016

Localizing the latent structure canonical uncertainty: entropy profiles for hidden Markov models

Abstract

This paper addresses state inference for hidden Markov models. These models rely on unobserved states, which often have a meaningful interpretation. This makes it necessary to develop diagnostic tools for quantification of state uncertainty. The entropy of the state sequence that explains an observed sequence for a given hidden Markov chain model can be considered as the canonical measure of state sequence uncertainty. This canonical measure of state sequence uncertainty is not reflected by the classic multidimensional posterior state (or smoothed) probability profiles because of the marginalization that is intrinsic in the computation of these posterior probabilities. Here, we introduce a new type of profiles that have the following properties: (i) these profiles of conditional entropies are a decomposition of the canonical measure of state sequence uncertainty along the sequence and makes it possible to localise this uncertainty, (ii) these profiles are unidimensional and thus remain easily interpretable on tree structures. We show how to extend the smoothing algorithms for hidden Markov chain and tree models to compute these entropy profiles efficiently. The use of entropy profiles is illustrated by sequence and tree data examples.
Fichier principal
Vignette du fichier
manuscript.pdf (558.86 Ko) Télécharger le fichier
Vignette du fichier
temp2.jpg (120.72 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Format Figure, Image
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01090836 , version 1 (07-01-2015)

Identifiers

Cite

Jean-Baptiste Durand, Yann Guédon. Localizing the latent structure canonical uncertainty: entropy profiles for hidden Markov models. Statistics and Computing, 2016, 26 (1), pp.549-567. ⟨10.1007/s11222-014-9494-9⟩. ⟨hal-01090836⟩
672 View
214 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More