Parameter Learning for Log-supermodular Distributions - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2016

Parameter Learning for Log-supermodular Distributions

Résumé

We consider log-supermodular models on binary variables, which are probabilistic models with negative log-densities which are submodular. These models provide probabilistic interpretations of common combinatorial optimization tasks such as image segmentation. In this paper, we focus primarily on parameter estimation in the models from known upper-bounds on the intractable log-partition function. We show that the bound based on separable optimization on the base polytope of the submodular function is always inferior to a bound based on " perturb-and-MAP " ideas. Then, to learn parameters, given that our approximation of the log-partition function is an expectation (over our own randomization), we use a stochastic subgradient technique to maximize a lower-bound on the log-likelihood. This can also be extended to conditional maximum likelihood. We illustrate our new results in a set of experiments in binary image denoising, where we highlight the flexibility of a probabilistic model to learn with missing data.
Fichier principal
Vignette du fichier
shpakova_hal_2016.pdf (368.38 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01354789 , version 1 (19-08-2016)
hal-01354789 , version 2 (03-11-2016)

Identifiants

Citer

Tatiana Shpakova, Francis Bach. Parameter Learning for Log-supermodular Distributions. 2016. ⟨hal-01354789v1⟩
308 Consultations
447 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More