On variational inference and maximum likelihood estimation with the $ \lambda $-exponential family - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Foundations of Data Science Année : 2024

On variational inference and maximum likelihood estimation with the $ \lambda $-exponential family

Résumé

The lambda-exponential family has recently been proposed to generalize the exponential family. While the exponential family is well-understood and widely used, this is not the case yet for the -exponential family. However, many applications require models that are more general than the exponential family, and the lambda-exponential family is often a good alternative. In this work, we propose a theoretical and algorithmic framework to solve variational inference and maximum likelihood estimation problems over the lambda-exponential family. We give new sufficient optimality conditions for variational inference problems. Our conditions take the form of generalized moment-matching conditions and generalize existing similar results for the exponential family. We exhibit novel characterizations of the solutions of maximum likelihood estimation problems, that recover optimality conditions in the case of the exponential family. For the resolution of both problems, we propose novel proximal-like algorithms that exploit the geometry underlying the lambda-exponential family. These new theoretical and methodological insights are tested on numerical examples, showcasing their usefulness and interest, especially on heavy-tailed target distributions.
Fichier principal
Vignette du fichier
VI_and_MLE_over_lambda_exponential_families_HAL.pdf (2.14 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04616759 , version 1 (19-06-2024)

Licence

Identifiants

Citer

Thomas Guilmeau, Emilie Chouzenoux, Víctor Elvira. On variational inference and maximum likelihood estimation with the $ \lambda $-exponential family. Foundations of Data Science, 2024, 6 (1), pp.85-123. ⟨10.3934/fods.2024011⟩. ⟨hal-04616759⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More