Self-organization by optimizing free-energy
Résumé
We present a variational Expectation-Maximization algorithm to learn probabilistic mixture models. The algorithm is similar to Kohonen's Self-Organizing Map algorithm and not limited to Gaussian mixtures. We maximize the variational free-energy that sums data log-likelihood and Kullback-Leibler divergence between a normalized neighborhood function and the posterior distribution on the components, given data. We illustrate the algorithm with an application on word clustering.
Domaines
Apprentissage [cs.LG]
Fichier principal
verbeek03esann.pdf (184.14 Ko)
Télécharger le fichier
VVK03a.png (30.03 Ko)
Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Loading...