A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Statistics and Computing Year : 2021

A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering

Abstract

High-dimensional data clustering has become and remains a challenging task for modern statistics and machine learning, with a wide range of applications. We consider in this work the powerful discriminative latent mixture model, and we extend it to the Bayesian framework. Modeling data as a mixture of Gaussians in a low-dimensional discriminative subspace, a Gaussian prior distribution is introduced over the latent group means and a family of twelve submodels are derived considering different covariance structures. Model inference is done with a variational EM algorithm, while the discriminative subspace is estimated via a Fisher-step maximizing an unsupervised Fisher criterion. An empirical Bayes procedure is proposed for the estimation of the prior hyper-parameters, and an integrated classification likelihood criterion is derived for selecting both the number of clusters and the submodel. The performances of the resulting Bayesian Fisher-EM algorithm are investigated in two thorough simulated scenarios, regarding both dimensionality as well as noise and assessing its superiority with respect to state-of-the-art Gaussian subspace clustering models. In addition to standard real data benchmarks, an application to single image denoising is proposed, displaying relevant results. This work comes with a reference implementation for the R software in the FisherEM package accompanying the paper.

Dates and versions

hal-03047930 , version 1 (09-12-2020)

Identifiers

Cite

Nicolas Jouvin, Charles Bouveyron, Pierre Latouche. A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering. Statistics and Computing, 2021, 31, ⟨10.1007/s11222-021-10018-6⟩. ⟨hal-03047930⟩
357 View
0 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More