Rethinking LDA: Moment Matching for Discrete ICA - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2015

Rethinking LDA: Moment Matching for Discrete ICA


We consider moment matching techniques for estimation in latent Dirichlet allocation (LDA). By drawing explicit links between LDA and discrete versions of independent component analysis (ICA), we first derive a new set of cumulant-based tensors, with an improved sample complexity. Moreover, we reuse standard ICA techniques such as joint diagonalization of tensors to improve over existing methods based on the tensor power method. In an extensive set of experiments on both synthetic and real datasets, we show that our new combination of tensors and orthogonal joint diagonalization techniques outperforms existing moment matching methods.
Fichier principal
Vignette du fichier
lda.pdf (539.91 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01225271 , version 1 (06-11-2015)



Anastasia Podosinnikova, Francis Bach, Simon Lacoste-Julien. Rethinking LDA: Moment Matching for Discrete ICA. NIPS 2015 - Advances in Neural Information Processing Systems 28, Dec 2015, Montreal, Canada. ⟨hal-01225271⟩
290 View
161 Download



Gmail Facebook X LinkedIn More