The Perturbed Prox-Preconditioned SPIDER algorithm for EM-based large scale learning - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

The Perturbed Prox-Preconditioned SPIDER algorithm for EM-based large scale learning

Abstract

Incremental Expectation Maximization (EM) algorithms were introduced to design EM for the large scale learning framework by avoiding the full data set to be processed at each iteration. Nevertheless, these algorithms all assume that the conditional expectations of the sufficient statistics are explicit. In this paper, we propose a novel algorithm named Perturbed Prox-Preconditioned SPIDER (3P-SPIDER), which builds on the Stochastic Path Integral Differential EstimatoR EM (SPIDER-EM) algorithm. The 3P-SPIDER algorithm addresses many intractabilities of the E-step of EM; it also deals with non-smooth regularization and convex constraint set. Numerical experiments show that 3P-SPIDER outperforms other incremental EM methods and discuss the role of some design parameters.
Fichier principal
Vignette du fichier
FM_HAL.pdf (170.1 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03183774 , version 1 (28-03-2021)
hal-03183774 , version 2 (24-05-2021)

Identifiers

  • HAL Id : hal-03183774 , version 2

Cite

Gersende Fort, Eric Moulines. The Perturbed Prox-Preconditioned SPIDER algorithm for EM-based large scale learning. SSP 2021 - IEEE Statistical Signal Processing Workshop, Jul 2021, Rio de Janeiro, Brazil. ⟨hal-03183774v2⟩
121 View
95 Download

Share

Gmail Mastodon Facebook X LinkedIn More