A Statistically Principled and Computationally Efficient Approach to Speech Enhancement using Variational Autoencoders - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2019

A Statistically Principled and Computationally Efficient Approach to Speech Enhancement using Variational Autoencoders

Résumé

Recent studies have explored the use of deep generative models of speech spectra based on variational autoencoders (VAEs), combined with unsupervised noise models, to perform speech enhancement. These studies developed iterative algorithms involving either Gibbs sampling or gradient descent at each step, making them computationally expensive. This paper proposes a variational inference method to iteratively estimate the power spectrogram of the clean speech. Our main contribution is the analytical derivation of the variational steps in which the encoder of the pre-learned VAE can be used to estimate the variational approximation of the true posterior distribution, using the very same assumption made to train VAEs. Experiments show that the proposed method produces results on par with the aforementioned iterative methods using sampling, while decreasing the computational cost by a factor 36 to reach a given performance.
Fichier principal
Vignette du fichier
MPADEV_INTERSPEECH_2019.pdf (223.44 Ko) Télécharger le fichier
SDRs_4.pdf (13.66 Ko) Télécharger le fichier
sdr_time_3.pdf (14.45 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02116165 , version 1 (02-05-2019)
hal-02116165 , version 2 (03-07-2019)

Identifiants

  • HAL Id : hal-02116165 , version 2

Citer

Manuel Pariente, Antoine Deleforge, Emmanuel Vincent. A Statistically Principled and Computationally Efficient Approach to Speech Enhancement using Variational Autoencoders. INTERSPEECH 2019 - 20th Annual Conference of the International Speech Communication Association, Sep 2019, Graz, Austria. ⟨hal-02116165v2⟩
178 Consultations
335 Téléchargements

Partager

More