Text-informed audio source separation using nonnegative matrix partial co-factorization - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2013

Text-informed audio source separation using nonnegative matrix partial co-factorization

Luc Le Magoarou
Alexey Ozerov
  • Fonction : Auteur
  • PersonId : 930358
Ngoc Q. K. Duong
  • Fonction : Auteur
  • PersonId : 946470

Résumé

We consider a single-channel source separation problem consisting in separating speech from nonstationary background such as music. We introduce a novel approach called text-informed separation, where the source separation process is guided by the corresponding textual information. First, given the text, we propose to produce a speech example via either a speech synthesizer or a human. We then use this example to guide source separation and, for that purpose, we introduce a new variant of the nonnegative matrix partial co-factorization (NMPCF) model based on a so called excitation-filter-channel speech model. The proposed NMPCF model allows sharing the linguistic information between the example speech and the speech in the mixture. We then derive the corresponding multiplicative update (MU) rules for the parameter estimation. Experimental results over different types of mixtures and speech examples show the effectiveness of the proposed approach.
Fichier principal
Vignette du fichier
MLSP2013_FINAL_VERSION.pdf (564.03 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00870066 , version 1 (04-10-2013)

Identifiants

  • HAL Id : hal-00870066 , version 1

Citer

Luc Le Magoarou, Alexey Ozerov, Ngoc Q. K. Duong. Text-informed audio source separation using nonnegative matrix partial co-factorization. IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2013), Sep 2013, Southampton, United Kingdom. ⟨hal-00870066⟩
180 Consultations
519 Téléchargements

Partager

More