Text-informed audio source separation using nonnegative matrix partial co-factorization - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2013

Text-informed audio source separation using nonnegative matrix partial co-factorization

Luc Le Magoarou
Alexey Ozerov
  • Function : Author
  • PersonId : 930358
Ngoc Q. K. Duong
  • Function : Author
  • PersonId : 946470

Abstract

We consider a single-channel source separation problem consisting in separating speech from nonstationary background such as music. We introduce a novel approach called text-informed separation, where the source separation process is guided by the corresponding textual information. First, given the text, we propose to produce a speech example via either a speech synthesizer or a human. We then use this example to guide source separation and, for that purpose, we introduce a new variant of the nonnegative matrix partial co-factorization (NMPCF) model based on a so called excitation-filter-channel speech model. The proposed NMPCF model allows sharing the linguistic information between the example speech and the speech in the mixture. We then derive the corresponding multiplicative update (MU) rules for the parameter estimation. Experimental results over different types of mixtures and speech examples show the effectiveness of the proposed approach.
Fichier principal
Vignette du fichier
MLSP2013_FINAL_VERSION.pdf (564.03 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00870066 , version 1 (04-10-2013)

Identifiers

  • HAL Id : hal-00870066 , version 1

Cite

Luc Le Magoarou, Alexey Ozerov, Ngoc Q. K. Duong. Text-informed audio source separation using nonnegative matrix partial co-factorization. IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2013), Sep 2013, Southampton, United Kingdom. ⟨hal-00870066⟩
171 View
505 Download

Share

Gmail Facebook X LinkedIn More