Algorithms for audio inpainting based on probabilistic nonnegative matrix factorization - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

Algorithms for audio inpainting based on probabilistic nonnegative matrix factorization

Résumé

Audio inpainting, i.e., the task of restoring missing or occluded audio signal samples, usually relies on sparse representations or autoregressive modeling. In this paper, we propose to structure the spectrogram with nonnegative matrix factorization (NMF) in a probabilistic framework. First, we treat the missing samples as latent variables, and derive two expectation-maximization algorithms for estimating the parameters of the model, depending on whether we formulate the problem in the time-or time-frequency domain. Then, we treat the missing samples as parameters, and we address this novel problem by deriving an alternating minimization scheme. We assess the potential of these algorithms for the task of restoring short-to middle-length gaps in music signals. Experiments reveal great convergence properties of the proposed methods, as well as competitive performance when compared to state-of-the-art audio inpainting techniques.
Fichier principal
Vignette du fichier
main.pdf (597.07 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03708613 , version 1 (29-06-2022)
hal-03708613 , version 2 (05-01-2023)

Identifiants

  • HAL Id : hal-03708613 , version 1

Citer

Ondřej Mokrý, Paul Magron, Thomas Oberlin, Cédric Févotte. Algorithms for audio inpainting based on probabilistic nonnegative matrix factorization. 2022. ⟨hal-03708613v1⟩
155 Consultations
132 Téléchargements

Partager

Gmail Facebook X LinkedIn More