Online Localization and Tracking of Multiple Moving Speakers in Reverberant Environments - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue IEEE Journal of Selected Topics in Signal Processing Année : 2019

Online Localization and Tracking of Multiple Moving Speakers in Reverberant Environments

Résumé

This paper addresses the problem of online multiple-speaker localization and tracking in reverberant environment. We propose to use the direct-path relative transfer function (DP-RTF) – a feature that encodes the inter-channel direct-path information robust against reverberation, hence well suited for reliable localization. A complex Gaussian mixture model (CGMM) is then used, such that each component weight represents the probability that an active speaker is present at a corresponding candidate source direction. Exponentiated gradient descent is used to update these weights online by minimizing a combination of negative log-likelihood and entropy. The latter imposes sparsity over the number of audio sources, since in practice only a few speakers are simultaneously active. The outputs of this online localization process are then used as observations within a Bayesian filtering process whose computation is made tractable via an instance of variational expectation-maximization. Birth and sleeping processes are used to account for the intermittent nature of speech. The method is thoroughly evaluated using several datasets.
Fichier principal
Vignette du fichier
SSLT_JSTSP.pdf (666.66 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01851985 , version 1 (31-07-2018)
hal-01851985 , version 2 (01-03-2019)

Identifiants

Citer

Xiaofei Li, Yutong Ban, Laurent Girin, Xavier Alameda-Pineda, Radu Horaud. Online Localization and Tracking of Multiple Moving Speakers in Reverberant Environments. IEEE Journal of Selected Topics in Signal Processing, 2019. ⟨hal-01851985v1⟩
532 Consultations
740 Téléchargements

Altmetric

Partager

More