CRNN-based multiple DoA estimation using acoustic intensity features for Ambisonics recordings - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue IEEE Journal of Selected Topics in Signal Processing Année : 2019

CRNN-based multiple DoA estimation using acoustic intensity features for Ambisonics recordings

Résumé

Localizing audio sources is challenging in real reverberant environments, especially when several sources are active. We propose to use a neural network built from stacked convolutional and recurrent layers in order to estimate the direction of arrival of multiple sources from a first-order Ambisonics recording. It returns the directions of arrival (over a discrete grid) of a known number of sources. We propose to use features derived from the acoustic intensity vector as inputs. We analyze the behavior of the neural network by means of a visualization technique called layerwise relevance propagation. This analysis highlights which parts of the input signal are relevant in a given situation. We also conduct experiments to evaluate the performance of our system in various environments, from simulated rooms to real recordings, with one or two speech sources. The results show that the proposed features significantly improve performances with respect to raw Ambisonics inputs.
Fichier principal
Vignette du fichier
Perotin-2019-CRNN-based_multiple_DoA_estimation.pdf (4.55 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01839883 , version 1 (16-07-2018)
hal-01839883 , version 2 (26-02-2019)

Identifiants

Citer

Lauréline Perotin, Romain Serizel, Emmanuel Vincent, Alexandre Guérin. CRNN-based multiple DoA estimation using acoustic intensity features for Ambisonics recordings. IEEE Journal of Selected Topics in Signal Processing, 2019, Special Issue on Acoustic Source Localization and Tracking in Dynamic Real-life Scenes, 13 (1), pp.22-33. ⟨10.1109/jstsp.2019.2900164⟩. ⟨hal-01839883v2⟩
540 Consultations
1847 Téléchargements

Altmetric

Partager

More