A Comparative Error Analysis of Audio-Visual Source Localization - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2008

A Comparative Error Analysis of Audio-Visual Source Localization

Abstract

This paper examines the accuracy of audio-video based localization using multiple cameras and multi-microphones. Covariance mapping theory is used to determine the accuracy of audio and video based localization. Both modalities are compared in terms of their ability to provide accurate location estimates of a moving audio-visual source. Relatively, video is found to be significantly more accurate than audio. The problem of audio-video fusion is also examined. The fusion of audio and video location estimates is applied in the audio domain, the video domain and the positional domain. The accuracy of these three fusion strategies for 3D localization are examined from a theoretical basis. The best localization performance is found when fusion is applied in the positional domain. Fusing audio and video data in the video domain is found to exhibit the worst localization performance. This analysis is confirmed by measuring the accuracy of each fusion strategy in localizing a moving audio-visual source.
Fichier principal
Vignette du fichier
1569140110.pdf (752.56 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00326742 , version 1 (05-10-2008)

Identifiers

  • HAL Id : inria-00326742 , version 1

Cite

Damien Kelly, François Pitié, Anil Kokaram, Frank Boland. A Comparative Error Analysis of Audio-Visual Source Localization. Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications - M2SFA2 2008, Andrea Cavallaro and Hamid Aghajan, Oct 2008, Marseille, France. ⟨inria-00326742⟩

Collections

M2SFA2
56 View
53 Download

Share

Gmail Facebook X LinkedIn More