Simultaneous Estimation of Gaze Direction and Visual Focus of Attention for Multi-Person-to-Robot Interaction - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Simultaneous Estimation of Gaze Direction and Visual Focus of Attention for Multi-Person-to-Robot Interaction

Résumé

We address the problem of estimating the visual focus of attention (VFOA), e.g. who is looking at whom? This is of particular interest in human-robot interactive scenarios, e.g. when the task requires to identify targets of interest over time. The paper makes the following contributions. We propose a Bayesian temporal model that connects VFOA to gaze direction and to head pose. Model inference is then cast into a switching Kalman filter formulation, which makes it tractable. The model parameters are estimated via training based on manual annotations. The method is tested and benchmarked using a publicly available dataset. We show that both the gaze and the VFOA of several persons can be reliably and simultaneously estimated over time from observed head poses as well as from people and object locations. On average , our method compares favorably with two other methods.
Fichier principal
Vignette du fichier
camera_ready.pdf (2.54 Mo) Télécharger le fichier
Vignette du fichier
nao_0745480.png (421.17 Ko) Télécharger le fichier
Vignette du fichier
nao_0745480.jpg (33.4 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01301766 , version 1 (12-04-2016)

Identifiants

Citer

Benoit Massé, Silèye Ba, Radu Horaud. Simultaneous Estimation of Gaze Direction and Visual Focus of Attention for Multi-Person-to-Robot Interaction. International Conference on Multimedia and Expo, IEEE Signal Processing Society, Jun 2016, Seattle, United States. pp.1-6, ⟨10.1109/ICME.2016.7552986⟩. ⟨hal-01301766⟩
496 Consultations
329 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More