Communication Dans Un Congrès Année : 1998

Acting on a visual world : the role of perception in multimodal HCI

Résumé

Following the ecological theory of perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect of perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.

Domaines

Fichier principal
Vignette du fichier
AAAIBIS.pdf (414.78 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Loading...

Dates et versions

inria-00107515 , version 1 (13-01-2009)
inria-00107515 , version 2 (01-03-2010)

Licence

Identifiants

  • HAL Id : inria-00107515 , version 2

Citer

Frédéric Wolff, Antonella de Angeli, Laurent Romary. Acting on a visual world : the role of perception in multimodal HCI. AAAI '98 Workshop: Representations for Multi-modal Human-Computer Interaction, Jul 1998, Madison, Wisconsin, United States. 6 p. ⟨inria-00107515v2⟩
282 Consultations
405 Téléchargements

Partager

  • More