Relevance and Perceptual Constraints in Multimodal Referring Actions - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 1999

Relevance and Perceptual Constraints in Multimodal Referring Actions

Abstract

This paper presents a first attempt to score the relevance of multimodal referring expressions within a task oriented environment. It is based upon the application of the ecological approach to multimodal system design, which in particular implies that perception has to play a central role in the understanding of a gestural designation. The results of an experimental work is presented, together with the scores obtained by combining the linguistic characteristic of the referring expression and the properties of the corresponding gestures (if any). Even if the calculus that we present has to be refined it seems to be already suited to validate our approach regarding the importance group salience and access type in the choice of a referring mode.
Fichier principal
Vignette du fichier
99-R-052.pdf (223.13 Ko) Télécharger le fichier

Dates and versions

inria-00098751 , version 1 (13-01-2009)

Identifiers

  • HAL Id : inria-00098751 , version 1

Cite

Antonella de Angeli, Frédéric Wolff, Patrice Lopez, Laurent Romary. Relevance and Perceptual Constraints in Multimodal Referring Actions. ESSLLI Workshop on Deixis, Demonstration & Deictic belief in Multimedia Contexts, Aug 1999, Utrecht, The Netherlands, 9 p. ⟨inria-00098751⟩
74 View
89 Download

Share

Gmail Facebook Twitter LinkedIn More