On-Line Learning of Lexical Items and Grammatical Constructions via Speech, Gaze and Action-Based Human-Robot Interaction - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2013

On-Line Learning of Lexical Items and Grammatical Constructions via Speech, Gaze and Action-Based Human-Robot Interaction

Résumé

In order to be able to understand a conversation in interaction, a robot, has to first understand the language used by his interlocutor. A central aspect of language learning is adaptability. Individuals can learn new words and new grammatical structures. We have developed learning methods that allow the hu-manoid robot iCub to robot can learn new lexical items by interaction with the human and consolidation of its autobiographical memory. Then, based on these open class words, the robot can bootstrap the acquisition of novel grammatical structures in real-time. Finally, we demonstrate how human gaze can be monitored, and could be used in order to reduce referential ambiguity inherent in such learning conditions. These learning capabilities are demonstrated in a collection of videos.
Fichier principal
Vignette du fichier
Pointeau2013.pdf (638.35 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02561340 , version 1 (03-05-2020)

Identifiants

  • HAL Id : hal-02561340 , version 1

Citer

Gregoire Pointeau, Maxime Petit, Xavier Hinaut, Guillaume Gibert, Peter Ford Dominey. On-Line Learning of Lexical Items and Grammatical Constructions via Speech, Gaze and Action-Based Human-Robot Interaction. INTERSPEECH 2013 - 14th Annual Conference of the International Speech Communication Association, Aug 2013, Lyon, France. ⟨hal-02561340⟩
47 Consultations
81 Téléchargements

Partager

More