Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue Frontiers in Neurorobotics Année : 2014

Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks

Résumé

One of the principal functions of human language is to allow people to coordinate joint action. This includes the description of events, requests for action, and their organization in time. A crucial component of language acquisition is learning the grammatical structures that allow the expression of such complex meaning related to physical events. The current research investigates the learning of grammatical constructions and their temporal organization in the context of human-robot physical interaction with the embodied sensorimotor humanoid platform, the iCub. We demonstrate three noteworthy phenomena. First, a recurrent network model is used in conjunction with this robotic platform to learn the mappings between grammatical forms and predicate-argument representations of meanings related to events, and the robot's execution of these events in time. Second, this learning mechanism functions in the inverse sense, i.e., in a language production mode, where rather than executing commanded actions, the robot will describe the results of human generated actions. Finally, we collect data from naïve subjects who interact with the robot via spoken language, and demonstrate significant learning and generalization results. This allows us to conclude that such a neural language learning system not only helps to characterize and understand some aspects of human language acquisition, but also that it can be useful in adaptive human-robot interaction.
Fichier principal
Vignette du fichier
fnbot-08-00016.pdf (4.35 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02383530 , version 1 (18-05-2020)

Identifiants

Citer

Xavier Hinaut, Maxime Petit, Gregoire Pointeau, Peter F. Dominey. Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks. Frontiers in Neurorobotics, 2014, 8, ⟨10.3389/fnbot.2014.00016⟩. ⟨hal-02383530⟩
69 Consultations
98 Téléchargements

Altmetric

Partager

More