Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Frontiers in Robotics and AI Year : 2016

Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience

Fabien Benureau
Pierre-Yves Oudeyer

Abstract

The production of behavioral diversity – producing a diversity of effects – is an essential strategy for robots exploring the world when facing situations where interaction possibilities are unknown or non-obvious. It allows to discover new aspects of the environment that cannot be inferred or deduced from available knowledge. However, creating behavioral diversity in situations where it is most crucial – new and unknown ones – is far from trivial. In particular in large and redundant sensorimotor spaces, only small areas are interesting to explore for any practical purpose. When the environment does not provide clues or gradient toward those areas, trying to discover those areas relies on chance. To address this problem, we introduce a method to create behavioral diversity in a new sensorimotor task by re-enacting actions that allowed to produce behavioral diversity in a previous task, along with a measure that quantifies this diversity. We show that our method can learn how to interact with an object by reusing experience from another, that it adapts to instances of morphological changes and of dissimilarity between tasks, and how scaffolding behaviors can emerge by simply switching the attention of the robot to different parts of the environment. Finally, we show that the method can robustly use simulated experiences and crude cognitive models to generate behavioral diversity in real robots.
Fichier principal
Vignette du fichier
frontiersBenureauOudeyer16.pdf (5.66 Mo) Télécharger le fichier
Origin Publication funded by an institution

Dates and versions

hal-01404329 , version 1 (28-11-2016)

Licence

Identifiers

Cite

Fabien Benureau, Pierre-Yves Oudeyer. Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience. Frontiers in Robotics and AI, 2016, 3 (8), ⟨10.3389/frobt.2016.00008⟩. ⟨hal-01404329⟩
188 View
113 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More