Robots Learn Increasingly Complex Tasks with Intrinsic Motivation and Automatic Curriculum Learning - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles KI - Künstliche Intelligenz Year : 2021

Robots Learn Increasingly Complex Tasks with Intrinsic Motivation and Automatic Curriculum Learning

Abstract

Multi-task learning by robots poses the challenge of the domain knowledge: complexity of tasks, complexity of the actions required, relationship between tasks for transfer learning. We demonstrate that this domain knowledge can be learned to address the challenges in life-long learning. Specifically, the hierarchy between tasks of various complexities is key to infer a curriculum from simple to composite tasks. We propose a framework for robots to learn sequences of actions of unbounded complexity in order to achieve multiple control tasks of various complexity. Our hierarchical reinforcement learning framework, named SGIM-SAHT, offers a new direction of research, and tries to unify partial implementations on robot arms and mobile robots. We outline our contributions to enable robots to map multiple control tasks to sequences of actions: representations of task dependencies, an intrinsically motivated exploration to learn task hierarchies, and active imitation learning. While learning the hierarchy of tasks, it infers its curriculum by deciding which tasks to explore first, how to transfer knowledge, and when, how and whom to imitate.
Fichier principal
Vignette du fichier
reportKIarxiv.pdf (5.53 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03157219 , version 1 (11-02-2022)

Identifiers

Cite

Sao Mai Nguyen, Nicolas Duminy, Alexandre Manoury, Dominique Duhaut, Cédric Buche. Robots Learn Increasingly Complex Tasks with Intrinsic Motivation and Automatic Curriculum Learning. KI - Künstliche Intelligenz, 2021, 35 (81-90), ⟨10.1007/s13218-021-00708-8⟩. ⟨hal-03157219⟩
231 View
76 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More