SofaGym: An open platform for Reinforcement Learning based on Soft Robot simulations - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Soft Robotics Year : 2022

SofaGym: An open platform for Reinforcement Learning based on Soft Robot simulations

Etienne Ménager
Pierre Schegg
  • Function : Author
  • PersonId : 1164794
Elie Khairallah
  • Function : Author
  • PersonId : 1164795
Damien Marchal
Jérémie Dequidt
Philippe Preux
Christian Duriez

Abstract

OpenAI Gym is one of the standard interfaces used to train Reinforcement Learning (RL) Algorithms. The Simulation Open Framework Architecture (SOFA) is a physics based engine that is used for soft robotics simulation and control based on real-time models of deformation. The aim of this paper is to present SofaGym, an open source software to create OpenAI Gym interfaces, called environments, out of soft robot digital twins.The link between soft robotics and RL offers new challenges for both fields: representation of the soft robot in a RL context, complex interactions with the environment, use of specific mechanical tools to control soft robots, transfer of policies learned in simulation to the real world, etc. The article presents the large possible uses of SofaGym to tackle these challenges by using RL and planning algorithms. This publication contains neither new algorithms nor new models but proposes a new platform, open to the community, that offers non existing possibilities of coupling RL to physics based simulation of soft robots. We present 11 environments, representing a wide variety of soft robots and applications, we highlight the challenges showcased by each environment. We propose methods of solving the task using traditional control, RL and planning and point out research perspectives using the platform.
Fichier principal
Vignette du fichier
SofaGym.pdf (6.33 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03778189 , version 1 (15-09-2022)

Identifiers

  • HAL Id : hal-03778189 , version 1

Cite

Etienne Ménager, Pierre Schegg, Elie Khairallah, Damien Marchal, Jérémie Dequidt, et al.. SofaGym: An open platform for Reinforcement Learning based on Soft Robot simulations. Soft Robotics, In press. ⟨hal-03778189⟩
351 View
696 Download

Share

Gmail Facebook X LinkedIn More