Neural Style Transfer with Twin-Delayed DDPG for Shared Control of Robotic Manipulators - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

Neural Style Transfer with Twin-Delayed DDPG for Shared Control of Robotic Manipulators

Abstract

Neural Style Transfer (NST) refers to a class of algorithms able to manipulate an element, most often images, to adopt the appearance or style of another one. Each element is defined as a combination of Content and Style: the Content can be conceptually defined as the "what" and the Style as the "how" of said element. In this context, we propose a custom NST framework for transferring a set of styles to the motion of a robotic manipulator, e.g., the same robotic task can be carried out in an "angry", "happy", "calm", or "sad" way. An autoencoder architecture extracts and defines the Content and the Style of the target robot motions. A Twin Delayed Deep Deterministic Policy Gradient (TD3) network generates the robot control policy using the loss defined by the autoencoder. The proposed Neural Policy Style Transfer TD3 (NPST3 3) alters the robot motion by introducing the trained style. Such an approach can be implemented either offline, for carrying out autonomous robot motions in dynamic environments, or online, for adapting at runtime the style of a teleoperated robot. The considered styles can be learned online from human demonstrations. We carried out an evaluation with human subjects enrolling 73 volunteers, asking them to recognize the style behind some representative robotic motions. Results show a good recognition rate, proving that it is possible to convey different styles to a robot using this approach.
Fichier principal
Vignette du fichier
Fernandez-Fernandez_NeuralStyleTransfer.pdf (3.92 Mo) Télécharger le fichier
Fernandez-Fernandez_NeuralStyleTransfer.mp4 (13.08 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03584085 , version 1 (22-02-2022)

Licence

Attribution

Identifiers

Cite

Raul Fernandez-Fernandez, Marco Aggravi, Paolo Robuffo Giordano, Juan G Victores, Claudio Pacchierotti. Neural Style Transfer with Twin-Delayed DDPG for Shared Control of Robotic Manipulators. ICRA 2022 - 39th IEEE International Conference on Robotics and Automation, May 2022, Philadelphia, United States. pp.4073-4079, ⟨10.1109/ICRA46639.2022.9812245⟩. ⟨hal-03584085⟩
138 View
111 Download

Altmetric

Share

Gmail Facebook X LinkedIn More