Prescient Teleoperation of Humanoid Robots - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2023

Prescient Teleoperation of Humanoid Robots

Abstract

Teleoperated humanoid robots are ideally suited to act as human avatars in remote environments. Unfortunately, their deployment is hindered by the communication delays between the human input and the video feedback from the robot. Here, we introduce a direct teleoperation system in which the operator receives a synchronized video feed of real images, even when the communication channel imposes a 1 to 2-second delay. Our key idea is to leverage machine learning to allow the robot to execute commands before the operator performs them, so that the operator receives a delayed video stream that is almost indistinguishable from real-time feedback. In our experiments, the iCub humanoid robot (32 degrees of freedom) was successfully controlled to perform several wholebody manipulation tasks, including reaching different targets, picking up an object, and moving a box. This new technique may enable real-life avatars on long-range radio networks, from remote maintenance to space missions.
Fichier principal
Vignette du fichier
main_1030.pdf (21.73 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04265528 , version 1 (30-10-2023)

Licence

Identifiers

Cite

Luigi Penco, Jean-Baptiste Mouret, Serena Ivaldi. Prescient Teleoperation of Humanoid Robots. 2023 IEEE RAS International Conference on Humanoid Robots, Dec 2023, Austin, United States. ⟨10.1109/Humanoids57100.2023.10375166⟩. ⟨hal-04265528⟩
166 View
69 Download

Altmetric

Share

More