VP-GO: A 'Light' Action-Conditioned Visual Prediction Model for Grasping Objects - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

VP-GO: A 'Light' Action-Conditioned Visual Prediction Model for Grasping Objects

Résumé

Visual prediction models are promising solutions for visual-based robotic grasping of cluttered, unknown soft objects. Previous models from the literature are computationally greedy, which limits reproducibility; although some consider stochasticity in the prediction model, it is often too weak to catch the reality of robotics experiments involving grasping such objects. Furthermore, previous work focused on elementary movements that are not efficient to reason in terms of more complex semantic actions. To address these limitations, we propose VP-GO, a "light" stochastic action-conditioned visual prediction model. We propose a hierarchical decomposition of semantic grasping and manipulation actions into elementary end-effector movements, to ensure compatibility with existing models and datasets for visual prediction of robotic actions such as RoboNet. We also record and release a new open dataset for visual prediction of object grasping, called PandaGrasp. Our model can be pre-trained on RoboNet and fine-tuned on PandaGrasp, and performs similarly to more complex models in terms of signal prediction metrics. Qualitatively, it outperforms when predicting the outcome of complex grasps performed by our robot.
Fichier principal
Vignette du fichier
anji_paper_for_ICARM_final_version.pdf (5.43 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03727531 , version 1 (19-07-2022)

Identifiants

  • HAL Id : hal-03727531 , version 1

Citer

Anji Ma, Yoann Fleytoux, Jean-Baptiste Mouret, Serena Ivaldi. VP-GO: A 'Light' Action-Conditioned Visual Prediction Model for Grasping Objects. ICARM 2022 - IEEE International Conference on Advanced Robotics and Mechatronics, Jul 2022, Guilin, China. ⟨hal-03727531⟩
40 Consultations
69 Téléchargements

Partager

Gmail Facebook X LinkedIn More