Capturing Deformations of Interacting Non-rigid Objects Using RGB-D Data - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Capturing Deformations of Interacting Non-rigid Objects Using RGB-D Data


This paper presents a method for tracking multiple interacting deformable objects undergoing rigid motions, elastic deformations and contacts, using image and point cloud data provided by an RGB-D sensor. A joint registration framework is proposed, based on physical Finite Element Method (FEM) elastic and interaction models. It first relies on a visual segmentation of the considered objects in the RGB images. The different segmented point clouds are then processed to estimate rigid transformations with on an ICP algorithm, and to determine geometrical point-to-point correspondences with the meshes. External forces resulting from these correspondences and between the current and the rigidly transformed mesh can then be derived. It provides both non-rigid and rigid data cues. A classical collision detection and response model is also integrated, giving contact forces between the objects. The deformations of the objects are estimated by solving a dynamic system balancing these external and contact forces with the internal or regularization forces computed through the FEM elastic model. This approach has been here tested on different scenarios involving two or three interacting deformable objects of various shapes, with promising results.
Fichier principal
Vignette du fichier
iros2018_apetit_2.pdf (5.75 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-01889771 , version 1 (08-10-2018)


  • HAL Id : hal-01889771 , version 1


Antoine Petit, Stéphane Cotin, Vincenzo Lippiello, Bruno Siciliano. Capturing Deformations of Interacting Non-rigid Objects Using RGB-D Data. IROS 2018 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct 2018, Madrid, Spain. ⟨hal-01889771⟩
257 View
550 Download


Gmail Mastodon Facebook X LinkedIn More