Tracking of Non-Rigid Objects using RGB-D Camera - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2019

Tracking of Non-Rigid Objects using RGB-D Camera


A method to accurately track deformable objects using a RGB-D camera with the help of a coarse object model is presented in this paper. The deformation model is based on corotational FEM formulation. The physical model of the object does not need to be exact, nor do we require the precise physical properties for accurately tracking the object. The position of the vertices of the surface mesh of the tracked object is deformed using a set of virtual forces. A point-to-plane distance based geometric error between the pointcloud and the mesh is minimized with respect to these virtual forces. The point of application of force is determined by analysis of the error obtained from rigid tracking, which is done in parallel with the non-rigid tracking. This architecture also enables the overall system to be realtime. The proposed approach is evaluated on a synthetic data with ground-truth for deformation at every frame, as well as on real data.
Fichier principal
Vignette du fichier
SMC19_0740_FI.pdf (1.1 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02178353 , version 1 (09-07-2019)
hal-02178353 , version 2 (08-08-2019)



Agniva Sengupta, Alexandre Krupa, Eric Marchand. Tracking of Non-Rigid Objects using RGB-D Camera. SMC 2019 - IEEE International Conference on Systems, Man, and Cybernetics, Oct 2019, Bari, Italy. pp.3310-3317, ⟨10.1109/SMC.2019.8914543⟩. ⟨hal-02178353v2⟩
187 View
675 Download



Gmail Facebook X LinkedIn More