Visual Tracking of Deforming Objects Using Physics-based Models - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Visual Tracking of Deforming Objects Using Physics-based Models


In this paper, we propose a framework for tracking the deformation of soft objects using a RGB-D camera by utilizing the physically-based model of the considered object. A coarse, 3D template of the object being tracked is the only prior information required by the proposed method. The proposed approach does not rely on the accurate knowledge of the material properties of the object being tracked. In this paper, we integrate computer vision based tracking methodology with physical model based deformation representation without requiring expensive numerical optimization for minimizing nonlinear error terms. The proposed approach enables deformation tracking by joint minimization of a geometric error and a direct photometric intensity error while utilizing co-rotational Finite Element Method (FEM) as the underlying deformation model. The proposed method has been validated both on synthetic data (with groundtruth) and real data.
Fichier principal
Vignette du fichier
ICRA21__home_papercept_ras.papercept.net_www_conferences_conferences_ICRA21_submissions_0894_FI.pdf (5.02 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03179253 , version 1 (24-03-2021)


  • HAL Id : hal-03179253 , version 1


Agniva Sengupta, Alexandre Krupa, Eric Marchand. Visual Tracking of Deforming Objects Using Physics-based Models. ICRA 2021 - IEEE International Conference on Robotics and Automation, May 2021, Xi'an, China. pp.14178-14184. ⟨hal-03179253⟩
190 View
1185 Download


Gmail Mastodon Facebook X LinkedIn More