Monocular 3D Reconstruction and Augmentation of Elastic Surfaces with Self-occlusion Handling - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Visualization and Computer Graphics Année : 2015

Monocular 3D Reconstruction and Augmentation of Elastic Surfaces with Self-occlusion Handling

Résumé

This paper focuses on the 3D shape recovery and augmented reality on elastic objects with self-occlusions handling, using only single view images. Shape recovery from a monocular video sequence is an underconstrained problem and many approaches have been proposed to enforce constraints and resolve the ambiguities. State-of-the art solutions enforce smoothness or geometric constraints, consider specific deformation properties such as inextensibility or resort to shading constraints. However, few of them can handle properly large elastic deformations. We propose in this paper a real-time method that uses a mechanical model and able to handle highly elastic objects. The problem is formulated as an energy minimization problem accounting for a non-linear elastic model constrained by external image points acquired from a monocular camera. This method prevents us from formulating restrictive assumptions and specific constraint terms in the minimization. In addition, we propose to handle self-occluded regions thanks to the ability of mechanical models to provide appropriate predictions of the shape. Our method is compared to existing techniques with experiments conducted on computer-generated and real data that show the effectiveness of recovering and augmenting 3D elastic objects. Additionally, experiments in the context of minimally invasive liver surgery are also provided and results on deformations with the presence of self-occlusions are exposed.
Fichier principal
Vignette du fichier
haouchine_tvcg_2015.pdf (6.4 Mo) Télécharger le fichier
Vignette du fichier
Screen Shot 2015-08-23 at 11.56.21 AM.png (1.84 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01186011 , version 1 (23-08-2015)

Identifiants

Citer

Nazim Haouchine, Jeremie Dequidt, Marie-Odile Berger, Stephane Cotin. Monocular 3D Reconstruction and Augmentation of Elastic Surfaces with Self-occlusion Handling. IEEE Transactions on Visualization and Computer Graphics, 2015, pp.14. ⟨10.1109/TVCG.2015.2452905⟩. ⟨hal-01186011⟩
565 Consultations
829 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More