Calipso: Physics-based Image and Video Editing through CAD Model Proxies - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue The Visual Computer Année : 2018

Calipso: Physics-based Image and Video Editing through CAD Model Proxies

Résumé

We present Calipso, an interactive method for editing images and videos in a physically-coherent manner. Our main idea is to realize physics-based manipulations by running a full physics simulation on proxy geometries given by non-rigidly aligned CAD models. Running these simulations allows us to apply new, unseen forces to move or deform selected objects, change physical parameters such as mass or elasticity, or even add entire new objects that interact with the rest of the underlying scene. In our method the user makes edits directly in 3D; these edits are processed by the simulation and then transfered to the target 2D content using shape-to-image correspondences in a photo-realistic rendering process. To align the CAD models, we introduce an efficient CAD-to-image alignment procedure that jointly minimizes for rigid and non-rigid alignment while preserving the high-level structure of the input shape. Moreover, the user can choose to exploit image flow to estimate scene motion, producing coherent physical behavior with ambient dynamics. We demonstrate physics-based editing on a wide range of examples producing myriad physical behavior while preserving geometric and visual consistency.
Fichier principal
Vignette du fichier
calipso_haouchine.pdf (3.04 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01890684 , version 1 (08-10-2018)
hal-01890684 , version 2 (09-11-2018)

Identifiants

Citer

Nazim Haouchine, Frédérick Roy, Hadrien Courtecuisse, Matthias Niessner, Stéphane Cotin. Calipso: Physics-based Image and Video Editing through CAD Model Proxies. The Visual Computer, 2018, 36, pp.211-226. ⟨10.1007/s00371-018-1600-0⟩. ⟨hal-01890684v2⟩
312 Consultations
414 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More