Photometric Registration using Specular Reflections and Application to Augmented Reality - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2018

Photometric Registration using Specular Reflections and Application to Augmented Reality

Résumé

Photometric registration consists in blending real and virtual scenes in a visually coherent way. To achieve this goal, both reflectance and illumination properties must be estimated. These estimates are then used, within a rendering pipeline, to virtually simulate the real lighting's interaction with the scene. In this paper, we are interested in indoor scenes where light bounces off of objects with different reflective properties (diffuse and/or specular). In these scenarios, existing solutions often assume distant lighting or limit the analysis to a single specular object. We address scenes with various objects captured by a moving RGB-D camera and estimate the 3D position of light sources. Furthermore, using spatio-temporal data, our algorithm recovers dense diffuse and specular reflectance maps. Finally, using our estimates, we demonstrate photo-realistic augmentations of real scenes (virtual shadows, specular occlusions) as well as virtual spec-ular reflections on real world surfaces.
Fichier principal
Vignette du fichier
Photometric Registration using Specular Reflections and Application to Augmented Reality.pdf (3.02 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01792254 , version 1 (15-05-2018)

Identifiants

  • HAL Id : hal-01792254 , version 1

Citer

Salma Jiddi, Philippe Robert, Eric Marchand. Photometric Registration using Specular Reflections and Application to Augmented Reality. APMAR 2018 - 2nd Asia Pacific Workshop on Mixed and Augmented Reality, Apr 2018, Taipe, Taiwan. pp.1-4. ⟨hal-01792254⟩
293 Consultations
279 Téléchargements

Partager

More