Photometric Registration using Specular Reflections and Application to Augmented Reality - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Photometric Registration using Specular Reflections and Application to Augmented Reality

Abstract

Photometric registration consists in blending real and virtual scenes in a visually coherent way. To achieve this goal, both reflectance and illumination properties must be estimated. These estimates are then used, within a rendering pipeline, to virtually simulate the real lighting's interaction with the scene. In this paper, we are interested in indoor scenes where light bounces off of objects with different reflective properties (diffuse and/or specular). In these scenarios, existing solutions often assume distant lighting or limit the analysis to a single specular object. We address scenes with various objects captured by a moving RGB-D camera and estimate the 3D position of light sources. Furthermore, using spatio-temporal data, our algorithm recovers dense diffuse and specular reflectance maps. Finally, using our estimates, we demonstrate photo-realistic augmentations of real scenes (virtual shadows, specular occlusions) as well as virtual spec-ular reflections on real world surfaces.
Fichier principal
Vignette du fichier
Photometric Registration using Specular Reflections and Application to Augmented Reality.pdf (3.02 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01792254 , version 1 (15-05-2018)

Identifiers

  • HAL Id : hal-01792254 , version 1

Cite

Salma Jiddi, Philippe Robert, Eric Marchand. Photometric Registration using Specular Reflections and Application to Augmented Reality. APMAR 2018 - 2nd Asia Pacific Workshop on Mixed and Augmented Reality, Apr 2018, Taipe, Taiwan. pp.1-4. ⟨hal-01792254⟩
277 View
209 Download

Share

Gmail Facebook Twitter LinkedIn More