Automatic Spatially Varying Illumination Recovery of Indoor Scenes Based on a Single RGB-D Image - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Visualization and Computer Graphics Year : 2020

Automatic Spatially Varying Illumination Recovery of Indoor Scenes Based on a Single RGB-D Image

Abstract

We propose an automatic framework to recover the illumination of indoor scenes based on a single RGB-D image. Unlike previous works, our method can recover spatially varying illumination without using any lighting capturing devices or HDR information. The recovered illumination can produce realistic rendering results. To model the geometry of the visible and invisible parts of scenes corresponding to the input RGB-D image, we assume that all objects shown in the image are located in a box with six faces and build a geometry model based on the depth map. We then present a confidence-scoring based strategy to separate the light sources from the highlight areas. The positions of light sources both in and out of the camera's view are calculated based on the classification result and the recovered geometry model. Finally, an iterative procedure is proposed to calculate the colors of light sources and the materials in the scene. In addition, a data-driven method is used to set constraints on the light source intensities. Using the estimated light sources and geometry model, environment maps at different points in the scene are generated that can model the spatial variance of illumination. The experimental results demonstrate the validity of our approach.
Fichier principal
Vignette du fichier
TVCG_2018.pdf (38.58 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01907554 , version 1 (15-11-2018)

Identifiers

Cite

Guanyu Xing, Yanli Liu, Haibin Ling, Xavier Granier, Yanci Zhang. Automatic Spatially Varying Illumination Recovery of Indoor Scenes Based on a Single RGB-D Image. IEEE Transactions on Visualization and Computer Graphics, 2020, 26 (4), pp.1672 - 1685. ⟨10.1109/TVCG.2018.2876541⟩. ⟨hal-01907554⟩
277 View
77 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More