Rich Intrinsic Image Decomposition of Outdoor Scenes from Multiple Views - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Visualization and Computer Graphics Year : 2013

Rich Intrinsic Image Decomposition of Outdoor Scenes from Multiple Views

Abstract

Intrinsic images aim at separating an image into its reflectance and illumination components to facilitate further analysis or manipulation. This separation is severely ill-posed and the most successful methods rely on user indications or precise geometry to resolve the ambiguities inherent to this problem. In this paper we propose a method to estimate intrinsic images from multiple views of an outdoor scene without the need for precise geometry and with a few manual steps to calibrate the input. We use multiview stereo to automatically reconstruct a 3D point cloud of the scene. Although this point cloud is sparse and incomplete, we show that it provides the necessary information to compute plausible sky and indirect illumination at each 3D point. We then introduce an optimization method to estimate sun visibility over the point cloud. This algorithm compensates for the lack of accurate geometry and allows the extraction of precise shadows in the final image. We finally propagate the information computed over the sparse point cloud to every pixel in the photograph using image-guided propagation. Our propagation not only separates reflectance from illumination, but also decomposes the illumination into a sun, sky and indirect layer. This rich decomposition allows novel image manipulations as demonstrated by our results.
Fichier principal
Vignette du fichier
LDB_TVCG12-paper.pdf (12.08 Mo) Télécharger le fichier
Vignette du fichier
teaser_tvcg.PNG (868.88 Ko) Télécharger le fichier
LDB_TVCG12-supp-appendix.pdf (36.71 Mo) Télécharger le fichier
LDB_TVCG12-supp-video.mov (45.25 Mo) Télécharger le fichier
poster_siggraph_compressed.pdf (1.01 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Format : Other
Format : Video
Format : Other

Dates and versions

hal-00761121 , version 1 (05-12-2012)

Identifiers

  • HAL Id : hal-00761121 , version 1

Cite

Pierre-Yves Laffont, Adrien Bousseau, George Drettakis. Rich Intrinsic Image Decomposition of Outdoor Scenes from Multiple Views. IEEE Transactions on Visualization and Computer Graphics, 2013, 19 (2). ⟨hal-00761121⟩

Collections

INRIA INRIA2
202 View
2281 Download

Share

Gmail Facebook Twitter LinkedIn More