Silhouette-Aware Warping for Image-Based Rendering - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Computer Graphics Forum Year : 2011

Silhouette-Aware Warping for Image-Based Rendering

Abstract

Image-based rendering (IBR) techniques allow capture and display of 3D environments using photographs. Modern IBR pipelines reconstruct proxy geometry using multi-view stereo, reproject the photographs onto the proxy and blend them to create novel views. The success of these methods depends on accurate 3D proxies, which are difficult to obtain for complex objects such as trees and cars. Large number of input images do not improve reconstruction proportionally; surface extraction is challenging even from dense range scans for scenes containing such objects. Our approach does not depend on dense accurate geometric reconstruction; instead we compensate for sparse 3D information by variational image warping. In particular, we formulate silhouette-aware warps that preserve salient depth discontinuities. This improves the rendering of difficult foreground objects, even when deviating from view interpolation. We use a semi-automatic step to identify depth discontinuities and extract a sparse set of depth constraints used to guide the warp. Our framework is lightweight and results in good quality IBR for previously challenging environments.
Vignette du fichier
result_tree.jpg (569.63 Ko) Télécharger le fichier Fichier principal
Vignette du fichier
warpibr_paper_preprint.pdf (677.52 Ko) Télécharger le fichier
Vignette du fichier
result_aquarium.jpg (548.66 Ko) Télécharger le fichier
Vignette du fichier
result_castle.jpg (85.76 Ko) Télécharger le fichier
Vignette du fichier
result_street.jpg (592.22 Ko) Télécharger le fichier
warpibr_supplem.pdf (196.7 Ko) Télécharger le fichier
Format : Figure, Image
Origin : Files produced by the author(s)
Format : Figure, Image
Format : Figure, Image
Format : Figure, Image
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00607039 , version 1 (07-07-2011)
inria-00607039 , version 2 (21-11-2013)

Identifiers

Cite

Gaurav Chaurasia, Olga Sorkine, George Drettakis. Silhouette-Aware Warping for Image-Based Rendering. Computer Graphics Forum, 2011, Proceedings of the Eurographics Symposium on Rendering, 30 (4), ⟨10.1111/j.1467-8659.2011.01981.x⟩. ⟨inria-00607039v2⟩

Collections

INRIA INRIA2
200 View
844 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More