Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes

Abstract

Image-Based Rendering (IBR) allows high-fidelity free-viewpoint navigation using only a set of photographs and 3D reconstruction as input. It is often necessary or convenient to remove objects from the captured scenes, allowing a form of scene editing for IBR. This requires multi-view inpainting of the input images. Previous methods suffer from several major limitations: they lack true multi-view coherence, resulting in artifacts such as blur, they do not preserve perspective during inpainting, provide inaccurate depth completion and can only handle scenes with a few tens of images. Our approach addresses these limitations by introducing a new multi-view method that performs inpainting in intermediate, locally common planes. Use of these planes results in correct perspective and multi-view coherence of inpainting results. For efficient treatment of large scenes, we present a fast planar region extraction method operating on small image clusters. We adapt the resolution of inpainting to that required in each input image of the multi-view dataset, and carefully handle image resampling between the input images and rectified planes. We show results on large indoors and outdoors environments.
Fichier principal
Vignette du fichier
philip2018mvplanarInpaint.pdf (11.79 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01745568 , version 1 (28-03-2018)

Identifiers

Cite

Julien Philip, George Drettakis. Plane-Based Multi-View Inpainting for Image-Based Rendering in Large Scenes. I3D 2018 - ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, May 2018, Montréal, Canada. pp.1-11, ⟨10.1145/3190834.3190846⟩. ⟨hal-01745568⟩
239 View
727 Download

Altmetric

Share

Gmail Facebook X LinkedIn More