SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields

Abstract

In the literature, 3D reconstruction from 2D image has been extensively addressed but often still requires geometrical supervision. In this paper, we propose SceneRF, a self-supervised monocular scene reconstruction method with neural radiance fields (NeRF) learned from multiple image sequences with pose. To improve geometry prediction, we introduce new geometry constraints and a novel probabilistic sampling strategy that efficiently update radiance fields. As the latter are conditioned on a single frame, scene reconstruction is achieved from the fusion of multiple synthesized novel depth views. This is enabled by our spherical-decoder, which allows hallucination beyond the input frame field of view. Thorough experiments demonstrate that we outperform all baselines on all metrics for novel depth views synthesis and scene reconstruction. Our code is available at https://astra-vision.github.io/SceneRF

Dates and versions

hal-03945327 , version 1 (18-01-2023)

Licence

Attribution

Identifiers

Cite

Anh-Quan Cao, Raoul de Charette. SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields. International Conference on Computer Vision (ICCV), Oct 2023, Paris, France. ⟨hal-03945327⟩

Collections

INRIA INRIA2 ANR
31 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More