A Comparative Assessment Of Implicit and Explicit Plenoptic Scene Representations - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2024

A Comparative Assessment Of Implicit and Explicit Plenoptic Scene Representations

Résumé

3D scene representation has been a central theme of study for a wide range of applications, and the representation of light behavior is one of the relevant topics when producing realistic models. In this work, we create a framework to assess the representation of non-Lambertian scenes by generating a pipeline to create plenoptic point clouds (PPCs) systematically and evaluating them against implicit solutions, such as Neural Radiance Fields (NeRF)-like models. We compare such approaches according to rendering quality and compression efficiency. On the compression side, we propose an encoding scheme for PPC, leveraging the occlusion masks of the points and the Moving Picture Expert Group's (MPEG) Geometry-Based Solid Content Test Model (GeS-TM). Rendering results over the training views show that the uncompressed PPC outperforms 3D Gaussian Splatting (3DGS) by 1.51 dB, on average, for the 8 scenes of the NeRF Synthetic 360 dataset. In compression efficiency, 3DGS outperforms the compressed PPCs by 0.7 dB in BD-PSNR on average. Our occlusion-aware encoding scheme reduces the size of uncompressed PPCs up to 800 times, outperforming current encoding schemes for PPC by 1.9 dB in BD-PSNR.

Fichier principal
Vignette du fichier
MMSP_2024_PPCs_vs_Nerf_Camera-Ready_v2.pdf (4.37 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04709909 , version 1 (26-09-2024)

Licence

Identifiants

  • HAL Id : hal-04709909 , version 1

Citer

Davi R Freitas, Ricardo L de Queiroz, Ioan Tabus, Christine Guillemot. A Comparative Assessment Of Implicit and Explicit Plenoptic Scene Representations. MMSP 2024 - 26th IEEE International Workshop on Multimedia Signal Processing, Oct 2024, West Lafayette (IN), United States. pp.1-6. ⟨hal-04709909⟩
0 Consultations
0 Téléchargements

Partager

More