Light Field Compression via Compact Neural Scene Representation - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Light Field Compression via Compact Neural Scene Representation

Résumé

In this paper, we propose a novel light field compression method based on a low rank-constrained neural scene representation. While most existing methods directly compress the light field views, our method first learns a Multi-Layer Perceptron (MLP)-based Neural Radiance Field (NeRF) from the input views. To be able to efficiently compress the NeRF scene representation, the weights of the MLP are optimized under a low-rank constraint using the Alternating Direction Method of Multipliers (ADMM) optimization method. The weights of NeRF are then decomposed into Tensor Train (TT) components which allow us to distill original NeRF network into a slimmer one. The slim NeRF is then refined using a quantization-aware training procedure. Experimental results show that this low rank-constrained NeRF-based light field compression method can achieve better rate-distortion than reference methods, while keeping the free-viewpoint reconstruction capability.
Fichier principal
Vignette du fichier
ICASSP_2023_LFC.pdf (4.33 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04017645 , version 1 (09-03-2023)
hal-04017645 , version 2 (13-03-2023)
hal-04017645 , version 3 (29-03-2023)

Identifiants

  • HAL Id : hal-04017645 , version 3

Citer

Jinglei Shi, Christine Guillemot. Light Field Compression via Compact Neural Scene Representation. ICASSP 2023 - IEEE International Conference on Acoustics, Speech, and Signal Processing, Jun 2023, Rhodes island, Greece. pp.1-5. ⟨hal-04017645v3⟩
118 Consultations
160 Téléchargements

Partager

Gmail Facebook X LinkedIn More