Deep Unrolling for Light Field Compressed Acquisition using Coded Masks - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2022

Deep Unrolling for Light Field Compressed Acquisition using Coded Masks

Résumé

Compressed sensing using color-coded masks has been recently considered for capturing light fields using a small number of measurements. Such an acquisition scheme is very practical, since any consumer-level camera can be turned into a light field acquisition camera by simply adding a coded mask in front of the sensor. We present an efficient and mathematically grounded deep learning model to reconstruct a light field from a set of measurements obtained using a color-coded mask and a color filter array (CFA). Following the promising trend of unrolling optimization algorithms with learned priors, we formulate our task of light field reconstruction as an inverse problem and derive a principled deep network architecture from this formulation. We also introduce a closed-form extraction of information from the acquisition, while similar methods found in the recent literature systematically use an approximation. Compared to similar deep learning methods, we show that our approach allows for a better reconstruction quality. We further show that our approach is robust to noise using realistic simulations of the sensing acquisition process.
Fichier principal
Vignette du fichier
Deep Unrolling for Light Field Compressed Acquisition using Coded Masks.pdf (4.32 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03643112 , version 1 (15-04-2022)

Identifiants

Citer

Guillaume Le Guludec, Christine Guillemot. Deep Unrolling for Light Field Compressed Acquisition using Coded Masks. IEEE Access, 2022, pp.1-17. ⟨10.1109/access.2022.3168362⟩. ⟨hal-03643112⟩
101 Consultations
93 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More