Reparameterizing Discontinuous Integrands for Differentiable Rendering - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue ACM Transactions on Graphics Année : 2019

Reparameterizing Discontinuous Integrands for Differentiable Rendering

Résumé

Differentiable rendering has recently opened the door to a number of challenging inverse problems involving photorealistic images, such as computational material design and scattering-aware reconstruction of geometry and materials from photographs. Differentiable rendering algorithms strive to estimate partial derivatives of pixels in a rendered image with respect to scene parameters, which is difficult because visibility changes are inherently non-differentiable. We propose a new technique for differentiating path-traced images with respect to scene parameters that affect visibility, including the position of cameras, light sources, and vertices in triangle meshes. Our algorithm computes the gradients of illumination integrals by applying changes of variables that remove or strongly reduce the dependence of the position of discontinuities on differentiable scene parameters. The underlying parameterization is created on the fly for each integral and enables accurate gradient estimates using standard Monte Carlo sampling in conjunction with automatic differentiation. Importantly, our approach does not rely on sampling silhouette edges, which has been a bottleneck in previous work and tends to produce high-variance gradients when important edges are found with insufficient probability in scenes with complex visibility and high-resolution geometry. We show that our method only requires a few samples to produce gradients with low bias and variance for challenging cases such as glossy reflections and shadows. Finally, we use our differentiable path tracer to reconstruct the 3D geometry and materials of several real-world objects from a set of reference photographs.
Fichier principal
Vignette du fichier
differentiable-pt-cov.pdf (9.09 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02497191 , version 1 (03-03-2020)

Identifiants

Citer

Guillaume Loubet, Nicolas Holzschuch, Wenzel Jakob. Reparameterizing Discontinuous Integrands for Differentiable Rendering. ACM Transactions on Graphics, 2019, 38 (6), pp.228:1 - 228:14. ⟨10.1145/3355089.3356510⟩. ⟨hal-02497191⟩
213 Consultations
694 Téléchargements

Altmetric

Partager

More