Litcius/Paper detail

Unbiased warped-area sampling for differentiable rendering

Sai Praveen Bangaru, Tzu‐Mao Li, Frédo Durand

2020ACM Transactions on Graphics120 citationsDOIOpen Access PDF

Abstract

Differentiable rendering computes derivatives of the light transport equation with respect to arbitrary 3D scene parameters, and enables various applications in inverse rendering and machine learning. We present an unbiased and efficient differentiable rendering algorithm that does not require explicit boundary sampling. We apply the divergence theorem to the derivative of the rendering integral to convert the boundary integral into an area integral. We rewrite the converted area integral to a form that is suitable for Monte Carlo rendering. We then develop an efficient Monte Carlo sampling algorithm for solving the area integral. Our method can be easily plugged into a traditional path tracer and does not require dedicated data structures for sampling boundaries. We analyze the convergence properties through bias-variance metrics, and demonstrate our estimator's advantages over existing methods for some synthetic inverse rendering examples.

Topics & Concepts

Rendering (computer graphics)Differentiable functionComputer scienceMonte Carlo methodImportance samplingEstimatorAlgorithmPath tracingMathematical optimizationApplied mathematicsMathematicsArtificial intelligenceMathematical analysisStatisticsComputer Graphics and Visualization TechniquesAdvanced Vision and Imaging3D Shape Modeling and Analysis
Unbiased warped-area sampling for differentiable rendering | Litcius