Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields

Abstract

Neural Radiance Fields (NeRFs) have shown promise in applications like view synthesis and depth estimation, but learning from multiview images faces inherent uncertain-ties. Current methods to quantify them are either heuristic or computationally demanding. We introduce Bayes'Rays, a post-hoc framework to evaluate uncertainty in any pre-trained NeRF without modifying the training process. Our method establishes a volumetric uncertainty field using spa-tial perturbations and a Bayesian Laplace approximation. We derive our algorithm statistically and show its superior performance in key metrics and applications. More results available at: https://bayesrays.github.io

Topics & Concepts