Litcius/Paper detail

Joint Neural Denoising of Surfaces and Volumes

Nikolai Hofmann, Jon Hasselgren, Jacob Munkberg

2023Proceedings of the ACM on Computer Graphics and Interactive Techniques10 citationsDOI

Abstract

Denoisers designed for surface geometry rely on noise-free feature guides for high quality results. However, these guides are not readily available for volumes. Our method enables combined volume and surface denoising in real time from low sample count (4 spp) renderings. The rendered image is decomposed into volume and surface layers, leveraging spatio-temporal neural denoisers for both components. The individual signals are composited using learned weights and denoised transmittance. Our architecture outperforms current denoisers in scenes containing both surfaces and volumes, and produces temporally stable results at interactive rates.

Topics & Concepts

Computer scienceJoint (building)Noise reductionArtificial intelligenceSurface (topology)Noise (video)Volume (thermodynamics)Computer visionFeature (linguistics)Image denoisingSample (material)Image (mathematics)Pattern recognition (psychology)MathematicsGeometryEngineeringLinguisticsArchitectural engineeringPhysicsPhilosophyChemistryQuantum mechanicsChromatographyComputer Graphics and Visualization Techniques3D Shape Modeling and AnalysisAdvanced Vision and Imaging
Joint Neural Denoising of Surfaces and Volumes | Litcius