Litcius/Paper detail

Contrastive Learning for Joint Normal Estimation and Point Cloud Filtering

Dasith de Silva Edirimuni, Xuequan Lu, Gang Li, Antonio Robles‐Kelly

2023IEEE Transactions on Visualization and Computer Graphics20 citationsDOIOpen Access PDF

Abstract

Point cloud filtering and normal estimation are two fundamental research problems in the 3D field. Existing methods usually perform normal estimation and filtering separately and often show sensitivity to noise and/or inability to preserve sharp geometric features such as corners and edges. In this article, we propose a novel deep learning method to jointly estimate normals and filter point clouds. We first introduce a 3D patch based contrastive learning framework, with noise corruption as an augmentation, to train a feature encoder capable of generating faithful representations of point cloud patches while remaining robust to noise. These representations are consumed by a simple regression network and supervised by a novel joint loss, simultaneously estimating point normals and displacements that are used to filter the patch centers. Experimental results show that our method well supports the two tasks simultaneously and preserves sharp features and fine details. It generally outperforms state-of-the-art techniques on both tasks.

Topics & Concepts

Point cloudComputer scienceFilter (signal processing)Artificial intelligenceNoise (video)Feature (linguistics)Deep learningCode (set theory)EncoderSource codePattern recognition (psychology)Point (geometry)Computer visionImage (mathematics)MathematicsLinguisticsSet (abstract data type)Programming languagePhilosophyOperating systemGeometry3D Shape Modeling and AnalysisOptical measurement and interference techniques3D Surveying and Cultural Heritage