Litcius/Paper detail

PRIN/SPRIN: On Extracting Point-Wise Rotation Invariant Features

Yang You, Yujing Lou, Ruoxi Shi, Qi Liu, Yu-Wing Tai, Lizhuang Ma, Weiming Wang, Cewu Lu

2021IEEE Transactions on Pattern Analysis and Machine Intelligence16 citationsDOI

Abstract

Point cloud analysis without pose priors is very challenging in real applications, as the orientations of point clouds are often unknown. In this paper, we propose a brand new point-set learning framework PRIN, namely, Point-wise Rotation Invariant Network, focusing on rotation invariant feature extraction in point clouds analysis. We construct spherical signals by Density Aware Adaptive Sampling to deal with distorted point distributions in spherical space. Spherical Voxel Convolution and Point Re-sampling are proposed to extract rotation invariant features for each point. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Both PRIN and SPRIN can be applied to tasks ranging from object classification, part segmentation, to 3D feature matching and label alignment. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation. We also provide thorough theoretical proof and analysis for point-wise rotation invariance achieved by our methods. The code to reproduce our results will be made publicly available.

Topics & Concepts

Point cloudInvariant (physics)Artificial intelligenceRotation (mathematics)Feature extractionComputer sciencePattern recognition (psychology)Computer visionCognitive neuroscience of visual object recognitionConvolution (computer science)AlgorithmMathematicsPoint (geometry)Rotational invarianceFeature (linguistics)Matching (statistics)PoseObject detectionShape analysis (program analysis)Rigid transformationPoint set registrationPoint distribution model3D Shape Modeling and AnalysisRobotics and Sensor-Based Localization3D Surveying and Cultural Heritage