Litcius/Paper detail

Learning Multiview 3D Point Cloud Registration

Žan Gojčič, Caifa Zhou, Jan Dirk Wegner, Leonidas Guibas, Tolga Birdal

2020193 citationsDOI

Abstract

We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm. Registration of multiple scans typically follows a two-stage pipeline: the initial pairwise alignment and the globally consistent refinement. The former is often ambiguous due to the low overlap of neighboring point clouds, symmetries and repetitive scene parts. Therefore, the latter global refinement aims at establishing the cyclic consistency across multiple scans and helps in resolving the ambiguous cases. In this paper we propose, to the best of our knowledge, the first end-to-end algorithm for joint learning of both parts of this two-stage problem. Experimental evaluation on well accepted benchmark datasets shows that our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly. Moreover, we present detailed analysis and an ablation study that validate the novel components of our approach. The source code and pretrained models are publicly available under https://github.com/zgojcic/3D_multiview_reg.

Topics & Concepts

Point cloudComputer scienceMargin (machine learning)Benchmark (surveying)Artificial intelligencePairwise comparisonConsistency (knowledge bases)Pipeline (software)Point (geometry)Image registrationCode (set theory)Computer visionSource codeAlgorithmMachine learningImage (mathematics)Set (abstract data type)GeographyMathematicsGeodesyProgramming languageGeometryOperating system3D Surveying and Cultural Heritage3D Shape Modeling and AnalysisRemote Sensing and LiDAR Applications