Litcius/Paper detail

LighTN: Light-Weight Transformer Network for Performance-Overhead Tradeoff in Point Cloud Downsampling

Xu Wang, Yi Jin, Yigang Cen, Tao Wang, Bowen Tang, Yidong Li

2023IEEE Transactions on Multimedia44 citationsDOI

Abstract

Downsampling is a crucial task for processing large scale and/or dense point clouds with limited resources. Owing to the development of deep learning, approaches of task-oriented point cloud downsampling have significant performance gains in preserving geometric information. However, most downsamling methods are limited by the disordered and unstructured point cloud data, making it difficult to continually improve the performance. To address this issue, we propose a light-weight Transformer network (LighTN) for the task-oriented point cloud downsampling as an end-to-end solution. In LighTN, we design an energy-efficient and permutation invariant single-head self-correlation module to extract refined global geometric features. Moreover, we present a novel sampling loss function to guide LighTN to focus on critical point cloud regions with more uniform distributions and prominent point coverage. Extensive experiments on classification, registration, and reconstruction tasks demonstrate that LighTN can achieve the state-of-the-art performance-overhead tradeoff and high-quality qualitative results.

Topics & Concepts

Computer scienceUpsamplingCloud computingComputer networkTransformerOverhead (engineering)Artificial intelligenceElectrical engineeringOperating systemEngineeringImage (mathematics)VoltageAdvanced Optical Sensing TechnologiesOptical Imaging and Spectroscopy TechniquesOcular and Laser Science Research