Pseudo-Reference Point Cloud Quality Measurement Based on Joint 2-D and 3-D Distortion Description

Abstract

Point cloud (PC) compression inevitably introduces distortion during communication, which can affect users’ visual experience. Thus, efficient point cloud quality measurement (PCQM) tools are highly desired to measure the PC’s visual quality. In this paper, a pseudo-reference PCQM metric based on joint two-dimensional (2D) and three-dimensional (3D) distortion description is proposed. In 2D description, aiming at the visual quality degradation reflected cooperatively by PC’s texture distortion and geometry distortion, a joint texture-geometry distribution with texture projection map and geometry projection map of the video-based point cloud compression (V-PCC) standard is constructed to measure the joint texture-geometry distortion of PC. Since the geometry distortion of PC results in the similar distortion phenomena in the geometry projection map and texture projection map, a self-reference geometry-texture structural similarity (SGT-SSIM) is proposed. The separate statistical features of texture projection map and geometry projection map are also considered. In 3D description, considering the limitations of using full-reference metric and the difficulty of directly reflecting PC cracks and outliers only by the V-PCC projection, a pseudo-reference PC is constructed by performing Poisson surface reconstruction on the distorted PC. Then, the point-to-distribution is used to directly characterize pseudo-referenced geometry distortion, while gray level-gradient co-occurrence matrix based on key points of PC is constructed to measure the texture distortion. Finally, the features with joint 2D and 3D distortion description are combined to measure the PC visual quality more comprehensively. Experimental results on five PC datasets demonstrate that the proposed metric has comparable performance to the existing full-reference metrics.

Topics & Concepts