Litcius/Paper detail

Evaluation of Convolution Operation Based on the Interpretation of Deep Learning on 3-D Point Cloud

Bufan Zhao, Xianghong Hua, Kegen Yu, Wuyong Tao, Xiaoxing He, Shaoquan Feng, Pengju Tian

2020IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing14 citationsDOIOpen Access PDF

Abstract

The interpretation of deep learning network is an important part in understanding the convolutional neural networks (CNNs). As an exploratory research, this article explored the interpretation method in 3-D point cloud deep learning networks, for the purpose of evaluating the performance of convolution functions in 3-D point cloud CNNs. Specifically, a 3-D point cloud classification network with two branches is used as the interpretation network in two aspects; 1) information entropy is introduced to diagnose the internal representation in the middle layer of CNN; and 2) the external consistency of convolution function is measured by per-point classification accuracy with class activation mapping technique. Four typical convolution functions are tested by the interpretation network on ModelNet40 dataset and the experimental results demonstrate that the proposed evaluation method is reliable. Feature transformation ability and feature recognition ability of convolution functions are extracted by visualization evaluation and proposed measurable metrics evaluation.

Topics & Concepts

Computer scienceConvolution (computer science)Interpretation (philosophy)Cloud computingPoint cloudPoint (geometry)Artificial intelligenceDeep learningArtificial neural networkMathematicsProgramming languageGeometryOperating systemRemote Sensing and LiDAR ApplicationsImage Processing and 3D ReconstructionAdvanced Neural Network Applications