Litcius/Paper detail

Tensor Entropy for Uniform Hypergraphs

Can Chen, Indika Rajapakse

2020IEEE Transactions on Network Science and Engineering43 citationsDOIOpen Access PDF

Abstract

In this paper, we develop the notion of entropy for uniform hypergraphs via tensor theory. We employ the probability distribution of the generalized singular values, calculated from the higher-order singular value decomposition of the Laplacian tensors, to fit into the Shannon entropy formula. We show that this tensor entropy is an extension of von Neumann entropy for graphs. In addition, we establish results on the lower and upper bounds of the entropy and demonstrate that it is a measure of regularity for uniform hypergraphs in simulated and experimental data. We exploit the tensor train decomposition in computing the proposed tensor entropy efficiently. Finally, we introduce the notion of robustness for uniform hypergraphs.

Topics & Concepts

MathematicsVon Neumann entropyEntropy (arrow of time)Joint quantum entropyGeneralized relative entropyRényi entropyQuantum relative entropyLaplace operatorMaximum entropy probability distributionEntropy rateTensor (intrinsic definition)Joint entropyMin entropyDifferential entropyProbability distributionSingular value decompositionProbability measurePure mathematicsUpper and lower boundsStatistical physicsRobustness (evolution)Information theoryDiscrete mathematicsSingular valueMathematical analysisConditional quantum entropyApplied mathematicsBinary entropy functionTensor decomposition and applicationsAdvanced Graph Neural NetworksGenerative Adversarial Networks and Image Synthesis