Litcius/Paper detail

Estimating Mixed Memberships With Sharp Eigenvector Deviations

Xueyu Mao, Purnamrita Sarkar, Deepayan Chakrabarti

2020Journal of the American Statistical Association66 citationsDOI

Abstract

We consider the problem of estimating community memberships of nodes in a network, where every node is associated with a vector determining its degree of membership in each community. Existing provably consistent algorithms often require strong assumptions about the population, are computationally expensive, and only provide an overall error bound for the whole community membership matrix. This article provides uniform rates of convergence for the inferred community membership vector of each node in a network generated from the mixed membership stochastic blockmodel (MMSB); to our knowledge, this is the first work to establish per-node rates for overlapping community detection in networks. We achieve this by establishing sharp row-wise eigenvector deviation bounds for MMSB. Based on the simplex structure inherent in the eigen-decomposition of the population matrix, we build on established corner-finding algorithms from the optimization community to infer the community membership vectors. Our results hold over a broad parameter regime where the average degree only grows poly-logarithmically with the number of nodes. Using experiments with simulated and real datasets, we show that our method achieves better error with lower variability over competing methods, and processes real world networks of up to 100,000 nodes within tens of seconds. Supplementary materials for this article are available online.

Topics & Concepts

Eigenvalues and eigenvectorsNode (physics)SimplexConvergence (economics)Stochastic block modelMathematicsMathematical optimizationPopulationComputer scienceMatrix (chemical analysis)Degree (music)Community structureRate of convergenceUpper and lower boundsData miningAlgorithmStatisticsCombinatoricsKey (lock)Cluster analysisEconomicsPhysicsQuantum mechanicsComposite materialAcousticsMaterials scienceEconomic growthEngineeringSociologyDemographyMathematical analysisStructural engineeringComputer securityComplex Network Analysis TechniquesData Management and AlgorithmsHuman Mobility and Location-Based Analysis
Estimating Mixed Memberships With Sharp Eigenvector Deviations | Litcius