Litcius/Paper detail

Robust sub-Gaussian estimation of a mean vector in nearly linear time

Jules Depersin, Guillaume Lecué

2022The Annals of Statistics56 citationsDOI

Abstract

We construct an algorithm for estimating the mean of a heavy-tailed random variable when given an adversarial corrupted sample of N independent observations. The only assumption we make on the distribution of the noncorrupted (or informative) data is the existence of a covariance matrix Σ, unknown to the statistician. Our algorithm outputs μˆ, which is robust to the presence of |O| adversarial outliers and satisfies (1)‖μˆ−μ‖2≲ Tr(Σ) N+ ‖Σ‖opK N with probability at least 1−exp(−c0K)−exp(−c1u), and runtime O˜(Nd+uKd) where K∈{600|O|,…,N} and u∈N∗ are two parameters of the algorithm. The algorithm is fully data-dependent and does not use (1) in its construction, which combines recently developed tools for median-of-means estimators and covering semidefinite programming. We also show that this algorithm can automatically adapt to the number of outliers (adaptive choice of K) and that it satisfies the same bound in expectation.

Topics & Concepts

MathematicsOutlierCovariance matrixEstimatorCovarianceGaussianMultivariate random variableAlgorithmRandom variableSemidefinite programmingCombinatoricsMathematical optimizationStatisticsQuantum mechanicsPhysicsSparse and Compressive Sensing TechniquesMachine Learning and AlgorithmsMarkov Chains and Monte Carlo Methods
Robust sub-Gaussian estimation of a mean vector in nearly linear time | Litcius