Litcius/Paper detail

Sparse SIR: Optimal rates and adaptive estimation

Kai Tan, Lei Shi, Zhou Yu

2020The Annals of Statistics30 citationsDOIOpen Access PDF

Abstract

Sliced inverse regression (SIR) is an innovative and effective method for sufficient dimension reduction and data visualization. Recently, an impressive range of penalized SIR methods has been proposed to estimate the central subspace in a sparse fashion. Nonetheless, few of them considered the sparse sufficient dimension reduction from a decision-theoretic point of view. To address this issue, we in this paper establish the minimax rates of convergence for estimating the sparse SIR directions under various commonly used loss functions in the literature of sufficient dimension reduction. We also discover the possible trade-off between statistical guarantee and computational performance for sparse SIR. We finally propose an adaptive estimation scheme for sparse SIR which is computationally tractable and rate optimal. Numerical studies are carried out to confirm the theoretical properties of our proposed methods.

Topics & Concepts

MinimaxMathematicsSufficient dimension reductionDimensionality reductionSubspace topologyMathematical optimizationDimension (graph theory)Rate of convergenceSliced inverse regressionRange (aeronautics)Reduction (mathematics)AlgorithmRegressionComputer scienceArtificial intelligenceStatisticsKey (lock)Materials scienceComputer securityMathematical analysisComposite materialGeometryPure mathematicsSparse and Compressive Sensing TechniquesStatistical Methods and InferenceNumerical methods in inverse problems