Local convergence of tensor methods
Nikita Doikov, Yurii Nesterov
Abstract
In this paper, we study local convergence of high-order Tensor Methods for solving convex optimization problems with composite objective. We justify local superlinear convergence under the assumption of uniform convexity of the smooth component, having Lipschitz-continuous high-order derivative. The convergence both in function value and in the norm of minimal subgradient is established. Global complexity bounds for the Composite Tensor Method in convex and uniformly convex cases are also discussed. Lastly, we show how local convergence of the methods can be globalized using the inexact proximal iterations.
Topics & Concepts
MathematicsSubgradient methodConvergence (economics)Compact convergenceConvexityModes of convergence (annotated index)Applied mathematicsConvex optimizationConvex functionConvex analysisNorm (philosophy)Local convergenceTensor (intrinsic definition)Mathematical analysisRegular polygonConvergence testsMathematical optimizationUniform convergenceMatrix normFunction (biology)Proper convex functionConic optimizationSubderivativeNormal convergenceWeak convergenceNumerical analysisSymbolic convergence theoryLinear matrix inequalityGradient methodConvex combinationRate of convergenceTensor decomposition and applicationsStochastic Gradient Optimization TechniquesAdvanced Optimization Algorithms Research