Convergence analysis of AdaBound with relaxed bound functions for non-convex optimization
Jinlan Liu, Jun Kong, Dongpo Xu, Miao Qi, Yinghua Lu
Topics & Concepts
MathematicsUpper and lower boundsCompact convergenceMonotonic functionConvergence (economics)Applied mathematicsConvex functionConvex optimizationMathematical optimizationNormal convergenceMomentum (technical analysis)Modes of convergence (annotated index)Convergence testsFunction (biology)Rate of convergenceRegular polygonComputer scienceMathematical analysisDiscrete mathematicsFinanceTopological vector spaceComputer networkEconomicsGeometryBiologyEvolutionary biologyTopological spaceEconomic growthChannel (broadcasting)Isolated pointStochastic Gradient Optimization TechniquesSparse and Compressive Sensing TechniquesMedical Image Segmentation Techniques