Last-iterate convergence analysis of stochastic momentum methods for neural networks
Jinlan Liu, Dongpo Xu, Yinghua Lu, Jun Kong, Danilo P. Mandic
Topics & Concepts
Stochastic optimizationConvergence (economics)Iterated functionMomentum (technical analysis)MathematicsMathematical optimizationApplied mathematicsCompact convergenceStochastic gradient descentConvex functionStochastic approximationComputer scienceRegular polygonRate of convergenceArtificial neural networkMathematical analysisKey (lock)Computer securityEconomicsGeometryMachine learningFinanceEconomic growthStochastic Gradient Optimization TechniquesAdvanced Neural Network ApplicationsMachine Learning and ELM