Adaptive learning rate optimization algorithms with dynamic bound based on Barzilai-Borwein method
Zhijun Wang, He-Bei Gao, Xianghong Wang, Shuai-Ye Zhao, Hong Li, Xiaoqin Zhang
Topics & Concepts
Stability (learning theory)Computer scienceConvergence (economics)AlgorithmAdaptive optimizationRate of convergenceStochastic gradient descentArtificial neural networkGradient descentUpper and lower boundsMathematical optimizationArtificial intelligenceMathematicsMachine learningKey (lock)Operating systemEconomic growthMathematical analysisEconomicsComputer securityStochastic Gradient Optimization TechniquesNeural Networks and ApplicationsMachine Learning and ELM