Calibrating the adaptive learning rate to improve convergence of ADAM
Qianqian Tong, Guannan Liang, Jinbo Bi
Topics & Concepts
Convergence (economics)Rate of convergenceComputer scienceArtificial intelligenceAdaptive learningMathematical optimizationDeep learningAlgorithmMathematicsEmpirical researchMachine learningApplied mathematicsStochastic Gradient Optimization TechniquesSparse and Compressive Sensing TechniquesNeural Networks and Applications