On hyper-parameter selection for guaranteed convergence of RMSProp
Jinlan Liu, Dongpo Xu, Huisheng Zhang, Danilo P. Mandic
Topics & Concepts
Convergence (economics)HyperparameterBenchmark (surveying)Computer scienceDivergence (linguistics)Mathematical optimizationSelection (genetic algorithm)Sequence (biology)Artificial intelligenceMathematicsEconomic growthBiologyEconomicsGeographyGeneticsPhilosophyLinguisticsGeodesySparse and Compressive Sensing TechniquesStochastic Gradient Optimization TechniquesGaussian Processes and Bayesian Inference