Convergence of the RMSProp deep learning method with penalty for nonconvex optimization
Dongpo Xu, Shengdong Zhang, Huisheng Zhang, Danilo P. Mandic
Topics & Concepts
Norm (philosophy)MathematicsSequence (biology)Penalty methodMathematical optimizationConvergence (economics)MNIST databaseStationary pointStochastic gradient descentApplied mathematicsComputer scienceArtificial neural networkArtificial intelligenceMathematical analysisEconomic growthEconomicsLawGeneticsPolitical scienceBiologyStochastic Gradient Optimization TechniquesSparse and Compressive Sensing TechniquesMachine Learning and ELM