Stochastic Gradient Descent with Polyak’s Learning Rate
Mariana Prazeres, Adam M. Oberman
Topics & Concepts
Stochastic gradient descentSubgradient methodMathematicsConstant (computer programming)Rate of convergenceGeneralizationGradient descentRegular polygonDescent (aeronautics)Applied mathematicsConvex functionMathematical optimizationConvergence (economics)Artificial neural networkMathematical analysisComputer scienceArtificial intelligenceGeometryComputer networkEconomic growthChannel (broadcasting)Programming languageEconomicsEngineeringAerospace engineeringStochastic Gradient Optimization TechniquesSparse and Compressive Sensing TechniquesMachine Learning and Algorithms