A novel stepsize for gradient descent method
Pham Thi Hoai, Nguyen The Vinh, Nguyen Phung Hai Chung
Topics & Concepts
Lipschitz continuityGradient descentMathematical optimizationMathematicsGradient methodAdaptive stepsizeRegular polygonConvex optimizationNonlinear systemConvex functionProximal Gradient MethodsSet (abstract data type)Optimization problemStochastic gradient descentAlgorithmApplied mathematicsComputer scienceNumerical analysisMathematical analysisArtificial intelligenceArtificial neural networkQuantum mechanicsProgramming languagePhysicsGeometrySparse and Compressive Sensing TechniquesStochastic Gradient Optimization TechniquesAdvanced Optimization Algorithms Research