A new non-adaptive optimization method: Stochastic gradient descent with momentum and difference
Wei Yuan, Fei Hu, Liangfu Lu
Topics & Concepts
Momentum (technical analysis)Convergence (economics)Stochastic gradient descentComputer scienceGradient descentExponential functionRate of convergenceAdaptive optimizationGradient methodSpeedupMathematical optimizationStochastic optimizationApplied mathematicsAlgorithmMathematicsArtificial neural networkArtificial intelligenceKey (lock)Mathematical analysisComputer securityFinanceOperating systemEconomicsEconomic growthStochastic Gradient Optimization TechniquesAdvanced Neural Network ApplicationsMachine Learning and ELM