Learning dynamics of gradient descent optimization in deep neural networks
Wei Wu, Xiao‐Yuan Jing, Wencai Du, Guoliang Chen
Topics & Concepts
Computer scienceStability (learning theory)Stochastic gradient descentConvergence (economics)Gradient descentArtificial intelligenceArtificial neural networkMomentum (technical analysis)Dynamics (music)Perspective (graphical)Deep learningFunction (biology)Machine learningPhysicsEconomicsBiologyEconomic growthEvolutionary biologyFinanceAcousticsStochastic Gradient Optimization TechniquesMachine Learning and ELMModel Reduction and Neural Networks