Accelerating gradient descent and Adam via fractional gradients
Yeonjong Shin, Jérôme Darbon, George Em Karniadakis
Topics & Concepts
Gradient descentMathematicsFractional calculusAccelerationApplied mathematicsConvergence (economics)Integer (computer science)Order (exchange)Rate of convergenceConvex functionMathematical optimizationOptimization problemArtificial neural networkComputer scienceRegular polygonArtificial intelligenceGeometryEconomicsClassical mechanicsComputer networkProgramming languageChannel (broadcasting)Economic growthFinancePhysicsFractional Differential Equations SolutionsMachine Learning and ELMModel Reduction and Neural Networks