Quasi-Newton Optimization Methods for Deep Learning Applications
Jacob Rafati, Roummel F. Marica
Topics & Concepts
Hessian matrixQuasi-Newton methodBroyden–Fletcher–Goldfarb–Shanno algorithmComputer scienceReinforcement learningArtificial intelligenceMathematical optimizationTrust regionLine searchConvergence (economics)Deep learningOptimization problemStochastic gradient descentAlgorithmNewton's methodMathematicsNonlinear systemApplied mathematicsArtificial neural networkComputer securityEconomicsAsynchronous communicationPhysicsComputer networkEconomic growthRADIUSQuantum mechanicsStochastic Gradient Optimization TechniquesSparse and Compressive Sensing TechniquesAdvanced Optimization Algorithms Research