Variable three-term conjugate gradient method for training artificial neural networks
Hansu Kim, Chuxuan Wang, Hyoseok Byun, Weifei Hu, Sanghyuk Kim, Qing Jiao, Tae Hee Lee
Topics & Concepts
Conjugate gradient methodHessian matrixComputer scienceArtificial neural networkArtificial intelligenceNonlinear conjugate gradient methodGradient descentStochastic gradient descentTerm (time)Stability (learning theory)Gradient methodBenchmark (surveying)Variable (mathematics)Convolutional neural networkAlgorithmMathematical optimizationMachine learningMathematicsApplied mathematicsGeodesyPhysicsMathematical analysisGeographyQuantum mechanicsAdvanced Neural Network ApplicationsRobot Manipulation and LearningStochastic Gradient Optimization Techniques