Litcius/Paper detail

An efficient hybrid conjugate gradient method for unconstrained optimization

Abdulkarim Hassan Ibrahim, Poom Kumam, Ahmad Kamandi, Auwal Bala Abubakar

2022Optimization methods & software58 citationsDOI

Abstract

In this paper, we propose a hybrid conjugate gradient method for unconstrained optimization, obtained by a convex combination of the LS and KMD conjugate gradient parameters. A favourite property of the proposed method is that the search direction satisfies the Dai–Liao conjugacy condition and the quasi-Newton direction. In addition, this property does not depend on the line search. Under a modified strong Wolfe line search, we establish the global convergence of the method. Numerical comparison using a set of 109 unconstrained optimization test problems from the CUTEst library show that the proposed method outperforms the Liu–Storey and Hager–Zhang conjugate gradient methods.

Topics & Concepts

Conjugate gradient methodNonlinear conjugate gradient methodLine searchMathematicsDerivation of the conjugate gradient methodGradient methodConjugate residual methodConvergence (economics)Mathematical optimizationGradient descentProperty (philosophy)Conjugacy classApplied mathematicsComputer scienceCombinatoricsArtificial intelligenceComputer securityRADIUSEconomic growthPhilosophyEpistemologyArtificial neural networkEconomicsAdvanced Optimization Algorithms ResearchOptimization and Variational AnalysisIterative Methods for Nonlinear Equations