Modified λ-Policy Iteration Based Adaptive Dynamic Programming for Unknown Discrete-Time Linear Systems
Huaiyuan Jiang, Bin Zhou, Guang‐Ren Duan
Abstract
In this article, the λ -policy iteration ( λ -PI) method for the optimal control problem of discrete-time linear systems is reconsidered and restated from a novel aspect. First, the traditional λ -PI method is recalled, and some new properties of the traditional λ -PI are proposed. Based on these new properties, a modified λ -PI algorithm is introduced with its convergence proven. Compared with the existing results, the initial condition is further relaxed. The data-driven implementation is then constructed with a new matrix rank condition for verifying the feasibility of the proposed data-driven implementation. A simulation example verifies the effectiveness of the proposed method.
Topics & Concepts
Discrete time and continuous timeDynamic programmingComputer scienceMathematical optimizationLinear programmingMathematicsApplied mathematicsControl theory (sociology)StatisticsArtificial intelligenceControl (management)Adaptive Dynamic Programming ControlMechanical Circulatory Support DevicesFrequency Control in Power Systems