Litcius/Paper detail

Infinite time linear quadratic stackelberg game problem for unknown stochastic discrete‐time systems via adaptive dynamic programming approach

Xikui Liu, Ruirui Liu, Yan Li

2020Asian Journal of Control15 citationsDOI

Abstract

Abstract In this paper, we propose an adaptive dynamic programming (ADP) approach to solve the infinite horizon linear quadratic (LQ) Stackelberg game problem for unknown stochastic discrete‐time systems with multiple decision makers. Firstly, the stochastic LQ Stackelberg game problem is converted into the deterministic problem by system transformation. Next, a value iteration ADP approach is put forword and the convergence is given. Thirdly, in order to implement the iterative method, back propagation neural network (BPNN) is chosen to design model network, critic network and action network to approximate the unknown systems, objective functions and Stackelberg strategies. Finally, simulation results show that the algorithm is effective.

Topics & Concepts

Stackelberg competitionMathematical optimizationConvergence (economics)Discrete time and continuous timeComputer scienceTime horizonTransformation (genetics)Dynamic programmingSequential gameStochastic programmingQuadratic programmingMathematicsGame theoryMathematical economicsEconomic growthGeneBiochemistryStatisticsEconomicsChemistryAdaptive Dynamic Programming ControlReinforcement Learning in Robotics