Safe RL-Based Adaptive Cooperative Game Control of Wing Deformation and Flight State Tracking for Morphing Hypersonic Vehicles
Jun‐Wei Wang, Feng Wang, Huai-Ning Wu, Zhou-Yang Liu
Abstract
This study addresses the issue of adaptive cooperative game control (ACGC) design for wing deformation and flight state tracking of morphing hypersonic vehicles (MHVs) with variable wing shapes, input constraints and state constraints. To access a better flight control performance, the wing deformation parameter is extended in this work as an auxiliary control input. An oriented-coordinated-control nonlinear differential equation model is first established to describe the complicated longitudinal flight state tracking error dynamics of the MHV. Then, a control barrier function (CBF) is introduced and incorporated into the value function as a risk penalty term of state security constraint. Based on the differential game (DG) theory, the optimal coordinated control problem for the MHV with input constraints and state constraints is treated as a constrained cooperative DG that is further formulated as a Hamilton-Jacobi-Bellman (HJB) equation with barrier and hyperbolic functions. A safe RL algorithm is proposed to solve the above HJB equation and an online Pareto joint control strategy is achieved thereby. Hereafter the stability analysis of the closed-loop state tracking error system is done by the Lyapunov technique. Meanwhile, both state and input constraints are met during the the parameter learning regulation process. At last, a simulation study is performed to support the proposed safe RL-ACGC algorithm.