Game-Based Adaptive Fuzzy Optimal Bipartite Containment of Nonlinear Multiagent Systems
Lei Yan, Junhe Liu, C. L. Philip Chen, Yun Zhang, Zongze Wu, Zhi Liu
Abstract
Existing adaptive optimal consensus approaches for high-order nonlinear multiagent systems (MASs) are limited by their complicated and computation-intensive identifier–actor–critic structure and ignore the conflict of interest between agents. This article proposes a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">graphical game-based adaptive fuzzy optimal bipartite containment scheme</i> that removes these restrictions. The optimal containment is formulated as an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$N$</tex-math></inline-formula> -player game over the communication topology for high-order nonlinear MASs by defining a cost function that integrates the agent's control inputs, including those of its neighbors, and the local tracking errors. To seek the Nash equilibrium, integral reinforcement learning is adopted, which does not involve the system drift dynamic. This approach eliminates the need for an identifier network and simplifies the control scheme using adaptive critic learning. To drive the online learning mechanism, the Bellman residual error is utilized, and a fuzzy logic system is used to approximate the optimal value functions of the critic networks. The updating laws incorporate an experience stack, resulting in an easy-to-check persistence excitation condition. It is proven that the synchronization error is uniformly ultimately bounded, and the bipartite containment of the outputs of followers is achieved. An illustrative example is presented to verify the effectiveness of the developed control scheme.