Litcius/Paper detail

Adaptive Critic Learning-Based Optimal Bipartite Consensus for Multiagent Systems With Prescribed Performance

Lei Yan, Junhe Liu, Guanyu Lai, C. L. Philip Chen, Zongze Wu, Zhi Liu

2024IEEE Transactions on Neural Networks and Learning Systems17 citationsDOI

Abstract

Developing a distributed bipartite optimal consensus scheme while ensuring user-predefined performance is essential in practical applications. Existing approaches to this problem typically require a complex controller structure due to adopting an identifier-actor-critic framework and prescribed performance cannot be guaranteed. In this work, an adaptive critic learning (ACL)-based optimal bipartite consensus scheme is developed to bridge the gap. A newly designed error scaling function, which defines the user-predefined settling time and steady accuracy without relying on the initial conditions, is then integrated into a cost function. The backstepping framework combines the ACL and integral reinforcement learning (IRL) algorithm to develop the adaptive optimal bipartite consensus scheme, which contributes a critic-only controller structure by removing the identifier and actor networks in the existing methods. The adaptive law of the critic network is derived by the gradient descent algorithm and experience replay to minimize the IRL-based residual error. It is shown that a compute-saving learning mechanism can achieve the optimal consensus, and the error variables of the closed-loop system are uniformly ultimately bounded (UUB). Besides, in any bounded initial condition, the evolution of bipartite consensus is limited to a user-prescribed boundary under bounded initial conditions. The illustrative simulation results validate the efficacy of the approach.

Topics & Concepts

Reinforcement learningBipartite graphComputer scienceMathematical optimizationBounded functionController (irrigation)IdentifierGradient descentControl theory (sociology)MathematicsArtificial neural networkArtificial intelligenceTheoretical computer scienceBiologyGraphProgramming languageMathematical analysisControl (management)AgronomyAdaptive Dynamic Programming ControlDistributed Control Multi-Agent SystemsReinforcement Learning in Robotics
Adaptive Critic Learning-Based Optimal Bipartite Consensus for Multiagent Systems With Prescribed Performance | Litcius