Litcius/Paper detail

Reinforcement Learning-Based Fixed-Time Trajectory Tracking Control for Uncertain Robotic Manipulators With Input Saturation

Shengjie Cao, Liang Sun, Jingjing Jiang, Zongyu Zuo

2021IEEE Transactions on Neural Networks and Learning Systems190 citationsDOIOpen Access PDF

Abstract

A fixed-time trajectory tracking control method for uncertain robotic manipulators with input saturation based on reinforcement learning (RL) is studied. The designed RL control algorithm is implemented by a radial basis function (RBF) neural network (NN), in which the actor NN is used to generate the control strategy and the critic NN is used to evaluate the execution cost. A new nonsingular fast terminal sliding mode technique is used to ensure the convergence of tracking error in fixed time, and the upper bound of convergence time is estimated. To solve the saturation problem of an actuator, a nonlinear antiwindup compensator is designed to compensate for the saturation effect of the joint torque actuator in real time. Finally, the stability of the closed-loop system based on the Lyapunov candidate is analyzed, and the timing convergence of the closed-loop system is proven. Simulation and experimental results show the effectiveness and superiority of the proposed control law.

Topics & Concepts

Control theory (sociology)Reinforcement learningComputer scienceLyapunov functionConvergence (economics)Artificial neural networkActuatorTrajectoryLyapunov stabilityNonlinear systemArtificial intelligenceControl (management)AstronomyQuantum mechanicsEconomic growthEconomicsPhysicsAdaptive Dynamic Programming ControlAdaptive Control of Nonlinear SystemsReinforcement Learning in Robotics