Noisy-Output-Based Direct Learning Tracking Control With Markov Nonuniform Trial Lengths Using Adaptive Gains
Dong Shen, Samer S. Saab
Abstract
In this article, a noisy-output-based direct learning tracking control is proposed for stochastic linear systems with nonuniform trial lengths. The iteration-varying trial length is modeled using a Markov chain for demonstration of the iteration dependence. The effect of the noisy output is asymptotically eliminated using a prior given decreasing gain sequence in the learning algorithm. Two alternative adaptive gains are presented for improving the tracking performance and the convergence speed. Both the mean-square and almost-sure convergence are provided. Numerical simulations on a four-degree-of-freedom robot arm are presented to illustrate the effectiveness of the proposed scheme.
Topics & Concepts
Convergence (economics)Iterative learning controlControl theory (sociology)Markov chainTracking (education)Adaptive controlMathematicsTracking errorStochastic approximationSequence (biology)Markov processMathematical optimizationComputer scienceAlgorithmControl (management)Artificial intelligenceStatisticsAsynchronous communicationComputer networkEconomic growthEconomicsPsychologyGeneticsBiologyPedagogyIterative Learning Control SystemsAdvanced Control Systems OptimizationControl Systems in Engineering