Event-triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs

In this article, the event-triggered optimal tracking control problem for multiplayer unknown nonlinear systems is investigated by using adaptive critic designs. By constructing a neural network (NN)-based observer with input–output data, the system dynamics of multiplayer unknown nonlinear systems is obtained. Subsequently, the optimal tracking control problem is converted to an optimal regulation problem by establishing a tracking error system. Then, the optimal tracking control policy for each player is derived by solving coupled event-triggered Hamilton-Jacobi (HJ) equation via a critic NN. Meanwhile, a novel weight updating rule is designed by adopting concurrent learning method to relax the persistence of excitation (PE) condition. Moreover, an event-triggering condition is designed by using Lyapunov's direct method to guarantee the uniform ultimate boundedness (UUB) of the closed-loop multiplayer systems. Finally, the effectiveness of the developed method is verified by two different multiplayer nonlinear systems.     

Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach

In this paper, a finite-horizon neuro-optimal tracking control strategy for a class of discrete-time nonlinear systems is proposed. Through system transformation, the optimal tracking problem is converted into designing a finite-horizon optimal regulator for the tracking error dynamics. Then, with convergence analysis in terms of cost function and control law, the iterative adaptive dynamic programming (ADP) algorithm via heuristic dynamic programming (HDP) technique is introduced to obtain the finite-horizon optimal tracking controller which makes the cost function close to its optimal value within an ?-error bound. Three neural networks are used as parametric structures to implement the algorithm, which aims at approximating the cost function, the control law, and the error dynamics, respectively. Two simulation examples are included to complement the theoretical discussions.     

A novel optimal tracking control scheme for a class of discrete-time nonlinear systems using generalised policy iteration adaptive dynamic programming algorithm

In this paper, a novel iterative adaptive dynamic programming (ADP) algorithm, called generalised policy iteration ADP algorithm, is developed to solve optimal tracking control problems for discrete-time nonlinear systems. The idea is to use two iteration procedures, including an i-iteration and a j-iteration, to obtain the iterative tracking control laws and the iterative value functions. By system transformation, we first convert the optimal tracking control problem into an optimal regulation problem. Then the generalised policy iteration ADP algorithm, which is a general idea of interacting policy and value iteration algorithms, is introduced to deal with the optimal regulation problem. The convergence and optimality properties of the generalised policy iteration algorithm are analysed. Three neural networks are used to implement the developed algorithm. Finally, simulation examples are given to illustrate the performance of the present algorithm.     

基于自适应动态规划的非线性鲁棒近似最优跟踪控制

为克服现有近似最优跟踪控制方法只能跟踪连续可微参考输入的局限,本文针对一类具有未知动态的连续时间非线性时不变仿射系统,提出了一种新的基于自适应动态规划的鲁棒近似最优跟踪控制方法.首先采用递归神经网络建立系统模型,然后建立评价神经网络对最优性能指标进行估计,从而得到最优性能指标偏导数的估计值,进而得到近似最优跟踪控制器,最后利用系统输出与参考输入之间的跟踪误差设计鲁棒项对神经网络建模误差进行补偿.分别针对两个非线性系统进行仿真实验,仿真结果表明了所提方法的有效性和优越性.     

Optimal prescribed performance tracking control of nonlinear motor driven systems via adaptive dynamic programming

Although optimal regulation problem has been well studied, resolving optimal tracking control via adaptive dynamic programming (ADP) has not been completely resolved, particularly for nonlinear uncertain systems. In this paper, an online adaptive learning method is developed to realize the optimal tracking control design for nonlinear motor driven systems (NMDSs), which adopts the concept of ADP, unknown system dynamic estimator (USDE), and prescribed performance function (PPF). To this end, the USDE in a simple form is first proposed to address the NMDSs with bounded disturbances. Then, based on the estimated unknown dynamics, we define an optimal cost function and derive the optimal tracking control. The derived optimal tracking control is divided into two parts, that is, steady-state control and optimal feedback control. The steady-state control can be obtained with the tracking commands directly. The optimal feedback control can be obtained via the concept of ADP based on the PPF; this contributes to improving the convergence of critic neural network (CNN) weights and tracking accuracy of NMDSs. Simulations are provided to display the feasibility of the designed control method.     

Neural-network-observer-based optimal control for unknown nonlinear systems using adaptive dynamic programming

In this paper, an observer-based optimal control scheme is developed for unknown nonlinear systems using adaptive dynamic programming (ADP) algorithm. First, a neural-network (NN) observer is designed to estimate system states. Then, based on the observed states, a neuro-controller is constructed via ADP method to obtain the optimal control. In this design, two NN structures are used: a three-layer NN is used to construct the observer which can be applied to systems with higher degrees of nonlinearity and without a priori knowledge of system dynamics, and a critic NN is employed to approximate the value function. The optimal control law is computed using the critic NN and the observer NN. Uniform ultimate boundedness of the closed-loop system is guaranteed. The actor, critic, and observer structures are all implemented in real-time, continuously and simultaneously. Finally, simulation results are presented to demonstrate the effectiveness of the proposed control scheme.     

Design of decentralised variable structure observer for mismatched nonlinear uncertain large-scale systems

Although the state feedback approach is quite popular in control engineering, it cannot be used while the system states cannot be measured. The state observer approach may be used to overcome such a shortcoming. Also, most control systems have become larger and more complicated; therefore, based on the variable structure control theory, a new decentralised variable structure observer (DVSO) for a class of nonlinear large-scale systems with mismatched uncertainties will be considered in this article. The switching surface function is determined such that the equivalent system will have the desired behaviour once the system reaches the switching surface. And then a new DVSO is designed such that the estimated states will approach the system states. Using the Lyapunov stability theory and using the generalised matrix inverse concept, the uncertain nonlinear error system trajectories can be driven onto the sliding manifold and then the existence of a sliding mode and the attractiveness to the sliding surface is ensured. With the proposed DVSO, the estimation errors asymptotically tend to zero if the matching condition is satisfied, and the effects of the mismatched parts can be uniformly ultimately bounded if the matching condition is not satisfied. Finally, a numerical example with a succession of computer simulations is given to demonstrate the effectiveness of the proposed approach.     

Adaptive tracking control of nonlinear systems with dynamic uncertainties using neural network

In this paper, an adaptive neural tracking control approach is proposed for a class of nonlinear systems with dynamic uncertainties. The radial basis function neural networks (RBFNNs) are used to estimate the unknown nonlinear uncertainties, and then a novel adaptive neural scheme is developed, via backstepping technique. In the controller design, instead of using RBFNN to approximate each unknown function, we lump all unknown functions into a suitable unknown function that is approximated by only a RBFNN in each step of the backstepping. It is shown that the designed controller can guarantee that all signals in the closed-loop system are semi-globally bounded and the tracking error finally converges to a small domain around the origin. Two examples are given to demonstrate the effectiveness of the proposed control scheme.     

Adaptive fuzzy decentralised control for stochastic nonlinear large-scale systems in pure-feedback form

This paper is concerned with the problem of adaptive fuzzy decentralised output-feedback control for a class of uncertain stochastic nonlinear pure-feedback large-scale systems with completely unknown functions, the mismatched interconnections and without requiring the states being available for controller design. With the help of fuzzy logic systems approximating the unknown nonlinear functions, a fuzzy state observer is designed estimating the unmeasured states. Therefore, the nonlinear filtered signals are incorporated into the backstepping recursive design, and an adaptive fuzzy decentralised output-feedback control scheme is developed. It is proved that the filter system converges to a small neighbourhood of the origin based on appropriate choice of the design parameters. Simulation studies are included illustrating the effectiveness of the proposed approach.     

Decentralised zero-sum differential game for a class of large-scale interconnected systems via adaptive dynamic programming

In this paper, a novel decentralised differential game strategy for large-scale nonlinear systems with matched interconnections is developed by using adaptive dynamic programming technique. First, the Nash-equilibrium solutions of the corresponding isolated differential game subsystems are found by appropriately redefining the associated cost functions accounting for the bounds of interconnections. Then, the decentralised differential game strategy is established by integrating all the modified Nash-equilibrium solutions of the isolated subsystems to stabilise the overall system. Next, the solutions of Hamilton–Jacobi–Isaaci equations are approximated online by constructing a set of critic neural networks with adaptation law of weights. The stability analysis of each subsystem is provided to show that all the signals in the closed-loop system are guaranteed to be bounded by utilising Lyapunov method. Finally, the effectiveness of the proposed decentralised differential game method is illustrated by a simple example.     

HGO-based decentralised indirect adaptive fuzzy control for a class of large-scale nonlinear systems

In this article, a novel high gain observer (HGO)-based decentralised indirect adaptive fuzzy controller is developed for a class of uncertain affine large-scale nonlinear systems. By the combination of fuzzy logic systems and an HGO, the state variables are not required to be measurable. The proposed feedback and adaptation mechanisms guarantee that each subsystem is able to adaptively compensate for interconnections and disturbances with unknown bounds. It is ascertained using a singular perturbation method that all the signals of the closed-loop large-scale system stand uniformly ultimately bounded and the tracking errors converge to tunable neighbourhoods of the origin. Simulation results of correlated double inverted pendulums substantiate the effectiveness of the proposed controller.     

Adaptive dynamic programming and optimal control of nonlinear nonaffine systems

In this paper, a novel optimal control design scheme is proposed for continuous-time nonaffine nonlinear dynamic systems with unknown dynamics by adaptive dynamic programming (ADP). The proposed methodology iteratively updates the control policy online by using the state and input information without identifying the system dynamics. An ADP algorithm is developed, and can be applied to a general class of nonlinear control design problems. The convergence analysis for the designed control scheme is presented, along with rigorous stability analysis for the closed-loop system. The effectiveness of this new algorithm is illustrated by two simulation examples.     

Non-affine nonlinear adaptive control of decentralized large-scale systems using neural networks

This paper introduces a new decentralized adaptive neural network controller for a class of large-scale nonlinear systems with unknown non-affine subsystems and unknown interconnections represented by nonlinear functions. A radial basis function neural network is used to represent the controller’s structure. The stability of the closed loop system is guaranteed through Lyapunov stability analysis. The effectiveness of the proposed decentralized adaptive controller is illustrated by considering two nonlinear systems: a two-inverted pendulum and a turbo generator. The simulation results verify the merits of the proposed controller.     

Adaptive tracking H-infinity control for switched nonlinear systems with unknown control gain sign

This paper addresses the adaptive tracking control scheme for switched nonlinear systems with unknown control gain sign. The approach relaxes the hypothesis that the upper bound of function control gain is known constant and the bounds of external disturbance and approximation errors of neural networks are known. RBF neural networks (NNs) are used to approximate unknown functions and an H-infinity controller is introduced to enhance robustness. The adaptive updating laws and the admissible switching signals have been derived from switched multiple Lyapunov function method. It’s proved that the resulting closed loop system is asymptotically Lyapunov stable such that the output tracking error performance and H-infinity disturbance attenuation level are well obtained. Finally, a simulation example of Forced Duffing systems is given to illustrate the effectiveness of the proposed control scheme and improve significantly the transient performance.     

Adaptive fuzzy decentralised fault-tolerant control for nonlinear large-scale systems with actuator failures and unmodelled dynamics

This paper discusses the adaptive fuzzy decentralised fault-tolerant control (FTC) problem for a class of nonlinear large-scale systems in strict-feedback form. The systems under study contain the unknown nonlinearities, unmodelled dynamics, actuator faults and without the direct measurements of state variables. With the help of fuzzy logic systems identifying the unknown functions and a fuzzy adaptive observer is designed to estimate the unmeasured states. By using the backstepping design technique and the dynamic surface control approach and combining with the changing supply function technique, a fuzzy adaptive FTC scheme is developed. The main features of the proposed control approach are that it can guarantee the closed-loop system to be input–to-state practically stable, and also has the robustness to the unmodelled dynamics. Moreover, it can overcome the so-called problem of ‘explosion of complexity’ existing in the previous literature. Finally, simulation studies are provided to illustrate the effectiveness of the proposed approach.     

Decentralized adaptive tracking control of nonaffine nonlinear large-scale systems with time delays

This paper addresses the problem of decentralized tracking control of large-scale systems with uncertain nonaffine nonlinear isolated subsystems and nonlinear interconnections with time-varying delays. Based on Lyapunov-Krasovskii functional approach and implicit function theorem, a delay-independent decentralized tracking controller is proposed. Due to functional approximation capability of fuzzy logic systems (FLS), neither strict structure restrictions on the isolated subsystems nor a priori knowledge of the strong interconnections with time-varying delays is required in our control design. Furthermore, transient performance of the resulting closed-loop system is also addressed under an analytical framework. Finally, two numerical examples are provided to show the effectiveness of the proposed controller.     

Observer-based adaptive control for nonlinear input-delay systems with unknown control directions

This paper investigates the problem of adaptive control for strict-feedback nonlinear systems with input delay and unknown control directions. The Nussbaum function is utilised to deal with the unknown control directions and a novel compensation system is introduced to handle the time-varying input delay. By using neural network(NN) approximation and backstepping approaches, an adaptive NN controller is designed which can guarantee the semi-global boundedness of all the signals in the closed-loop system. Two simulation examples are also given to illustrate the effectiveness of the proposed method.     

Global robust output tracking control for a class of cascade nonlinear systems with unknown control directions

We investigate the global robust tracking problem via output feedback for a class of cascade nonlinear systems with dynamic uncertainties and non-vanishing disturbances. It does not require a priori knowledge of the sign of the high-frequency gain. A recursive design scheme is presented using the ideas of pseudosign function, Nussbaum-type gain technique and the deadzone method. It is shown that under some conditions, the tracking error can be guaranteed asymptotic to the interval [?ε, ε]?? with arbitrary prescribed ε>0 after a finite time, while keeping all signals of the resulting closed-loop systems bounded. The simulation results demonstrate the effectiveness of the proposed algorithm.     

Global decentralised stabilisation for a class of uncertain large-scale feedforward nonlinear systems

In this paper, the problem of global decentralised stabilisation for a class of uncertain large-scale feedforward nonlinear systems is investigated. The system under consideration is allowed to contain unknown non-Lipschitz continuous nonlinear terms. The design of the global decentralised controllers takes a two steps procedure. First of all, based on the adding a power integrator technique and the homogeneous domination approach a local homogeneous decentralised controller is proposed for each subsystem of the large-scale feedforward nonlinear system. Then, we integrate a series of nested saturation functions with the homogeneous decentralised controllers and adjust the saturation levels to ensure globally asymptotic stability of the closed-loop system. Simulation studies are conducted to illustrate the effectiveness of the proposed control method.     

Online optimal tracking control of continuous-time linear systems with unknown dynamics by using adaptive dynamic programming

In this paper, a novel theoretic formulation based on adaptive dynamic programming (ADP) is developed to solve online the optimal tracking problem of the continuous-time linear system with unknown dynamics. First, the original system dynamics and the reference trajectory dynamics are transformed into an augmented system. Then, under the same performance index with the original system dynamics, an augmented algebraic Riccati equation is derived. Furthermore, the solutions for the optimal control problem of the augmented system are proven to be equal to the standard solutions for the optimal tracking problem of the original system dynamics. Moreover, a new online algorithm based on the ADP technique is presented to solve the optimal tracking problem of the linear system with unknown system dynamics. Finally, simulation results are given to verify the effectiveness of the theoretic results.