具有乘性噪声的线性离散时间随机控制系统综述

具有乘性噪声的随机不确定系统的控制问题有着广泛的应用背景. 本文概述了具有乘性噪声的线性离散时间随机系统的稳定性分析、均方镇定、最优控制以及最优估计问题和相关结论. 同时, 本文研究了具有状态与控制乘性噪声的线性多变量离散时间系统的均方镇定和最优控制问题, 分析了这两个问题之间的联系, 并讨论了最优状态反馈控制器的设计算法.     

Deterministic and stochastic control of discrete-time bilinear systems

Optimal control of a class of time invariant single-input, discrete bilinear systems is investigated in this paper. Both deterministic and stochastic problems are considered.

In the deterministic problem, for the initial state in a certain set ∑₀, the solution is the same as the solution to the associated linear system. The optimal path may be a regular path or a singular path.

The stochastic control problem is considered with perfect state observation, and additive and multiplicative noise in the state equation. It is demonstrated that the presence of noise simplifies the analysis compared to that in the determinstic case.     

Exponential stability of stochastic singular delay systems with general Markovian switchings

In recent years, Markovian jump systems have received much attention. However, there are very few results on the stability of stochastic singular systems with Markovian switching. In this paper, the discussed system is the stochastic singular delay system with general transition rate matrix in terms of uncertain and partially unknown transition rate matrix. The aim is to answer the question whether there are conditions guaranteeing the underlying system having a unique solution and being exponentially admissible simultaneously. The proposed results show that all the features of the underlying system such as time delay, diffusion, and general Markovian switchings play important roles in the system analysis of exponential admissibility. A numerical example is used to demonstrate the effectiveness of the proposed methods. Copyright © 2014 John Wiley & Sons, Ltd.     

Asymptotic stability in probability of singular stochastic systems with Markovian switchings

This paper investigates the problem of asymptotic stability in probability for singular stochastic systems with Markovian switchings. A stochastic Lyapunov theorem on asymptotic stability in probability for the considered systems is provided. Also, we show that the original system has the same stability property as its difference‐algebraic form based on singular value decomposition. By utilizing the earlier results, a sufficient condition is obtained in terms of linear matrix inequalities, which is easy to check by using standard software. Copyright © 2017 John Wiley & Sons, Ltd.     

H2 control of discrete-time periodic systems with Markovian jumps and multiplicative noise

This paper addresses the problem of optimal and robust H₂ control for discrete-time periodic systems with Markov jump parameters and multiplicative noise. To analyse the system performance in the presence of exogenous random disturbance, an H₂ norm is firstly established on the basis of Gramian matrices. Further, under the condition of exact observability, a necessary and sufficient condition is presented for the solvability of H₂ optimal control problem by means of a generalised Riccati equation. When the transition probabilities of jump parameter are incompletely measurable, an H₂-guaranteed cost norm is exploited and the robust H₂ controller is designed through a linear matrix inequality (LMI) optimisation approach. An example of a networked control system is supplied to illustrate the proposed results.     

Robust stochastic stability of uncertain discrete-time impulsive Markovian jump delay systems with multiplicative noises

In this paper, the robust stochastic stability is investigated for a class of uncertain discrete-time impulsive Markovian jump delay systems with multiplicative noises. Using the method of stochastic Lyapunov functionals construction, it is shown that impulses can stabilise the original impulse-free unstable systems. Moreover, the stability property of the impulse-free systems can be retained in the cases of appropriately large impulsive time interval. Some numerical examples are exploited to demonstrate the effectiveness and the superiority of the proposed results.     

Reliable dissipative control for uncertain time‐delayed stochastic systems with Markovian jump switching and multiplicative noise

This paper considers the robust reliable dissipative control problem for a class of hybrid systems, which includes stochastics, Markovian jumping, state time delay, parameter uncertainty, possible actuator failure, multiplicative noises and impulsive effects. We propose a linear feedback memoryless controller and impulsive controller such that the hybrid system is stochastically stable and strictly (Q, S, R) dissipative, which include H_∞ performance as a special case, for all the admissible uncertainties and actuator failures occurring among a prescribed subset of actuators. Based on Itô's differential formula and Lyapunov stability theory, sufficient conditions are obtained in terms of linear matrix inequalities. A numerical example is constructed to show the effectiveness of the controller designed in this paper. Copyright © 2011 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

一类离散时间非齐次马尔可夫跳跃系统最优控制

本文研究了一类离散时间非齐次马尔可夫跳跃线性系统的线型二次高斯(linear quadratic Gaussian,LQG)问题,其中系统模态转移概率矩阵随时间随机变化,其变化特性由一高阶马尔可夫链描述.对于该系统的LQG问题,文中首先给出了线性最优滤波器,得到最优状态估计;其次,验证分离定理成立,并利用利用动态规划方法设计了系统最优控制器;最后,数值仿真结果验证了所设计控制器的有效性.     

Robust H∞ control for uncertain discrete‐time stochastic bilinear systems with Markovian switching

This paper is concerned with the problems of robust stochastic stabilization and robust H_∞ control for uncertain discrete‐time stochastic bilinear systems with Markovian switching. The parameter uncertainties are time‐varying norm‐bounded. For the robust stochastic stabilization problem, the purpose is the design of a state feedback controller which ensures the robust stochastic stability of the closed‐loop system irrespective of all admissible parameter uncertainties; while for the robust H_∞ control problem, in addition to the robust stochastic stability requirement, a prescribed level of disturbance attenuation is required to be achieved. Sufficient conditions for the solvability of these problems are obtained in terms of linear matrix inequalities (LMIs). When these LMIs are feasible, explicit expressions of the desired state feedback controllers are also given. An illustrative example is provided to show the effectiveness of the proposed approach. Copyright © 2005 John Wiley & Sons, Ltd.     

带Markov跳的离散时间随机控制系统的最大值原理

本文研究一类同时含有Markov跳过程和乘性噪声的离散时间非线性随机系统的最优控制问题, 给出并证明了相应的最大值原理. 首先, 利用条件期望的平滑性, 通过引入具有适应解的倒向随机差分方程, 给出了带有线性差分方程约束的线性泛函的表示形式, 并利用Riesz定理证明其唯一性. 其次, 对带Markov跳的非线性随机控制系统, 利用针状变分法, 对状态方程进行一阶变分, 获得其变分所满足的线性差分方程. 然后, 在引入Hamilton函数的基础上, 通过一对由倒向随机差分方程刻画的伴随方程, 给出并证明了带有Markov跳的离散时间非线性随机最优控制问题的最大值原理, 并给出该最优控制问题的一个充分条件和相应的Hamilton-Jacobi-Bellman方程. 最后, 通过 一个实际例子说明了所提理论的实用性和可行性.     

随机时滞马尔可夫跳跃系统的比例-积分跟踪控制

针对具有时变时滞和未知非线性的随机马尔可夫跳变系统,基于传统的PI控制策略和线性矩阵不等式算法,提出一种具有随机稳定性能、跟踪性能和鲁棒性能的多目标控制器设计方案.运用Lyapunov稳定性理论并引入L<,1>性能指标,构造出具有PI结构的跟踪控制器,保证了随机马尔可大跳跃系统的稳定性和跟踪性能,实现了系统跟踪性能的优...     

Stabilization of stochastic systems with hidden Markovian jumps

This paper considers the adaptive control of discrete-time hybrid stochastic systems with unknown randomly jumping parameters described by a finite-state hidden Markov chain. An intuitive yet longstanding conjecture in this area is that such hybrid systems can be adaptively stabilized whenever the rate of transition of the hidden Markov chain is small enough. This paper provides a rigorous positive answer to this conjecture by establishing the global stability of a gradient-algorithm-based adaptive linear-quadratic control.     

转移概率部分未知的随机Markov 跳跃系统的镇定控制

研究一类随机Markov跳跃系统的稳定性与镇定控制问题.此类系统跳跃过程的转移概率部分未知,包括转移概率完全已知和完全未知两种情形,因而更具一般性.首先,给出保证随机Markov跳跃系统均方渐近稳定的充分性判据,并设计了相应的状态反馈镇定控制器;然后,基于矩阵的奇异值分解给出了系统静态输出反馈镇定控制器的设计方法,并将其归结为求解一组线性矩阵不等式（LMIs）的可行性问题;最后,通过数值仿真验证了所得结论的正确性.     

Optimal control of stochastic dynamic systems with past history and poison switchings

An optimal control problem for systems of stochastic differential-functional linear equations with past history and Poisson switchings is formulated. The Bellman equation is solved for this problem.Translated from Kibernetika i Sistemnyi Analiz, No. 6, pp. 112–118, November–December 2004.This revised version was published online in April 2005 with a corrected cover date.     

Optimal control of discrete-time bilinear systems with applications to switched linear stochastic systems

This paper aims at characterizing the most destabilizing switching law for discrete-time switched systems governed by a set of bounded linear operators. The switched system is embedded in a special class of discrete-time bilinear control systems. This allows us to apply the variational approach to the bilinear control system associated with a Mayer-type optimal control problem, and a second-order necessary optimality condition is derived. Optimal equivalence between the bilinear system and the switched system is analyzed, which shows that any optimal control law can be equivalently expressed as a switching law. This specific switching law is most unstable for the switched system, and thus can be used to determine stability under arbitrary switching. Based on the second-order moment of the state, the proposed approach is applied to analyze uniform mean-square stability of discrete-time switched linear stochastic systems. Numerical simulations are presented to verify the usefulness of the theoretic results.     

Robust H-infinity control for uncertain discrete-time Markovian jump systems with actuator saturation

The design of robust H-infinity controller for uncertain discrete-time Markovian jump systems with actuator saturation is addressed in this paper. The parameter uncertainties are assumed to be norm-bounded. Linear matrix inequality (LMI) conditions are proposed to design a set of controllers in order to satisfy the closed-loop local stability and closed-loop H-infinity performance. Using an LMI approach, a set of state feedback gains is constructed such that the set of admissible initial conditions is enlarged and formulated through solving an optimization problem. A numerical example is given to illustrate the effectiveness of the proposed methods.     

Derandomisation-based multiple frequency control for stochastic Markov jump systems

Under the framework of derandomisation approach, the state feedback control issues for both continuous-time and discrete-time Markov jump linear systems (MJLSs) are investigated to meet multiple performance objectives over multiple frequency ranges. Because of the stochastic jumping among different modes, the generalised Kalman–Yakubovic–Popov lemma-based finite-frequency controller design approach cannot be directly applied to MJLSs. To overcome this limitation, a derandomisation approach is established by transforming the original stochastic multiple modes systems to deterministic ones. Then the multiple frequency controllers for both discrete-time and continuous-time MJLSs are designed to guarantee the multiple performances of the closed-loop systems. To verify the effectiveness of the developed algorithms, examples are presented, where the performance requirements include specifications in low-frequency and high-frequency ranges, respectively.     

Stability of discrete-time linear systems with Markovian jumping parameters

This paper deals with the robustness of a class of discrete-time linear systems with Markovian jumping parameters and unknown but bounded uncertainties. Assuming that the Markovian jump process (disturbance) has finite state space and that there is complete access to the system's state and its mode, we establish necessary and sufficient conditions for stochastic stability of the autonomous nominal model. We also establish sufficient conditions for robust stability for this class of uncertain systems under matching conditions and with bounded uncertainties.The research of the first author was supported by the Natural Sciences and Engineering Research Council of Canada under Grant OGP0036444.     

Quantized stabilization for stochastic discrete‐time systems with multiplicative noises

This paper considers the problem of quadratic mean‐square stabilization of a class of stochastic linear systems using quantized state feedback. Different from the previous works where the system is restricted to be deterministic, we focus on stochastic systems with multiplicative noises in both the system matrix and the control input. A static quantizer is used in the feedback channel. It is shown that the coarsest quantization density that permits stabilization of a stochastic system with multiplicative noises in the sense of quadratic mean‐square stability is achieved with the use of a logarithmic quantizer, and the coarsest quantization density is determined by an algebraic Riccati equation, which is also the solution to a special stochastic linear control problem. Our work is then extended to exponential quadratic mean‐square stabilization of the same class of stochastic systems. Copyright © 2011 John Wiley & Sons, Ltd.     

随机马尔可夫跳变系统的变结构控制设计

采用滑动扇区方法,研究了不确定随机马尔可夫跳变系统的变结构控制设计问题。首先给出随机马尔可夫跳变系统滑动扇区的定义,然后基于线性矩阵不等式技术,提出一种滑动扇区及变结构控制律设计方法。经过理论证明该控制律能够确保随机马尔可夫跳变不确定系统二次稳定,并有效地抑制抖振。最后数值仿真算例验证了控制方案的有效性。