On the existence of the stabilizing solution of generalized Riccati equations arising in zero-sum stochastic difference games: the time-varying case

In this paper, a large class of time-varying Riccati equations arising in stochastic dynamic games is considered. The problem of the existence and uniqueness of some globally defined solution, namely the bounded and stabilizing solution, is investigated. As an application of the obtained existence results, we address in a second step the problem of infinite-horizon zero-sum two players linear quadratic (LQ) dynamic game for a stochastic discrete-time dynamical system subject to both random switching of its coefficients and multiplicative noise. We show that in the solution of such an optimal control problem, a crucial role is played by the unique bounded and stabilizing solution of the considered class of generalized Riccati equations.     

Systems of matrix rational differential equations arising in connection with linear stochastic systems with Markovian jumping

In this paper, a class of systems of matrix nonlinear differential equations containing as particular cases the systems of coupled Riccati differential equations arising in connection with control of some linear stochastic systems is considered.The system of differential equations considered in this paper are converted in a suitable nonlinear differential equation on a finite-dimensional Hilbert space adequately choosen.This allows us to use the positivity properties of the linear evolution operator defined by the linear differential equations of Lyapunov type.Our aim is to investigate properties of stabilizing and bounded solutions of the considered differential equations and to obtain some conditions ensuring the existence of such solutions.Conditions providing the existence of a maximal solution (minimal solution respectively) with respect to some classes of global solutions are presented. It is shown that if the coefficients of the equations are periodic functions all these special solutions (stabilizing, maximal, minimal) are periodic functions, too.Whenever possible the probabilistic arguments were avoided and so the results proved in the paper appear as results in the field of differential equations with interest in themselves.     

Stability of discrete-time positive evolution operators on ordered Banach spaces and applications

In this paper we discuss stability problems for a class of discrete-time evolution operators generated by linear positive operators acting on certain ordered Banach spaces. Our approach is based upon a new representation result that links a positive operator with the adjoint operator of its restriction to a Hilbert subspace formed by sequences of Hilbert–Schmidt operators. This class includes the evolution operators involved in stability and optimal control problems for linear discrete-time stochastic systems. The inclusion is strict because, following the results of Choi, we have proved that there are positive operators on spaces of linear, bounded and self-adjoint operators which have not the representation that characterize the completely positive operators. As applications, we introduce a new concept of weak-detectability for pairs of positive operators, which we use to derive sufficient conditions for the existence of global and stabilizing solutions for a class of generalized discrete-time Riccati equations. Finally, assuming weak-detectability conditions and using the method of Lyapunov equations we derive a new stability criterion for positive evolution operators.     

Stability,stabilizability and detectability for Markov jump discrete-time linear systems with multiplicative noise in Hilbert spaces

In this article we discuss stability, stabilizability and detectability problems for Markov-jump discrete-time linear systems (MJDLSs) with multiplicative noise (MN) and countably infinite state space of the Markov chain. On the basis of a new solution representation formula, we give new deterministic characterizations of the stability and the detectability properties of MJDLSs with MN. These results are obtained using an operatorial approach and the properties of certain positive evolution operators defined on ordered Banach spaces of sequences of nuclear operators. Assuming detectability conditions and avoiding stochastic proofs, we prove that any global, nonnegative and bounded solution of the Riccati equation of control is stabilizing for the MJDLSs with MN and control. Finally, we apply our results to solve a linear quadratic optimal control problem. The theory is illustrated by an example.     

Exponential Stability for Discrete Time Linear Equations Defined by Positive Operators

In this paper the problem of exponential stability of the zero state equilibrium of a discrete-time time-varying linear equation described by a sequence of linear positive operators acting on an ordered finite dimensional Hilbert space is investigated. The class of linear equations considered in this paper contains as particular cases linear equations described by Lyapunov operators or symmetric Stein operators as well as nonsymmetric Stein operators. Such equations occur in connection with the problem of mean square exponential stability for a class of difference stochastic equations affected by independent random perturbations and Markovian jumping as well us in connection with some iterative procedures which allow us to compute global solutions of discrete time generalized symmetric or nonsymmetric Riccati equations. The exponential stability is characterized in terms of the existence of some globally defined and bounded solutions of some suitable backward affine equations (inequalities) or forward affine equations (inequalities).     

Solutions for the Linear-Quadratic Control Problem of Markov Jump Linear Systems

The paper is concerned with recursive methods for obtaining the stabilizing solution of coupled algebraic Riccati equations arising in the linear-quadratic control of Markovian jump linear systems by solving at each iteration uncoupled algebraic Riccati equations. It is shown that the new updates carried out at each iteration represent approximations of the original control problem by control problems with receding horizon, for which some sequences of stopping times define the terminal time. Under this approach, unlike previous results, no initialization conditions are required to guarantee the convergence of the algorithms. The methods can be ordered in terms of number of iterations to reach convergence, and comparisons with existing methods in the current literature are also presented. Also, we extend and generalize current results in the literature for the existence of the mean-square stabilizing solution of coupled algebraic Riccati equations.     

Stochastic Differential Equations with Non-Lipschitz Coefficients in Hilbert Spaces

Abstract

In this article, we discuss the successive approximations problem for the solutions of the semilinear stochastic differential equations in Hilbert spaces with cylindrical Wiener processes under some conditions which are weaker than the Lipschitz one. We establish the existence and the uniqueness of the solution and additionally, in our framework we consider a limiting problem for the mild solution. It is shown that the mild solution tends to the solution of the stochastic differential equation of Itô type in finite dimensional space.     

Existence of solutions for nonlinear fractional stochastic differential equations

The fractional stochastic differential equations have wide applications in various fields of science and engineering. This paper addresses the issue of existence of mild solutions for a class of fractional stochastic differential equations with impulses in Hilbert spaces. Using fractional calculations, fixed point technique, stochastic analysis theory and methods adopted directly from deterministic fractional equations, new set of sufficient conditions are formulated and proved for the existence of mild solutions for the fractional impulsive stochastic differential equation with infinite delay. Further, we study the existence of solutions for fractional stochastic semilinear differential equations with nonlocal conditions. Examples are provided to illustrate the obtained theory.     

Quadratic Control for Stochastic Systems Defined by Evolution Operators and Square Integrable Martingales

The infinite dimensional version of the linear quadratic cost control problem is studied by Curtain and Pritchard [2], Gibson [5] by using Riccati integral equations, instead of differential equations. In the present paper the corresponding stochastic case over a finite horizon is considered. The stochastic perturbations are given by Hilbert valued square integrable martingales and it is shown that the deterministic optimal feedback control is also optimal in the stochastic case. Sufficient conditions are given for the convergence of approximate solutions of optimal control problems.     

Regularity of Solutions to Bilinear Stochastic Wave Equations

Abstract

The paper is concerned with strong solutions of bilinear stochastic wave equations in ? ^d , of which the coefficients contain semimartingale white noises with spatial parameters. For the Cauchy problems, the existence and spatial regularity of solutions in Sobolev spaces are proved under appropriate conditions. The dependence of solution regularity on the smoothness of the random coefficients is ascertained. The proofs are based on stochastic energy inequalities, the semigroup method and certain submartingale inequalities. Regularity results are also obtained for the special case of Wiener semimartingales.     

Skorohod problem and multivalued stochastic evolution equations in Banach spaces

By solving a deterministic Skorohod problem in the framework of evolutional triple, we prove the existence and uniqueness of solutions to multivalued stochastic evolution equations involving maximal monotone operators. The existence and uniqueness of invariant measures associated with the solutions as Markov processes are also considered in the present paper. Moreover, we apply the results to stochastic differential equations with normal reflecting boundary conditions and with singular drift terms, as well as a class of multivalued nonlinear stochastic partial differential equations with possibly discontinuous coefficients.     

代数Riccati方程可稳解的条件数

１．引言 关于代数Ｒｉｃｃａｔｉ方程（ＡＲＥ）的研究是大量的．从数值角度看,有关数值方法,扰动理论的研究已比较深入．而关于条件数理论的研究则还不多［３］,［６］． Ｒｙｅｒｓ［１］研究了时连续代数 Ｒｉｃｃａｔｉ方程可稳解的条件数; Ｋｅｎｎｅｙ和 Ｈｅｗｅｒ［３］讨论了时连续代数 Ｒｉｃｃａｔｉ方程（以下简称 ＣＴＡＲＥ）可稳解的敏度分析,给出了一阶扰动界,引进了条件数; Ｓｕｎ［６］从最佳向后扰动理论角度研究了时离散代数Ｒｉｃｃａｔｉ方程（以下简称ＤＴＡＲＥ）可稳解的条件数;徐树方［８］针对 ＣＴＡ…     

ϵ-Optimal and Optimal Controls for the Stochastic Linear-Quadratic Problem

We study the stochastic regulator problem in Hilbert spaces for systems governed by linear stochastic differential equations with retarded controls and with state and control dependent noise. We use integral Riccati equations and no reference to a Riccati differential equation or to the Ito formula is made.     

Comparison Method of Stability Analysis of Semilinear Time-Delay Stochastic Evolution Equation

Abstract

In this paper, we set up the comparison theorem between the mild solution of semilinear time-delay stochastic evolution equation with general time-delay variable and the solution of a class (1-dimension) deterministic functional differential equation, by using the Razumikhin–Lyapunov type functional and the theory of functional differential inequalities. By applying this comparison theorem, we give various types of the stability comparison criteria for the semilinear time-delay stochastic evolution equations. With the aid of these comparison criteria, one can reduce the stability analysis of semilinear time-delay stochastic evolution equations in Hilbert space to that of a class (1-dimension) deterministic functional differential equations. Furthermore, these comparison criteria in special case have been applied to derive sufficient conditions for various stability of the mild solution of semilinear time-delay stochastic evolution equations. Finally, the theories are illustrated with some examples.     

Random fixed point theorems for Hardy-Rogers self-random operators with applications to random integral equations

In this paper, we prove some random fixed point theorems for Hardy–Rogers self-random operators in separable Banach spaces and, as some applications, we show the existence of a solution for random nonlinear integral equations in Banach spaces. Some stochastic versions of deterministic fixed point theorems for Hardy–Rogers self mappings and stochastic integral equations are obtained.     

Deterministic and stochastic differential equations in infinite-dimensional spaces

This article is a survey of deterministic and stochastic differential equations in infinite-dimensional spaces. We discuss the existence and uniqueness of solutions of such equations in general locally convex spaces. In particular, linear equations are considered. Some interesting connections between the solvability of deterministic and stochastic equations are studied.     

On a fractional impulsive partial stochastic integro-differential equation with state-dependent delay and optimal controls

This paper is mainly concerned with a new class of fractional impulsive partial stochastic integro-differential equations with state-dependent delay and optimal controls in Hilbert spaces. Firstly, a more appropriate concept for mild solutions is introduced. Secondly, existence and uniqueness of mild solutions are proved by means of stochastic analysis theory, fractional calculus and the fixed point technique combined with solution operator. The existence of optimal pairs of system governed by fractional impulsive partial stochastic integro-differential equations is also presented. Finally, an example is given for demonstration.     

Computation of the stabilizing solution of game theoretic Riccati equation arising in stochastic <Emphasis Type="Italic">H</Emphasis><Subscript> ∞ </Subscript> control problems

In this paper, the problem of the numerical computation of the stabilizing solution of the game theoretic algebraic Riccati equation is investigated. The Riccati equation under consideration occurs in connection with the solution of the H _∞ control problem for a class of stochastic systems affected by state dependent and control dependent white noise. The stabilizing solution of the considered game theoretic Riccati equation is obtained as a limit of a sequence of approximations constructed based on stabilizing solutions of a sequence of algebraic Riccati equations of stochastic control with definite sign of the quadratic part. The efficiency of the proposed algorithm is demonstrated by several numerical experiments.     

Sesquilinear quantum stochastic analysis in Banach space

A theory of quantum stochastic processes in Banach space is initiated. The processes considered here consist of Banach space valued sesquilinear maps. We establish an existence and uniqueness theorem for quantum stochastic differential equations in Banach modules, show that solutions in unital Banach algebras yield stochastic cocycles, give sufficient conditions for a stochastic cocycle to satisfy such an equation, and prove a stochastic Lie–Trotter product formula. The theory is used to extend, unify and refine standard quantum stochastic analysis through different choices of Banach space, of which there are three paradigm classes: spaces of bounded Hilbert space operators, operator mapping spaces and duals of operator space coalgebras. Our results provide the basis for a general theory of quantum stochastic processes in operator spaces, of which Lévy processes on compact quantum groups is a special case.     

A New Approach to Linearly Perturbed Riccati Equations Arising in Stochastic Control

In this paper a linearly perturbed version of the well-known matrix Riccati equations which arise in certain stochastic optimal control problems is studied. Via the concepts of mean square stabilizability and mean square detectability we improve previous results on both the convergence properties of the linearly perturbed Riccati differential equation and the solutions of the linearly perturbed algebraic Riccati equation. Furthermore, our approach unifies, in some way, the study for this class of Riccati equations with the one for classical theory, by eliminating a certain inconvenient assumption used in previous works (e.g., [10] and [26]). The results are derived under relatively weaker assumptions and include, inter alia, the following: (a) An extension of Theorem 4.1 of [26] to handle systems not necessarily observable. (b) The existence of a strong solution, subject only to the mean square stabilizability assumption. (c) Conditions for the existence and uniqueness of stabilizing solutions for systems not necessarily detectable. (d) Conditions for the existence and uniqueness of mean square stabilizing solutions instead of just stabilizing. (e) Relaxing the assumptions for convergence of the solution of the linearly perturbed Riccati differential equation and deriving new convergence results for systems not necessarily observable. Accepted 30 July 1996