Title:Stochastic Linear Quadratic Optimal Control Problems with Random Coefficients and Markovian Regime Switching System

Abstract:This paper develops a thorough investigation for the stochastic linear-quadratic optimal control problems for systems under the Markovian regime switching, where coefficients in the state equation and the weighting matrices in the cost functional are random. We first present a representation of the cost functional, which is characterized as a bilinear form on a Hilbert space in terms of the adapted solutions of some forward-backward stochastic differential equations by the technique of Itô's formula with jumps. We show that a necessary condition of open-loop optimal control is the convexity of the cost functional, and a sufficient condition of it is the uniform convexity of the cost functional. Also, we investigate the properties of the stochastic value flow of the stochastic linear-quadratic optimal control problem. We obtain the solvability of the corresponding stochastic Riccati equation under the uniform convexity condition. Furthermore, we show that the open-loop optimal control admits a closed-loop representation by using the unique solvability of the stochastic Riccati equation.