Showing 1–3 of 3 results for author: Rafieisakhaei, M

A Decoupled Data Based Approach to Stochastic Optimal Control Problems

Authors: Dan Yu, Mohammandhussen Rafieisakhaei, Suman Chakravorty

Abstract: This paper studies the stochastic optimal control problem for systems with unknown dynamics. A novel decoupled data based control (D2C) approach is proposed, which solves the problem in a decoupled "open loop-closed loop" fashion that is shown to be near-optimal. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system u… ▽ More This paper studies the stochastic optimal control problem for systems with unknown dynamics. A novel decoupled data based control (D2C) approach is proposed, which solves the problem in a decoupled "open loop-closed loop" fashion that is shown to be near-optimal. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system using a standard nonlinear programming (NLP) solver. Then a Linear Quadratic Regulator (LQR) controller is designed for the nominal trajectory-dependent linearized system which is learned using input-output experimental data. Computational examples are used to illustrate the performance of the proposed approach with three benchmark problems. △ Less

Submitted 10 September, 2018; v1 submitted 1 July, 2018; originally announced July 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1711.01167, arXiv:1705.09761

A Separation-based Approach to Data-based Control for Large-Scale Partially Observed Systems

Authors: Dan Yu, Mohammadhussein Rafieisakhaei, Suman Chakravorty

Abstract: This paper studies the partially observed stochastic optimal control problem for systems with state dynamics governed by partial differential equations (PDEs) that leads to an extremely large problem. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system. Next, a Linear Quadratic Gaussian (LQG) controller is designed… ▽ More This paper studies the partially observed stochastic optimal control problem for systems with state dynamics governed by partial differential equations (PDEs) that leads to an extremely large problem. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system. Next, a Linear Quadratic Gaussian (LQG) controller is designed for the nominal trajectory-dependent linearized system which is identified using input-output experimental data consisting of the impulse responses of the optimized nominal system. A computational nonlinear heat example is used to illustrate the performance of the proposed approach. △ Less

Submitted 2 November, 2017; originally announced November 2017.

Comments: arXiv admin note: text overlap with arXiv:1705.09761, arXiv:1707.03092

Belief Space Planning Simplified: Trajectory-Optimized LQG (T-LQG) (Extended Report)

Authors: Mohammadhussein Rafieisakhaei, Suman Chakravorty, P. R. Kumar

Abstract: Planning under motion and observation uncertainties requires solution of a stochastic control problem in the space of feedback policies. In this paper, we reduce the general (n^2+n)-dimensional belief space planning problem to an (n)-dimensional problem by obtaining a Linear Quadratic Gaussian (LQG) design with the best nominal performance. Then, by taking the underlying trajectory of the LQG cont… ▽ More Planning under motion and observation uncertainties requires solution of a stochastic control problem in the space of feedback policies. In this paper, we reduce the general (n^2+n)-dimensional belief space planning problem to an (n)-dimensional problem by obtaining a Linear Quadratic Gaussian (LQG) design with the best nominal performance. Then, by taking the underlying trajectory of the LQG controller as the decision variable, we pose a coupled design of trajectory, estimator, and controller design through a Non-Linear Program (NLP) that can be solved by a general NLP solver. We prove that under a first-order approximation and a careful usage of the separation principle, our approximations are valid. We give an analysis on the existing major belief space planning methods and show that our algorithm has the lowest computational burden. Finally, we extend our solution to contain general state and control constraints. Our simulation results support our design. △ Less

Submitted 11 August, 2016; v1 submitted 9 August, 2016; originally announced August 2016.

Comments: 20 pages, 12 figures. A shorter version has been submitted to WAFR, 2016