Showing 1–6 of 6 results for author: Rafieisakhaei, M

A Decoupled Data Based Approach to Stochastic Optimal Control Problems

Authors: Dan Yu, Mohammandhussen Rafieisakhaei, Suman Chakravorty

Abstract: This paper studies the stochastic optimal control problem for systems with unknown dynamics. A novel decoupled data based control (D2C) approach is proposed, which solves the problem in a decoupled "open loop-closed loop" fashion that is shown to be near-optimal. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system u… ▽ More This paper studies the stochastic optimal control problem for systems with unknown dynamics. A novel decoupled data based control (D2C) approach is proposed, which solves the problem in a decoupled "open loop-closed loop" fashion that is shown to be near-optimal. First, an open-loop deterministic trajectory optimization problem is solved using a black-box simulation model of the dynamical system using a standard nonlinear programming (NLP) solver. Then a Linear Quadratic Regulator (LQR) controller is designed for the nominal trajectory-dependent linearized system which is learned using input-output experimental data. Computational examples are used to illustrate the performance of the proposed approach with three benchmark problems. △ Less

Submitted 10 September, 2018; v1 submitted 1 July, 2018; originally announced July 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1711.01167, arXiv:1705.09761

On the Use of the Observability Gramian for Partially Observed Robotic Path Planning Problems

Authors: Mohammadhussein Rafieisakhaei, Suman Chakravorty, P. R. Kumar

Abstract: Optimizing measures of the observability Gramian as a surrogate for the estimation performance may provide irrelevant or misleading trajectories for planning under observation uncertainty. Optimizing measures of the observability Gramian as a surrogate for the estimation performance may provide irrelevant or misleading trajectories for planning under observation uncertainty. △ Less

Submitted 30 January, 2018; originally announced January 2018.

Comments: 6 pages, 9 figures. CDC 2017

Journal ref: 2017 IEEE 56th Annual Conference on Decision and Control (CDC)

A Separation-Based Design to Data-Driven Control for Large-Scale Partially Observed Systems

Authors: Dan Yu, Mohammadhussein Rafieisakhaei, Suman Chakravorty

Abstract: This paper studies the partially observed stochastic optimal control problem for systems with state dynamics governed by Partial Differential Equations (PDEs) that leads to an extremely large problem. First, an open-loop deterministic trajectory optimization problem is solved using a black box simulation model of the dynamical system. Next, a Linear Quadratic Gaussian (LQG) controller is designed… ▽ More This paper studies the partially observed stochastic optimal control problem for systems with state dynamics governed by Partial Differential Equations (PDEs) that leads to an extremely large problem. First, an open-loop deterministic trajectory optimization problem is solved using a black box simulation model of the dynamical system. Next, a Linear Quadratic Gaussian (LQG) controller is designed for the nominal trajectory-dependent linearized system, which is identified using input-output experimental data consisting of the impulse responses of the optimized nominal system. A computational nonlinear heat example is used to illustrate the performance of the approach. △ Less

Submitted 10 July, 2017; originally announced July 2017.

Comments: 3 pages, 6 figures, In Robotics: Science and Systems (RSS) 2017 Workshop of "POMDPs in Robotics: State of The Art, Challenges, and Opportunities"

Stochastic Feedback Control of Systems with Unknown Nonlinear Dynamics

Authors: Dan Yu, Mohammadhussein Rafieisakhaei, Suman Chakravorty

Abstract: This paper studies the stochastic optimal control problem for systems with unknown dynamics. First, an open-loop deterministic trajectory optimization problem is solved without knowing the explicit form of the dynamical system. Next, a Linear Quadratic Gaussian (LQG) controller is designed for the nominal trajectory-dependent linearized system, such that under a small noise assumption, the actual… ▽ More This paper studies the stochastic optimal control problem for systems with unknown dynamics. First, an open-loop deterministic trajectory optimization problem is solved without knowing the explicit form of the dynamical system. Next, a Linear Quadratic Gaussian (LQG) controller is designed for the nominal trajectory-dependent linearized system, such that under a small noise assumption, the actual states remain close to the optimal trajectory. The trajectory-dependent linearized system is identified using input-output experimental data consisting of the impulse responses of the nominal system. A computational example is given to illustrate the performance of the proposed approach. △ Less

Submitted 26 May, 2017; originally announced May 2017.

Comments: 7 pages, 7 figures, submitted to 56th IEEE Conference on Decision and Control (CDC), 2017

Near-Optimal Belief Space Planning via T-LQG

Authors: Mohammadhussein Rafieisakhaei, Suman Chakravorty, P. R. Kumar

Abstract: We consider the problem of planning under observation and motion uncertainty for nonlinear robotics systems. Determining the optimal solution to this problem, generally formulated as a Partially Observed Markov Decision Process (POMDP), is computationally intractable. We propose a Trajectory-optimized Linear Quadratic Gaussian (T-LQG) approach that leads to quantifiably near-optimal solutions for… ▽ More We consider the problem of planning under observation and motion uncertainty for nonlinear robotics systems. Determining the optimal solution to this problem, generally formulated as a Partially Observed Markov Decision Process (POMDP), is computationally intractable. We propose a Trajectory-optimized Linear Quadratic Gaussian (T-LQG) approach that leads to quantifiably near-optimal solutions for the POMDP problem. We provide a novel "separation principle" for the design of an optimal nominal open-loop trajectory followed by an optimal feedback control law, which provides a near-optimal feedback control policy for belief space planning problems involving a polynomial order of calculations of minimum order. △ Less

Submitted 10 July, 2017; v1 submitted 25 May, 2017; originally announced May 2017.

Comments: 3 pages, 3 figures, In Robotics: Science and Systems (RSS) 2017 Workshop of "POMDPs in Robotics: State of The Art, Challenges, and Opportunities"

A Near-Optimal Separation Principle for Nonlinear Stochastic Systems Arising in Robotic Path Planning and Control

Authors: Mohammadhussein Rafieisakhaei, Suman Chakravorty, P. R. Kumar

Abstract: We consider nonlinear stochastic systems that arise in path planning and control of mobile robots. As is typical of almost all nonlinear stochastic systems, the optimally solving problem is intractable. We provide a design approach which yields a tractable design that is quantifiably near-optimal. We exhibit a "separation" principle under a small noise assumption consisting of the optimal open-loo… ▽ More We consider nonlinear stochastic systems that arise in path planning and control of mobile robots. As is typical of almost all nonlinear stochastic systems, the optimally solving problem is intractable. We provide a design approach which yields a tractable design that is quantifiably near-optimal. We exhibit a "separation" principle under a small noise assumption consisting of the optimal open-loop design of nominal trajectory followed by an optimal feedback law to track this trajectory, which is different from the usual effort of separating estimation from control. As a corollary, we obtain a trajectory-optimized linear quadratic regulator design for stochastic nonlinear systems with Gaussian noise. △ Less

Submitted 23 May, 2017; originally announced May 2017.

Comments: 7 pages, 4 Figures, Submitted to 56th IEEE Conference on Decision and Control (CDC), 2017