-
Exploiting characteristics in stationary action problems
Authors:
V. Basco,
P. M. Dower,
W. M. McEneaney,
I. Yegorov
Abstract:
Connections between the principle of stationary action and optimal control, and between established notions of minimax and viscosity solutions, are combined to describe trajectories of energy conserving systems as solutions of corresponding Cauchy problems defined with respect to attendant systems of characteristics equations.
Connections between the principle of stationary action and optimal control, and between established notions of minimax and viscosity solutions, are combined to describe trajectories of energy conserving systems as solutions of corresponding Cauchy problems defined with respect to attendant systems of characteristics equations.
△ Less
Submitted 19 February, 2020;
originally announced February 2020.
-
Synthesis of control Lyapunov functions and stabilizing feedback strategies using exit-time optimal control
Authors:
Ivan Yegorov,
Peter M. Dower,
Lars Grüne
Abstract:
This paper studies the problem of constructing control Lyapunov functions (CLFs) and feedback stabilization strategies for deterministic nonlinear control systems described by ordinary differential equations. Many numerical methods for solving the Hamilton-Jacobi-Bellman partial differential equations specifying CLFs typically require dense state space discretizations and consequently suffer from…
▽ More
This paper studies the problem of constructing control Lyapunov functions (CLFs) and feedback stabilization strategies for deterministic nonlinear control systems described by ordinary differential equations. Many numerical methods for solving the Hamilton-Jacobi-Bellman partial differential equations specifying CLFs typically require dense state space discretizations and consequently suffer from the curse of dimensionality. A relevant direction of attenuating the curse of dimensionality concerns reducing the computation of the values of CLFs and associated feedbacks at any selected states to finite-dimensional nonlinear programming problems. In this work, exit-time optimal control is used for that purpose. First, we state an exit-time optimal control problem with respect to a sublevel set of an appropriate local CLF and establish that, under a number of reasonable conditions, the concatenation of the corresponding value function and the local CLF is a global CLF in the whole domain of asymptotic null-controllability. This leads to a curse-of-dimensionality-free approach to feedback stabilization. We also investigate the formulated optimal control problem. A modification of these constructions for the case when one does not find a suitable local CLF is provided as well. Supporting numerical simulation results that illustrate our development are subsequently presented and discussed. Furthermore, it is pointed out that the curse of complexity may cause significant issues in practical implementation even if the curse of dimensionality is mitigated.
△ Less
Submitted 6 June, 2019;
originally announced June 2019.
-
Perspectives on characteristics based curse-of-dimensionality-free numerical approaches for solving Hamilton-Jacobi equations
Authors:
Ivan Yegorov,
Peter Dower
Abstract:
This paper extends the considerations of the works [1, 2] regarding curse-of-dimensionality-free numerical approaches to solve certain types of Hamilton-Jacobi equations arising in optimal control problems, differential games and elsewhere. A rigorous formulation and justification for the extended Hopf-Lax formula of [2] is provided together with novel theoretical and practical discussions includi…
▽ More
This paper extends the considerations of the works [1, 2] regarding curse-of-dimensionality-free numerical approaches to solve certain types of Hamilton-Jacobi equations arising in optimal control problems, differential games and elsewhere. A rigorous formulation and justification for the extended Hopf-Lax formula of [2] is provided together with novel theoretical and practical discussions including useful recommendations. By using the method of characteristics, the solutions of some problem classes under convexity/concavity conditions on Hamiltonians (in particular, the solutions of Hamilton-Jacobi-Bellman equations in optimal control problems) are evaluated separately at different initial positions. This allows for the avoidance of the curse of dimensionality, as well as for choosing arbitrary computational regions. The corresponding feedback control strategies are obtained at selected positions without approximating the partial derivatives of the solutions. The results of numerical simulations demonstrate the high potential of the proposed techniques. It is also pointed out that, despite the indicated advantages, the related approaches still have a limited range of applicability, and their extensions to Hamilton-Jacobi-Isaacs equations in zero-sum two-player differential games are currently developed only for sufficiently narrow classes of control systems. That is why further extensions are worth investigating.
△ Less
Submitted 9 November, 2017;
originally announced November 2017.
