-
An instability result of Hamiltonian systems related to optimal swing-up control of a pendulum
Authors:
Noboru Sakamoto
Abstract:
This paper presents an instability result of Hamiltonian systems associated with optimal swing-up control for a pendulum. The systems possess weak (higher-order) instability at the initial point of the swing-up control, the analysis for which requires techniques from celestial mechanics. The obtained result may have relationships with the previously obtained numerical studies for the existence of…
▽ More
This paper presents an instability result of Hamiltonian systems associated with optimal swing-up control for a pendulum. The systems possess weak (higher-order) instability at the initial point of the swing-up control, the analysis for which requires techniques from celestial mechanics. The obtained result may have relationships with the previously obtained numerical studies for the existence of multiple locally optimal solutions and the non-existence conjecture of the optimal control.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
Optimal Stabilization of Periodic Orbits
Authors:
Fabian Beck,
Noboru Sakamoto
Abstract:
In this contribution, the optimal stabilization problem of periodic orbits is studied via invariant manifold theory and symplectic geometry. The stable manifold theory for the optimal point stabilization case is generalized to the case of periodic orbit stabilization, where a normally hyperbolic invariant manifold (NHIM) plays the role of a hyperbolic equilibrium.
A sufficient condition for the…
▽ More
In this contribution, the optimal stabilization problem of periodic orbits is studied via invariant manifold theory and symplectic geometry. The stable manifold theory for the optimal point stabilization case is generalized to the case of periodic orbit stabilization, where a normally hyperbolic invariant manifold (NHIM) plays the role of a hyperbolic equilibrium.
A sufficient condition for the existence of an NHIM of an associated Hamiltonian system is derived in terms of a periodic Riccati differential equation. It is shown that the problem of optimal orbit stabilization has a solution if a linearized periodic system satisfies stabilizability and detectability. A moving orthogonal coordinate system is employed along the periodic orbit which is a natural framework for orbital stabilization and linearization argument.
Examples illustrated include an optimal control problem for a spring-mass oscillator system, which should be stabilized at a certain energy level, and an orbit transfer problem for a satellite, which constitutes a typical control problem of orbital mechanics.
△ Less
Submitted 7 January, 2025; v1 submitted 21 November, 2022;
originally announced November 2022.
-
Hamilton-Jacobi-Bellman equation of nonlinear optimal control problems with fractional discount rate
Authors:
Gou Nishida,
Takamatsu Takahiro,
Noboru Sakamoto
Abstract:
This paper derives the Hamilton-Jacobi-Bellman equation of nonlinear optimal control problems for cost functions with fractional discount rate from the Bellman's principle of optimality. The fractional discount rate is described by Mittag-Leffler function that can be considered as a generalized exponential function.
This paper derives the Hamilton-Jacobi-Bellman equation of nonlinear optimal control problems for cost functions with fractional discount rate from the Bellman's principle of optimality. The fractional discount rate is described by Mittag-Leffler function that can be considered as a generalized exponential function.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
Optimal Sampled-Data Control of a Nonlinear System
Authors:
Yasuaki Oishi,
Noboru Sakamoto
Abstract:
Optimal sampled-data control of a nonlinear system is considered with the stable-manifold approach and extensive use of numerical techniques. The idea is to notice the Hamiltonian system associated with the considered optimal control problem and to compute trajectories on its stable manifold. Since the control input accompanied with those trajectories is proved to be optimal, the optimal control l…
▽ More
Optimal sampled-data control of a nonlinear system is considered with the stable-manifold approach and extensive use of numerical techniques. The idea is to notice the Hamiltonian system associated with the considered optimal control problem and to compute trajectories on its stable manifold. Since the control input accompanied with those trajectories is proved to be optimal, the optimal control law can be obtained through interpolation. The stable-manifold approach was originally proposed for continuous-time optimal control and here it is adapted for sampled-data control based on the works of Navasca. In the case of sampled-data control, the approach requires the state transition of the controlled plant during one sampling period together with its derivatives with respect to the state and the input. Their computation is achieved by numerical techniques. Moreover, a shooting method is proposed for systematic generation of the trajectories and extension is considered for the intersample behavior to be taken into account. The proposed method is applied to tracking control of a wheeled mobile robot. It works successfully with a rather long sampling period.
△ Less
Submitted 29 December, 2021;
originally announced December 2021.
-
When does stabilizability imply the existence of infinite horizon optimal control in nonlinear systems?
Authors:
Noboru Sakamoto
Abstract:
The paper addresses an existence problem for infinite horizon optimal control when the system under control is exponentially stabilizable or stable. Classes of nonlinear control systems for which infinite horizon optimal controls exist are identified in terms of stability, stabilizability, detectability and growth conditions. The result then applies to estimate the existence region of stable manif…
▽ More
The paper addresses an existence problem for infinite horizon optimal control when the system under control is exponentially stabilizable or stable. Classes of nonlinear control systems for which infinite horizon optimal controls exist are identified in terms of stability, stabilizability, detectability and growth conditions. The result then applies to estimate the existence region of stable manifolds in the associated Hamiltonian systems. Applications of the results also include the analysis for turnpike property in nonlinear finite horizon optimal control problems by a geometric approach.
△ Less
Submitted 8 June, 2021; v1 submitted 31 August, 2020;
originally announced August 2020.
-
The turnpike with lack of observability
Authors:
Dario Pighin,
Noboru Sakamoto
Abstract:
We obtain turnpike results for optimal control problems with lack of stabilizability in the state equation and/or detectability in the state term in the cost functional.
We show how, under weakened stabilizability/detectability conditions, terminal conditions may affect turnpike phenomena.
Numerical simulations have been performed to illustrate the theoretical results.
We obtain turnpike results for optimal control problems with lack of stabilizability in the state equation and/or detectability in the state term in the cost functional.
We show how, under weakened stabilizability/detectability conditions, terminal conditions may affect turnpike phenomena.
Numerical simulations have been performed to illustrate the theoretical results.
△ Less
Submitted 28 July, 2020;
originally announced July 2020.
-
The turnpike property in the maximum hands-off control
Authors:
Noboru Sakamoto,
Masaaki Nagahara
Abstract:
This paper presents analyses for the maximum hands-off control using the geometric methods developed for the theory of turnpike in optimal control. First, a sufficient condition is proved for the existence of the maximum hands-off control for linear time-invariant systems with arbitrarily fixed initial and terminal points using the relation with $L^1$ optimal control. Next, a sufficient condition…
▽ More
This paper presents analyses for the maximum hands-off control using the geometric methods developed for the theory of turnpike in optimal control. First, a sufficient condition is proved for the existence of the maximum hands-off control for linear time-invariant systems with arbitrarily fixed initial and terminal points using the relation with $L^1$ optimal control. Next, a sufficient condition is derived for the maximum hands-off control to have the turnpike property, which may be useful for approximate design of the control.
△ Less
Submitted 29 April, 2020;
originally announced April 2020.
-
Rotor imbalance suppression by optimal control
Authors:
Matteo Gnuffi,
Dario Pighin,
Noboru Sakamoto
Abstract:
An imbalanced rotor is considered. A system of moving balancing masses is given. We determine the optimal movement of the balancing masses to minimize the imbalance on the rotor. The optimal movement is given by an open-loop control solving an optimal control problem posed in infinite time. By methods of the Calculus of Variations, the existence of the optimum is proved and the corresponding optim…
▽ More
An imbalanced rotor is considered. A system of moving balancing masses is given. We determine the optimal movement of the balancing masses to minimize the imbalance on the rotor. The optimal movement is given by an open-loop control solving an optimal control problem posed in infinite time. By methods of the Calculus of Variations, the existence of the optimum is proved and the corresponding optimality conditions have been derived. Asymptotic behavior of the control system is studied rigorously. By Łojasiewicz inequality, convergence of the optima as time $t\to +\infty$ towards a steady configuration is ensured. An explicit estimate of the convergence rate is given. This guarantees that the optimal control stabilizes the system. In case the imbalance is below a computed threshold, the convergence occurs exponentially fast. This is proved by the Stable Manifold Theorem applied to the Pontryagin optimality system. Moreover, a closed-loop control strategy based on Reinforcement Learning is proposed. Numerical simulations have been performed, validating the theoretical results.
△ Less
Submitted 27 December, 2020; v1 submitted 26 July, 2019;
originally announced July 2019.
-
The turnpike property in nonlinear optimal control -- A geometric approach
Authors:
Noboru Sakamoto,
Enrique Zuazua
Abstract:
This paper presents, using dynamical system theory, a framework for investigating the turnpike property in nonlinear optimal control. First, it is shown that a turnpike-like property appears in general dynamical systems with hyperbolic equilibrium and then, apply it to optimal control problems to obtain sufficient conditions for the turnpike occurs. The approach taken is geometric and gives insigh…
▽ More
This paper presents, using dynamical system theory, a framework for investigating the turnpike property in nonlinear optimal control. First, it is shown that a turnpike-like property appears in general dynamical systems with hyperbolic equilibrium and then, apply it to optimal control problems to obtain sufficient conditions for the turnpike occurs. The approach taken is geometric and gives insights for the behaviors of controlled trajectories, allowing us to find simpler proofs for existing results on the turnpike properties. Attempts to remove smallness restrictions for initial and target states are also discussed based on the geometry of (un)stable manifold and exponential stabilizability of control systems.
△ Less
Submitted 9 February, 2021; v1 submitted 21 March, 2019;
originally announced March 2019.
