-
Input-Output Stability of Gradient Descent: A Discrete-Time Passivity-Based Approach
Authors:
Sepehr Moalemi,
James Richard Forbes
Abstract:
This paper presents a discrete-time passivity-based analysis of the gradient descent method for a class of functions with sector-bounded gradients. Using a loop transformation, it is shown that the gradient descent method can be interpreted as a passive controller in negative feedback with a very strictly passive system. The passivity theorem is then used to guarantee input-output stability, as we…
▽ More
This paper presents a discrete-time passivity-based analysis of the gradient descent method for a class of functions with sector-bounded gradients. Using a loop transformation, it is shown that the gradient descent method can be interpreted as a passive controller in negative feedback with a very strictly passive system. The passivity theorem is then used to guarantee input-output stability, as well as the global convergence, of the gradient descent method. Furthermore, provided that the lower and upper sector bounds are not equal, the input-output stability of the gradient descent method is guaranteed using the weak passivity theorem for a larger choice of step size. Finally, to demonstrate the utility of this passivity-based analysis, a new variation of the gradient descent method with variable step size is proposed by gain-scheduling the input and output of the gradient.
△ Less
Submitted 24 November, 2024;
originally announced November 2024.
-
Uncertainty Modelling and Robust Observer Synthesis using the Koopman Operator
Authors:
Steven Dahdah,
James Richard Forbes
Abstract:
This paper proposes a robust nonlinear observer synthesis method for a population of systems modelled using the Koopman operator. The Koopman operator allows nonlinear systems to be rewritten as infinite-dimensional linear systems. A finite-dimensional approximation of the Koopman operator can be identified directly from data, yielding an approximately linear model of a nonlinear system. The propo…
▽ More
This paper proposes a robust nonlinear observer synthesis method for a population of systems modelled using the Koopman operator. The Koopman operator allows nonlinear systems to be rewritten as infinite-dimensional linear systems. A finite-dimensional approximation of the Koopman operator can be identified directly from data, yielding an approximately linear model of a nonlinear system. The proposed observer synthesis method is made possible by this linearity that in turn allows uncertainty within a population of Koopman models to be quantified in the frequency domain. Using this uncertainty model, linear robust control techniques are used to synthesize robust nonlinear Koopman observers. A population of several dozen motor drives is used to experimentally demonstrate the proposed method. Manufacturing variation is characterized in the frequency domain, and a robust Koopman observer is synthesized using mixed $\mathcal{H}_2$-$\mathcal{H}_\infty$ optimal control.
△ Less
Submitted 1 October, 2024;
originally announced October 2024.
-
Synthesizing Control Laws from Data using Sum-of-Squares Optimization
Authors:
Jason J. Bramburger,
Steven Dahdah,
James Richard Forbes
Abstract:
The control Lyapunov function (CLF) approach to nonlinear control design is well established. Moreover, when the plant is control affine and polynomial, sum-of-squares (SOS) optimization can be used to find a polynomial controller as a solution to a semidefinite program. This letter considers the use of data-driven methods to design a polynomial controller by leveraging Koopman operator theory, CL…
▽ More
The control Lyapunov function (CLF) approach to nonlinear control design is well established. Moreover, when the plant is control affine and polynomial, sum-of-squares (SOS) optimization can be used to find a polynomial controller as a solution to a semidefinite program. This letter considers the use of data-driven methods to design a polynomial controller by leveraging Koopman operator theory, CLFs, and SOS optimization. First, Extended Dynamic Mode Decomposition (EDMD) is used to approximate the Lie derivative of a given CLF candidate with polynomial lifting functions. Then, the polynomial Koopman model of the Lie derivative is used to synthesize a polynomial controller via SOS optimization. The result is a flexible data-driven method that skips the intermediary process of system identification and can be applied widely to control problems. The proposed approach is used to successfully synthesize a controller to stabilize an inverted pendulum on a cart.
△ Less
Submitted 3 July, 2023;
originally announced July 2023.
-
Cascaded Model Predictive Control of a Tandem-Rotor Helicopter
Authors:
Faraaz Ahmed,
Ludwik Sobiesiak,
James Richard Forbes
Abstract:
This letter considers cascaded model predictive control (MPC) as a computationally lightweight method for controlling a tandem-rotor helicopter. A traditional single MPC structure is split into separate outer and inner-loops. The outer-loop MPC uses an $SE_2(3)$ error to linearize the translational dynamics about a reference trajectory. The inner-loop MPC uses the optimal angular velocity sequence…
▽ More
This letter considers cascaded model predictive control (MPC) as a computationally lightweight method for controlling a tandem-rotor helicopter. A traditional single MPC structure is split into separate outer and inner-loops. The outer-loop MPC uses an $SE_2(3)$ error to linearize the translational dynamics about a reference trajectory. The inner-loop MPC uses the optimal angular velocity sequence of the outer-loop MPC to linearize the rotational dynamics. The outer-loop MPC is run at a slower rate than the inner-loop allowing for longer prediction time and improved performance. Monte-Carlo simulations demonstrate robustness to model uncertainty and environmental disturbances. The proposed control structure is benchmarked against a single MPC algorithm where it shows significant improvements in position and velocity tracking while using significantly less computational resources.
△ Less
Submitted 28 June, 2023;
originally announced June 2023.
-
Closed-Loop Koopman Operator Approximation
Authors:
Steven Dahdah,
James Richard Forbes
Abstract:
This paper proposes a method to identify a Koopman model of a feedback-controlled system given a known controller. The Koopman operator allows a nonlinear system to be rewritten as an infinite-dimensional linear system by viewing it in terms of an infinite set of lifting functions. A finite-dimensional approximation of the Koopman operator can be identified from data by choosing a finite subset of…
▽ More
This paper proposes a method to identify a Koopman model of a feedback-controlled system given a known controller. The Koopman operator allows a nonlinear system to be rewritten as an infinite-dimensional linear system by viewing it in terms of an infinite set of lifting functions. A finite-dimensional approximation of the Koopman operator can be identified from data by choosing a finite subset of lifting functions and solving a regression problem in the lifted space. Existing methods are designed to identify open-loop systems. However, it is impractical or impossible to run experiments on some systems, such as unstable systems, in an open-loop fashion. The proposed method leverages the linearity of the Koopman operator, along with knowledge of the controller and the structure of the closed-loop system, to simultaneously identify the closed-loop and plant systems. The advantages of the proposed closed-loop Koopman operator approximation method are demonstrated in simulation using a Duffing oscillator and experimentally using a rotary inverted pendulum system. An open-source software implementation of the proposed method is publicly available, along with the experimental dataset generated for this paper.
△ Less
Submitted 1 May, 2024; v1 submitted 27 March, 2023;
originally announced March 2023.
-
Model Predictive Control of a Tandem-Rotor Helicopter With a Nonuniformly Spaced Prediction Horizon
Authors:
Faraaz Ahmed,
Ludwik Sobiesiak,
James Richard Forbes
Abstract:
This letter considers model predictive control of a tandem-rotor helicopter. The error is formulated using the matrix Lie group $SE_2(3)$. A reference trajectory to a target is calculated using a quartic guidance law, leveraging the differentially flat properties of the system, and refined using a finite-horizon linear quadratic regulator. The nonlinear system is linearized about the reference tra…
▽ More
This letter considers model predictive control of a tandem-rotor helicopter. The error is formulated using the matrix Lie group $SE_2(3)$. A reference trajectory to a target is calculated using a quartic guidance law, leveraging the differentially flat properties of the system, and refined using a finite-horizon linear quadratic regulator. The nonlinear system is linearized about the reference trajectory enabling the formulation of a quadratic program with control input, attitude keep-in zone, and attitude error constraints. A non-uniformly spaced prediction horizon is leveraged to capture the multi-timescale dynamics while keeping the problem size tractable. Monte-Carlo simulations demonstrate robustness of the proposed control structure to initial conditions, model uncertainty, and environmental disturbances.
△ Less
Submitted 14 June, 2022;
originally announced June 2022.
-
System Norm Regularization Methods for Koopman Operator Approximation
Authors:
Steven Dahdah,
James Richard Forbes
Abstract:
Approximating the Koopman operator from data is numerically challenging when many lifting functions are considered. Even low-dimensional systems can yield unstable or ill-conditioned results in a high-dimensional lifted space. In this paper, Extended Dynamic Mode Decomposition (DMD) and DMD with control, two methods for approximating the Koopman operator, are reformulated as convex optimization pr…
▽ More
Approximating the Koopman operator from data is numerically challenging when many lifting functions are considered. Even low-dimensional systems can yield unstable or ill-conditioned results in a high-dimensional lifted space. In this paper, Extended Dynamic Mode Decomposition (DMD) and DMD with control, two methods for approximating the Koopman operator, are reformulated as convex optimization problems with linear matrix inequality constraints. Asymptotic stability constraints and system norm regularizers are then incorporated as methods to improve the numerical conditioning of the Koopman operator. Specifically, the H-infinity norm is used to penalize the input-output gain of the Koopman system. Weighting functions are then applied to penalize the system gain at specific frequencies. These constraints and regularizers introduce bilinear matrix inequality constraints to the regression problem, which are handled by solving a sequence of convex optimization problems. Experimental results using data from an aircraft fatigue structural test rig and a soft robot arm highlight the advantages of the proposed regression methods.
△ Less
Submitted 9 August, 2022; v1 submitted 18 October, 2021;
originally announced October 2021.
-
The Complex-Step Derivative Approximation on Matrix Lie Groups
Authors:
Charles Champagne Cossette,
Alex Walsh,
James Richard Forbes
Abstract:
The complex-step derivative approximation is a numerical differentiation technique that can achieve analytical accuracy, to machine precision, with a single function evaluation. In this letter, the complex-step derivative approximation is extended to be compatible with elements of matrix Lie groups. As with the standard complex-step derivative, the method is still able to achieve analytical accura…
▽ More
The complex-step derivative approximation is a numerical differentiation technique that can achieve analytical accuracy, to machine precision, with a single function evaluation. In this letter, the complex-step derivative approximation is extended to be compatible with elements of matrix Lie groups. As with the standard complex-step derivative, the method is still able to achieve analytical accuracy, up to machine precision, with a single function evaluation. Compared to a central-difference scheme, the proposed complex-step approach is shown to have superior accuracy. The approach is applied to two different pose estimation problems, and is able to recover the same results as an analytical method when available.
△ Less
Submitted 6 May, 2021;
originally announced May 2021.
-
Linear Matrix Inequality Approaches to Koopman Operator Approximation
Authors:
Steven Dahdah,
James Richard Forbes
Abstract:
The regression problem associated with finding a matrix approximation of the Koopman operator from data is considered. The regression problem is formulated as a convex optimization problem subject to linear matrix inequality (LMI) constraints. Doing so allows for additional LMI constraints to be incorporated into the regression problem. In particular, asymptotic stability constraints, regularizati…
▽ More
The regression problem associated with finding a matrix approximation of the Koopman operator from data is considered. The regression problem is formulated as a convex optimization problem subject to linear matrix inequality (LMI) constraints. Doing so allows for additional LMI constraints to be incorporated into the regression problem. In particular, asymptotic stability constraints, regularization using matrix norms, and even regularization using system norms can be easily incorporated into the regression problem.
△ Less
Submitted 18 October, 2021; v1 submitted 6 February, 2021;
originally announced February 2021.
-
LMI Properties and Applications in Systems, Stability, and Control Theory
Authors:
Ryan James Caverly,
James Richard Forbes
Abstract:
Linear matrix inequalities (LMIs) commonly appear in systems, stability, and control applications. Many analysis and synthesis problems in these areas can be solved as feasibility or optimization problems subject to LMI constraints. Although most well-known LMI properties and manipulation tricks, such as the Schur complement and the congruence transformation, can be found in standard references, m…
▽ More
Linear matrix inequalities (LMIs) commonly appear in systems, stability, and control applications. Many analysis and synthesis problems in these areas can be solved as feasibility or optimization problems subject to LMI constraints. Although most well-known LMI properties and manipulation tricks, such as the Schur complement and the congruence transformation, can be found in standard references, many useful LMI properties are scattered throughout the literature. The purpose of this document is to collect and organize properties, tricks, and applications related to LMIs from a number of references together in a single document. In this sense, the document can be thought of as an "LMI encyclopedia" or "LMI cookbook." Proofs of the properties presented in this document are not included when they can be found in the cited references in the interest of brevity. Illustrative examples are included whenever necessary to fully explain a certain property. Multiple equivalent forms of LMIs are often presented to give the reader a choice of which form may be best suited for a particular problem at hand. The equivalency of some of the LMIs in this document may be straightforward to more experienced readers, but the authors believe that some readers may benefit from the presentation of multiple equivalent LMIs.
△ Less
Submitted 21 May, 2024; v1 submitted 20 March, 2019;
originally announced March 2019.
-
Conic-sector-based analysis and control synthesis for linear parameter varying systems
Authors:
S Sivaranjani,
James Richard Forbes,
Peter Seiler,
Vijay Gupta
Abstract:
We present a conic sector theorem for linear parameter varying (LPV) systems in which the traditional definition of conicity is violated for certain values of the parameter. We show that such LPV systems can be defined to be conic in an average sense if the parameter trajectories are restricted so that the system operates with such values of the parameter sufficiently rarely. We then show that suc…
▽ More
We present a conic sector theorem for linear parameter varying (LPV) systems in which the traditional definition of conicity is violated for certain values of the parameter. We show that such LPV systems can be defined to be conic in an average sense if the parameter trajectories are restricted so that the system operates with such values of the parameter sufficiently rarely. We then show that such an average definition of conicity is useful in analyzing the stability of the system when it is connected in feedback with a conic system with appropriate conic properties. This can be regarded as an extension of the classical conic sector theorem. Based on this modified conic sector theorem, we design conic controllers that allow the closed-loop system to operate in nonconic parameter regions for brief periods of time. Due to this extra degree of freedom, these controllers lead to less conservative performance than traditional designs, in which the controller parameters are chosen based on the largest cone that the plant dynamics are contained in. We demonstrate the effectiveness of the proposed design in stabilizing a power grid with very high penetration of renewable energy while minimizing power transmission losses.
△ Less
Submitted 29 January, 2018; v1 submitted 3 December, 2017;
originally announced December 2017.
