-
Sufficient conditions for the absence of relaxation gaps in state-constrained optimal control
Authors:
Nicolas Augier,
Milan Korda,
Rodolfo Rios-Zertuche
Abstract:
This work presents new sufficient conditions for the absence of a gap corresponding to Young measure and occupation measure relaxations for constrained optimal control problems. Unlike existing conditions, these sufficient conditions do not rely on convexity of the Lagrangian or the set of admissible velocities. We use these conditions to derive new bounds for the size of the relaxation gap.
This work presents new sufficient conditions for the absence of a gap corresponding to Young measure and occupation measure relaxations for constrained optimal control problems. Unlike existing conditions, these sufficient conditions do not rely on convexity of the Lagrangian or the set of admissible velocities. We use these conditions to derive new bounds for the size of the relaxation gap.
△ Less
Submitted 17 March, 2025;
originally announced March 2025.
-
Young measure relaxation gaps for controllable systems with smooth state constraints
Authors:
Nicolas Augier,
Milan Korda,
Rodolfo Rios-Zertuche
Abstract:
In this article, we tackle the problem of the existence of a gap corresponding to Young measure relaxations for state-constrained optimal control problems. We provide a counterexample proving that a gap may occur in a very regular setting, namely for a smooth controllable system state-constrained to the closed unit ball, provided that the Lagrangian density (i.e., the running cost) is non-convex i…
▽ More
In this article, we tackle the problem of the existence of a gap corresponding to Young measure relaxations for state-constrained optimal control problems. We provide a counterexample proving that a gap may occur in a very regular setting, namely for a smooth controllable system state-constrained to the closed unit ball, provided that the Lagrangian density (i.e., the running cost) is non-convex in the control variables. The example is constructed in the setting of sub-Riemannian geometry with the core ingredient being an unusual admissible curve that exhibits a certain form of resistance to state-constrained approximation. Specifically, this curve cannot be approximated by neighboring admissible curves while obeying the state constraint due to the intricate nature of the dynamics near the boundary of the constraint set. Our example also presents an occupation measure relaxation gap.
△ Less
Submitted 17 March, 2025;
originally announced March 2025.
-
Solving unbounded optimal control problems with the moment-SOS hierarchy *
Authors:
Karolına Sehnalová,
Didier Henrion,
Milan Korda,
Martin Kružík
Abstract:
The behaviour of the moment-sums-of-squares (moment-SOS) hierarchy for polynomial optimal control problems on compact sets has been explored to a large extent. Our contribution focuses on the case of non-compact control sets. We describe a new approach to optimal control problems with unbounded controls, using compactification by partial homogenization, leading to an equivalent infinite dimensiona…
▽ More
The behaviour of the moment-sums-of-squares (moment-SOS) hierarchy for polynomial optimal control problems on compact sets has been explored to a large extent. Our contribution focuses on the case of non-compact control sets. We describe a new approach to optimal control problems with unbounded controls, using compactification by partial homogenization, leading to an equivalent infinite dimensional linear program with compactly supported measures. Our results are closely related to the results of a previous approach using DiPerna-Majda measures. However, our work provides a sound proof of the absence of relaxation gap, which was conjectured in the previous work, and thereby enables the design of a moment-sum-of-squares relaxation with guaranteed convergence.
△ Less
Submitted 7 July, 2025; v1 submitted 17 March, 2025;
originally announced March 2025.
-
Optimal Control of 1D Semilinear Heat Equations with Moment-SOS Relaxations
Authors:
Charlie Lebarbé,
Emilien Flayac,
Michel Fournié,
Didier Henrion,
Milan Korda
Abstract:
We use moment-SOS (Sum Of Squares) relaxations to address the optimal control problem of the 1D heat equation perturbed with a nonlinear term. We extend the current framework of moment-based optimal control of PDEs to consider a quadratic cost on the control. We develop a new method to extract a nonlinear controller from approximate moments of the solution. The control law acts on the boundary of…
▽ More
We use moment-SOS (Sum Of Squares) relaxations to address the optimal control problem of the 1D heat equation perturbed with a nonlinear term. We extend the current framework of moment-based optimal control of PDEs to consider a quadratic cost on the control. We develop a new method to extract a nonlinear controller from approximate moments of the solution. The control law acts on the boundary of the domain and depends on the solution over the whole domain. Our method is validated numerically and compared to a linear-quadratic controller.
△ Less
Submitted 15 April, 2025; v1 submitted 18 November, 2024;
originally announced November 2024.
-
Towards Optimal Spatio-Temporal Decomposition of Control-Related Sum-of-Squares Programs
Authors:
Vít Cibulka,
Milan Korda,
Tomáš Haniš
Abstract:
This paper presents a method for calculating the Region of Attraction (ROA) of nonlinear dynamical systems, both with and without control. The ROA is determined by solving a hierarchy of semidefinite programs (SDPs) defined on a splitting of the time and state space. Previous works demonstrated that this splitting could significantly enhance approximation accuracy, although the improvement was hig…
▽ More
This paper presents a method for calculating the Region of Attraction (ROA) of nonlinear dynamical systems, both with and without control. The ROA is determined by solving a hierarchy of semidefinite programs (SDPs) defined on a splitting of the time and state space. Previous works demonstrated that this splitting could significantly enhance approximation accuracy, although the improvement was highly dependent on the ad-hoc selection of split locations. In this work, we eliminate the need for this ad-hoc selection by introducing an optimization-based method that performs the splits through conic differentiation of the underlying semidefinite programming problem. We provide the differentiability conditions for the split ROA problem, prove the absence of a duality gap, and demonstrate the effectiveness of our method through numerical examples.
△ Less
Submitted 17 September, 2024;
originally announced September 2024.
-
Set-Valued Koopman Theory for Control Systems
Authors:
Benoît Bonnet-Weill,
Milan Korda
Abstract:
In this paper, we introduce a new notion of Koopman operator which faithfully encodes the dynamics of controlled systems by leveraging the grammar of set-valued analysis. In this context, we propose meaningful generalisations of the Liouville and Perron-Frobenius operators, and show that they respectively coincide with proper set-valued analogues of the infinitesimal generator and dual operator of…
▽ More
In this paper, we introduce a new notion of Koopman operator which faithfully encodes the dynamics of controlled systems by leveraging the grammar of set-valued analysis. In this context, we propose meaningful generalisations of the Liouville and Perron-Frobenius operators, and show that they respectively coincide with proper set-valued analogues of the infinitesimal generator and dual operator of the Koopman semigroup. We also give meaning to the spectra of these set-valued maps and prove an adapted version of the classical spectral mapping theorem relating the eigenvalues of a semigroup and those of its generator. In essence, these results provide theoretical justifications for existing approaches in the Koopman communities which consist in studying control systems by bundling together the Liouville operators associated with different input parameters.
△ Less
Submitted 18 November, 2024; v1 submitted 21 January, 2024;
originally announced January 2024.
-
Invariant Consistent Dynamic Mode Decomposition
Authors:
Gowtham S Seenivasaharagavan,
Milan Korda,
Hassan Arbabi,
Igor Mezić
Abstract:
Any deterministic autonomous dynamical system may be globally linearized by its' Koopman operator. This object is typically infinite-dimensional and can be approximated by the so-called Dynamic Mode Decomposition (DMD). In DMD, the central idea is to preserve a fundamental property of the Koopman operator: linearity. This work augments DMD by preserving additional properties like functional relati…
▽ More
Any deterministic autonomous dynamical system may be globally linearized by its' Koopman operator. This object is typically infinite-dimensional and can be approximated by the so-called Dynamic Mode Decomposition (DMD). In DMD, the central idea is to preserve a fundamental property of the Koopman operator: linearity. This work augments DMD by preserving additional properties like functional relationships between observables and consistency along geometric invariants. The first set of constraints provides a framework for understanding DMD variants like Higher-order DMD and Affine DMD. The latter set guarantees the estimation of Koopman eigen-functions with eigen-value 1, whose level sets are known to delineate invariant sets. These benefits are realized with only a minimal increase in computational cost, primarily due to the linearity of constraints.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Learning Parametric Koopman Decompositions for Prediction and Control
Authors:
Yue Guo,
Milan Korda,
Ioannis G. Kevrekidis,
Qianxiao Li
Abstract:
We present an approach to construct approximate Koopman-type decompositions for dynamical systems depending on static or time-varying parameters. Our method simultaneously constructs an invariant subspace and a parametric family of projected Koopman operators acting on this subspace. We parametrize both the projected Koopman operator family and the dictionary that spans the invariant subspace by n…
▽ More
We present an approach to construct approximate Koopman-type decompositions for dynamical systems depending on static or time-varying parameters. Our method simultaneously constructs an invariant subspace and a parametric family of projected Koopman operators acting on this subspace. We parametrize both the projected Koopman operator family and the dictionary that spans the invariant subspace by neural networks and jointly train them with trajectory data. We show theoretically the validity of our approach, and demonstrate via numerical experiments that it exhibits significant improvements over existing methods in solving prediction problems, especially those with large state or parameter dimensions, and those possessing strongly non-linear dynamics. Moreover, our method enables data-driven solution of optimal control problems involving non-linear dynamics, with interesting implications on controllability.
△ Less
Submitted 10 November, 2024; v1 submitted 2 October, 2023;
originally announced October 2023.
-
Symmetry reduction and recovery of trajectories of optimal control problems via measure relaxations
Authors:
Nicolas Augier,
Didier Henrion,
Milan Korda,
Victor Magron
Abstract:
We address the problem of symmetry reduction of optimal control problems under the action of a finite group from a measure relaxation viewpoint. We propose a method based on the moment-SOS aka Lasserre hierarchy which allows one to significantly reduce the computation time and memory requirements compared to the case without symmetry reduction. We show that the recovery of optimal trajectories boi…
▽ More
We address the problem of symmetry reduction of optimal control problems under the action of a finite group from a measure relaxation viewpoint. We propose a method based on the moment-SOS aka Lasserre hierarchy which allows one to significantly reduce the computation time and memory requirements compared to the case without symmetry reduction. We show that the recovery of optimal trajectories boils down to solving a symmetric parametric polynomial system. Then we illustrate our method on the symmetric integrator and the time-optimal inversion of qubits.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Convergence rates for sums-of-squares hierarchies with correlative sparsity
Authors:
Milan Korda,
Victor Magron,
Rodolfo Rios-Zertuche
Abstract:
This work derives upper bounds on the convergence rate of the moment-sum-of-squares hierarchy with correlative sparsity for global minimization of polynomials on compact basic semialgebraic sets. The main conclusion is that both sparse hierarchies based on the Schmüdgen and Putinar Positivstellensätze enjoy a polynomial rate of convergence that depends on the size of the largest clique in the spar…
▽ More
This work derives upper bounds on the convergence rate of the moment-sum-of-squares hierarchy with correlative sparsity for global minimization of polynomials on compact basic semialgebraic sets. The main conclusion is that both sparse hierarchies based on the Schmüdgen and Putinar Positivstellensätze enjoy a polynomial rate of convergence that depends on the size of the largest clique in the sparsity graph but not on the ambient dimension. Interestingly, the sparse bounds outperform the best currently available bounds for the dense hierarchy when the maximum clique size is sufficiently small compared to the ambient dimension and the performance is measured by the running time of an interior point method required to obtain a bound on the global minimum of a given accuracy.
△ Less
Submitted 26 March, 2023;
originally announced March 2023.
-
Peak Estimation of Time Delay Systems using Occupation Measures
Authors:
Jared Miller,
Milan Korda,
Victor Magron,
Mario Sznaier
Abstract:
This work proposes a method to compute the maximum value obtained by a state function along trajectories of a Delay Differential Equation (DDE). An example of this task is finding the maximum number of infected people in an epidemic model with a nonzero incubation period. The variables of this peak estimation problem include the stopping time and the original history (restricted to a class of admi…
▽ More
This work proposes a method to compute the maximum value obtained by a state function along trajectories of a Delay Differential Equation (DDE). An example of this task is finding the maximum number of infected people in an epidemic model with a nonzero incubation period. The variables of this peak estimation problem include the stopping time and the original history (restricted to a class of admissible histories). The original nonconvex DDE peak estimation problem is approximated by an infinite-dimensional Linear Program (LP) in occupation measures, inspired by existing measure-based methods in peak estimation and optimal control. This LP is approximated from above by a sequence of Semidefinite Programs (SDPs) through the moment-Sum of Squares (SOS) hierarchy. Effectiveness of this scheme in providing peak estimates for DDEs is demonstrated with provided examples
△ Less
Submitted 5 April, 2023; v1 submitted 22 March, 2023;
originally announced March 2023.
-
Occupation measure relaxations in variational problems: the role of convexity
Authors:
Didier Henrion,
Milan Korda,
Martin Kružík,
Rodolfo Rios-Zertuche
Abstract:
This work addresses the occupation measure relaxation of calculus of variations problems, which is an infinite-dimensional linear programming relaxation amenable to numerical approximation by a hierarchy of semidefinite optimization problems. We address the problem of equivalence of this relaxation to the original problem. Our main result provides sufficient conditions for this equivalence. These…
▽ More
This work addresses the occupation measure relaxation of calculus of variations problems, which is an infinite-dimensional linear programming relaxation amenable to numerical approximation by a hierarchy of semidefinite optimization problems. We address the problem of equivalence of this relaxation to the original problem. Our main result provides sufficient conditions for this equivalence. These conditions, revolving around the convexity of the data, are simple and apply in very general settings that may be of arbitrary dimensions and may include pointwise and integral constraints, thereby considerably strengthening the existing results. Our conditions are also extended to optimal control problems. In addition, we demonstrate how these results can be applied in non-convex settings, showing that the occupation measure relaxation is at least as strong as the convexification using the convex envelope; in doing so, we prove that a certain weakening of the occupation measure relaxation is equivalent to the convex envelope. This opens the way to application of the occupation measure relaxation in situations where the convex envelope relaxation is known to be equivalent to the original problem, which includes problems in magnetism and elasticity.
△ Less
Submitted 4 March, 2023;
originally announced March 2023.
-
Polynomial argmin for recovery and approximation of multivariate discontinuous functions
Authors:
Didier Henrion,
Milan Korda,
Jean-Bernard Lasserre
Abstract:
We propose to approximate a (possibly discontinuous) multivariate function f (x) on a compact set by the partial minimizer arg miny p(x, y) of an appropriate polynomial p whose construction can be cast in a univariate sum of squares (SOS) framework, resulting in a highly structured convex semidefinite program. In a number of non-trivial cases (e.g. when f is a piecewise polynomial) we prove that t…
▽ More
We propose to approximate a (possibly discontinuous) multivariate function f (x) on a compact set by the partial minimizer arg miny p(x, y) of an appropriate polynomial p whose construction can be cast in a univariate sum of squares (SOS) framework, resulting in a highly structured convex semidefinite program. In a number of non-trivial cases (e.g. when f is a piecewise polynomial) we prove that the approximation is exact with a low-degree polynomial p. Our approach has three distinguishing features: (i) It is mesh-free and does not require the knowledge of the discontinuity locations. (ii) It is model-free in the sense that we only assume that the function to be approximated is available through samples (point evaluations). (iii) The size of the semidefinite program is independent of the ambient dimension and depends linearly on the number of samples. We also analyze the sample complexity of the approach, proving a generalization error bound in a probabilistic setting. This allows for a comparison with machine learning approaches.
△ Less
Submitted 2 November, 2023; v1 submitted 14 February, 2023;
originally announced February 2023.
-
Dictionary-free Koopman model predictive control with nonlinear input transformation
Authors:
Vít Cibulka,
Milan Korda,
Tomáš Haniš
Abstract:
This paper introduces a method for data-driven control based on the Koopman operator model predictive control. Unlike exiting approaches, the method does not require a dictionary and incorporates a nonlinear input transformation, thereby allowing for more accurate predictions with less ad hoc tuning. In addition to this, the method allows for input quantization and exploits symmetries, thereby red…
▽ More
This paper introduces a method for data-driven control based on the Koopman operator model predictive control. Unlike exiting approaches, the method does not require a dictionary and incorporates a nonlinear input transformation, thereby allowing for more accurate predictions with less ad hoc tuning. In addition to this, the method allows for input quantization and exploits symmetries, thereby reducing computational cost, both offline and online. Importantly, the method retains convexity of the optimization problem solved within the model predictive control online. Numerical examples demonstrate superior performance compared to existing methods as well as the capacity to learn discontinuous lifting functions.
△ Less
Submitted 21 September, 2023; v1 submitted 28 December, 2022;
originally announced December 2022.
-
Controlled Synchronization of Coupled Pendulums by Koopman Model Predictive Control
Authors:
Loi Do,
Milan Korda,
Zdeněk Hurák
Abstract:
We propose and experimentally demonstrate a feedback control method that allows synchronizing the motion of a chain of several coupled nonlinear oscillators actuated through one end of the chain. The chain considered in this work is a one-dimensional array of pendulums pivoting around a single axis and interacting with adjacent pendulums through torsion springs; the array is actuated using a singl…
▽ More
We propose and experimentally demonstrate a feedback control method that allows synchronizing the motion of a chain of several coupled nonlinear oscillators actuated through one end of the chain. The chain considered in this work is a one-dimensional array of pendulums pivoting around a single axis and interacting with adjacent pendulums through torsion springs; the array is actuated using a single torque motor attached to one of the two boundary pendulums. This represents a mechanical realization of the Frenkel-Kontorova model { a spatially discrete version of a sine-Gordon equation describing (nonlinear) waves. The main challenges of controlling these systems are: high order (the number of pendulums can be high), nonlinear dynamics, and (as we set the problem here) only one actuator. The presented problem of synchronization of motion is a special case of the problem of reference tracking, where all pendulums reach a common point or a trajectory. In particular, we demonstrate synchronization to a stable equilibrium (all pendulums downward), unstable equilibrium (all pendulums upward), and a periodic orbit (all pendulums revolving). We use the Koopman Model Predictive Control (KMPC) that constructs a linear predictor of the nonlinear system in a higher-dimensional lifted space and uses the predictor within a classical linear MPC, thereby maintaining low computational cost that allows for a real-time implementation, while taking into account the complex nonlinear dynamics.
△ Less
Submitted 28 December, 2022;
originally announced December 2022.
-
Time-dependent moments from partial differential equations and the time-dependent set of atoms
Authors:
Raúl E. Curto,
Philipp J. di Dio,
Milan Korda,
Victor Magron
Abstract:
We study the time-dependent moments and associated polynomials arising from the partial differential equation $\partial_t f = νΔf + g\cdot\nabla f + h\cdot f$, and consider in detail the dual equation. For the heat equation we find that several non-negative polynomials which are not sums of squares become sums of squares under the heat equation in finite time. We show that every non-negative polyn…
▽ More
We study the time-dependent moments and associated polynomials arising from the partial differential equation $\partial_t f = νΔf + g\cdot\nabla f + h\cdot f$, and consider in detail the dual equation. For the heat equation we find that several non-negative polynomials which are not sums of squares become sums of squares under the heat equation in finite time. We show that every non-negative polynomial in $\mathbb{R}[x,y,z]_{\leq 4}$ becomes a sum of squares in finite time under the heat equation. We solve the problem of moving atoms under the equation $\partial_t f = g\cdot\nabla f + h\cdot f$ with $f_0 = μ_0$ being a finitely atomic measure. The time evolution $μ_t = \sum_{i=1}^k c_i(t)\cdot δ_{x_i(t)}$ of the atom positions $x_i(t)$ are described by the transport term $g\cdot\nabla$ and the time-dependent coefficients $c_i(t)$ have an explicit solution depending on $x_i(t)$, $h$, and $\mathrm{div}\, g$.
△ Less
Submitted 13 March, 2023; v1 submitted 8 November, 2022;
originally announced November 2022.
-
Exploiting ideal-sparsity in the generalized moment problem with application to matrix factorization ranks
Authors:
Milan Korda,
Monique Laurent,
Victor Magron,
Andries Steenkamp
Abstract:
We explore a new type of sparsity for the generalized moment problem (GMP) that we call ideal-sparsity. This sparsity exploits the presence of equality constraints requiring the measure to be supported on the variety of an ideal generated by bilinear monomials modeled by an associated graph. We show that this enables an equivalent sparse reformulation of the GMP, where the single (high dimensional…
▽ More
We explore a new type of sparsity for the generalized moment problem (GMP) that we call ideal-sparsity. This sparsity exploits the presence of equality constraints requiring the measure to be supported on the variety of an ideal generated by bilinear monomials modeled by an associated graph. We show that this enables an equivalent sparse reformulation of the GMP, where the single (high dimensional) measure variable is replaced by several (lower-dimensional) measure variables supported on the maximal cliques of the graph. We explore the resulting hierarchies of moment-based relaxations for the original dense formulation of GMP and this new, equivalent ideal-sparse reformulation, when applied to the problem of bounding nonnegative- and completely positive matrix factorization ranks. We show that the ideal-sparse hierarchies provide bounds that are at least as good (and often tighter) as those obtained from the dense hierarchy. This is in sharp contrast to the situation when exploiting correlative sparsity, as is most common in the literature, where the resulting bounds are weaker than the dense bounds. Moreover, while correlative sparsity requires the underlying graph to be chordal, no such assumption is needed for ideal-sparsity. Numerical results show that the ideal-sparse bounds are often tighter and much faster to compute than their dense analogs.
△ Less
Submitted 9 July, 2023; v1 submitted 20 September, 2022;
originally announced September 2022.
-
Urysohn in action: separating semialgebraic sets by polynomials
Authors:
Milan Korda,
Jean-Bernard Lasserre,
Alexey Lazarev,
Victor Magron,
Simone Naldi
Abstract:
A classical result from topology called Uryshon's lemma asserts the existence of a continuous separator of two disjoint closed sets in a sufficiently regular topological space. In this work we make a search for this separator constructive and efficient in the context of real algebraic geometry. Namely, given two compact disjoint basic semialgebraic sets which are contained in an $n$-dimensional bo…
▽ More
A classical result from topology called Uryshon's lemma asserts the existence of a continuous separator of two disjoint closed sets in a sufficiently regular topological space. In this work we make a search for this separator constructive and efficient in the context of real algebraic geometry. Namely, given two compact disjoint basic semialgebraic sets which are contained in an $n$-dimensional box, we provide an algorithm that computes a separating polynomial greater than or equal to 1 on the first set and less than or equal to 0 on the second one.
△ Less
Submitted 1 July, 2022;
originally announced July 2022.
-
The gap between a variational problem and its occupation measure relaxation
Authors:
Milan Korda,
Rodolfo Rios-Zertuche
Abstract:
Recent works have proposed linear programming relaxations of variational optimization problems subject to nonlinear PDE constraints based on the occupation measure formalism. The main appeal of these methods is the fact that they rely on convex optimization, typically semidefinite programming. In this work we close an open question related to this approach. We prove that the classical and relaxed…
▽ More
Recent works have proposed linear programming relaxations of variational optimization problems subject to nonlinear PDE constraints based on the occupation measure formalism. The main appeal of these methods is the fact that they rely on convex optimization, typically semidefinite programming. In this work we close an open question related to this approach. We prove that the classical and relaxed minima coincide when the dimension of the codomain of the unknown function equals one, both for calculus of variations and for optimal control problems, thereby complementing analogous results that existed for the case when the dimension of the domain equals one. In order to do so, we prove a generalization of the Hardt-Pitts decomposition of normal currents applicable in our setting. We also show by means of a counterexample that, if both the dimensions of the domain and of the codomain are greater than one, there may be a positive gap. The example we construct to show the latter serves also to show that sometimes relaxed occupation measures may represent a more conceptually-satisfactory "solution" than their classical counterparts, so that -- even though they may not be equivalent -- algorithms rendering accessible the minimum in the larger space of relaxed occupation measures remain extremely valuable. Finally, we show that in the presence of integral constraints, a positive gap may occur at any dimension of the domain and of the codomain.
△ Less
Submitted 22 July, 2022; v1 submitted 27 May, 2022;
originally announced May 2022.
-
Sparsity structures for Koopman operators
Authors:
Corbinian Schlosser,
Milan Korda
Abstract:
We present a decomposition of the Koopman operator based on the sparse structure of the underlying dynamical system, allowing one to consider the system as a family of subsystems interconnected by a graph. Using the intrinsic properties of the Koopman operator, we show that eigenfunctions for the subsystems induce eigenfunctions for the whole system. The use of principal eigenfunctions allows to r…
▽ More
We present a decomposition of the Koopman operator based on the sparse structure of the underlying dynamical system, allowing one to consider the system as a family of subsystems interconnected by a graph. Using the intrinsic properties of the Koopman operator, we show that eigenfunctions for the subsystems induce eigenfunctions for the whole system. The use of principal eigenfunctions allows to reverse this result. Similarly for the adjoint operator, the Perron-Frobenius operator, invariant measures for the dynamical system induce invariant measures of the subsystems, while constructing invariant measures from invariant measures of the subsystems is less straightforward. We address this question and show that under necessary compatibility assumptions such an invariant measure exists. Based on these results we demonstrate that the a-priori knowledge of a decomposition of a dynamical system allows for a reduction of the computational cost for data driven approaches on the example of the dynamic mode decomposition.
△ Less
Submitted 20 December, 2021;
originally announced December 2021.
-
Exploiting Term Sparsity in Moment-SOS hierarchy for Dynamical Systems
Authors:
Jie Wang,
Corbinian Schlosser,
Milan Korda,
Victor Magron
Abstract:
In this paper, we develop a dynamical system counterpart to the term sparsity sum-of-squares (TSSOS) algorithm proposed for static polynomial optimization. This allows for computational savings and improved scalability while preserving convergence guarantees when sum-of-squares methods are applied to problems from dynamical systems, including the problems of approximating region of attraction, the…
▽ More
In this paper, we develop a dynamical system counterpart to the term sparsity sum-of-squares (TSSOS) algorithm proposed for static polynomial optimization. This allows for computational savings and improved scalability while preserving convergence guarantees when sum-of-squares methods are applied to problems from dynamical systems, including the problems of approximating region of attraction, the maximum positively invariant set, and the global attractor. At its core, the method exploits the algebraic structure of the data, thereby complementing existing methods that exploit causality relations among the states of the dynamical system. The procedure encompasses sign symmetries of the dynamical system as was already revealed for polynomial optimization. Numerical examples demonstrate the efficiency of the approach in the presence of this type of sparsity.
△ Less
Submitted 9 October, 2023; v1 submitted 16 November, 2021;
originally announced November 2021.
-
Revisiting semidefinite programming approaches to options pricing: complexity and computational perspectives
Authors:
Didier Henrion,
Felix Kirschner,
Etienne de Klerk,
Milan Korda,
Jean-Bernard Lasserre,
Victor Magron
Abstract:
In this paper we consider the problem of finding bounds on the prices of options depending on multiple assets without assuming any underlying model on the price dynamics, but only the absence of arbitrage opportunities. We formulate this as a generalized moment problem and utilize the well-known Moment-Sum-of-Squares (SOS) hierarchy of Lasserre to obtain bounds on the range of the possible prices.…
▽ More
In this paper we consider the problem of finding bounds on the prices of options depending on multiple assets without assuming any underlying model on the price dynamics, but only the absence of arbitrage opportunities. We formulate this as a generalized moment problem and utilize the well-known Moment-Sum-of-Squares (SOS) hierarchy of Lasserre to obtain bounds on the range of the possible prices. A complementary approach (also due to Lasserre) is employed for comparison. We present several numerical examples to demonstrate the viability of our approach. The framework we consider makes it possible to incorporate different kinds of observable data, such as moment information, as well as observable prices of options on the assets of interest.
△ Less
Submitted 3 June, 2022; v1 submitted 15 November, 2021;
originally announced November 2021.
-
Clarifying the effect of mean subtraction on Dynamic Mode Decomposition
Authors:
Gowtham S Seenivasaharagavan,
Milan Korda,
Hassan Arbabi,
Igor Mezić
Abstract:
Any autonomous nonlinear dynamical system can be viewed as a superposition of infinitely many linear processes, through the so-called Koopman mode decomposition. Its data-driven approximation- Dynamic Mode Decomposition (DMD)- has been extensively developed and deployed across a plethora of fields. In this work, we study the effect of subtracting the temporal mean on the DMD approximation, for obs…
▽ More
Any autonomous nonlinear dynamical system can be viewed as a superposition of infinitely many linear processes, through the so-called Koopman mode decomposition. Its data-driven approximation- Dynamic Mode Decomposition (DMD)- has been extensively developed and deployed across a plethora of fields. In this work, we study the effect of subtracting the temporal mean on the DMD approximation, for observables possessing only a finite number of Koopman modes.
Pre-processing time-sequential training data by removing the temporal mean has been a point of contention in the Companion matrix formulation of DMD. This stems from the potential of said pre-processing to render DMD equivalent to a temporal Discrete Fourier Transform (DFT). We prove that this equivalence is impossible when the training data is linearly consistent and the order of the DMD model exceeds the number of Koopman modes. Since model order and training set size are synonymous in this variant of DMD, the parity of DMD and DFT can, therefore, be indicative of inadequate training data.
△ Less
Submitted 8 March, 2025; v1 submitted 8 May, 2021;
originally announced May 2021.
-
Peak Estimation for Uncertain and Switched Systems
Authors:
Jared Miller,
Didier Henrion,
Mario Sznaier,
Milan Korda
Abstract:
Peak estimation bounds extreme values of a function of state along trajectories of a dynamical system. This paper focuses on extending peak estimation to continuous and discrete settings with time-independent and time-dependent uncertainty. Techniques from optimal control are used to incorporate uncertainty into an existing occupation measure-based peak estimation framework, which includes special…
▽ More
Peak estimation bounds extreme values of a function of state along trajectories of a dynamical system. This paper focuses on extending peak estimation to continuous and discrete settings with time-independent and time-dependent uncertainty. Techniques from optimal control are used to incorporate uncertainty into an existing occupation measure-based peak estimation framework, which includes special consideration for handling switching uncertainties. The resulting infinite-dimensional linear programs can be solved approximately with Linear Matrix Inequalities arising from the moment-SOS hierarchy.
△ Less
Submitted 24 March, 2021;
originally announced March 2021.
-
Model Predictive Control of a Vehicle using Koopman Operator
Authors:
Vít Cibulka,
Milan Korda,
Tomáš Haniš,
Martin Hromčík
Abstract:
This paper continues in the work from arXiv:1903.06103 [math.OC] where a nonlinear vehicle model was approximated in a purely data-driven manner by a linear predictor of higher order, namely the Koopman operator. The vehicle system typically features a lot of nonlinearities such as rigid-body dynamics, coordinate system transformations and most importantly the tire. These nonlinearities are approx…
▽ More
This paper continues in the work from arXiv:1903.06103 [math.OC] where a nonlinear vehicle model was approximated in a purely data-driven manner by a linear predictor of higher order, namely the Koopman operator. The vehicle system typically features a lot of nonlinearities such as rigid-body dynamics, coordinate system transformations and most importantly the tire. These nonlinearities are approximated in a predefined subset of the state-space by the linear Koopman operator and used for a linear Model Predictive Control (MPC) design in the high-dimension state space where the nonlinear system dynamics evolve linearly. The result is a nonlinear MPC designed by linear methodologies. It is demonstrated that the Koopman-based controller is able to recover from a very unusual state of the vehicle where all the aforementioned nonlinearities are dominant. The controller is compared with a controller based on a classic local linearization and shortcomings of this approach are discussed.
△ Less
Submitted 8 March, 2021;
originally announced March 2021.
-
Spatio-Temporal Decomposition of Sum-of-Squares Programs for the Region of Attraction and Reachability
Authors:
Vít Cibulka,
Milan Korda,
Tomáš Haniš
Abstract:
This paper presents a method for calculating Region of Attraction of a target set (not necessarily an equilibrium) for controlled polynomial dynamical systems, using a hierarchy of semidefinite programming problems (SDPs). Our approach builds on previous work and addresses its main issue, the fast-growing memory demands for solving large-scale SDPs. The main idea in this work is in dissecting the…
▽ More
This paper presents a method for calculating Region of Attraction of a target set (not necessarily an equilibrium) for controlled polynomial dynamical systems, using a hierarchy of semidefinite programming problems (SDPs). Our approach builds on previous work and addresses its main issue, the fast-growing memory demands for solving large-scale SDPs. The main idea in this work is in dissecting the original resource-demanding problem into multiple smaller, interconnected, and easier to solve problems. This is achieved by spatio-temporal splitting akin to methods based on partial differential equations. We show that the splitting procedure retains the convergence and outer-approximation guarantees of the previous work, while achieving higher precision in less time and with smaller memory footprint.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
-
Stability and performance verification of dynamical systems controlled by neural networks: algorithms and complexity
Authors:
Milan Korda
Abstract:
This work makes several contributions on stability and performance verification of nonlinear dynamical systems controlled by neural networks. First, we show that the stability and performance of a polynomial dynamical system controlled by a neural network with semialgebraically representable activation functions (e.g., ReLU) can be certified by convex semidefinite programming. The result is based…
▽ More
This work makes several contributions on stability and performance verification of nonlinear dynamical systems controlled by neural networks. First, we show that the stability and performance of a polynomial dynamical system controlled by a neural network with semialgebraically representable activation functions (e.g., ReLU) can be certified by convex semidefinite programming. The result is based on the fact that the semialgebraic representation of the activation functions and polynomial dynamics allows one to search for a Lyapunov function using polynomial sum-of-squares methods. Second, we remark that even in the case of a linear system controlled by a neural network with ReLU activation functions, the problem of verifying asymptotic stability is undecidable. Finally, under additional assumptions, we establish a converse result on the existence of a polynomial Lyapunov function for this class of systems. Numerical results with code available online on examples of state-space dimension up to 50 and neural networks with several hundred neurons and up to 30 layers demonstrate the method.
△ Less
Submitted 24 September, 2022; v1 submitted 3 February, 2021;
originally announced February 2021.
-
Sparse decompositions of nonlinear dynamical systems and applications to moment-sum-of-squares relaxations
Authors:
Corbinian Schlosser,
Milan Korda
Abstract:
In this paper, we propose a general sparse decomposition of dynamical systems provided that the vector field and constraint set possess certain sparse structures, which we call subsystems. This notion is based on causal dependence in the dynamics between the different states. This results in sparse descriptions for fundamental problems from nonlinear dynamical systems: region of attraction, maximu…
▽ More
In this paper, we propose a general sparse decomposition of dynamical systems provided that the vector field and constraint set possess certain sparse structures, which we call subsystems. This notion is based on causal dependence in the dynamics between the different states. This results in sparse descriptions for fundamental problems from nonlinear dynamical systems: region of attraction, maximum positively invariant set, and global attractor. The decompositions can be paired with any method for computing (outer) approximations of these sets to reduce the computation to lower dimensional systems. This is illustrated by methods from previous work based on infinite-dimensional linear programming. This exhibits one example where the curse of dimensionality is present and hence dimension reduction is crucial. In this context, for polynomial dynamics, we show that these problems admit a sparse sum-of-squares (SOS) approximation with guaranteed convergence such that the number of variables in the largest SOS multiplier is given by the dimension of the largest subsystem appearing in the decomposition. The dimension of such subsystems depends on the sparse structure of the vector field and the constraint set; if the dimension of the largest subsystem is small compared to the ambient dimension, this allows for a significant reduction in the computation time of the SOS approximations. Numerical examples accompany the approach.
△ Less
Submitted 5 August, 2024; v1 submitted 10 December, 2020;
originally announced December 2020.
-
Converging outer approximations to global attractors using semidefinite programming
Authors:
Corbinian Schlosser,
Milan Korda
Abstract:
This paper develops a method for obtaining guaranteed outer approximations for global attractors of continuous and discrete time nonlinear dynamical systems. The method is based on a hierarchy of semidefinite programming problems of increasing size with guaranteed convergence to the global attractor. The approach taken follows an established line of reasoning, where we first characterize the globa…
▽ More
This paper develops a method for obtaining guaranteed outer approximations for global attractors of continuous and discrete time nonlinear dynamical systems. The method is based on a hierarchy of semidefinite programming problems of increasing size with guaranteed convergence to the global attractor. The approach taken follows an established line of reasoning, where we first characterize the global attractor via an infinite dimensional linear programming problem (LP) in the space of Borel measures. The dual to this LP is in the space of continuous functions and its feasible solutions provide guaranteed outer approximations to the global attractor. For systems with polynomial dynamics, a hierarchy of finite-dimensional sum-of-squares tightenings of the dual LP provides a sequence of outer approximations to the global attractor with guaranteed convergence in the sense of volume discrepancy tending to zero. The method is very simple to use and based purely on convex optimization. Numerical examples with the code available online demonstrate the method.
△ Less
Submitted 4 October, 2023; v1 submitted 7 May, 2020;
originally announced May 2020.
-
Computing controlled invariant sets from data using convex optimization
Authors:
Milan Korda
Abstract:
This work presents a data-driven method for approximation of the maximum positively invariant (MPI) set and the maximum controlled invariant (MCI) set for nonlinear dynamical systems. The method only requires the knowledge of a finite collection of one-step transitions of the discrete-time dynamics, without the requirement of segments of trajectories or the control inputs that effected the transit…
▽ More
This work presents a data-driven method for approximation of the maximum positively invariant (MPI) set and the maximum controlled invariant (MCI) set for nonlinear dynamical systems. The method only requires the knowledge of a finite collection of one-step transitions of the discrete-time dynamics, without the requirement of segments of trajectories or the control inputs that effected the transitions to be available. The approach uses a novel characterization of the MPI and MCI sets as the solution to an infinite-dimensional linear programming (LP) problem in the space of continuous functions, with the optimum being attained by a (Lipschitz) continuous function under mild assumptions. The infinite-dimensional LP is then approximated by restricting the decision variable to a finite-dimensional subspace and by imposing the non-negativity constraint of this LP only on the available data samples. This leads to a single finite-dimensional LP that can be easily solved using off-the-shelf solvers. We analyze the convergence rate and sample complexity, proving probabilistic as well as hard guarantees on the volume error of the approximations. The approach is very general, requiring minimal underlying assumptions. In particular, the dynamics is not required to be polynomial or even continuous (forgoing some of the theoretical results). Detailed numerical examples up to state-space dimension ten with code available online demonstrate the method.
△ Less
Submitted 9 October, 2020; v1 submitted 6 December, 2019;
originally announced December 2019.
-
Optimal construction of Koopman eigenfunctions for prediction and control
Authors:
Milan Korda,
Igor Mezić
Abstract:
This work presents a novel data-driven framework for constructing eigenfunctions of the Koopman operator geared toward prediction and control. The method leverages the richness of the spectrum of the Koopman operator away from attractors to construct a rich set of eigenfunctions such that the state (or any other observable quantity of interest) is in the span of these eigenfunctions and hence pred…
▽ More
This work presents a novel data-driven framework for constructing eigenfunctions of the Koopman operator geared toward prediction and control. The method leverages the richness of the spectrum of the Koopman operator away from attractors to construct a rich set of eigenfunctions such that the state (or any other observable quantity of interest) is in the span of these eigenfunctions and hence predictable in a linear fashion. The eigenfunction construction is optimization-based with no dictionary selection required. Once a predictor for the uncontrolled part of the system is obtained in this way, the incorporation of control is done through a multi-step prediction error minimization, carried out by a simple linear least-squares regression. The predictor so obtained is in the form of a linear controlled dynamical system and can be readily applied within the Koopman model predictive control framework of [12] to control nonlinear dynamical systems using linear model predictive control tools. The method is entirely data-driven and based purely on convex optimization, with no reliance on neural networks or other non-convex machine learning tools. The novel eigenfunction construction method is also analyzed theoretically, proving rigorously that the family of eigenfunctions obtained is rich enough to span the space of all continuous functions. In addition, the method is extended to construct generalized eigenfunctions that also give rise Koopman invariant subspaces and hence can be used for linear prediction. Detailed numerical examples with code available online demonstrate the approach, both for prediction and feedback control.
△ Less
Submitted 7 May, 2020; v1 submitted 19 October, 2018;
originally announced October 2018.
-
Convex computation of extremal invariant measures of nonlinear dynamical systems and Markov processes
Authors:
Milan Korda,
Didier Henrion,
Igor Mezic
Abstract:
We propose a convex-optimization-based framework for computation of invariant measures of polynomial dynamical systems and Markov processes, in discrete and continuous time. The set of all invariant measures is characterized as the feasible set of an infinite-dimensional linear program (LP). The objective functional of this LP is then used to single-out a specific measure (or a class of measures)…
▽ More
We propose a convex-optimization-based framework for computation of invariant measures of polynomial dynamical systems and Markov processes, in discrete and continuous time. The set of all invariant measures is characterized as the feasible set of an infinite-dimensional linear program (LP). The objective functional of this LP is then used to single-out a specific measure (or a class of measures) extremal with respect to the selected functional such as physical measures, ergodic measures, atomic measures (corresponding to, e.g., periodic orbits) or measures absolutely continuous w.r.t. to a given measure. The infinite-dimensional LP is then approximated using a standard hierarchy of finite-dimensional semidefinite programming problems (SDPs), the solutions of which are truncated moment sequences, which are then used to reconstruct the measure. In particular, we show how to approximate the support of the measure as well as how to construct a sequence of weakly converging absolutely continuous approximations. The presented framework, where a convex functional is minimized or maximized among all invariant measures, can be seen as a generalization of and a computational method to carry out the so called ergodic optimization, where linear functionals are optimized over the set of invariant measures. Finally, we also describe how the presented framework can be adapted to compute eigenmeasures of the Perron-Frobenius operator.
△ Less
Submitted 17 September, 2020; v1 submitted 24 July, 2018;
originally announced July 2018.
-
Moments and convex optimization for analysis and control of nonlinear partial differential equations
Authors:
Milan Korda,
Didier Henrion,
Jean-Bernard Lasserre
Abstract:
This work presents a convex-optimization-based framework for analysis and control of nonlinear partial differential equations. The approach uses a particular weak embedding of the nonlinear PDE, resulting in a linear equation in the space of Borel measures. This equation is then used as a constraint of an infinite-dimensional linear programming problem (LP). This LP is then approximated by a hiera…
▽ More
This work presents a convex-optimization-based framework for analysis and control of nonlinear partial differential equations. The approach uses a particular weak embedding of the nonlinear PDE, resulting in a linear equation in the space of Borel measures. This equation is then used as a constraint of an infinite-dimensional linear programming problem (LP). This LP is then approximated by a hierarchy of convex, finite-dimensional, semidefinite programming problems (SDPs). In the case of analysis of uncontrolled PDEs, the solutions to these SDPs provide bounds on a specified, possibly nonlinear, functional of the solutions to the PDE; in the case of PDE control, the solutions to these SDPs provide bounds on the optimal value of a given optimal control problem as well as suboptimal feedback controllers. The entire approach is based purely on convex optimization and does not rely on spatio-temporal gridding, even though the PDE addressed can be fully nonlinear. The approach is applicable to a very broad class nonlinear PDEs with polynomial data. Computational complexity is analyzed and several complexity reduction procedures are described. Numerical examples demonstrate the approach.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
Power grid transient stabilization using Koopman model predictive control
Authors:
Milan Korda,
Yoshihiko Susuki,
Igor Mezić
Abstract:
This work addresses the problem of transient stabilization of a power grid, following a destabilizing disturbance. The model considered is the cascade interconnection of seven New England test models with the disturbance (e.g., a powerline failure) occurring in the first grid and propagating forward, emulating a wide-area blackout. We consider a data-driven control framework based on the Koopman o…
▽ More
This work addresses the problem of transient stabilization of a power grid, following a destabilizing disturbance. The model considered is the cascade interconnection of seven New England test models with the disturbance (e.g., a powerline failure) occurring in the first grid and propagating forward, emulating a wide-area blackout. We consider a data-driven control framework based on the Koopman operator theory, where a linear predictor, evolving on a higher dimensional (embedded) state-space, is built from observed data and subsequently used within a model predictive control (MPC) framework, allowing for the use of efficient computational tools of linear MPC to control this highly nonlinear dynamical system.
△ Less
Submitted 28 March, 2018;
originally announced March 2018.
-
Data-driven spectral analysis of the Koopman operator
Authors:
Milan Korda,
Mihai Putinar,
Igor Mezić
Abstract:
Starting from measured data, we develop a method to compute the fine structure of the spectrum of the Koopman operator with rigorous convergence guarantees. The method is based on the observation that, in the measure-preserving ergodic setting, the moments of the spectral measure associated to a given observable are computable from a single trajectory of this observable. Having finitely many momen…
▽ More
Starting from measured data, we develop a method to compute the fine structure of the spectrum of the Koopman operator with rigorous convergence guarantees. The method is based on the observation that, in the measure-preserving ergodic setting, the moments of the spectral measure associated to a given observable are computable from a single trajectory of this observable. Having finitely many moments available, we use the classical Christoffel-Darboux kernel to separate the atomic and absolutely continuous parts of the spectrum, supported by convergence guarantees as the number of moments tends to infinity. In addition, we propose a technique to detect the singular continuous part of the spectrum as well as two methods to approximate the spectral measure with guaranteed convergence in the weak topology, irrespective of whether the singular continuous part is present or not. The proposed method is simple to implement and readily applicable to large-scale systems since the computational complexity is dominated by inverting an $N\times N$ Hermitian positive-definite Toeplitz matrix, where $N$ is the number of moments, for which efficient and numerically stable algorithms exist; in particular, the complexity of the approach is independent of the dimension of the underlying state-space. We also show how to compute, from measured data, the spectral projection on a given segment of the unit circle, allowing us to obtain a finite-dimensional approximation of the operator that explicitly takes into account the point and continuous parts of the spectrum. Finally, we describe a relationship between the proposed method and the so-called Hankel Dynamic Mode Decomposition, providing new insights into the behavior of the eigenvalues of the Hankel DMD operator. A number of numerical examples illustrate the approach, including a study of the spectrum of the lid-driven two-dimensional cavity flow.
△ Less
Submitted 24 August, 2018; v1 submitted 17 October, 2017;
originally announced October 2017.
-
On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator
Authors:
Milan Korda,
Igor Mezić
Abstract:
Extended Dynamic Mode Decomposition (EDMD) is an algorithm that approximates the action of the Koopman operator on an $N$-dimensional subspace of the space of observables by sampling at $M$ points in the state space. Assuming that the samples are drawn either independently or ergodically from some measure $μ$, it was shown that, in the limit as $M\rightarrow\infty$, the EDMD operator…
▽ More
Extended Dynamic Mode Decomposition (EDMD) is an algorithm that approximates the action of the Koopman operator on an $N$-dimensional subspace of the space of observables by sampling at $M$ points in the state space. Assuming that the samples are drawn either independently or ergodically from some measure $μ$, it was shown that, in the limit as $M\rightarrow\infty$, the EDMD operator $\mathcal{K}_{N,M}$ converges to $\mathcal{K}_N$, where $\mathcal{K}_N$ is the $L_2(μ)$-orthogonal projection of the action of the Koopman operator on the finite-dimensional subspace of observables. In this work, we show that, as $N \rightarrow \infty$, the operator $\mathcal{K}_N$ converges in the strong operator topology to the Koopman operator. This in particular implies convergence of the predictions of future values of a given observable over any finite time horizon, a fact important for practical applications such as forecasting, estimation and control. In addition, we show that accumulation points of the spectra of $\mathcal{K}_N$ correspond to the eigenvalues of the Koopman operator with the associated eigenfunctions converging weakly to an eigenfunction of the Koopman operator, provided that the weak limit of eigenfunctions is nonzero. As a by-product, we propose an analytic version of the EDMD algorithm which, under some assumptions, allows one to construct $\mathcal{K}_N$ directly, without the use of sampling. Finally, under additional assumptions, we analyze convergence of $\mathcal{K}_{N,N}$ (i.e., $M=N$), proving convergence, along a subsequence, to weak eigenfunctions (or eigendistributions) related to the eigenmeasures of the Perron-Frobenius operator. No assumptions on the observables belonging to a finite-dimensional invariant subspace of the Koopman operator are required throughout.
△ Less
Submitted 20 October, 2017; v1 submitted 14 March, 2017;
originally announced March 2017.
-
Convergence rates of moment-sum-of-squares hierarchies for volume approximation of semialgebraic sets
Authors:
Milan Korda,
Didier Henrion
Abstract:
Moment-sum-of-squares hierarchies of semidefinite programs can be used to approximate the volume of a given compact basic semialgebraic set K. The idea consists of approximating from above the indicator function of K with a sequence of polynomials of increasing degree d, so that the integrals of these polynomials generate a convergence sequence of upper bounds on the volume of K. We show that the…
▽ More
Moment-sum-of-squares hierarchies of semidefinite programs can be used to approximate the volume of a given compact basic semialgebraic set K. The idea consists of approximating from above the indicator function of K with a sequence of polynomials of increasing degree d, so that the integrals of these polynomials generate a convergence sequence of upper bounds on the volume of K. We show that the asymptotic rate of this convergence is at least O(1/ log log d).
△ Less
Submitted 13 December, 2016;
originally announced December 2016.
-
Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control
Authors:
Milan Korda,
Igor Mezić
Abstract:
This paper presents a class of linear predictors for nonlinear controlled dynamical systems. The basic idea is to lift the nonlinear dynamics into a higher dimensional space where its evolution is approximately linear. In an uncontrolled setting, this procedure amounts to a numerical approximation of the Koopman operator associated to the nonlinear dynamics. In this work, we extend the Koopman ope…
▽ More
This paper presents a class of linear predictors for nonlinear controlled dynamical systems. The basic idea is to lift the nonlinear dynamics into a higher dimensional space where its evolution is approximately linear. In an uncontrolled setting, this procedure amounts to a numerical approximation of the Koopman operator associated to the nonlinear dynamics. In this work, we extend the Koopman operator to controlled dynamical systems and compute a finite-dimensional approximation of the operator in such a way that this approximation has the form a linear controlled dynamical system. In numerical examples, the linear predictors obtained in this way exhibit a performance superior to existing linear predictors such as those based on local linearization or the so-called Carleman linearization. Importantly, the procedure to construct these linear predictors is completely data-driven and extremely simple -- it boils down to a nonlinear transformation of the data (the lifting) and a linear least squares problem in the lifted space that can be readily solved for large data sets. These linear predictors can be readily used to design controllers for the nonlinear dynamical system using linear controller design methodologies. We focus in particular on model predictive control (MPC) and show that MPC controllers designed in this way enjoy computational complexity of the underlying optimization problem comparable to that of MPC for a linear dynamical system of the same size. Importantly, linear inequality constraints on the state and control inputs as well as nonlinear constraints on the state can be imposed in a linear fashion in the proposed MPC scheme. Similarly, cost functions nonlinear in the state variable can be handled in a linear fashion. Numerical examples (including a high-dimensional nonlinear PDE control) demonstrate the approach with the source code available online.
△ Less
Submitted 23 March, 2018; v1 submitted 10 November, 2016;
originally announced November 2016.
-
Convergence rates of moment-sum-of-squares hierarchies for optimal control problems
Authors:
Milan Korda,
Didier Henrion,
Colin N. Jones
Abstract:
We study the convergence rate of moment-sum-of-squares hierarchies of semidefinite programs for optimal control problems with polynomial data. It is known that these hierarchies generate polynomial under-approximations to the value function of the optimal control problem and that these under-approximations converge in the L1 norm to the value function as their degree d tends to infinity. We show t…
▽ More
We study the convergence rate of moment-sum-of-squares hierarchies of semidefinite programs for optimal control problems with polynomial data. It is known that these hierarchies generate polynomial under-approximations to the value function of the optimal control problem and that these under-approximations converge in the L1 norm to the value function as their degree d tends to infinity. We show that the rate of this convergence is O(1/ log log d). We treat in detail the continuous-time infinite-horizon discounted problem and describe in brief how the same rate can be obtained for the finite-horizon continuous-time problem and for the discrete-time counterparts of both problems.
△ Less
Submitted 9 September, 2016;
originally announced September 2016.
-
On Turnpike and Dissipativity Properties of Continuous-Time Optimal Control Problems
Authors:
Timm Faulwasser,
Milan Korda,
Colin N. Jones,
Dominique Bonvin
Abstract:
This paper investigates the relations between three different properties, which are of importance in optimal control problems: dissipativity of the underlying dynamics with respect to a specific supply rate, optimal operation at steady state, and the turnpike property. We show in a continuous-time setting that if along optimal trajectories a strict dissipation inequality is satisfied, then this im…
▽ More
This paper investigates the relations between three different properties, which are of importance in optimal control problems: dissipativity of the underlying dynamics with respect to a specific supply rate, optimal operation at steady state, and the turnpike property. We show in a continuous-time setting that if along optimal trajectories a strict dissipation inequality is satisfied, then this implies optimal operation at this steady state and the existence of a turnpike at the same steady state. Finally, we establish novel converse turnpike results, i.e., we show that the existence of a turnpike at a steady state implies optimal operation at this steady state and dissipativity with respect to this steady state. We draw upon a numerical example to illustrate our findings.
△ Less
Submitted 16 July, 2017; v1 submitted 24 September, 2015;
originally announced September 2015.
-
Controller design and value function approximation for nonlinear dynamical systems
Authors:
Milan Korda,
Didier Henrion,
Colin N. Jones
Abstract:
This work considers the infinite-time discounted optimal control problem for continuous time input-affine polynomial dynamical systems subject to polynomial state and box input constraints. We propose a sequence of sum-of-squares (SOS) approximations of this problem obtained by first lifting the original problem into the space of measures with continuous densities and then restricting these densit…
▽ More
This work considers the infinite-time discounted optimal control problem for continuous time input-affine polynomial dynamical systems subject to polynomial state and box input constraints. We propose a sequence of sum-of-squares (SOS) approximations of this problem obtained by first lifting the original problem into the space of measures with continuous densities and then restricting these densities to polynomials. These approximations are tightenings, rather than relaxations, of the original problem and provide a sequence of rational controllers with value functions associated to these controllers converging (under some technical assumptions) to the value function of the original problem. In addition, we describe a method to obtain polynomial approximations from above and from below to the value function of the extracted rational controllers, and a method to obtain approximations from below to the optimal value function of the original problem, thereby obtaining a sequence of asymptotically optimal rational controllers with explicit estimates of suboptimality. Numerical examples demonstrate the approach.
△ Less
Submitted 23 March, 2015;
originally announced March 2015.
-
Solving the Infinite-horizon Constrained LQR Problem using Accelerated Dual Proximal Methods
Authors:
Giorgos Stathopoulos,
Milan Korda,
Colin N. Jones
Abstract:
This work presents an algorithmic scheme for solving the infinite-time constrained linear quadratic regulation problem. We employ an accelerated version of a popular proximal gradient scheme, commonly known as the Forward-Backward Splitting (FBS), and prove its convergence to the optimal solution in our infinite-dimensional setting. Each iteration of the algorithm requires only finite memory, is c…
▽ More
This work presents an algorithmic scheme for solving the infinite-time constrained linear quadratic regulation problem. We employ an accelerated version of a popular proximal gradient scheme, commonly known as the Forward-Backward Splitting (FBS), and prove its convergence to the optimal solution in our infinite-dimensional setting. Each iteration of the algorithm requires only finite memory, is computationally cheap, and makes no use of terminal invariant sets; hence, the algorithm can be applied to systems of very large dimensions. The acceleration brings in optimal convergence rates O(1/k^2) for function values and O(1/k) for primal iterates and renders the proposed method a practical alternative to model predictive control schemes for setpoint tracking. In addition, for the case when the true system is subject to disturbances or modelling errors, we propose an efficient warm-starting procedure, which significantly reduces the number of iterations when the algorithm is applied in closed-loop. Numerical examples demonstrate the approach.
△ Less
Submitted 18 January, 2015;
originally announced January 2015.
-
Stability and Performance Verification of Optimization-based Controllers
Authors:
Milan Korda,
Colin N. Jones
Abstract:
This paper presents a method to verify closed-loop properties of optimization-based controllers for deterministic and stochastic constrained polynomial discrete-time dynamical systems. The closed-loop properties amenable to the proposed technique include global and local stability, performance with respect to a given cost function (both in a deterministic and stochastic setting) and the…
▽ More
This paper presents a method to verify closed-loop properties of optimization-based controllers for deterministic and stochastic constrained polynomial discrete-time dynamical systems. The closed-loop properties amenable to the proposed technique include global and local stability, performance with respect to a given cost function (both in a deterministic and stochastic setting) and the $\mathcal{L}_2$ gain. The method applies to a wide range of practical control problems: For instance, a dynamical controller (e.g., a PID) plus input saturation, model predictive control with state estimation, inexact model and soft constraints, or a general optimization-based controller where the underlying problem is solved with a fixed number of iterations of a first-order method are all amenable to the proposed approach.
The approach is based on the observation that the control input generated by an optimization-based controller satisfies the associated Karush-Kuhn-Tucker (KKT) conditions which, provided all data is polynomial, are a system of polynomial equalities and inequalities. The closed-loop properties can then be analyzed using sum-of-squares (SOS) programming.
△ Less
Submitted 15 November, 2016; v1 submitted 16 January, 2015;
originally announced January 2015.
-
Controller design and region of attraction estimation for nonlinear dynamical systems
Authors:
Milan Korda,
Didier Henrion,
Colin N. Jones
Abstract:
This work presents a method to obtain inner and outer approximations of the region of attraction of a given target set as well as an admissible controller generating the inner approximation. The method is applicable to constrained polynomial dynamical systems and extends to trigonometric and rational systems. The method consists of three steps: compute outer approximations, extract a polynomial co…
▽ More
This work presents a method to obtain inner and outer approximations of the region of attraction of a given target set as well as an admissible controller generating the inner approximation. The method is applicable to constrained polynomial dynamical systems and extends to trigonometric and rational systems. The method consists of three steps: compute outer approximations, extract a polynomial controller while guaranteeing the satisfaction of the input constraints, compute inner approximations with respect to the closed-loop system with this controller. Each step of the method is a convex optimization problem, in fact a semidefinite program consisting of minimizing a linear function subject to linear matrix inequality (LMI) constraints. The inner approximations are positively invariant provided that the target set is included in the inner approximation and/or is itself invariant. %The approach readily extends to trigonometric dynamics and/or constraints.
△ Less
Submitted 20 March, 2014; v1 submitted 8 October, 2013;
originally announced October 2013.
-
Convex computation of the maximum controlled invariant set for polynomial control systems
Authors:
Milan Korda,
Didier Henrion,
Colin N. Jones
Abstract:
We characterize the maximum controlled invariant (MCI) set for discrete- as well as continuous-time nonlinear dynamical systems as the solution of an infinite-dimensional linear programming problem. For systems with polynomial dynamics and compact semialgebraic state and control constraints, we describe a hierarchy of finite-dimensional linear matrix inequality (LMI) relaxations whose optimal valu…
▽ More
We characterize the maximum controlled invariant (MCI) set for discrete- as well as continuous-time nonlinear dynamical systems as the solution of an infinite-dimensional linear programming problem. For systems with polynomial dynamics and compact semialgebraic state and control constraints, we describe a hierarchy of finite-dimensional linear matrix inequality (LMI) relaxations whose optimal values converge to the volume of the MCI set; dual to these LMI relaxations are sum-of-squares (SOS) problems providing a converging sequence of outer approximations to the MCI set. The approach is simple and readily applicable in the sense that the approximations are the outcome of a single semidefinite program with no additional input apart from the problem description. A number of numerical examples illustrate the approach.
△ Less
Submitted 26 March, 2013;
originally announced March 2013.
-
Inner approximations of the region of attraction for polynomial dynamical systems
Authors:
Milan Korda,
Didier Henrion,
Colin N. Jones
Abstract:
In a previous work we developed a convex infinite dimensional linear programming (LP) approach to approximating the region of attraction (ROA) of polynomial dynamical systems subject to compact basic semialgebraic state constraints. Finite dimensional relaxations to the infinite-dimensional LP lead to a truncated moment problem in the primal and a polynomial sum-of-squares problem in the dual. Thi…
▽ More
In a previous work we developed a convex infinite dimensional linear programming (LP) approach to approximating the region of attraction (ROA) of polynomial dynamical systems subject to compact basic semialgebraic state constraints. Finite dimensional relaxations to the infinite-dimensional LP lead to a truncated moment problem in the primal and a polynomial sum-of-squares problem in the dual. This primal-dual linear matrix inequality (LMI) problem can be solved numerically with standard semidefinite programming solvers, producing a hierarchy of outer (i.e. exterior) approximations of the ROA by polynomial sublevel sets, with a guarantee of almost uniform and set-wise convergence. In this companion paper, we show that our approach is flexible enough to be modified so as to generate a hierarchy of polynomial inner (i.e.\,interior) approximations of the ROA with similar convergence guarantees.
△ Less
Submitted 11 October, 2012;
originally announced October 2012.
-
Convex computation of the region of attraction of polynomial control systems
Authors:
Didier Henrion,
Milan Korda
Abstract:
We address the long-standing problem of computing the region of attraction (ROA) of a target set (e.g., a neighborhood of an equilibrium point) of a controlled nonlinear system with polynomial dynamics and semialgebraic state and input constraints. We show that the ROA can be computed by solving an infinite-dimensional convex linear programming (LP) problem over the space of measures. In turn, thi…
▽ More
We address the long-standing problem of computing the region of attraction (ROA) of a target set (e.g., a neighborhood of an equilibrium point) of a controlled nonlinear system with polynomial dynamics and semialgebraic state and input constraints. We show that the ROA can be computed by solving an infinite-dimensional convex linear programming (LP) problem over the space of measures. In turn, this problem can be solved approximately via a classical converging hierarchy of convex finite-dimensional linear matrix inequalities (LMIs). Our approach is genuinely primal in the sense that convexity of the problem of computing the ROA is an outcome of optimizing directly over system trajectories. The dual infinite-dimensional LP on nonnegative continuous functions (approximated by polynomial sum-of-squares) allows us to generate a hierarchy of semialgebraic outer approximations of the ROA at the price of solving a sequence of LMI problems with asymptotically vanishing conservatism. This sharply contrasts with the existing literature which follows an exclusively dual Lyapunov approach yielding either nonconvex bilinear matrix inequalities or conservative LMI conditions. The approach is simple and readily applicable as the outer approximations are the outcome of a single semidefinite program with no additional data required besides the problem description.
△ Less
Submitted 28 November, 2013; v1 submitted 8 August, 2012;
originally announced August 2012.
