Showing 1–50 of 121 results for author: Henrion, D

Solving unbounded optimal control problems with the moment-SOS hierarchy *

Authors: Karolına Sehnalová, Didier Henrion, Milan Korda, Martin Kružík

Abstract: The behaviour of the moment-sums-of-squares (moment-SOS) hierarchy for polynomial optimal control problems on compact sets has been explored to a large extent. Our contribution focuses on the case of non-compact control sets. We describe a new approach to optimal control problems with unbounded controls, using compactification by partial homogenization, leading to an equivalent infinite dimensiona… ▽ More The behaviour of the moment-sums-of-squares (moment-SOS) hierarchy for polynomial optimal control problems on compact sets has been explored to a large extent. Our contribution focuses on the case of non-compact control sets. We describe a new approach to optimal control problems with unbounded controls, using compactification by partial homogenization, leading to an equivalent infinite dimensional linear program with compactly supported measures. Our results are closely related to the results of a previous approach using DiPerna-Majda measures. However, our work provides a sound proof of the absence of relaxation gap, which was conjectured in the previous work, and thereby enables the design of a moment-sum-of-squares relaxation with guaranteed convergence. △ Less

Submitted 17 March, 2025; originally announced March 2025.

Fast control allocation algorithm for tilt-rotor VTOL aircraft

Authors: Jan Belák, Didier Henrion, Martin Hromčík

Abstract: Control algorithms initially developed for tilt-wing vertical take-off and landing (VTOL) aircraft are adapted to the tilt-rotor design. The main difference between the two types of planes is the more complicated interaction between propellers and wings in the tilt-rotor design. Unlike tilt-wing design, the tilt-rotor case varies the angle between the propeller disk and wing cord line, thus introd… ▽ More Control algorithms initially developed for tilt-wing vertical take-off and landing (VTOL) aircraft are adapted to the tilt-rotor design. The main difference between the two types of planes is the more complicated interaction between propellers and wings in the tilt-rotor design. Unlike tilt-wing design, the tilt-rotor case varies the angle between the propeller disk and wing cord line, thus introducing a non-linear dependency of lift on thrust and tilt angle. In this paper we develop a precise control allocation method, utilizing Groebner basis algorithms to mask the non-linearity of the control action and allow the use of linear time-invariant control laws for attitude and velocity control architectures. The performance of our approach is discussed and quantified w.r.t. the accuracy of the developed propeller-wing interaction model. △ Less

Submitted 24 February, 2025; originally announced February 2025.

Optimizing quasi-dissipative evolution equations with the moment-SOS hierarchy

Authors: Saroj Prasad Chhatoi, Didier Henrion, Swann Marx, Nicolas Seguin

Abstract: We prove that there is no relaxation gap between a quasi-dissipative nonlinear evolution equation in a Hilbert space and its linear Liouville equation reformulation on probability measures. In other words, strong and generalized solutions of such equations are unique in the class of measure-valued solutions. As a major consequence, non-convex numerical optimization over these non-linear partial di… ▽ More We prove that there is no relaxation gap between a quasi-dissipative nonlinear evolution equation in a Hilbert space and its linear Liouville equation reformulation on probability measures. In other words, strong and generalized solutions of such equations are unique in the class of measure-valued solutions. As a major consequence, non-convex numerical optimization over these non-linear partial differential equations can be carried out with the infinite-dimensional moment-SOS hierarchy with global convergence guarantees. This covers in particular all reaction-diffusion equations with polynomial nonlinearity. △ Less

Submitted 18 April, 2025; v1 submitted 10 December, 2024; originally announced December 2024.

Report number: Rapport LAAS n{\textdegree} 24441

Optimal Control of 1D Semilinear Heat Equations with Moment-SOS Relaxations

Authors: Charlie Lebarbé, Emilien Flayac, Michel Fournié, Didier Henrion, Milan Korda

Abstract: We use moment-SOS (Sum Of Squares) relaxations to address the optimal control problem of the 1D heat equation perturbed with a nonlinear term. We extend the current framework of moment-based optimal control of PDEs to consider a quadratic cost on the control. We develop a new method to extract a nonlinear controller from approximate moments of the solution. The control law acts on the boundary of… ▽ More We use moment-SOS (Sum Of Squares) relaxations to address the optimal control problem of the 1D heat equation perturbed with a nonlinear term. We extend the current framework of moment-based optimal control of PDEs to consider a quadratic cost on the control. We develop a new method to extract a nonlinear controller from approximate moments of the solution. The control law acts on the boundary of the domain and depends on the solution over the whole domain. Our method is validated numerically and compared to a linear-quadratic controller. △ Less

Submitted 15 April, 2025; v1 submitted 18 November, 2024; originally announced November 2024.

Approximate D-optimal design and equilibrium measure

Authors: Didier Henrion, Jean Bernard Lasserre

Abstract: We introduce a minor variant of the approximate D-optimal design of experiments with a more general information matrix that takes into account the representation of the design space S. The main motivation (and result) is that if S in R^d is the unit ball, the unit box or the canonical simplex, then remarkably, for every dimension d and every degree n, one obtains an optimal solution in closed form… ▽ More We introduce a minor variant of the approximate D-optimal design of experiments with a more general information matrix that takes into account the representation of the design space S. The main motivation (and result) is that if S in R^d is the unit ball, the unit box or the canonical simplex, then remarkably, for every dimension d and every degree n, one obtains an optimal solution in closed form, namely the equilibrium measure of S (in pluripotential theory). Equivalently, for each degree n, the unique optimal solution is the vector of moments (up to degree 2n) of the equilibrium measure of S. Hence finding an optimal design reduces to finding a cubature for the equilibrium measure, with atoms in S, positive weights, and exact up to degree 2n. In addition, any resulting sequence of atomic D-optimal measures converges to the equilibrium measure of S for the weak-star topology, as n increases. Links with Fekete sets of points are also discussed. More general compact basic semi-algebraic sets are also considered, and a previously developed two-step design algorithm is easily adapted to this new variant of D-optimal design problem. △ Less

Submitted 14 May, 2025; v1 submitted 6 September, 2024; originally announced September 2024.

Report number: Rapport LAAS n{\textdegree} 24251

An infinite-dimensional Christoffel function and detection of abnormal trajectories

Authors: Didier Henrion, Jean-Bernard Lasserre

Abstract: We introduce an infinite-dimensional version of the Christoffel function, where now (i) its argument lies in a Hilbert space of functions, and (ii) its associated underlying measure is supported on a compact subset of the Hilbert space. We show that it possesses the same crucial property as its finite-dimensional version to identify the support of the measure (and so to detect outliers). Indeed, t… ▽ More We introduce an infinite-dimensional version of the Christoffel function, where now (i) its argument lies in a Hilbert space of functions, and (ii) its associated underlying measure is supported on a compact subset of the Hilbert space. We show that it possesses the same crucial property as its finite-dimensional version to identify the support of the measure (and so to detect outliers). Indeed, the growth of its reciprocal with respect to its degree is at least exponential outside the support of the measure and at most polynomial inside. Moreover, for a fixed degree, its computation mimics that of the finite-dimensional case, but now the entries of the moment matrix associated with the measure are moments of moments. To illustrate the potential of this new tool, we consider the following application. Given a data base of registered reference trajectories, we consider the problem of detecting whether a newly acquired trajectory is abnormal (or out of distribution) with respect to the data base. As in the finite-dimensional case, we use the infinite-dimensional Christoffel function as a score function to detect outliers and abnormal trajectories. A few numerical examples are provided to illustrate the theory. △ Less

Submitted 2 July, 2024; originally announced July 2024.

Infinite-dimensional Christoffel-Darboux polynomial kernels on Hilbert spaces

Authors: Didier Henrion

Abstract: In these notes, the Christoffel-Darboux polynomial kernel is extended to infinite-dimensional Hilbert spaces, following as closely as possible its original finite-dimensional treatment. In these notes, the Christoffel-Darboux polynomial kernel is extended to infinite-dimensional Hilbert spaces, following as closely as possible its original finite-dimensional treatment. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Evolution of Measures in Nonsmooth Dynamical Systems: Formalisms and Computation

Authors: Saroj Prasad Chhatoi, Aneel Tanwani, Didier Henrion

Abstract: This article develops mathematical formalisms and provides numerical methods for studying the evolution of measures in nonsmooth dynamical systems using the continuity equation. The nonsmooth dynamical system is described by an evolution variational inequality and we derive the continuity equation associated with this system class using three different formalisms. The first formalism consists of u… ▽ More This article develops mathematical formalisms and provides numerical methods for studying the evolution of measures in nonsmooth dynamical systems using the continuity equation. The nonsmooth dynamical system is described by an evolution variational inequality and we derive the continuity equation associated with this system class using three different formalisms. The first formalism consists of using the {superposition principle} to describe the continuity equation for a measure that disintegrates into a probability measure supported on the set of vector fields and another measure representing the distribution of system trajectories at each time instant. The second formalism is based on the regularization of the nonsmooth vector field and describing the measure as the limit of a sequence of measures associated with the regularization parameter. In doing so, we obtain quantitative bounds on the Wasserstein metric between measure solutions of the regularized vector field and the limiting measure associated with the nonsmooth vector field. The third formalism uses a time-stepping algorithm to model a time-discretized evolution of the measures and show that the absolutely continuous trajectories associated with the continuity equation are recovered in the limit as the sampling time goes to zero. We also validate each formalism with numerical examples. For the first formalism, we use polynomial optimization techniques and the moment-SOS hierarchy to obtain approximate moments of the measures. For the second formalism, we illustrate the bounds on the Wasserstein metric for an academic example for which the closed-form expression of the Wasserstein metric can be calculated. For the third formalism, we illustrate the time-stepping based algorithm for measure evolution on an example that shows the effect of the concentration of measures. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Algebraic Proofs of Path Disconnectedness using Time-Dependent Barrier Functions

Authors: Didier Henrion, Jared Miller, Mohab Safey El Din

Abstract: Two subsets of a given set are path-disconnected if they lie in different connected components of the larger set. Verification of path-disconnectedness is essential in proving the infeasibility of motion planning and trajectory optimization algorithms. We formulate path-disconnectedness as the infeasibility of a single-integrator control task to move between an initial set and a target set in a su… ▽ More Two subsets of a given set are path-disconnected if they lie in different connected components of the larger set. Verification of path-disconnectedness is essential in proving the infeasibility of motion planning and trajectory optimization algorithms. We formulate path-disconnectedness as the infeasibility of a single-integrator control task to move between an initial set and a target set in a sufficiently long time horizon. This control-infeasibility task is certified through the generation of a time-dependent barrier function that separates the initial and final sets. The existence of a time-dependent barrier function is a necessary and sufficient condition for path-disconnectedness under compactness conditions. Numerically, the search for a polynomial barrier function is formulated using the moment-sum-of-squares hierarchy of semidefinite programs. The barrier function proves path-disconnectedness at a sufficiently large polynomial degree. The computational complexity of these semidefinite programs can be reduced by elimination of the control variables. Disconnectedness proofs are synthesized for example systems. △ Less

Submitted 10 April, 2024; originally announced April 2024.

Comments: 17 pages, 2 tables, 3 figures

Peak Time-Windowed Risk Estimation of Stochastic Processes

Authors: Jared Miller, Niklas Schmid, Matteo Tacchi, Didier Henrion, Roy S. Smith

Abstract: This paper develops a method to upper-bound extreme-values of time-windowed risks for stochastic processes. Examples of such risks include the maximum average or 90% quantile of the current along a transmission line in any 5-minute window. This work casts the time-windowed risk analysis problem as an infinite-dimensional linear program in occupation measures. In particular, we employ the coherent… ▽ More This paper develops a method to upper-bound extreme-values of time-windowed risks for stochastic processes. Examples of such risks include the maximum average or 90% quantile of the current along a transmission line in any 5-minute window. This work casts the time-windowed risk analysis problem as an infinite-dimensional linear program in occupation measures. In particular, we employ the coherent risk measures of the mean and the expected shortfall (conditional value at risk) to define the maximal time-windowed risk along trajectories. The infinite-dimensional linear program must then be truncated into finite-dimensional optimization problems, such as by using the moment-sum of squares hierarchy of semidefinite programs. The infinite-dimensional linear program will have the same optimal value as the original nonconvex risk estimation task under compactness and regularity assumptions, and the sequence of semidefinite programs will converge to the true value under additional properties of algebraic characterization. The scheme is demonstrated for risk analysis of example stochastic processes. △ Less

Submitted 11 April, 2024; v1 submitted 10 April, 2024; originally announced April 2024.

Comments: 26 pages, 11 figures

Slow convergence of the moment-SOS hierarchy for an elementary polynomial optimization problem

Authors: Didier Henrion, Adrien Le Franc, Victor Magron

Abstract: We describe a parametric univariate quadratic optimization problem for which the moment-SOS hierarchy has finite but increasingly slow convergence when the parameter tends to its limit value. We estimate the order of finite convergence as a function of the parameter. We describe a parametric univariate quadratic optimization problem for which the moment-SOS hierarchy has finite but increasingly slow convergence when the parameter tends to its limit value. We estimate the order of finite convergence as a function of the parameter. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Solving moment and polynomial optimization problems on Sobolev spaces

Authors: Didier Henrion, Alessandro Rudi

Abstract: Using standard tools of harmonic analysis, we state and solve the problem of moments for non-negative measures supported on the unit ball of a Sobolev space of multivariate periodic trigonometric functions. We describe outer and inner semidefinite approximations of the cone of Sobolev moments. They are the basic components of an infinite-dimensional moment-sums of squares hierarchy, allowing to n… ▽ More Using standard tools of harmonic analysis, we state and solve the problem of moments for non-negative measures supported on the unit ball of a Sobolev space of multivariate periodic trigonometric functions. We describe outer and inner semidefinite approximations of the cone of Sobolev moments. They are the basic components of an infinite-dimensional moment-sums of squares hierarchy, allowing to numerically solve non-convex polynomial optimization problems on infinite-dimensional Sobolev spaces with global convergence guarantees △ Less

Submitted 24 February, 2025; v1 submitted 15 January, 2024; originally announced January 2024.

Report number: Rapport LAAS n{\textdegree} 24009

Unsafe Probabilities and Risk Contours for Stochastic Processes using Convex Optimization

Authors: Jared Miller, Matteo Tacchi, Didier Henrion, Mario Sznaier

Abstract: This paper proposes an algorithm to calculate the maximal probability of unsafety with respect to trajectories of a stochastic process and a hazard set. The unsafe probability estimation problem is cast as a primal-dual pair of infinite-dimensional linear programs in occupation measures and continuous functions. This convex relaxation is nonconservative (to the true probability of unsafety) under… ▽ More This paper proposes an algorithm to calculate the maximal probability of unsafety with respect to trajectories of a stochastic process and a hazard set. The unsafe probability estimation problem is cast as a primal-dual pair of infinite-dimensional linear programs in occupation measures and continuous functions. This convex relaxation is nonconservative (to the true probability of unsafety) under compactness and regularity conditions in dynamics. The continuous-function linear program is linked to existing probability-certifying barrier certificates of safety. Risk contours for initial conditions of the stochastic process may be generated by suitably modifying the objective of the continuous-function program, forming an interpretable and visual representation of stochastic safety for test initial conditions. All infinite-dimensional linear programs are truncated to finite dimension by the Moment-Sum-of-Squares hierarchy of semidefinite programs. Unsafe-probability estimation and risk contours are generated for example stochastic processes. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Comments: 18 pages, 5 figures, 2 tables

Geometry of exactness of moment-SOS relaxations for polynomial optimization

Authors: Didier Henrion

Abstract: The moment-SOS (sum of squares) hierarchy is a powerful approach for solving globally non-convex polynomial optimization problems (POPs) at the price of solving a family of convex semidefinite optimization problems (called moment-SOS relaxations) of increasing size, controlled by an integer, the relaxation order. We say that a relaxation of a given order is exact if solving the relaxation actually… ▽ More The moment-SOS (sum of squares) hierarchy is a powerful approach for solving globally non-convex polynomial optimization problems (POPs) at the price of solving a family of convex semidefinite optimization problems (called moment-SOS relaxations) of increasing size, controlled by an integer, the relaxation order. We say that a relaxation of a given order is exact if solving the relaxation actually solves the POP globally. In this note, we study the geometry of the exactness cone, defined as the set of polynomial objective functions for which the relaxation is exact. Generalizing previous foundational work on quadratic optimization on real varieties, we prove by elementary arguments that the exactness cones are unions of semidefinite representable cones monotonically embedded for increasing relaxation order. △ Less

Submitted 28 February, 2024; v1 submitted 26 October, 2023; originally announced October 2023.

Comments: This is a new version without Lemma 3 of the previous version, which was obviously incorrect, as illustrated by the univariate example of Remark 6

Report number: Rapport LAAS n 23435

Symmetry reduction and recovery of trajectories of optimal control problems via measure relaxations

Authors: Nicolas Augier, Didier Henrion, Milan Korda, Victor Magron

Abstract: We address the problem of symmetry reduction of optimal control problems under the action of a finite group from a measure relaxation viewpoint. We propose a method based on the moment-SOS aka Lasserre hierarchy which allows one to significantly reduce the computation time and memory requirements compared to the case without symmetry reduction. We show that the recovery of optimal trajectories boi… ▽ More We address the problem of symmetry reduction of optimal control problems under the action of a finite group from a measure relaxation viewpoint. We propose a method based on the moment-SOS aka Lasserre hierarchy which allows one to significantly reduce the computation time and memory requirements compared to the case without symmetry reduction. We show that the recovery of optimal trajectories boils down to solving a symmetric parametric polynomial system. Then we illustrate our method on the symmetric integrator and the time-optimal inversion of qubits. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Comments: 38 pages, 23 figures

MSC Class: 49M20; 90C22; 93C10; 28A99

Infinite-dimensional moment-SOS hierarchy for nonlinear partial differential equations

Authors: Didier Henrion, Maria Infusino, Salma Kuhlmann, Victor Vinnikov

Abstract: We formulate a class of nonlinear {evolution} partial differential equations (PDEs) as linear optimization problems on moments of positive measures supported on infinite-dimensional vector spaces. Using sums of squares (SOS) representations of polynomials in these spaces, we can prove convergence of a hierarchy of finite-dimensional semidefinite relaxations solving approximately these infinite-dim… ▽ More We formulate a class of nonlinear {evolution} partial differential equations (PDEs) as linear optimization problems on moments of positive measures supported on infinite-dimensional vector spaces. Using sums of squares (SOS) representations of polynomials in these spaces, we can prove convergence of a hierarchy of finite-dimensional semidefinite relaxations solving approximately these infinite-dimensional optimization problems. As an illustration, we report on numerical experiments for solving the heat equation subject to a nonlinear perturbation. △ Less

Submitted 30 May, 2023; originally announced May 2023.

Comments: 24 pages, 1 table, 3 figures

MSC Class: Primary 90C25; Secondary 90C22; 13J30; 44A60; 46N10; 47A57

Occupation measure relaxations in variational problems: the role of convexity

Authors: Didier Henrion, Milan Korda, Martin Kružík, Rodolfo Rios-Zertuche

Abstract: This work addresses the occupation measure relaxation of calculus of variations problems, which is an infinite-dimensional linear programming relaxation amenable to numerical approximation by a hierarchy of semidefinite optimization problems. We address the problem of equivalence of this relaxation to the original problem. Our main result provides sufficient conditions for this equivalence. These… ▽ More This work addresses the occupation measure relaxation of calculus of variations problems, which is an infinite-dimensional linear programming relaxation amenable to numerical approximation by a hierarchy of semidefinite optimization problems. We address the problem of equivalence of this relaxation to the original problem. Our main result provides sufficient conditions for this equivalence. These conditions, revolving around the convexity of the data, are simple and apply in very general settings that may be of arbitrary dimensions and may include pointwise and integral constraints, thereby considerably strengthening the existing results. Our conditions are also extended to optimal control problems. In addition, we demonstrate how these results can be applied in non-convex settings, showing that the occupation measure relaxation is at least as strong as the convexification using the convex envelope; in doing so, we prove that a certain weakening of the occupation measure relaxation is equivalent to the convex envelope. This opens the way to application of the occupation measure relaxation in situations where the convex envelope relaxation is known to be equivalent to the original problem, which includes problems in magnetism and elasticity. △ Less

Submitted 4 March, 2023; originally announced March 2023.

Polynomial argmin for recovery and approximation of multivariate discontinuous functions

Authors: Didier Henrion, Milan Korda, Jean-Bernard Lasserre

Abstract: We propose to approximate a (possibly discontinuous) multivariate function f (x) on a compact set by the partial minimizer arg miny p(x, y) of an appropriate polynomial p whose construction can be cast in a univariate sum of squares (SOS) framework, resulting in a highly structured convex semidefinite program. In a number of non-trivial cases (e.g. when f is a piecewise polynomial) we prove that t… ▽ More We propose to approximate a (possibly discontinuous) multivariate function f (x) on a compact set by the partial minimizer arg miny p(x, y) of an appropriate polynomial p whose construction can be cast in a univariate sum of squares (SOS) framework, resulting in a highly structured convex semidefinite program. In a number of non-trivial cases (e.g. when f is a piecewise polynomial) we prove that the approximation is exact with a low-degree polynomial p. Our approach has three distinguishing features: (i) It is mesh-free and does not require the knowledge of the discontinuity locations. (ii) It is model-free in the sense that we only assume that the function to be approximated is available through samples (point evaluations). (iii) The size of the semidefinite program is independent of the ambient dimension and depends linearly on the number of samples. We also analyze the sample complexity of the approach, proving a generalization error bound in a probabilistic setting. This allows for a comparison with machine learning approaches. △ Less

Submitted 2 November, 2023; v1 submitted 14 February, 2023; originally announced February 2023.

Report number: Rapport LAAS n{\textdegree} 23015

Algebraic certificates for the truncated moment problem

Authors: Didier Henrion, Simone Naldi, Mohab Safey El Din

Abstract: The truncated moment problem consists of determining whether a given finitedimensional vector of real numbers y is obtained by integrating a basis of the vector space of polynomials of bounded degree with respect to a non-negative measure on a given set K of a finite-dimensional Euclidean space. This problem has plenty of applications e.g. in optimization, control theory and statistics. When K is… ▽ More The truncated moment problem consists of determining whether a given finitedimensional vector of real numbers y is obtained by integrating a basis of the vector space of polynomials of bounded degree with respect to a non-negative measure on a given set K of a finite-dimensional Euclidean space. This problem has plenty of applications e.g. in optimization, control theory and statistics. When K is a compact semialgebraic set, the duality between the cone of moments of non-negative measures on K and the cone of non-negative polynomials on K yields an alternative: either y is a moment vector, or y is not a moment vector, in which case there exists a polynomial strictly positive on K making a linear functional depending on y vanish. Such a polynomial is an algebraic certificate of moment unrepresentability. We study the complexity of computing such a certificate using computer algebra algorithms. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Revisiting semidefinite programming approaches to options pricing: complexity and computational perspectives

Authors: Didier Henrion, Felix Kirschner, Etienne de Klerk, Milan Korda, Jean-Bernard Lasserre, Victor Magron

Abstract: In this paper we consider the problem of finding bounds on the prices of options depending on multiple assets without assuming any underlying model on the price dynamics, but only the absence of arbitrage opportunities. We formulate this as a generalized moment problem and utilize the well-known Moment-Sum-of-Squares (SOS) hierarchy of Lasserre to obtain bounds on the range of the possible prices.… ▽ More In this paper we consider the problem of finding bounds on the prices of options depending on multiple assets without assuming any underlying model on the price dynamics, but only the absence of arbitrage opportunities. We formulate this as a generalized moment problem and utilize the well-known Moment-Sum-of-Squares (SOS) hierarchy of Lasserre to obtain bounds on the range of the possible prices. A complementary approach (also due to Lasserre) is employed for comparison. We present several numerical examples to demonstrate the viability of our approach. The framework we consider makes it possible to incorporate different kinds of observable data, such as moment information, as well as observable prices of options on the assets of interest. △ Less

Submitted 3 June, 2022; v1 submitted 15 November, 2021; originally announced November 2021.

Comments: 20 pages

Cone-Copositive Lyapunov Functions for Complementarity Systems: Converse Result and Polynomial Approximation

Authors: Marianne Souaiby, Aneel Tanwani, Didier Henrion

Abstract: This article establishes the existence of Lyapunov functions for analyzing the stability of a class of state-constrained systems, and it describes algorithms for their numerical computation. The system model consists of a differential equation coupled with a set-valued relation which introduces discontinuities in the vector field at the boundaries of the constraint set. In particular, the set-valu… ▽ More This article establishes the existence of Lyapunov functions for analyzing the stability of a class of state-constrained systems, and it describes algorithms for their numerical computation. The system model consists of a differential equation coupled with a set-valued relation which introduces discontinuities in the vector field at the boundaries of the constraint set. In particular, the set-valued relation is described by the subdifferential of the indicator function of a closed convex cone, which results in a cone-complementarity system. The question of analyzing stability of such systems is addressed by constructing cone-copositive Lyapunov functions. As a first analytical result, we show that exponentially stable complementarity systems always admit a continuously differentiable cone-copositive Lyapunov function. Putting some more structure on the system vector field, such as homogeneity, we can show that the aforementioned functions can be approximated by a rational function of cone-copositive homogeneous polynomials. This later class of functions is seen to be particularly amenable for numerical computation as we provide two types of algorithms for precisely that purpose. These algorithms consist of a hierarchy of either linear or semidefinite optimization problems for computing the desired cone-copositive Lyapunov function. Some examples are given to illustrate our approach. △ Less

Submitted 13 April, 2021; originally announced April 2021.

Journal ref: Scheduled for publication in March 2022 issue of IEEE Transactions on Automatic Control; DOI: 10.1109/TAC.2021.3061557

Parametric Semidefinite Programming: Geometry of the Trajectory of Solutions

Authors: Antonio Bellon, Didier Henrion, Vyacheslav Kungurtsev, Jakub Marecek

Abstract: In many applications, solutions of convex optimization problems are updated on-line, as functions of time. In this paper, we consider parametric semidefinite programs, which are linear optimization problems in the semidefinite cone whose coefficients (input data) depend on a time parameter. We are interested in the geometry of the solution (output data) trajectory, defined as the set of solutions… ▽ More In many applications, solutions of convex optimization problems are updated on-line, as functions of time. In this paper, we consider parametric semidefinite programs, which are linear optimization problems in the semidefinite cone whose coefficients (input data) depend on a time parameter. We are interested in the geometry of the solution (output data) trajectory, defined as the set of solutions depending on the parameter. We propose an exhaustive description of the geometry of the solution trajectory. As our main result, we show that only six distinct behaviors can be observed at a neighborhood of a given point along the solution trajectory. Each possible behavior is then illustrated by an example. △ Less

Submitted 10 October, 2023; v1 submitted 12 April, 2021; originally announced April 2021.

Journal ref: Mathematics of Operations Research, 2024

Peak Estimation for Uncertain and Switched Systems

Authors: Jared Miller, Didier Henrion, Mario Sznaier, Milan Korda

Abstract: Peak estimation bounds extreme values of a function of state along trajectories of a dynamical system. This paper focuses on extending peak estimation to continuous and discrete settings with time-independent and time-dependent uncertainty. Techniques from optimal control are used to incorporate uncertainty into an existing occupation measure-based peak estimation framework, which includes special… ▽ More Peak estimation bounds extreme values of a function of state along trajectories of a dynamical system. This paper focuses on extending peak estimation to continuous and discrete settings with time-independent and time-dependent uncertainty. Techniques from optimal control are used to incorporate uncertainty into an existing occupation measure-based peak estimation framework, which includes special consideration for handling switching uncertainties. The resulting infinite-dimensional linear programs can be solved approximately with Linear Matrix Inequalities arising from the moment-SOS hierarchy. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Comments: 15 pages, 10 figures

Moment-SOS hierarchy and exit time of stochastic processes

Authors: Didier Henrion, Mauricio Junca, Mauricio Velasco

Abstract: The moment sum of squares (moment-SOS) hierarchy produces sequences of upper and lower bounds on functionals of the exit time solution of a polynomial stochastic differential equation with polynomial constraints, at the price of solving semidefinite optimization problems of increasing size. In this note we use standard results from elliptic partial differential equation analysis to prove convergen… ▽ More The moment sum of squares (moment-SOS) hierarchy produces sequences of upper and lower bounds on functionals of the exit time solution of a polynomial stochastic differential equation with polynomial constraints, at the price of solving semidefinite optimization problems of increasing size. In this note we use standard results from elliptic partial differential equation analysis to prove convergence of the bounds produced by the hierarchy. We also use elementary convex analysis to describe a super- and sub-solution interpretation dual to a linear formulation on occupation measures. The practical relevance of the hierarchy is illustrated with numerical examples. △ Less

Submitted 15 January, 2021; originally announced January 2021.

Graph Recovery From Incomplete Moment Information

Authors: Didier Henrion, Jean Lasserre

Abstract: We investigate a class of moment problems, namely recovering a measure supported on the graph of a function from partial knowledge of its moments, as for instance in some problems of optimal transport or density estimation. We show that the sole knowledge of first degree moments of the function, namely linear measurements, is sufficient to obtain asymptotically all the other moments by solving a h… ▽ More We investigate a class of moment problems, namely recovering a measure supported on the graph of a function from partial knowledge of its moments, as for instance in some problems of optimal transport or density estimation. We show that the sole knowledge of first degree moments of the function, namely linear measurements, is sufficient to obtain asymptotically all the other moments by solving a hierarchy of semidefinite relax-ations (viewed as moment matrix completion problems) with a specific sparsity inducing criterion related to a weighted 1-norm of the moment sequence of the measure. The resulting sequence of optimal solutions converges to the whole moment sequence of the measure which is shown to be the unique optimal solution of a certain infinite-dimensional linear optimization problem (LP). Then one may recover the function by a recent extraction algorithm based on the Christoffel-Darboux kernel associated with the measure. Finally, the support of such a measure supported on a graph is a meager, very thin (hence sparse) set. Therefore the LP on measures with this sparsity inducing criterion can be interpreted as an analogue for infinite-dimensional signals of the LP in super-resolution for (sparse) atomic signals. In data science, it is often relevant to process moments of a signal instead of the signal itself. For complex valued signals, the moments are Fourier coefficients, and many filtering operations are efficiently carried out in the sequence of moments. In numerical approximation algorithms, many operations on real valued signals are more efficiently implemented in their sequence of Chebyshev coefficients [19]. In the moment-SOS hierarchy approach, many nonlinear nonconvex problems are reformulated and solved approximately in the sequence of moments; see [13, 12] and references therein. Once moments or approximate moments have been computed, one is faced with the inverse problem of reconstructing the signal from its moments. The recent work [15] describes an algorithm based on the Christoffel-Darboux kernel, to recover the graph of a function from knowledge of its moments. Its novelty (and distinguishing feature) is to approximate the graph of the function (rather than the function itself) with a semialgebraic function (namely a minimizer of a sum of squares of polynomials) with L 1 and pointwise convergence guarantees for an increasing number of input moments. In △ Less

Submitted 23 June, 2021; v1 submitted 10 November, 2020; originally announced November 2020.

Report number: Rapport LAAS n{\textdegree} 20289

Global optimality in minimum compliance topology optimization of frames and shells by moment-sum-of-squares hierarchy

Authors: Marek Tyburec, Jan Zeman, Martin Kružík, Didier Henrion

Abstract: The design of minimum-compliance bending-resistant structures with continuous cross-section parameters is a challenging task because of its inherent non-convexity. Our contribution develops a strategy that facilitates computing all guaranteed globally optimal solutions for frame and shell structures under multiple load cases and self-weight. To this purpose, we exploit the fact that the stiffness… ▽ More The design of minimum-compliance bending-resistant structures with continuous cross-section parameters is a challenging task because of its inherent non-convexity. Our contribution develops a strategy that facilitates computing all guaranteed globally optimal solutions for frame and shell structures under multiple load cases and self-weight. To this purpose, we exploit the fact that the stiffness matrix is usually a polynomial function of design variables, allowing us to build an equivalent non-linear semidefinite programming formulation over a semi-algebraic feasible set. This formulation is subsequently solved using the Lasserre moment-sum-of-squares hierarchy, generating a sequence of outer convex approximations that monotonically converges from below to the optimum of the original problem. Globally optimal solutions can subsequently be extracted using the Curto-Fialkow flat extension theorem. Furthermore, we show that a simple correction to the solutions of the relaxed problems establishes a feasible upper bound, thereby deriving a simple sufficient condition of global $\varepsilon$-optimality. When the original problem possesses a unique minimum, we show that this solution is found with a zero optimality gap in the limit. These theoretical findings are illustrated on several examples of topology optimization of frames and shells, for which we observe that the hierarchy converges in a finite (rather small) number of steps. △ Less

Submitted 26 September, 2020; originally announced September 2020.

Comments: 16 pages, 7 figures

Stokes, Gibbs and volume computation of semi-algebraic sets

Authors: Matteo Tacchi, Jean B Lasserre, Didier Henrion

Abstract: We consider the problem of computing the Lebesgue volume of compact basic semi-algebraic sets. In full generality, it can be approximated as closely as desired by a converging hierarchy of upper bounds obtained by applying the Moment-SOS (sums of squares) methodology to a certain infinite-dimensional linear program (LP). At each step one solves a semidefinite relaxation of the LP which involves… ▽ More We consider the problem of computing the Lebesgue volume of compact basic semi-algebraic sets. In full generality, it can be approximated as closely as desired by a converging hierarchy of upper bounds obtained by applying the Moment-SOS (sums of squares) methodology to a certain infinite-dimensional linear program (LP). At each step one solves a semidefinite relaxation of the LP which involves pseudo-moments up to a certain degree. Its dual computes a polynomial of same degree which approximates from above the discontinuous indicator function of the set, hence with a typical Gibbs phenomenon which results in a slow convergence of the associated numerical scheme. Drastic improvements have been observed by introducing in the initial LP additional linear moment constraints obtained from a certain application of Stokes' theorem for integration on the set. However and so far there was no rationale to explain this behavior. We provide a refined version of this extended LP formulation. When the set is the smooth super-level set of a single polynomial, we show that the dual of this refined LP has an optimal solution which is a continuous function.Therefore in this dual one now approximates a continuous function by a polynomial, hence with no Gibbs phenomenon, which explains and improves the already observed drastic acceleration of the convergence of the hierarchy. Interestingly, the technique of proof involves recent results on Poisson's partial differential equation (PDE). △ Less

Submitted 4 July, 2022; v1 submitted 25 September, 2020; originally announced September 2020.

Report number: Rapport LAAS n{\textdegree} 20210

Computation of Lyapunov Functions under State Constraints using Semidefinite Programming Hierarchies *

Authors: Marianne Souaiby, Aneel Tanwani, Didier Henrion

Abstract: We provide algorithms for computing a Lyapunov function for a class of systems where the state trajectories are constrained to evolve within a closed convex set. The dynamical systems that we consider comprise a differential equation which ensures continuous evolution within the domain, and a normal cone inclusion which ensures that the state trajectory remains within a prespecified set at all tim… ▽ More We provide algorithms for computing a Lyapunov function for a class of systems where the state trajectories are constrained to evolve within a closed convex set. The dynamical systems that we consider comprise a differential equation which ensures continuous evolution within the domain, and a normal cone inclusion which ensures that the state trajectory remains within a prespecified set at all times. Finding a Lyapunov function for such a system boils down to finding a function which satisfies certain inequalities on the admissible set of state constraints. It is well-known that this problem, despite being convex, is computationally difficult. For conic constraints, we provide a discretization algorithm based on simplicial partitioning of a sim-plex, so that the search of desired function is addressed by constructing a hierarchy (associated with the diameter of the cells in the partition) of linear programs. Our second algorithm is tailored to semi-algebraic sets, where a hierarchy of semidefinite programs is constructed to compute Lyapunov functions as a sum-of-squares polynomial. △ Less

Submitted 8 October, 2020; v1 submitted 15 September, 2020; originally announced September 2020.

Report number: Rapport LAAS n{\textdegree} 20184

Journal ref: Proceedings of 21st IFAC World Congress, Jul 2020, Berlin, Germany

Peak Estimation and Recovery with Occupation Measures

Authors: Jared Miller, Didier Henrion, Mario Sznaier

Abstract: Peak Estimation aims to find the maximum value of a state function achieved by a dynamical system. This problem is non-convex when considering standard Barrier and Density methods for invariant sets, and has been treated heuristically by using auxiliary functions. A convex formulation based on occupation measures is proposed in this paper to solve peak estimation. This method is dual to the auxili… ▽ More Peak Estimation aims to find the maximum value of a state function achieved by a dynamical system. This problem is non-convex when considering standard Barrier and Density methods for invariant sets, and has been treated heuristically by using auxiliary functions. A convex formulation based on occupation measures is proposed in this paper to solve peak estimation. This method is dual to the auxiliary function approach. Our method will converge to the optimal solution and can recover trajectories even from approximate solutions. This framework is extended to safety analysis by maximizing the minimum of a set of costs along trajectories. △ Less

Submitted 20 December, 2020; v1 submitted 13 September, 2020; originally announced September 2020.

Comments: 13 pages, 7 figures. Changed according to helpful comments by reviewers, focus shifted to recovery algorithm and safety margins

MSC Class: 37M99

Journal ref: LCSS Vol 5 Issue 6 (Dec 2020)

Dual optimal design and the Christoffel-Darboux polynomial

Authors: Yohann de Castro, Fabrice Gamboa, Didier Henrion, Jean Lasserre

Abstract: The purpose of this short note is to show that the Christoffel-Darboux polynomial, useful in approximation theory and data science, arises naturally when deriving the dual to the problem of semi-algebraic D-optimal experimental design in statistics. It uses only elementary notions of convex analysis. Geometric interpretations and algorithmic consequences are mentioned. The purpose of this short note is to show that the Christoffel-Darboux polynomial, useful in approximation theory and data science, arises naturally when deriving the dual to the problem of semi-algebraic D-optimal experimental design in statistics. It uses only elementary notions of convex analysis. Geometric interpretations and algorithmic consequences are mentioned. △ Less

Submitted 8 December, 2020; v1 submitted 8 September, 2020; originally announced September 2020.

Report number: Rapport LAAS n{\textdegree} 20178

Globally Optimal Solution to Inverse Kinematics of 7DOF Serial Manipulator

Authors: Pavel Trutman, Safey El Din Mohab, Didier Henrion, Tomas Pajdla

Abstract: The Inverse Kinematics (IK) problem is to nd robot control parameters to bring it into the desired position under the kinematics and collision constraints. We present a global solution to the optimal IK problem for a general serial 7DOF manipulator with revolute joints and a quadratic polynomial objective function. We show that the kinematic constraints due to rotations can all be generated by sec… ▽ More The Inverse Kinematics (IK) problem is to nd robot control parameters to bring it into the desired position under the kinematics and collision constraints. We present a global solution to the optimal IK problem for a general serial 7DOF manipulator with revolute joints and a quadratic polynomial objective function. We show that the kinematic constraints due to rotations can all be generated by second-degree polynomials. This is important since it signicantly simplies further step where we nd the optimal solution by Lasserre relaxations of non-convex polynomial systems. We demonstrate that the second relaxation is sucient to solve the 7DOF IK problem. Our approach is certiably globally optimal. We demonstrate the method on the 7DOF KUKA LBR IIWA manipulator and show that we are able to compute the optimal IK or certify in-feasibility in 99 % tested poses. △ Less

Submitted 24 July, 2020; originally announced July 2020.

Measures and LMIs for Adaptive Control Validation

Authors: Daniel Wagner, Didier Henrion, Martin Hrom{č}ík

Abstract: Occupation measures and linear matrix inequality (LMI) relax-ations (called the moment sums of squares or Lasserre hierarchy) have been used previously as a means for solving control law verification and validation (VV) problems. However, these methods have been restricted to relatively simple control laws and a limited number of states. In this document, we extend these methods to model reference… ▽ More Occupation measures and linear matrix inequality (LMI) relax-ations (called the moment sums of squares or Lasserre hierarchy) have been used previously as a means for solving control law verification and validation (VV) problems. However, these methods have been restricted to relatively simple control laws and a limited number of states. In this document, we extend these methods to model reference adaptive control (MRAC) configurations typical of the aircraft industry. The main contribution is a validation scheme that exploits the specific nonlinearities and structure of MRAC. A nonlinear F-16 plant is used for illustration. LMI relaxations solved by off-the-shelf-software are compared to traditional Monte-Carlo simulations. △ Less

Submitted 19 May, 2020; originally announced May 2020.

Measures and LMIs for Lateral F-16 MRAC Validation

Authors: Daniel Wagner, Didier Henrion, Martin Hromčík

Abstract: Occupation measures and linear matrix inequality (LMI) relax-ations (called the moment sums of squares or Lasserre hierarchy) are state-of-the-art methods for verification and validation (VV) in aerospace. In this document, we extend these results to a full F-16 closed-loop nonlinear dutch roll polynomial model complete with model reference adaptive control (MRAC). This is done through a new techn… ▽ More Occupation measures and linear matrix inequality (LMI) relax-ations (called the moment sums of squares or Lasserre hierarchy) are state-of-the-art methods for verification and validation (VV) in aerospace. In this document, we extend these results to a full F-16 closed-loop nonlinear dutch roll polynomial model complete with model reference adaptive control (MRAC). This is done through a new technique of approximating the reference trajectory by exploiting sparse ordinary differential equations (ODEs) with parsimony. The VV problem is then solved directly using moment LMI relaxations and off-the-shelf-software. The main results are then compared to their numerical counterparts obtained using traditional Monte-Carlo simulations. △ Less

Submitted 25 March, 2020; originally announced March 2020.

Approximating regions of attraction of a sparse polynomial differential system *

Authors: Didier Henrion, Matteo Tacchi, Carmen Cardozo, Jean Lasserre

Abstract: Motivated by stability analysis of large scale power systems, we describe how the Lasserre (moment-sums of squares, SOS) hierarchy can be used to generate outer approximations of the region of attraction (ROA) of sparse polynomial differential systems, at the price of solving linear matrix inequalities (LMI) of increasing size. We identify specific sparsity structures for which we can provide nume… ▽ More Motivated by stability analysis of large scale power systems, we describe how the Lasserre (moment-sums of squares, SOS) hierarchy can be used to generate outer approximations of the region of attraction (ROA) of sparse polynomial differential systems, at the price of solving linear matrix inequalities (LMI) of increasing size. We identify specific sparsity structures for which we can provide numerically certified outer approximations of the region of attraction in high dimension. For this purpose, we combine previous results on non-sparse ROA approximations with sparse semi-algebraic set volume computation. △ Less

Submitted 16 March, 2020; v1 submitted 21 November, 2019; originally announced November 2019.

On optimum design of frame structures

Authors: Marek Tyburec, Jan Zeman, Martin Kružík, Didier Henrion

Abstract: Optimization of frame structures is formulated as a~non-convex optimization problem, which is currently solved to local optimality. In this contribution, we investigate four optimization approaches: (i) general non-linear optimization, (ii) optimality criteria method, (iii) non-linear semidefinite programming, and (iv) polynomial optimization. We show that polynomial optimization solves the frame… ▽ More Optimization of frame structures is formulated as a~non-convex optimization problem, which is currently solved to local optimality. In this contribution, we investigate four optimization approaches: (i) general non-linear optimization, (ii) optimality criteria method, (iii) non-linear semidefinite programming, and (iv) polynomial optimization. We show that polynomial optimization solves the frame structure optimization to global optimality by building the (moment-sums-of-squares) hierarchy of convex linear semidefinite programming problems, and it also provides guaranteed lower and upper bounds on optimal design. Finally, we solve three sample optimization problems and conclude that the local optimization approaches may indeed converge to local optima, without any solution quality measure, or even to infeasible points. These issues are readily overcome by using polynomial optimization, which exhibits a finite convergence, at the prize of higher computational demands. △ Less

Submitted 16 September, 2019; originally announced September 2019.

Comments: 9 pages, 3 figures

Semi-algebraic approximation using Christoffel-Darboux kernel

Authors: Swann Marx, Edouard Pauwels, Tillmann Weisser, Didier Henrion, Jean Lasserre

Abstract: We provide a new method to approximate a (possibly discontinuous) function using Christoffel-Darboux kernels. Our knowledge about the unknown multivariate function is in terms of finitely many moments of the Young measure supported on the graph of the function. Such an input is available when approximating weak (or measure-valued) solution of optimal control problems, entropy solutions to non-line… ▽ More We provide a new method to approximate a (possibly discontinuous) function using Christoffel-Darboux kernels. Our knowledge about the unknown multivariate function is in terms of finitely many moments of the Young measure supported on the graph of the function. Such an input is available when approximating weak (or measure-valued) solution of optimal control problems, entropy solutions to non-linear hyperbolic PDEs, or using numerical integration from finitely many evaluations of the function. While most of the existing methods construct a piecewise polynomial approximation, we construct a semi-algebraic approximation whose estimation and evaluation can be performed efficiently. An appealing feature of this method is that it deals with non-smoothness implicitly so that a single scheme can be used to treat smooth or non-smooth functions without any prior knowledge. On the theoretical side, we prove pointwise convergence almost everywhere as well as convergence in the Lebesgue one norm under broad assumptions. Using more restrictive assumptions, we obtain explicit convergence rates. We illustrate our approach on various examples from control and approximation. In particular we observe empirically that our method does not suffer from the the Gibbs phenomenon when approximating discontinuous functions. △ Less

Submitted 8 April, 2021; v1 submitted 3 April, 2019; originally announced April 2019.

Report number: Rapport LAAS n{\textdegree} 19111

Inner approximations of the maximal positively invariant set for polynomial dynamical systems

Authors: Antoine Oustry, Matteo Tacchi, Didier Henrion

Abstract: The Lasserre or moment-sum-of-square hierarchy of linear matrix inequality relaxations is used to compute inner approximations of the maximal positively invariant set for continuous-time dynamical systems with polynomial vector fields. Convergence in volume of the hierarchy is proved under a technical growth condition on the average exit time of trajectories. Our contribution is to deal with inner… ▽ More The Lasserre or moment-sum-of-square hierarchy of linear matrix inequality relaxations is used to compute inner approximations of the maximal positively invariant set for continuous-time dynamical systems with polynomial vector fields. Convergence in volume of the hierarchy is proved under a technical growth condition on the average exit time of trajectories. Our contribution is to deal with inner approximations in infinite time, while former work with volume convergence guarantees proposed either outer approximations of the maximal positively invariant set or inner approximations of the region of attraction in finite time. △ Less

Submitted 22 May, 2023; v1 submitted 12 March, 2019; originally announced March 2019.

Parabolic Set Simulation for Reachability Analysis of Linear Time Invariant Systems with Integral Quadratic Constraint

Authors: Paul Rousse, Pierre-Loïc Garoche, Didier Henrion

Abstract: This work extends reachability analyses based on ellipsoidal techniques to Linear Time Invariant (LTI) systems subject to an integral quadratic constraint (IQC) between the past state and disturbance signals , interpreted as an input-output energetic constraint. To compute the reachable set, the LTI system is augmented with a state corresponding to the amount of energy still available before the c… ▽ More This work extends reachability analyses based on ellipsoidal techniques to Linear Time Invariant (LTI) systems subject to an integral quadratic constraint (IQC) between the past state and disturbance signals , interpreted as an input-output energetic constraint. To compute the reachable set, the LTI system is augmented with a state corresponding to the amount of energy still available before the constraint is violated. For a given parabolic set of initial states, the reachable set of the augmented system is overapproximated with a time-varying parabolic set. Parameters of this paraboloid are expressed as the solution of an Initial Value Problem (IVP) and the overapproximation relationship with the reachable set is proved. This paraboloid is actually supported by the reachable set on so-called touching trajectories. Finally , we describe a method to generate all the supporting paraboloids and prove that their intersection is an exact characterization of the reachable set. This work provides new practical means to compute overapproximation of reachable sets for a wide variety of systems such as delayed systems, rate limiters or energy-bounded linear systems. △ Less

Submitted 13 February, 2020; v1 submitted 28 February, 2019; originally announced February 2019.

Report number: Rapport LAAS n{\textdegree} 19066

Exploiting Sparsity for Semi-Algebraic Set Volume Computation

Authors: Matteo Tacchi, Tillmann Weisser, Jean-Bernard Lasserre, Didier Henrion

Abstract: We provide a systematic deterministic numerical scheme to approximate the volume (i.e. the Lebesgue measure) of a basic semi-algebraic set whose description follows a sparsity pattern. As in previous works (without sparsity), the underlying strategy is to consider an infinite-dimensional linear program on measures whose optimal value is the volume of the set. This is a particular instance of a gen… ▽ More We provide a systematic deterministic numerical scheme to approximate the volume (i.e. the Lebesgue measure) of a basic semi-algebraic set whose description follows a sparsity pattern. As in previous works (without sparsity), the underlying strategy is to consider an infinite-dimensional linear program on measures whose optimal value is the volume of the set. This is a particular instance of a generalized moment problem which in turn can be approximated as closely as desired by solving a hierarchy of semidefinite relaxations of increasing size. The novelty with respect to previous work is that by exploiting the sparsity pattern we can provide a sparse formulation for which the associated semidefinite relaxations are of much smaller size. In addition, we can decompose the sparse relaxations into completely decoupled subproblems of smaller size, and in some cases computations can be done in parallel. To the best of our knowledge, it is the first contribution that exploits sparsity for volume computation of semi-algebraic sets which are possibly high-dimensional and/or non-convex and/or non-connected. △ Less

Submitted 27 July, 2020; v1 submitted 8 February, 2019; originally announced February 2019.

Report number: Rapport LAAS n{\textdegree} 19030

Maximal Positive Invariant Set Determination for Transient Stability Assessment in Power Systems

Authors: Antoine Oustry, Carmen Cardozo, Patrick Panciatici, Didier Henrion

Abstract: This paper assesses the transient stability of a synchronous machine connected to an infinite bus through the notion of invariant sets. The problem of computing a conservative approximation of the maximal positive invariant set is formulated as a semi-definitive program based on occupation measures and Lasserre's relaxation. An extension of the proposed method into a robust formulation allows us t… ▽ More This paper assesses the transient stability of a synchronous machine connected to an infinite bus through the notion of invariant sets. The problem of computing a conservative approximation of the maximal positive invariant set is formulated as a semi-definitive program based on occupation measures and Lasserre's relaxation. An extension of the proposed method into a robust formulation allows us to handle Taylor approximation errors for non-polynomial systems. Results show the potential of this approach to limit the use of extensive time domain simulations provided that scalability issues are addressed. △ Less

Submitted 21 November, 2018; originally announced November 2018.

Convex computation of extremal invariant measures of nonlinear dynamical systems and Markov processes

Authors: Milan Korda, Didier Henrion, Igor Mezic

Abstract: We propose a convex-optimization-based framework for computation of invariant measures of polynomial dynamical systems and Markov processes, in discrete and continuous time. The set of all invariant measures is characterized as the feasible set of an infinite-dimensional linear program (LP). The objective functional of this LP is then used to single-out a specific measure (or a class of measures)… ▽ More We propose a convex-optimization-based framework for computation of invariant measures of polynomial dynamical systems and Markov processes, in discrete and continuous time. The set of all invariant measures is characterized as the feasible set of an infinite-dimensional linear program (LP). The objective functional of this LP is then used to single-out a specific measure (or a class of measures) extremal with respect to the selected functional such as physical measures, ergodic measures, atomic measures (corresponding to, e.g., periodic orbits) or measures absolutely continuous w.r.t. to a given measure. The infinite-dimensional LP is then approximated using a standard hierarchy of finite-dimensional semidefinite programming problems (SDPs), the solutions of which are truncated moment sequences, which are then used to reconstruct the measure. In particular, we show how to approximate the support of the measure as well as how to construct a sequence of weakly converging absolutely continuous approximations. The presented framework, where a convex functional is minimized or maximized among all invariant measures, can be seen as a generalization of and a computational method to carry out the so called ergodic optimization, where linear functionals are optimized over the set of invariant measures. Finally, we also describe how the presented framework can be adapted to compute eigenmeasures of the Perron-Frobenius operator. △ Less

Submitted 17 September, 2020; v1 submitted 24 July, 2018; originally announced July 2018.

Report number: RApport LAAS n{\textdegree} 18222

Optimal control problems with oscillations, concentrations and discontinuities

Authors: Didier Henrion, Martin Kru{ž}ík, Tillmann Weisser

Abstract: Optimal control problems with oscillations (chattering controls) and concentrations (impulsive controls) can have integral performance criteria such that concentration of the control signal occurs at a discontinuity of the state signal. Techniques from functional analysis (anisotropic parametrized measures) are applied to give a precise meaning of the integral cost and to allow for the sound appli… ▽ More Optimal control problems with oscillations (chattering controls) and concentrations (impulsive controls) can have integral performance criteria such that concentration of the control signal occurs at a discontinuity of the state signal. Techniques from functional analysis (anisotropic parametrized measures) are applied to give a precise meaning of the integral cost and to allow for the sound application of numerical methods. We show how this can be combined with the Lasserre hierarchy of semidefinite programming relaxations. △ Less

Submitted 28 January, 2019; v1 submitted 11 July, 2018; originally announced July 2018.

Report number: Rapport LAAS n{\textdegree} 18218

A moment approach for entropy solutions to nonlinear hyperbolic PDEs

Authors: Swann Marx, Tillmann Weisser, Didier Henrion, Jean Lasserre

Abstract: We propose to solve polynomial hyperbolic partial differential equations (PDEs) with convex optimization. This approach is based on a very weak notion of solution of the nonlinear equation, namely the measure-valued (mv) solution, satisfying a linear equation in the space of Borel measures. The aim of this paper is, first, to provide the conditions that ensure the equivalence between the two formu… ▽ More We propose to solve polynomial hyperbolic partial differential equations (PDEs) with convex optimization. This approach is based on a very weak notion of solution of the nonlinear equation, namely the measure-valued (mv) solution, satisfying a linear equation in the space of Borel measures. The aim of this paper is, first, to provide the conditions that ensure the equivalence between the two formulations and, second, to introduce a method which approximates the infinite-dimensional linear problem by a hierarchy of convex, finite-dimensional, semidefinite programming problems. This result is then illustrated on the celebrated Burgers equation. We also compare our results with an existing numerical scheme, namely the Godunov scheme. △ Less

Submitted 6 July, 2018; originally announced July 2018.

Semidefinite Approximations of Invariant Measures for Polynomial Systems

Authors: Victor Magron, Marcelo Forets, Didier Henrion

Abstract: We consider the problem of approximating numerically the moments and the supports of measures which are invariant with respect to the dynamics of continuous- and discrete-time polynomial systems, under semialgebraic set constraints. First, we address the problem of approximating the density and hence the support of an invariant measure which is absolutely continuous with respect to the Lebesgue me… ▽ More We consider the problem of approximating numerically the moments and the supports of measures which are invariant with respect to the dynamics of continuous- and discrete-time polynomial systems, under semialgebraic set constraints. First, we address the problem of approximating the density and hence the support of an invariant measure which is absolutely continuous with respect to the Lebesgue measure. Then, we focus on the approximation of the support of an invariant measure which is singular with respect to the Lebesgue measure. Each problem is handled through an appropriate reformulation into a linear optimization problem over measures, solved in practice with two hierarchies of finite-dimensional semidefinite moment-sum-of-square relaxations, also called Lasserre hierarchies. Under specific assumptions, the first Lasserre hierarchy allows to approximate the moments of an absolutely continuous invariant measure as close as desired and to extract a sequence of polynomials converging weakly to the density of this measure. The second Lasserre hierarchy allows to approximate as close as desired in the Hausdorff metric the support of a singular invariant measure with the level sets of the Christoffel polynomials associated to the moment matrices of this measure. We also present some application examples together with numerical results for several dynamical systems admitting either absolutely continuous or singular invariant measures. △ Less

Submitted 2 July, 2018; originally announced July 2018.

Comments: 28 pages, 14 figures

Moments and convex optimization for analysis and control of nonlinear partial differential equations

Authors: Milan Korda, Didier Henrion, Jean-Bernard Lasserre

Abstract: This work presents a convex-optimization-based framework for analysis and control of nonlinear partial differential equations. The approach uses a particular weak embedding of the nonlinear PDE, resulting in a linear equation in the space of Borel measures. This equation is then used as a constraint of an infinite-dimensional linear programming problem (LP). This LP is then approximated by a hiera… ▽ More This work presents a convex-optimization-based framework for analysis and control of nonlinear partial differential equations. The approach uses a particular weak embedding of the nonlinear PDE, resulting in a linear equation in the space of Borel measures. This equation is then used as a constraint of an infinite-dimensional linear programming problem (LP). This LP is then approximated by a hierarchy of convex, finite-dimensional, semidefinite programming problems (SDPs). In the case of analysis of uncontrolled PDEs, the solutions to these SDPs provide bounds on a specified, possibly nonlinear, functional of the solutions to the PDE; in the case of PDE control, the solutions to these SDPs provide bounds on the optimal value of a given optimal control problem as well as suboptimal feedback controllers. The entire approach is based purely on convex optimization and does not rely on spatio-temporal gridding, even though the PDE addressed can be fully nonlinear. The approach is applicable to a very broad class nonlinear PDEs with polynomial data. Computational complexity is analyzed and several complexity reduction procedures are described. Numerical examples demonstrate the approach. △ Less

Submitted 20 April, 2018; originally announced April 2018.

Exact algorithms for semidefinite programs with degenerate feasible set

Authors: Didier Henrion, Simone Naldi, Mohab Safey El Din

Abstract: Given symmetric matrices $A_0, A_1, \ldots, A_n$ of size $m$ with rational entries, the set of real vectors $x = (x_1, \ldots, x_n)$ such that the matrix $A_0 + x_1 A_1 + \cdots + x_n A_n$ has non-negative eigenvalues is called a spectrahedron. Minimization of linear functions over spectrahedra is called semidefinite programming. Such problems appear frequently in control theory and real algebra,… ▽ More Given symmetric matrices $A_0, A_1, \ldots, A_n$ of size $m$ with rational entries, the set of real vectors $x = (x_1, \ldots, x_n)$ such that the matrix $A_0 + x_1 A_1 + \cdots + x_n A_n$ has non-negative eigenvalues is called a spectrahedron. Minimization of linear functions over spectrahedra is called semidefinite programming. Such problems appear frequently in control theory and real algebra, especially in the context of nonnegativity certificates for multivariate polynomials based on sums of squares. Numerical software for semidefinite programming are mostly based on interior point methods, assuming non-degeneracy properties such as the existence of an interior point in the spectrahedron. In this paper, we design an exact algorithm based on symbolic homotopy for solving semidefinite programs without assumptions on the feasible set, and we analyze its complexity. Because of the exactness of the output, it cannot compete with numerical routines in practice. However, we prove that solving such problems can be done in polynomial time if either $n$ or $m$ is fixed. △ Less

Submitted 10 June, 2020; v1 submitted 8 February, 2018; originally announced February 2018.

Comments: 26 pages, 1 figure, extended version (the original paper is published in the Proceedings of ISSAC 2018)

Experiments in Verification of Linear Model Predictive Control: Automatic Generation and Formal Verification of an Interior Point Method Algorithm

Authors: Guillaume Davy, Eric Féron, Pierre-Loïc Garoche, Didier Henrion

Abstract: Classical control of cyber-physical systems used to rely on basic linear controllers. These controllers provided a safe and robust behavior but lack the ability to perform more complex controls such as aggressive maneuvering or performing fuel-efficient controls. Another approach called optimal control is capable of computing such difficult trajectories but lacks the ability to adapt to dynamic ch… ▽ More Classical control of cyber-physical systems used to rely on basic linear controllers. These controllers provided a safe and robust behavior but lack the ability to perform more complex controls such as aggressive maneuvering or performing fuel-efficient controls. Another approach called optimal control is capable of computing such difficult trajectories but lacks the ability to adapt to dynamic changes in the environment. In both cases, the control was designed offline, relying on more or less complex algorithms to find the appropriate parameters. More recent kinds of approaches such as Linear Model-Predictive Control (MPC) rely on the online use of convex optimization to compute the best control at each sample time. In these settings, optimization algorithms are specialized for the specific control problem and embed on the device. This paper proposes to revisit the code generation of an interior point method (IPM)algorithm, an efficient family of convex optimization, focusing on the proof of its implementation at code level. Our approach relies on the code specialization phase to produce additional annotations formalizing the intented specification of the algorithm. Deductive methods are then used to prove automatically the validity of these assertions. Since the algorithm is complex, additional lemmas are also produced, allowing the complete proofto be checked by SMT solvers only. This work is the first to address the effective formal proof of an IPM algorithm. Theapproach could also be generalized more systematically to code generation frameworks, producing proof certificate along the code, for numerical intensive software. △ Less

Submitted 28 September, 2018; v1 submitted 11 January, 2018; originally announced January 2018.

Report number: Rapport LAAS n{\textdegree} 18009

Journal ref: 22nd International Conference on Logic for Programming Artificial Intelligence and Reasoning (LPAR-22), Nov 2018, Awassa, Ethiopia. https://easychair.org/smart-program/LPAR-22/

Approximate Optimal Designs for Multivariate Polynomial Regression

Authors: Yohann De Castro, Fabrice Gamboa, Didier Henrion, Roxana Hess, Jean-Bernard Lasserre

Abstract: We introduce a new approach aiming at computing approximate optimal designs for multivariate polynomial regressions on compact (semi-algebraic) design spaces. We use the moment-sum-of-squares hierarchy of semidefinite programming problems to solve numerically the approximate optimal design problem. The geometry of the design is recovered via semidefinite programming duality theory. This article sh… ▽ More We introduce a new approach aiming at computing approximate optimal designs for multivariate polynomial regressions on compact (semi-algebraic) design spaces. We use the moment-sum-of-squares hierarchy of semidefinite programming problems to solve numerically the approximate optimal design problem. The geometry of the design is recovered via semidefinite programming duality theory. This article shows that the hierarchy converges to the approximate optimal design as the order of the hierarchy increases. Furthermore, we provide a dual certificate ensuring finite convergence of the hierarchy and showing that the approximate optimal design can be computed numerically with our method. As a byproduct, we revisit the equivalence theorem of the experimental design theory: it is linked to the Christoffel polynomial and it characterizes finite convergence of the moment-sum-of-square hierarchies. △ Less

Submitted 25 October, 2017; v1 submitted 9 June, 2017; originally announced June 2017.

Comments: 30 Pages, 8 Figures. arXiv admin note: substantial text overlap with arXiv:1703.01777

MSC Class: 62K05; 90C25 (Primary) 41A10; 49M29; 90C90; 15A15 (secondary)

Semidefinite Approximations of Reachable Sets for Discrete-time Polynomial Systems

Authors: Victor Magron, Pierre-Loic Garoche, Didier Henrion, Xavier Thirioux

Abstract: We consider the problem of approximating the reachable set of a discrete-time polynomial system from a semialgebraic set of initial conditions under general semialgebraic set constraints. Assuming inclusion in a given simple set like a box or an ellipsoid, we provide a method to compute certified outer approximations of the reachable set. The proposed method consists of building a hierarchy of r… ▽ More We consider the problem of approximating the reachable set of a discrete-time polynomial system from a semialgebraic set of initial conditions under general semialgebraic set constraints. Assuming inclusion in a given simple set like a box or an ellipsoid, we provide a method to compute certified outer approximations of the reachable set. The proposed method consists of building a hierarchy of relaxations for an infinite-dimensional moment problem. Under certain assumptions, the optimal value of this problem is the volume of the reachable set and the optimum solution is the restriction of the Lebesgue measure on this set. Then, one can outer approximate the reachable set as closely as desired with a hierarchy of super level sets of increasing degree polynomials. For each fixed degree, finding the coefficients of the polynomial boils down to computing the optimal solution of a convex semidefinite program. When the degree of the polynomial approximation tends to infinity, we provide strong convergence guarantees of the super level sets to the reachable set. We also present some application examples together with numerical results. △ Less

Submitted 5 June, 2019; v1 submitted 15 March, 2017; originally announced March 2017.

Comments: 26 pages, 28 figures

D-optimal design for multivariate polynomial regression via the Christoffel function and semidefinite relaxations

Authors: Yohann De Castro, F Gamboa, D Henrion, R Hess, J. -B Lasserre

Abstract: We present a new approach to the design of D-optimal experiments with multivariate polynomial regressions on compact semi-algebraic design spaces. We apply the moment-sum-of-squares hierarchy of semidefinite programming problems to solve numerically and approximately the optimal design problem. The geometry of the design is recovered with semidefinite programming duality theory and the Christoffel… ▽ More We present a new approach to the design of D-optimal experiments with multivariate polynomial regressions on compact semi-algebraic design spaces. We apply the moment-sum-of-squares hierarchy of semidefinite programming problems to solve numerically and approximately the optimal design problem. The geometry of the design is recovered with semidefinite programming duality theory and the Christoffel polynomial. △ Less

Submitted 6 March, 2017; originally announced March 2017.