Showing 1–43 of 43 results for author: Peet, M M

Picard Iteration for Parameter Estimation in Nonlinear Ordinary Differential Equations

Authors: Aleksandr Talitckii, Matthew M. Peet

Abstract: We consider the problem of using experimental time-series data for parameter estimation in nonlinear ordinary differential equations, focusing on the case where the data is noisy, sparse, irregularly sampled, includes multiple experiments, and does not directly measure the system state or its time-derivative. To account for such low-quality data, we propose a new framework for gradient-based param… ▽ More We consider the problem of using experimental time-series data for parameter estimation in nonlinear ordinary differential equations, focusing on the case where the data is noisy, sparse, irregularly sampled, includes multiple experiments, and does not directly measure the system state or its time-derivative. To account for such low-quality data, we propose a new framework for gradient-based parameter estimation which uses the Picard operator to reformulate the problem as constrained optimization with infinite-dimensional variables and constraints. We then use the contractive properties of the Picard operator to propose a class of gradient-contractive algorithms and provide conditions under which such algorithms are guaranteed to converge to a local optima. The algorithms are then tested on a battery of models and variety of datasets in order to demonstrate robustness and improvement over alternative approaches. △ Less

Submitted 3 January, 2025; v1 submitted 28 December, 2024; originally announced December 2024.

$H_2$-Optimal Estimation of a Class of Linear PDE Systems using Partial Integral Equations

Authors: Danio Braghini, Sachin Shivakumar, Matthew M. Peet

Abstract: The $H_2$ norm is a commonly used performance metric in the design of estimators. However, $H_2$-optimal estimation of most PDEs is complicated by the lack of state-space and transfer function representations. To address this problem, we re-characterize the $H_2$-norm in terms of a map from initial condition to output. We then leverage the Partial Integral Equation (PIE) state-space representation… ▽ More The $H_2$ norm is a commonly used performance metric in the design of estimators. However, $H_2$-optimal estimation of most PDEs is complicated by the lack of state-space and transfer function representations. To address this problem, we re-characterize the $H_2$-norm in terms of a map from initial condition to output. We then leverage the Partial Integral Equation (PIE) state-space representation of systems of linear PDEs coupled with ODEs to recast this characterization of $H_2$ norm as a convex optimization problem defined in terms of Linear Partial Integral (LPI) inequalities. We then parameterize a class of PIE-based observers and formulate the associated $H_2$-optimal estimation problem. The optimal observer synthesis problem is then recast as an LPI, and the resulting observers are validated using numerical simulation. △ Less

Submitted 3 November, 2024; originally announced November 2024.

Model Predictive Bang-Bang Controller Synthesis via Approximate Value Functions

Authors: Morgan Jones, Yuanbo Nie, Matthew M. Peet

Abstract: In this paper, we propose a novel method for addressing Optimal Control Problems (OCPs) with input-affine dynamics and cost functions. This approach adopts a Model Predictive Control (MPC) strategy, wherein a controller is synthesized to handle an approximated OCP within a finite time horizon. Upon reaching this horizon, the controller is re-calibrated to tackle another approximation of the OCP, w… ▽ More In this paper, we propose a novel method for addressing Optimal Control Problems (OCPs) with input-affine dynamics and cost functions. This approach adopts a Model Predictive Control (MPC) strategy, wherein a controller is synthesized to handle an approximated OCP within a finite time horizon. Upon reaching this horizon, the controller is re-calibrated to tackle another approximation of the OCP, with the approximation updated based on the final state and time information. To tackle each OCP instance, all non-polynomial terms are Taylor-expanded about the current time and state and the resulting Hamilton-Jacobi-Bellman (HJB) PDE is solved via Sum-of-Squares (SOS) programming, providing us with an approximate polynomial value function that can be used to synthesize a bang-bang controller. △ Less

Submitted 16 June, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

$H_{\infty}$-Optimal Estimator Synthesis for Coupled Linear 2D PDEs using Convex Optimization

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: Any suitably well-posed PDE in two spatial dimensions can be represented as a Partial Integral Equation (PIE) -- with system dynamics parameterized using Partial Integral (PI) operators. Furthermore, $L_2$-gain analysis of PDEs with a PIE representation can be posed as a linear operator inequality, which can be solved using convex optimization. In this paper, these results are used to derive a con… ▽ More Any suitably well-posed PDE in two spatial dimensions can be represented as a Partial Integral Equation (PIE) -- with system dynamics parameterized using Partial Integral (PI) operators. Furthermore, $L_2$-gain analysis of PDEs with a PIE representation can be posed as a linear operator inequality, which can be solved using convex optimization. In this paper, these results are used to derive a convex-optimization-based test for constructing an $H_{\infty}$-optimal estimator for 2D PDEs. In particular, we first use PIEs to represent an arbitrary well-posed 2D PDE where sensor measurements occur along some boundary of the domain. An associated Luenberger-type estimator is then parameterized using a PI operator $\mathcal{L}$ as the observer gain. Examining the error dynamics of this estimator, it is proven that an upper bound on the $H_{\infty}$-norm of these error dynamics can be minimized by solving a linear operator inequality on PI operator variables. Finally, an analytical formula is proposed for inversion of a class of 2D PI operators, which is then used to reconstruct the Luenberger gain $\mathcal{L}$. Results are implemented in the PIETOOLS software suite -- applying the methodology and simulating the resulting observer for an unstable 2D heat equation with boundary observations. △ Less

Submitted 16 June, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

Constructive Representation of Functions in $N$-Dimensional Sobolev Space

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: A new representation is proposed for functions in a Sobolev space with dominating mixed smoothness on an $N$-dimensional hyperrectangle. In particular, it is shown that these functions can be expressed in terms of their highest-order mixed derivative, as well as their lower-order derivatives evaluated along suitable boundaries of the domain. The proposed expansion is proven to be invertible, uniqu… ▽ More A new representation is proposed for functions in a Sobolev space with dominating mixed smoothness on an $N$-dimensional hyperrectangle. In particular, it is shown that these functions can be expressed in terms of their highest-order mixed derivative, as well as their lower-order derivatives evaluated along suitable boundaries of the domain. The proposed expansion is proven to be invertible, uniquely identifying any function in the Sobolev space with its derivatives and boundary values. Since these boundary values are either finite-dimensional, or exist in the space of square-integrable functions, this offers a bijective relation between the Sobolev space and $L_{2}$. Using this bijection, it is shown how approximation of functions in Sobolev space can be performed in the less restrictive space $L_{2}$, reconstructing such an approximation of the function from an $L_{2}$-optimal projection of its boundary values and highest-order derivative. This approximation method is presented using a basis of Legendre polynomials and a basis of step functions, and results using both bases are demonstrated to exhibit better convergence behavior than a direct projection approach for two numerical examples. △ Less

Submitted 29 April, 2024; v1 submitted 15 November, 2023; originally announced December 2023.

Integral Quadratic Constraints with Infinite-Dimensional Channels

Authors: Aleksandr Talitckii, Peter Seiler, Matthew M. Peet

Abstract: Modern control theory provides us with a spectrum of methods for studying the interconnection of dynamic systems using input-output properties of the interconnected subsystems. Perhaps the most advanced framework for such input-output analysis is the use of Integral Quadratic Constraints (IQCs), which considers the interconnection of a nominal linear system with an unmodelled nonlinear or uncertai… ▽ More Modern control theory provides us with a spectrum of methods for studying the interconnection of dynamic systems using input-output properties of the interconnected subsystems. Perhaps the most advanced framework for such input-output analysis is the use of Integral Quadratic Constraints (IQCs), which considers the interconnection of a nominal linear system with an unmodelled nonlinear or uncertain subsystem with known input-output properties. Although these methods are widely used for Ordinary Differential Equations (ODEs), there have been fewer attempts to extend IQCs to infinite-dimensional systems. In this paper, we present an IQC-based framework for Partial Differential Equations (PDEs) and Delay Differential Equations (DDEs). First, we introduce infinite-dimensional signal spaces, operators, and feedback interconnections. Next, in the main result, we propose a formulation of hard IQC-based input-output stability conditions, allowing for infinite-dimensional multipliers. We then show how to test hard IQC conditions with infinite-dimensional multipliers on a nominal linear PDE or DDE system via the Partial Integral Equation (PIE) state-space representation using a sufficient version of the Kalman-Yakubovich-Popov lemma (KYP). The results are then illustrated using four example problems with uncertainty and nonlinearity. △ Less

Submitted 1 September, 2023; originally announced September 2023.

Representation of PDE Systems with Delay and Stability Analysis using Convex Optimization -- Extended Version

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: Partial Integral Equations (PIEs) have been used to represent both systems with delay and systems of Partial Differential Equations (PDEs) in one or two spatial dimensions. In this paper, we show that these results can be combined to obtain a PIE representation of any suitably well-posed 1D PDE model with constant delay. In particular, we represent these delayed PDE systems as coupled systems of 1… ▽ More Partial Integral Equations (PIEs) have been used to represent both systems with delay and systems of Partial Differential Equations (PDEs) in one or two spatial dimensions. In this paper, we show that these results can be combined to obtain a PIE representation of any suitably well-posed 1D PDE model with constant delay. In particular, we represent these delayed PDE systems as coupled systems of 1D and 2D PDEs, obtaining a PIE representation of both subsystems. Taking the feedback interconnection of these PIE subsystems, we then obtain a 2D PIE representation of the 1D PDE with delay. Next, based on the PIE representation, we formulate the problem of stability analysis as convex optimization of positive operators which can be solved using the PIETOOLS software suite. We apply the result to PDE examples with delay in the state and boundary conditions. △ Less

Submitted 21 November, 2023; v1 submitted 9 November, 2022; originally announced November 2022.

Journal ref: IEEE Control Systems Letters, vol 7, pp 3627-3632, 2023

Existence of Partially Quadratic Lyapunov Functions That Can Certify The Local Asymptotic Stability of Nonlinear Systems

Authors: Morgan Jones, Matthew M. Peet

Abstract: This paper proposes a method for certifying the local asymptotic stability of a given nonlinear Ordinary Differential Equation (ODE) by using Sum-of-Squares (SOS) programming to search for a partially quadratic Lyapunov Function (LF). The proposed method is particularly well suited to the stability analysis of ODEs with high dimensional state spaces. This is due to the fact that partially quadrati… ▽ More This paper proposes a method for certifying the local asymptotic stability of a given nonlinear Ordinary Differential Equation (ODE) by using Sum-of-Squares (SOS) programming to search for a partially quadratic Lyapunov Function (LF). The proposed method is particularly well suited to the stability analysis of ODEs with high dimensional state spaces. This is due to the fact that partially quadratic LFs are parametrized by fewer decision variables when compared with general SOS LFs. The main contribution of this paper is using the Center Manifold Theorem to show that partially quadratic LFs that certify the local asymptotic stability of a given ODE exist under certain conditions. △ Less

Submitted 15 September, 2022; originally announced September 2022.

$L_2$-Gain Analysis of Coupled Linear 2D PDEs using Linear PI Inequalities

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: In this paper, we present a new method for estimating the $L_2$-gain of systems governed by 2nd order linear Partial Differential Equations (PDEs) in two spatial variables, using semidefinite programming. It has previously been shown that, for any such PDE, an equivalent Partial Integral Equation (PIE) can be derived. These PIEs are expressed in terms of Partial Integral (PI) operators mapping sta… ▽ More In this paper, we present a new method for estimating the $L_2$-gain of systems governed by 2nd order linear Partial Differential Equations (PDEs) in two spatial variables, using semidefinite programming. It has previously been shown that, for any such PDE, an equivalent Partial Integral Equation (PIE) can be derived. These PIEs are expressed in terms of Partial Integral (PI) operators mapping states in $L_2[Ω]$, and are free of the boundary and continuity constraints appearing in PDEs. In this paper, we extend the 2D PIE representation to include input and output signals in $\mathbb{R}^n$, deriving a bijective map between solutions of the PDE and the PIE, along with the necessary formulae to convert between the two representations. Next, using the algebraic properties of PI operators, we prove that an upper bound on the $L_2$-gain of PIEs can be verified by testing feasibility of a Linear PI Inequality (LPI), defined by a positivity constraint on a PI operator mapping $\mathbb{R}^n\times L_2[Ω]$. Finally, we use positive matrices to parameterize a cone of positive PI operators on $\mathbb{R}^n\times L_2[Ω]$, allowing feasibility of the $L_2$-gain LPI to be tested using semidefinite programming. We implement this test in the MATLAB toolbox PIETOOLS, and demonstrate that this approach allows an upper bound on the $L_2$-gain of PDEs to be estimated with little conservatism. △ Less

Submitted 11 September, 2022; v1 submitted 29 March, 2022; originally announced March 2022.

Journal ref: Proceedings of the 61st IEEE Conference on Decision and Control, 2022, pp. 6097-6104

A Converse Sum of Squares Lyapunov Function for Outer Approximation of Minimal Attractor Sets of Nonlinear Systems

Authors: Morgan Jones, Matthew M. Peet

Abstract: Many dynamical systems described by nonlinear ODEs are unstable. Their associated solutions do not converge towards an equilibrium point, but rather converge towards some invariant subset of the state space called an attractor set. For a given ODE, in general, the existence, shape and structure of the attractor sets of the ODE are unknown. Fortunately, the sublevel sets of Lyapunov functions can p… ▽ More Many dynamical systems described by nonlinear ODEs are unstable. Their associated solutions do not converge towards an equilibrium point, but rather converge towards some invariant subset of the state space called an attractor set. For a given ODE, in general, the existence, shape and structure of the attractor sets of the ODE are unknown. Fortunately, the sublevel sets of Lyapunov functions can provide bounds on the attractor sets of ODEs. In this paper we propose a new Lyapunov characterization of attractor sets that is well suited to the problem of finding the minimal attractor set. We show our Lyapunov characterization is non-conservative even when restricted to Sum-of-Squares (SOS) Lyapunov functions. Given these results, we propose a SOS programming problem based on determinant maximization that yields an SOS Lyapunov function whose 1-sublevel set has minimal volume, is an attractor set itself, and provides an optimal outer approximation of the minimal attractor set of the ODE. Several numerical examples are presented including the Lorenz attractor and Van-der-Pol oscillator. △ Less

Submitted 3 May, 2023; v1 submitted 6 October, 2021; originally announced October 2021.

A PIE Representation of Coupled Linear 2D PDEs and Stability Analysis using LPIs

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: We introduce a Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in two spatial variables. PIEs are an algebraic state-space representation of infinite-dimensional systems and have been used to model 1D PDEs and time-delay systems without continuity constraints or boundary conditions -- making these PIE representations amenable to stability analysis using conv… ▽ More We introduce a Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in two spatial variables. PIEs are an algebraic state-space representation of infinite-dimensional systems and have been used to model 1D PDEs and time-delay systems without continuity constraints or boundary conditions -- making these PIE representations amenable to stability analysis using convex optimization. To extend the PIE framework to 2D PDEs, we first construct an algebra of Partial Integral (PI) operators on the function space L_2[x,y], providing formulae for composition, adjoint, and inversion. We then extend this algebra to R^n x L_2[x] x L_2[y] x L_2[x,y] and demonstrate that, for any suitable coupled, linear PDE in 2 spatial variables, there exists an associated PIE whose solutions bijectively map to solutions of the original PDE -- providing conversion formulae between these representations. Next, we use positive matrices to parameterize the convex cone of 2D PI operators -- allowing us to optimize PI operators and solve Linear PI Inequality (LPI) feasibility problems. Finally, we use the 2D LPI framework to provide conditions for stability of 2D linear PDEs. We test these conditions on 2D heat and wave equations and demonstrate that the stability condition has little to no conservatism. △ Less

Submitted 2 September, 2022; v1 submitted 14 September, 2021; originally announced September 2021.

Journal ref: Proceedings of the 2022 American Control Conference, 2022, pp. 1659-1666

Converse Lyapunov Functions and Converging Inner Approximations to Maximal Regions of Attraction of Nonlinear Systems

Authors: Morgan Jones, Matthew M. Peet

Abstract: This paper considers the problem of approximating the "maximal" region of attraction (the set that contains all asymptotically stable sets) of any given set of locally exponentially stable nonlinear Ordinary Differential Equations (ODEs) with a sufficiently smooth vector field. Given a locally exponential stable ODE with a differentiable vector field, we show that there exists a globally Lipschitz… ▽ More This paper considers the problem of approximating the "maximal" region of attraction (the set that contains all asymptotically stable sets) of any given set of locally exponentially stable nonlinear Ordinary Differential Equations (ODEs) with a sufficiently smooth vector field. Given a locally exponential stable ODE with a differentiable vector field, we show that there exists a globally Lipschitz continuous converse Lyapunov function whose 1-sublevel set is equal to the maximal region of attraction of the ODE. We then propose a sequence of d-degree Sum-of-Squares (SOS) programming problems that yields a sequence of polynomials that converges to our proposed converse Lyapunov function uniformly from above in the L1 norm. We show that each member of the sequence of 1-sublevel sets of the polynomial solutions to our proposed sequence of SOS programming problems are certifiably contained inside the maximal region of attraction of the ODE, and moreover, we show that this sequence of sublevel sets converges to the maximal region of attraction of the ODE with respect to the volume metric. We provide numerical examples of estimations of the maximal region of attraction for the Van der Pol oscillator and a three dimensional servomechanism. △ Less

Submitted 3 September, 2022; v1 submitted 23 March, 2021; originally announced March 2021.

A New Treatment of Boundary Conditions in PDE Solution with Galerkin Methods via Partial Integral Equation Framework

Authors: Yulia T. Peet, Matthew M. Peet

Abstract: We present a new analytical and numerical framework for solution of Partial Differential Equations (PDEs) that is based on an exact transformation that moves the boundary constraints into the dynamics of the corresponding governing equation. The framework is based on a Partial Integral Equation (PIE) representation of PDEs, where a PDE equation is transformed into an equivalent PIE formulation tha… ▽ More We present a new analytical and numerical framework for solution of Partial Differential Equations (PDEs) that is based on an exact transformation that moves the boundary constraints into the dynamics of the corresponding governing equation. The framework is based on a Partial Integral Equation (PIE) representation of PDEs, where a PDE equation is transformed into an equivalent PIE formulation that does not require boundary conditions on its solution state. The PDE-PIE framework allows for a development of a generalized PIE-Galerkin approximation methodology for a broad class of linear PDEs with non-constant coefficients governed by non-periodic boundary conditions, including, e.g., Dirichlet, Neumann and Robin boundaries. The significance of this result is that solution to almost any linear PDE can now be constructed in a form of an analytical approximation based on a series expansion using a suitable set of basis functions, such as, e.g., Chebyshev polynomials of the first kind, irrespective of the boundary conditions. In many cases involving homogeneous or simple time-dependent boundary inputs, an analytical integration in time is also possible. We present several PDE solution examples in one spatial variable implemented with the developed PIE-Galerkin methodology using both analytical and numerical integration in time. The developed framework can be naturally extended to multiple spatial dimensions and, potentially, to nonlinear problems. △ Less

Submitted 10 February, 2023; v1 submitted 30 November, 2020; originally announced December 2020.

Comments: 42 pages, 9 figures

MSC Class: 65M70; 65M22; 65M12

Polynomial Approximation of Value Functions and Nonlinear Controller Design with Performance Bounds

Authors: Morgan Jones, Matthew M. Peet

Abstract: For any suitable Optimal Control Problem (OCP) there exists a value function, defined as the unique viscosity solution to the Hamilton-Jacobi-Bellman (HJB) Partial-Differential-Equation (PDE), and which can be used to design an optimal feedback controller for the given OCP. In this paper, we approximately solve the HJB-PDE by proposing a sequence of Sum-Of-Squares (SOS) problems, each of which yie… ▽ More For any suitable Optimal Control Problem (OCP) there exists a value function, defined as the unique viscosity solution to the Hamilton-Jacobi-Bellman (HJB) Partial-Differential-Equation (PDE), and which can be used to design an optimal feedback controller for the given OCP. In this paper, we approximately solve the HJB-PDE by proposing a sequence of Sum-Of-Squares (SOS) problems, each of which yields a polynomial subsolution to the HJB-PDE. We show that the resulting sequence of polynomial sub-solutions converges to the value function of the OCP in the L1 norm. Furthermore, for each polynomial sub-solution in this sequence, we show that the associated sequence of sublevel sets converge to the sublevel set of the value function of the OCP in the volume metric. Next, for any approximate value function, obtained from an SOS program or any other method (e.g. discretization), we construct an associated feedback controller, and show that sub-optimality of this controller as applied to the OCP is bounded by the distance between the approximate and true value function of the OCP in the Sobolev norm. Finally, we demonstrate numerically that by solving our proposed SOS problem we are able to accurately approximate value functions, design controllers and estimate reachable sets. △ Less

Submitted 28 January, 2023; v1 submitted 14 October, 2020; originally announced October 2020.

H\infty-Optimal Observer Design for Linear Systems with Delays in States, Outputs and Disturbances

Authors: Shuangshuang Wu, Sachin Shivakumar, Matthew M. Peet, Changchun Hua

Abstract: This paper considers the H\infty-optimal estimation problem for linear systems with multiple delays in states, output, and disturbances. First, we formulate the H\infty-optimal estimation problem in the Delay-Differential Equation (DDE) framework. Next, we construct an equivalent Partial Integral Equation (PIE) representation of the optimal estimator design framework. We then show that in the PIE… ▽ More This paper considers the H\infty-optimal estimation problem for linear systems with multiple delays in states, output, and disturbances. First, we formulate the H\infty-optimal estimation problem in the Delay-Differential Equation (DDE) framework. Next, we construct an equivalent Partial Integral Equation (PIE) representation of the optimal estimator design framework. We then show that in the PIE framework, the H\infty-optimal estimator synthesis problem can be posed as a Linear PI Inequality (LPI). LPIs are a generalization of LMIs to the algebra of Partial Integral (PI) operators and can be solved using the PIETOOLS toolbox. Finally, we convert the PIE representation of the optimal estimator back into an ODE-PDE representation - a form similar to a DDE, but with corrections to estimates of the infinite-dimensional state (the time-history). Numerical examples show that the synthesis condition we propose produces an estimator with provable H\infty-gain bound which is accurate to 4 decimal places when compared with results obtained using Pade-based discretization. △ Less

Submitted 9 April, 2020; originally announced April 2020.

Comments: 7 pages, 2 figures

Duality and $H_{\infty}$-Optimal Control Of Coupled ODE-PDE Systems

Authors: Sachin Shivakumar, Amritam Das, Siep Weiland, Matthew M. Peet

Abstract: In this paper, we present a convex formulation of $H_{\infty}$-optimal control problem for coupled linear ODE-PDE systems with one spatial dimension. First, we reformulate the coupled ODE-PDE system as a Partial Integral Equation (PIE) system and show that stability and $H_{\infty}$ performance of the PIE system implies that of the ODE-PDE system. We then construct a dual PIE system and show that… ▽ More In this paper, we present a convex formulation of $H_{\infty}$-optimal control problem for coupled linear ODE-PDE systems with one spatial dimension. First, we reformulate the coupled ODE-PDE system as a Partial Integral Equation (PIE) system and show that stability and $H_{\infty}$ performance of the PIE system implies that of the ODE-PDE system. We then construct a dual PIE system and show that asymptotic stability and $H_{\infty}$ performance of the dual system is equivalent to that of the primal PIE system. Next, we pose a convex dual formulation of the stability and $H_{\infty}$-performance problems using the Linear PI Inequality (LPI) framework. LPIs are a generalization of LMIs to Partial Integral (PI) operators and can be solved using PIETOOLS, a MATLAB toolbox. Next, we use our duality results to formulate the stabilization and $H_{\infty}$-optimal state-feedback control problems as LPIs. Finally, we illustrate the accuracy and scalability of the algorithms by constructing controllers for several numerical examples. △ Less

Submitted 24 June, 2020; v1 submitted 7 April, 2020; originally announced April 2020.

Representation of Networks and Systems with Delay: DDEs, DDFs, ODE-PDEs and PIEs

Authors: Matthew M. Peet

Abstract: Delay-Differential Equations (DDEs) are the most common representation for systems with delay. However, the DDE representation is limited. In network models with delay, the delayed channels are low-dimensional and accounting for this heterogeneity is not possible in the DDE framework. In addition, DDEs cannot be used to model difference equations. Furthermore, estimation and control of systems in… ▽ More Delay-Differential Equations (DDEs) are the most common representation for systems with delay. However, the DDE representation is limited. In network models with delay, the delayed channels are low-dimensional and accounting for this heterogeneity is not possible in the DDE framework. In addition, DDEs cannot be used to model difference equations. Furthermore, estimation and control of systems in DDE format has proven challenging, despite decades of study. In this paper, we examine alternative representations for systems with delay and provide formulae for conversion between representations. First, we examine the Differential-Difference (DDF) formulation which allows us to represent the low-dimensional nature of delayed information. Next, we examine the coupled ODE-PDE formulation, for which backstepping methods have recently become available. Finally, we consider the algebraic Partial-Integral Equation (PIE) representation, which allows the optimal estimation and control problems to be solved efficiently through the use of recent software packages such as PIETOOLS. In each case, we consider a very general class of delay systems, specifically accounting for all four possible sources of delay - state delay, input delay, output delay, and process delay. We then apply these representations to 3 archetypical network models. △ Less

Submitted 18 December, 2020; v1 submitted 9 October, 2019; originally announced October 2019.

PIETOOLS: A Matlab Toolbox for Manipulation and Optimization of Partial Integral Operators

Authors: Sachin Shivakumar, Amritam Das, Matthew M. Peet

Abstract: In this paper, we present PIETOOLS, a MATLAB toolbox for the construction and handling of Partial Integral (PI) operators. The toolbox introduces a new class of MATLAB object, opvar, for which standard MATLAB matrix operation syntax (e.g. +, *, ' e tc.) is defined. PI operators are a generalization of bounded linear operators on infinite-dimensional spaces that form a *-subalgebra with two binary… ▽ More In this paper, we present PIETOOLS, a MATLAB toolbox for the construction and handling of Partial Integral (PI) operators. The toolbox introduces a new class of MATLAB object, opvar, for which standard MATLAB matrix operation syntax (e.g. +, *, ' e tc.) is defined. PI operators are a generalization of bounded linear operators on infinite-dimensional spaces that form a *-subalgebra with two binary operations (addition and composition) on the space RxL2. These operators frequently appear in analysis and control of infinite-dimensional systems such as Partial Differential equations (PDE) and Time-delay systems (TDS). Furthermore, PIETOOLS can: declare opvar decision variables, add operator positivity constraints, declare an objective function, and solve the resulting optimization problem using a syntax similar to the sdpvar class in YALMIP. Use of the resulting Linear Operator Inequalities (LOIs) are demonstrated on several examples, including stability analysis of a PDE, bounding operator norms, and verifying integral inequalities. The result is that PIETOOLS, packaged with SOSTOOLS and MULTIPOLY, offers a scalable, user-friendly and computationally efficient toolbox for parsing, performing algebraic operations, setting up and solving convex optimization problems on PI operators. △ Less

Submitted 29 April, 2020; v1 submitted 3 October, 2019; originally announced October 2019.

Estimator-Based Output-Feedback Stabilization of Linear Multi-Delay Systems using SOS

Authors: Shuangshuang Wu, Matthew M. Peet, Changchun Hua

Abstract: In this paper, we investigate the estimator-based output feedback control problem of multi-delay systems. This work is an extension of recently developed operator-value LMI framework for infinite-dimensional time-delay systems. Based on the optimal convex state feedback controller and generalized Luenberger observer synthesis conditions we already have, the estimator-based output feedback controll… ▽ More In this paper, we investigate the estimator-based output feedback control problem of multi-delay systems. This work is an extension of recently developed operator-value LMI framework for infinite-dimensional time-delay systems. Based on the optimal convex state feedback controller and generalized Luenberger observer synthesis conditions we already have, the estimator-based output feedback controller is designed to contain the estimates of both the present state and history of the state. An output feedback controller synthesis condition is proposed using SOS method, which is expressed in a set of LMI/SDP constraints. The simulation examples are displayed to demonstrate the effectiveness and advantages of the proposed results. △ Less

Submitted 12 September, 2019; originally announced September 2019.

Comments: This is the accepted version of 59th IEEE CDC conference

A Generalized LMI Formulation for Input-Output Analysis of Linear Systems of ODEs Coupled with PDEs

Authors: Sachin Shivakumar, Amritam Das, Siep Weiland, Matthew M. Peet

Abstract: In this paper, we consider input-output properties of linear systems consisting of PDEs on a finite domain coupled with ODEs through the boundary conditions of the PDE. This framework can be used to represent e.g. a lumped mass fixed to a beam or a system with delay. This work generalizes the sufficiency proof of the KYP Lemma for ODEs to coupled ODE-PDE systems using a recently developed concept… ▽ More In this paper, we consider input-output properties of linear systems consisting of PDEs on a finite domain coupled with ODEs through the boundary conditions of the PDE. This framework can be used to represent e.g. a lumped mass fixed to a beam or a system with delay. This work generalizes the sufficiency proof of the KYP Lemma for ODEs to coupled ODE-PDE systems using a recently developed concept of fundamental state and the associated boundary-condition-free representation. The conditions of the generalized KYP are tested using the PQRS positive matrix parameterization of operators resulting in a finite-dimensional LMI, feasibility of which implies prima facie provable passivity or L2-gain of the system. No discretization or approximation is involved at any step and we use numerical examples to demonstrate that the bounds obtained are not conservative in any significant sense and that computational complexity is lower than existing methods involving finite-dimensional projection of PDEs. △ Less

Submitted 29 April, 2020; v1 submitted 22 April, 2019; originally announced April 2019.

Relaxing The Hamilton Jacobi Bellman Equation To Construct Inner And Outer Bounds On Reachable Sets

Authors: Morgan Jones, Matthew M. Peet

Abstract: We consider the problem of overbounding and underbounding both the backward and forward reachable set for a given polynomial vector field, nonlinear in both state and input, with a given semialgebriac set of initial conditions and with inputs constrained pointwise to lie in a semialgebraic set. Specifically, we represent the forward reachable set using the value function which gives the optimal co… ▽ More We consider the problem of overbounding and underbounding both the backward and forward reachable set for a given polynomial vector field, nonlinear in both state and input, with a given semialgebriac set of initial conditions and with inputs constrained pointwise to lie in a semialgebraic set. Specifically, we represent the forward reachable set using the value function which gives the optimal cost to go of an optimal control problems and if smooth satisfies the Hamilton-Jacobi- Bellman PDE. We then show that there exist polynomial upper and lower bounds to this value function and furthermore, these polynomial sub-value and super-value functions provide provable upper and lower bounds to the forward reachable set. Finally, by minimizing the distance between these sub-value and super-value functions in the L1-norm, we are able to construct inner and outer bounds for the reachable set and show numerically on several examples that for relatively small degree, the Hausdorff distance between these bounds is negligible. △ Less

Submitted 18 March, 2019; originally announced March 2019.

Journal ref: 2019 IEEE 58th Conference on Decision and Control (CDC)

Using SOS and Sublevel Set Volume Minimization for Estimation of Forward Reachable Sets

Authors: Morgan Jones, Matthew M. Peet

Abstract: In this paper we propose a convex Sum-of-Squares optimization problem for finding outer approximations of forward reachable sets for nonlinear uncertain Ordinary Differential Equations (ODE's) with either (or both) L2 or point-wise bounded input disturbances. To make our approximations tight we seek to minimize the volume of our approximation set. Our approach to volume minimization is based on th… ▽ More In this paper we propose a convex Sum-of-Squares optimization problem for finding outer approximations of forward reachable sets for nonlinear uncertain Ordinary Differential Equations (ODE's) with either (or both) L2 or point-wise bounded input disturbances. To make our approximations tight we seek to minimize the volume of our approximation set. Our approach to volume minimization is based on the use of a convex determinant-like objective function. We provide several numerical examples including the Lorenz system and the Van der Pol oscillator. △ Less

Submitted 30 January, 2019; originally announced January 2019.

A Partial Integral Equation (PIE) Representation of Coupled Linear PDEs and Scalable Stability Analysis using LMIs

Authors: Matthew M. Peet

Abstract: We present a new Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in which it is possible to use convex optimization to perform stability analysis with little or no conservatism. The first result gives a standardized representation for coupled linear PDEs in a single spatial variable and shows that any such PDE, suitably well-posed, admits an equivalent PIE r… ▽ More We present a new Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in which it is possible to use convex optimization to perform stability analysis with little or no conservatism. The first result gives a standardized representation for coupled linear PDEs in a single spatial variable and shows that any such PDE, suitably well-posed, admits an equivalent PIE representation, defined by the given conversion formulae. This leads to a new prima facie representation of the dynamics without the implicit constraints on system state imposed by boundary conditions. The second result is to show that for systems in this PIE representation, convex optimization may be used to verify stability without discretization. The resulting algorithms are implemented in the Matlab toolbox PIETOOLS, tested on several illustrative examples, compared with previous results, and the code has been posted on Code Ocean. Scalability testing indicates the algorithm can analyze systems of up to 40 coupled PDEs on a desktop computer. △ Less

Submitted 11 September, 2020; v1 submitted 14 December, 2018; originally announced December 2018.

Computing Input-Output Properties of Coupled PDE systems

Authors: Sachin Shivakumar, Matthew M. Peet

Abstract: In this paper, we propose an LMI-based approach to analyze input-output properties of coupled linear PDE systems. This work expands on a newly developed state-space theory for coupled PDEs and extends the positive-real and bounded-real lemmas to infinite dimensional systems. We show that conditions for passivity and bounded L2 gain can be expressed as linear operator inequalities on RxL2. A method… ▽ More In this paper, we propose an LMI-based approach to analyze input-output properties of coupled linear PDE systems. This work expands on a newly developed state-space theory for coupled PDEs and extends the positive-real and bounded-real lemmas to infinite dimensional systems. We show that conditions for passivity and bounded L2 gain can be expressed as linear operator inequalities on RxL2. A method to convert these operator inequalities to LMIs by using parameterization of the operator variables is proposed. This method does not rely on discretization and as such, the properties obtained are prima facie provable. We use numerical examples to demonstrate that the bounds obtained are not conservative in any significant sense and that the bounds are computable on desktop computers for systems consisting of up to 20 coupled PDEs. △ Less

Submitted 29 April, 2020; v1 submitted 12 December, 2018; originally announced December 2018.

Extensions of the Dynamic Programming Framework: Battery Scheduling, Demand Charges, and Renewable Integration

Authors: Morgan Jones, Matthew M. Peet

Abstract: We consider a general class of Dynamic Programming (DP) problems with non-separable objective functions. We show that for any problem in this class, there exists an augmented-state DP problem which satisfies the Principle of Optimality and the solutions to which yield solutions to the original problem. Furthermore, we identify a subclass of DP problems with Naturally Forward Separable (NFS) object… ▽ More We consider a general class of Dynamic Programming (DP) problems with non-separable objective functions. We show that for any problem in this class, there exists an augmented-state DP problem which satisfies the Principle of Optimality and the solutions to which yield solutions to the original problem. Furthermore, we identify a subclass of DP problems with Naturally Forward Separable (NFS) objective functions for which this state-augmentation scheme is tractable. We extend this framework to stochastic DP problems, proposing a suitable definition of the Principle of Optimality. We then apply the resulting algorithms to the problem of optimal battery scheduling with demand charges using a data-based stochastic model for electricity usage and solar generation by the consumer. △ Less

Submitted 9 June, 2020; v1 submitted 29 November, 2018; originally announced December 2018.

Comments: Latest TAC submission after second round of reviews 02/10/2020

Using SOS for Optimal Semialgebraic Representation of Sets: Finding Minimal Representations of Limit Cycles, Chaotic Attractors and Unions

Authors: Morgan Jones, Matthew M. Peet

Abstract: In this paper we show that Sum-of-Squares optimization can be used to find optimal semialgebraic representations of sets. These sets may be explicitly defined, as in the case of discrete points or unions of sets; or implicitly defined, as in the case of attractors of nonlinear systems. We define optimality in the sense of minimum volume, while satisfying constraints that can include set containmen… ▽ More In this paper we show that Sum-of-Squares optimization can be used to find optimal semialgebraic representations of sets. These sets may be explicitly defined, as in the case of discrete points or unions of sets; or implicitly defined, as in the case of attractors of nonlinear systems. We define optimality in the sense of minimum volume, while satisfying constraints that can include set containment, convexity, or Lyapunov stability conditions. Our admittedly heuristic approach to volume minimization is based on the use of a determinantlike objective function. We provide numerical examples for the Lorenz attractor and the Van der Pol limit cycle. △ Less

Submitted 26 September, 2018; originally announced September 2018.

A New State-Space Representation of Lyapunov Stability for Coupled PDEs and Scalable Stability Analysis in the SOS Framework - with Lemma Proofs

Authors: Matthew M. Peet

Abstract: In this paper, we present a framework for Stability Analysis of Systems of Coupled Linear Partial-Differential Equations. The class of PDE systems considered in this paper includes parabolic, elliptic and hyperbolic systems with Dirichelet, Neuman and mixed boundary conditions. The results in this paper apply to systems with a single spatial variable and assume existence and continuity of solution… ▽ More In this paper, we present a framework for Stability Analysis of Systems of Coupled Linear Partial-Differential Equations. The class of PDE systems considered in this paper includes parabolic, elliptic and hyperbolic systems with Dirichelet, Neuman and mixed boundary conditions. The results in this paper apply to systems with a single spatial variable and assume existence and continuity of solutions except in such cases when existence and continuity can be inferred from existence of a Lyapunov function. Our approach is based on a new concept of state for PDE systems which allows us to express the derivative of the Lyapunov function as a Linear Operator Inequality directly on $L_2$ and allows for any type of suitably well-posed boundary conditions. This approach obviates the need for integration by parts, spacing functions or similar mathematical encumbrances. The resulting algorithms are implemented in Matlab, tested on several motivating examples, and the codes have been posted online. Numerical testing indicates the approach has little or no conservatism for a large class of systems. △ Less

Submitted 27 March, 2018; v1 submitted 20 March, 2018; originally announced March 2018.

Comments: This document contains both manuscript and proofs

A Dynamic Programming Approach to Evaluating Multivariate Gaussian Probabilities

Authors: Morgan Jones, Matthew M. Peet

Abstract: We propose a method of approximating multivariate Gaussian probabilities using dynamic programming. We show that solving the optimization problem associated with a class of discrete-time finite horizon Markov decision processes with non-Lipschitz cost functions is equivalent to integrating a Gaussian functions over polytopes. An approximation scheme for this class of MDPs is proposed and explicit… ▽ More We propose a method of approximating multivariate Gaussian probabilities using dynamic programming. We show that solving the optimization problem associated with a class of discrete-time finite horizon Markov decision processes with non-Lipschitz cost functions is equivalent to integrating a Gaussian functions over polytopes. An approximation scheme for this class of MDPs is proposed and explicit error bounds under the supremum norm for the optimal cost to go functions are derived. △ Less

Submitted 7 February, 2018; originally announced February 2018.

Comments: Submitted to MTNS

Solving Dynamic Programming with Supremum Terms in the Objective and Application to Optimal Battery Scheduling for Electricity Consumers Subject to Demand Charges

Authors: Morgan Jones, Matthew M. Peet

Abstract: In this paper, we consider the problem of dynamic programming when supremum terms appear in the objective function. Such terms can represent overhead costs associated with the underlying state variables. Specifically, this form of optimization problem can be used to represent optimal scheduling of batteries such as the Tesla Powerwall for electrical consumers subject to demand charges - a charge b… ▽ More In this paper, we consider the problem of dynamic programming when supremum terms appear in the objective function. Such terms can represent overhead costs associated with the underlying state variables. Specifically, this form of optimization problem can be used to represent optimal scheduling of batteries such as the Tesla Powerwall for electrical consumers subject to demand charges - a charge based on the maximum rate of electricity consumption. These demand charges reflect the cost to the utility of building and maintaining generating capacity. Unfortunately, we show that dynamic programming problems with supremum terms do not satisfy the principle of optimality. However, we also show that the supremum is a special case of the class of forward separable objective functions. To solve the dynamic programming problem, we propose a general class of optimization problems with forward separable objectives. We then show that for any problem in this class, there exists an augmented-state dynamic programming problem which satisfies the principle of optimality and the solutions to which yield solutions to the original forward separable problem. We further generalize this approach to stochastic dynamic programming problems and apply the results to the problem of optimal battery scheduling with demand charges using a databased stochastic model for electricity usage and solar generation by the consumer. △ Less

Submitted 11 August, 2017; originally announced August 2017.

Estimating the Region of Attraction Using Polynomial Optimization: a Converse Lyapunov Result

Authors: Hesameddin Mohammadi, Matthew M. Peet

Abstract: In this paper, we propose an iterative method for using SOS programming to estimate the region of attraction of a polynomial vector field, the conjectured convergence of which necessitates the existence of polynomial Lyapunov functions whose sublevel sets approximate the true region of attraction arbitrarily well. The main technical result of the paper is the proof of existence of such a Lyapunov… ▽ More In this paper, we propose an iterative method for using SOS programming to estimate the region of attraction of a polynomial vector field, the conjectured convergence of which necessitates the existence of polynomial Lyapunov functions whose sublevel sets approximate the true region of attraction arbitrarily well. The main technical result of the paper is the proof of existence of such a Lyapunov function. Specifically, we use the Hausdorff distance metric to analyze convergence and in the main theorem demonstrate that the existence of an $n$-times continuously differentiable maximal Lyapunov function implies that for any $ε>0$, there exists a polynomial Lyapunov function and associated sub-level set which together prove stability of a set which is within $ε$ Hausdorff distance of the true region of attraction. The proposed iterative method and probably convergence is illustrated with a numerical example. △ Less

Submitted 23 April, 2017; originally announced April 2017.

Combining SOS and Moment Relaxations with Branch and Bound to Extract Solutions to Global Polynomial Optimization Problems

Authors: Hesameddin Mohammadi, Matthew M. Peet

Abstract: In this paper, we present a branch and bound algorithm for extracting approximate solutions to Global Polynomial Optimization (GPO) problems with bounded feasible sets. The algorithm is based on a combination of SOS/Moment relaxations and successively bisecting a hyper-rectangle containing the feasible set of the GPO problem. At each iteration, the algorithm makes a comparison between the volume… ▽ More In this paper, we present a branch and bound algorithm for extracting approximate solutions to Global Polynomial Optimization (GPO) problems with bounded feasible sets. The algorithm is based on a combination of SOS/Moment relaxations and successively bisecting a hyper-rectangle containing the feasible set of the GPO problem. At each iteration, the algorithm makes a comparison between the volume of the hyper-rectangles and their associated lower bounds to the GPO problem obtained by SOS/Moment relaxations to choose and subdivide an existing hyper-rectangle. For any desired accuracy, if we use sufficiently large order of SOS/Moment relaxations, then the algorithm is guaranteed to return a suboptimal point in a certain sense. For a fixed order of SOS/Moment relaxations, the complexity of the algorithm is linear in the number of iterations and polynomial in the number of constrains. We illustrate the effectiveness of the algorithm for a 6-variable, 5-constraint GPO problem for which the ideal generated by the equality constraints is not zero-dimensional - a case where the existing Moment-based approach for extracting the global minimizer might fail. △ Less

Submitted 23 April, 2017; v1 submitted 4 September, 2016; originally announced September 2016.

SOS Methods for Multi-Delay Systems: A Dual Form of Lyapanov-Krasovskii Functional

Authors: Matthew M. Peet

Abstract: We present a dual form of Lyapunov-Krasovskii functional which allows the problem of controller synthesis of multi-delay systems to be formulated and solved in a convex manner. First, we give a general form of dual stability condition formulated in terms of Lyapunov operators which are positive, self-adjoint and preserve the structure of the state-space. Second, we provide a class of such operator… ▽ More We present a dual form of Lyapunov-Krasovskii functional which allows the problem of controller synthesis of multi-delay systems to be formulated and solved in a convex manner. First, we give a general form of dual stability condition formulated in terms of Lyapunov operators which are positive, self-adjoint and preserve the structure of the state-space. Second, we provide a class of such operators and express the stability conditions as positivity and negativity of quadratic Lyapunov-Krasovskii functional forms. Next, we adapt the SOS methodology to express positivity and negativity of these forms as LMIs, describing a new set of polynomial manipulation tools designed for this purpose. Finally, we apply the resulting LMIs to a battery of numerical examples and demonstrate that the stability conditions are not conservative. The results of this paper are significant in that they open the way for dynamic output H-infinity optimal control of systems with multiple time-delays. △ Less

Submitted 13 May, 2016; originally announced May 2016.

A Convex Approach for Stability Analysis of Coupled PDEs with Spatially Dependent Coefficients

Authors: Evgeny Meyer, Matthew M. Peet

Abstract: In this paper, we present a methodology for stability analysis of a general class of systems defined by coupled Partial Differential Equations (PDEs) with spatially dependent coefficients and a general class of boundary conditions. This class includes PDEs of the parabolic, elliptic and hyperbolic type as well as coupled systems without boundary feedback. Our approach uses positive matrices to par… ▽ More In this paper, we present a methodology for stability analysis of a general class of systems defined by coupled Partial Differential Equations (PDEs) with spatially dependent coefficients and a general class of boundary conditions. This class includes PDEs of the parabolic, elliptic and hyperbolic type as well as coupled systems without boundary feedback. Our approach uses positive matrices to parameterize a new class of SOS Lyapunov functionals and combines these with a parametrization of projection operators which allow us to enforce positivity and negativity on subspaces of L_2. The result allows us to express Lyapunov stability conditions as a set of Linear Matrix Inequality (LMI) constraints which can be constructed using SOSTOOLS and tested using Semi-Definite Programming (SDP) solvers such as SeDuMi or Mosek. The methodology is tested using several simple numerical examples and compared with results obtained from simulation using a standard form of numerical discretization. △ Less

Submitted 24 March, 2016; originally announced March 2016.

Comments: Submitted to CDC 2016. arXiv admin note: text overlap with arXiv:1602.06986

A Convex Approach for Stability Analysis of Coupled PDEs using Lyapunov Functionals

Authors: Evgeny Meyer, Matthew M. Peet

Abstract: In this paper, we present an algorithm for stability analysis of systems described by coupled linear Partial Differential Equations (PDEs) with constant coefficients and mixed boundary conditions. Our approach uses positive matrices to parameterize functionals which are positive or negative on certain function spaces. Applying this parameterization to construct Lyapunov functionals with negative d… ▽ More In this paper, we present an algorithm for stability analysis of systems described by coupled linear Partial Differential Equations (PDEs) with constant coefficients and mixed boundary conditions. Our approach uses positive matrices to parameterize functionals which are positive or negative on certain function spaces. Applying this parameterization to construct Lyapunov functionals with negative derivative allows us to express stability conditions as a set of LMI constraints which can be constructed using SOSTOOLS and tested using standard SDP solvers such as SeDuMi. The results are tested using a simple numerical example and compared results obtained from simulation using a standard form of discretization. △ Less

Submitted 24 March, 2016; v1 submitted 22 February, 2016; originally announced February 2016.

Comments: This paper has been withdrawn by the author due to rejection

Stability Analysis of Parabolic Linear PDEs with Two Spatial Dimensions Using Lyapunov Method and SOS

Authors: Evgeny Meyer, Matthew M. Peet

Abstract: In this paper, we address stability of parabolic linear Partial Differential Equations (PDEs). We consider PDEs with two spatial variables and spatially dependent polynomial coefficients. We parameterize a class of Lyapunov functionals and their time derivatives by polynomials and express stability as optimization over polynomials. We use Sum-of-Squares and Positivstellensatz results to numericall… ▽ More In this paper, we address stability of parabolic linear Partial Differential Equations (PDEs). We consider PDEs with two spatial variables and spatially dependent polynomial coefficients. We parameterize a class of Lyapunov functionals and their time derivatives by polynomials and express stability as optimization over polynomials. We use Sum-of-Squares and Positivstellensatz results to numerically search for a solution to the optimization over polynomials. We also show that our algorithm can be used to estimate the rate of decay of the solution to PDE in the L2 norm. Finally, we validate the technique by applying our conditions to the 2D biological KISS PDE model of population growth and an additional example. △ Less

Submitted 13 September, 2015; originally announced September 2015.

Comments: IEEE Conference on Decision and Control, 2015

Solving Large-Scale Robust Stability Problems by Exploiting the Parallel Structure of Polya's Theorem

Authors: Reza Kamyar, Matthew M. Peet, Yulia Peet

Abstract: In this paper, we propose a distributed computing approach to solving large-scale robust stability problems on the simplex. Our approach is to formulate the robust stability problem as an optimization problem with polynomial variables and polynomial inequality constraints. We use Polya's theorem to convert the polynomial optimization problem to a set of highly structured Linear Matrix Inequalities… ▽ More In this paper, we propose a distributed computing approach to solving large-scale robust stability problems on the simplex. Our approach is to formulate the robust stability problem as an optimization problem with polynomial variables and polynomial inequality constraints. We use Polya's theorem to convert the polynomial optimization problem to a set of highly structured Linear Matrix Inequalities (LMIs). We then use a slight modification of a common interior-point primal-dual algorithm to solve the structured LMI constraints. This yields a set of extremely large yet structured computations. We then map the structure of the computations to a decentralized computing environment consisting of independent processing nodes with a structured adjacency matrix. The result is an algorithm which can solve the robust stability problem with the same per-core complexity as the deterministic stability problem with a conservatism which is only a function of the number of processors available. Numerical tests on cluster computers and supercomputers demonstrate the ability of the algorithm to efficiently utilize hundreds and potentially thousands of processors and analyze systems with 100+ dimensional state-space. The proposed algorithms can be extended to perform stability analysis of nonlinear systems and robust controller synthesis. △ Less

Submitted 13 November, 2014; originally announced November 2014.

Journal ref: IEEE Transactions on Automatic Control, vol. 58, no. 8, pp. 1931-1947, 2013

Optimal Thermostat Programming and Optimal Electricity Rates for Customers with Demand Charges

Authors: Reza Kamyar, Matthew M. Peet

Abstract: We consider the coupled problems of optimal thermostat programming and optimal pricing of electricity. Our framework consists of a single user and a single provider (a regulated utility). The provider sets prices for the user, who pays for both total energy consumed (\$/kWh, including peak and off-peak rates) and the peak rate of consumption in a month (a demand charge) (\$/kW). The cost of electr… ▽ More We consider the coupled problems of optimal thermostat programming and optimal pricing of electricity. Our framework consists of a single user and a single provider (a regulated utility). The provider sets prices for the user, who pays for both total energy consumed (\$/kWh, including peak and off-peak rates) and the peak rate of consumption in a month (a demand charge) (\$/kW). The cost of electricity for the provider is based on a combination of capacity costs (\$/kW) and fuel costs (\$/kWh). In the optimal thermostat programming problem, the user minimizes the amount paid for electricity while staying within a pre-defined temperature range. The user has access to energy storage in the form of thermal capacitance of the interior structure of the building. The provider sets prices designed to minimize the total cost of producing electricity while meeting the needs of the user. To solve the user-problem, we use a variant of dynamic programming. To solve the provider-problem, we use a descent algorithm coupled with our dynamic programming code - yielding optimal on-peak, off-peak and demand prices. We show that thermal storage and optimal thermostat programming can reduce electricity bills using current utility prices from utilities Arizona Public Service (APS) and Salt River Project (SRP). Moreover, we obtain optimal utility prices which lead to significant reductions in the cost of generating electricity and electricity bills. △ Less

Submitted 14 April, 2015; v1 submitted 8 October, 2014; originally announced October 2014.

Comments: American Control Conference, 2015

Global Stability Analysis of Nonlinear Sampled-Data Systems using Convex Methods

Authors: Matthew M. Peet, Alexandre Seuret

Abstract: We consider the problem of global stability of nonlinear sampled-data systems. Sampled-data systems are a form of hybrid model which arises when discrete measurements and updates are used to control continuous-time plants. In this paper, we use a recently introduced Lyapunov approach to derive stability conditions for both the case of fixed sampling period (synchronous) and the case of a time-vary… ▽ More We consider the problem of global stability of nonlinear sampled-data systems. Sampled-data systems are a form of hybrid model which arises when discrete measurements and updates are used to control continuous-time plants. In this paper, we use a recently introduced Lyapunov approach to derive stability conditions for both the case of fixed sampling period (synchronous) and the case of a time-varying sampling period (asynchronous). This approach requires the existence of a Lyapunov function which decreases over each sampling interval. To enforce this constraint, we use a form of slack variable which exists over the sampling period, may depend on the sampling period, and allows the Lyapunov function to be temporarily increasing. The resulting conditions are enforced using a new method of convex optimization of polynomial variables known as Sum-of-Squares.We use several numerical examples to illustrate this approach. △ Less

Submitted 21 August, 2014; originally announced August 2014.

Comments: in "Delay Systems: From Theory to Numerics and Applications", Springer, 2013

SOSTOOLS Version 4.00 Sum of Squares Optimization Toolbox for MATLAB

Authors: Antonis Papachristodoulou, James Anderson, Giorgio Valmorbida, Stephen Prajna, Pete Seiler, Pablo Parrilo, Matthew M. Peet, Declan Jagt

Abstract: The release of SOSTOOLS v4.00 comes as we approach the 20th anniversary of the original release of SOSTOOLS v1.00 back in April, 2002. SOSTOOLS was originally envisioned as a flexible tool for parsing and solving polynomial optimization problems, using the SOS tightening of polynomial positivity constraints, and capable of adapting to the ever-evolving fauna of applications of SOS. There are now a… ▽ More The release of SOSTOOLS v4.00 comes as we approach the 20th anniversary of the original release of SOSTOOLS v1.00 back in April, 2002. SOSTOOLS was originally envisioned as a flexible tool for parsing and solving polynomial optimization problems, using the SOS tightening of polynomial positivity constraints, and capable of adapting to the ever-evolving fauna of applications of SOS. There are now a variety of SOS programming parsers beyond SOSTOOLS, including YALMIP, Gloptipoly, SumOfSquares, and others. We hope SOSTOOLS remains the most intuitive, robust and adaptable toolbox for SOS programming. Recent progress in Semidefinite programming has opened up new possibilities for solving large Sum of Squares programming problems, and we hope the next decade will be one where SOS methods will find wide application in different areas. In SOSTOOLS v4.00, we implement a parsing approach that reduces the computational and memory requirements of the parser below that of the SDP solver itself. We have re-developed the internal structure of our polynomial decision variables. Specifically, polynomial and SOS variable declarations made using sossosvar, sospolyvar, sosmatrixvar, etc now return a new polynomial structure, dpvar. This new polynomial structure, is documented in the enclosed dpvar guide, and isolates the scalar SDP decision variables in the SOS program from the independent variables used to construct the SOS program. As a result, the complexity of the parser scales almost linearly in the number of decision variables. As a result of these changes, almost all users will notice a significant increase in speed, with large-scaleproblems experiencing the most dramatic speedups. Parsing time is now always less than 10% of time spent in the SDP solver. Finally, SOSTOOLS now provides support for the MOSEK solver interface as well as the SeDuMi, SDPT3, CSDP, SDPNAL, SDPNAL+, and SDPA solvers. △ Less

Submitted 27 December, 2021; v1 submitted 17 October, 2013; originally announced October 2013.

Comments: 64 pages, 3 figures, "software available from http://sysos.eng.ox.ac.uk/sostools/ "

A Converse Sum of Squares Lyapunov Result with a Degree Bound

Authors: Matthew M. Peet, Antonis Papachristodoulou

Abstract: Sum of Squares programming has been used extensively over the past decade for the stability analysis of nonlinear systems but several questions remain unanswered. In this paper, we show that exponential stability of a polynomial vector field on a bounded set implies the existence of a Lyapunov function which is a sum-of-squares of polynomials. In particular, the main result states that if a system… ▽ More Sum of Squares programming has been used extensively over the past decade for the stability analysis of nonlinear systems but several questions remain unanswered. In this paper, we show that exponential stability of a polynomial vector field on a bounded set implies the existence of a Lyapunov function which is a sum-of-squares of polynomials. In particular, the main result states that if a system is exponentially stable on a bounded nonempty set, then there exists an SOS Lyapunov function which is exponentially decreasing on that bounded set. The proof is constructive and uses the Picard iteration. A bound on the degree of this converse Lyapunov function is also given. This result implies that semidefinite programming can be used to answer the question of stability of a polynomial vector field with a bound on complexity. △ Less

Submitted 12 January, 2012; originally announced January 2012.

Positive Forms and Stability of Linear Time-Delay Systems

Authors: Matthew M. Peet, Antonis Papachristodoulou, Sanjay Lall

Abstract: We consider the problem of constructing Lyapunov functions for linear differential equations with delays. For such systems it is known that exponential stability implies the existence of a positive Lyapunov function which is quadratic on the space of continuous functions. We give an explicit parametrization of a sequence of finite-dimensional subsets of the cone of positive Lyapunov functions us… ▽ More We consider the problem of constructing Lyapunov functions for linear differential equations with delays. For such systems it is known that exponential stability implies the existence of a positive Lyapunov function which is quadratic on the space of continuous functions. We give an explicit parametrization of a sequence of finite-dimensional subsets of the cone of positive Lyapunov functions using positive semidefinite matrices. This allows stability analysis of linear time-delay systems to be formulated as a semidefinite program. △ Less

Submitted 2 July, 2007; originally announced July 2007.

Comments: journal version, 14 pages

Exponentially Stable Nonlinear Systems have Polynomial Lyapunov Functions on Bounded Regions

Authors: Matthew M. Peet

Abstract: This paper presents a proof that existence of a polynomial Lyapunov function is necessary and sufficient for exponential stability of sufficiently smooth nonlinear ordinary differential equations on bounded sets. The main result states that if there exists an n-times continuously differentiable Lyapunov function which proves exponential stability on a bounded subset of R^n, then there exists a p… ▽ More This paper presents a proof that existence of a polynomial Lyapunov function is necessary and sufficient for exponential stability of sufficiently smooth nonlinear ordinary differential equations on bounded sets. The main result states that if there exists an n-times continuously differentiable Lyapunov function which proves exponential stability on a bounded subset of R^n, then there exists a polynomial Lyapunov function which proves exponential stability on the same region. Such a continuous Lyapunov function will exist if, for example, the right-hand side of the differential equation is polynomial or at least n-times continuously differentiable. The proof is based on a generalization of the Weierstrass approximation theorem to differentiable functions in several variables. Specifically, we show how to use polynomials to approximate a differentiable function in the Sobolev norm W^{1,\infty} to any desired accuracy. We combine this approximation result with the second-order Taylor series expansion to find that polynomial Lyapunov functions can approximate continuous Lyapunov functions arbitrarily well on bounded sets. Our investigation is motivated by the use of polynomial optimization algorithms to construct polynomial Lyapunov functions. △ Less

Submitted 25 August, 2007; v1 submitted 2 July, 2007; originally announced July 2007.

Comments: journal version, 10 pages

Stability and Control of Functional Differential Equations

Authors: Matthew M. Peet

Abstract: This thesis addresses the question of stability of systems defined by differential equations which contain nonlinearity and delay. In particular, we analyze the stability of a well-known delayed nonlinear implementation of a certain Internet congestion control protocol. We also describe a generalized methodology for proving stability of time-delay systems through the use of semidefinite programm… ▽ More This thesis addresses the question of stability of systems defined by differential equations which contain nonlinearity and delay. In particular, we analyze the stability of a well-known delayed nonlinear implementation of a certain Internet congestion control protocol. We also describe a generalized methodology for proving stability of time-delay systems through the use of semidefinite programming. In Chapters 4 and 5, we consider an Internet congestion control protocol based on the decentralized gradient projection algorithm. For a certain class of utility function, this algorithm was shown to be globally convergent for some sufficiently small value of a gain parameter. Later work gave an explicit bound on this gain for a linearized version of the system. This thesis proves that this bound also implies stability of the original system. In Chapter 7, we describe a general methodology for proving stability of linear time-delay systems by computing solutions to an operator-theoretic version of the Lyapunov inequality via semidefinite programming. The result is stated in terms of a nested sequence of sufficient conditions which are of increasing accuracy. This approach is generalized to the case of parametric uncertainty by considering parameter-dependent Lyapunov functionals. Numerical examples are given to demonstrate convergence of the algorithm. In Chapter 8, this approach is generalized to nonlinear time-delay systems through the use of non-quadratic Lyapunov functionals. △ Less

Submitted 5 July, 2006; originally announced July 2006.

Comments: Thesis submitted for partial fulfillment of the requirements for the Doctor of Philosophy in Aeronautics and Astronautics at Stanford University