Showing 1–50 of 73 results for author: Peet, M

Representation and Stability Analysis of 1D PDEs with Periodic Boundary Conditions

Authors: Declan Jagt, Sergei Chernyshenko, Matthew Peet

Abstract: PDEs with periodic boundary conditions are frequently used to model processes in large spatial environments, assuming solutions to extend periodically beyond some bounded interval. However, solutions to these PDEs often do not converge to a unique equilibrium, but instead converge to non-stationary trajectories existing in the nullspace of the spatial differential operator (e.g.… ▽ More PDEs with periodic boundary conditions are frequently used to model processes in large spatial environments, assuming solutions to extend periodically beyond some bounded interval. However, solutions to these PDEs often do not converge to a unique equilibrium, but instead converge to non-stationary trajectories existing in the nullspace of the spatial differential operator (e.g. $\frac{\partial^2}{\partial x^2}$). To analyse this convergence behaviour, in this paper, it is shown how such trajectories can be modeled for a broad class of linear, 2nd order, 1D PDEs with periodic as well as more general boundary conditions, using the Partial Integral Equation (PIE) representation. In particular, it is first shown how any PDE state satisfying these boundary conditions can be uniquely expressed in terms of two components, existing in the image and the nullspace of the differential operator $\frac{\partial^2}{\partial x^2}$, respectively. An equivalent representation of linear PDEs is then derived as a PIE, explicitly defining the dynamics of both state components. Finally, a notion of exponential stability is defined that requires only one of the state components to converge to zero, and it is shown how this stability notion can be tested by solving a linear operator inequality. The proposed methodology is applied to two examples, demonstrating that exponential stability can be verified with tight bounds on the rate of decay. △ Less

Submitted 7 April, 2025; v1 submitted 28 March, 2025; originally announced March 2025.

Bounding the Error of Value Functions in Sobolev Norm Yields Bounds on Suboptimality of Controller Performance

Authors: Morgan Jones, Matthew Peet

Abstract: Optimal feedback controllers for nonlinear systems can be derived by solving the Hamilton-Jacobi-Bellman (HJB) equation. However, because the HJB is a nonlinear partial differential equation, in general only approximate solutions can be numerically found. While numerical error bounds on approximate HJB solutions are often available, we show that these bounds do not necessarily translate into guara… ▽ More Optimal feedback controllers for nonlinear systems can be derived by solving the Hamilton-Jacobi-Bellman (HJB) equation. However, because the HJB is a nonlinear partial differential equation, in general only approximate solutions can be numerically found. While numerical error bounds on approximate HJB solutions are often available, we show that these bounds do not necessarily translate into guarantees on the suboptimality of the resulting controllers. In this paper, we establish that if the numerical error in the HJB solution can be bounded in a Sobolev norm, a norm involving spatial derivatives, then the suboptimality of the corresponding feedback controller can also be bounded, and this bound can be made arbitrarily small. In contrast, we demonstrate that such guarantees do not hold when the error is measured in more typical norms, such as the uniform norm ($L^\infty$). Our results apply to systems governed by locally Lipschitz continuous dynamics over a finite time horizon with a compact input space. Numerical examples are provided to illustrate the theoretical findings. △ Less

Submitted 21 February, 2025; originally announced February 2025.

PIETOOLS 2024: User Manual

Authors: Sachin Shivakumar, Declan Jagt, Danilo Braghini, Amritam Das, Yulia Peet, Matthew Peet

Abstract: The PIETOOLS 2024 User Manual describes all the features of version 2024 of the MATLAB toolbox PIETOOLS for the analysis and control of Partial Integral Equations (PIEs). The manual is aimed to guide, with examples, first-time users to four fundamental features of PIETOOLS: converting coupled ODE-PDEs, DDEs, DDFs, etc., to PIE representation; analysis of stability and input-output properties of PI… ▽ More The PIETOOLS 2024 User Manual describes all the features of version 2024 of the MATLAB toolbox PIETOOLS for the analysis and control of Partial Integral Equations (PIEs). The manual is aimed to guide, with examples, first-time users to four fundamental features of PIETOOLS: converting coupled ODE-PDEs, DDEs, DDFs, etc., to PIE representation; analysis of stability and input-output properties of PIEs; design of optimal observers and controllers for PIEs; simulation of open- and closed-loop PIE systems. The use of PIETOOLS is not limited to the features described above. However, the manual focuses on these features to provide a holistic understanding of the workflow of PIETOOLS, which will serve as a foundation to develop more complicated programs, for example, the design of boundary feedback controllers, robust observers, robust controllers, etc.. △ Less

Submitted 29 January, 2025; originally announced January 2025.

Comments: See also https://control.asu.edu/pietools/pietools . Codes available at https://github.com/CyberneticSCL/PIETOOLS

Bounding the Settling Time of Finite-Time Stable Systems using Sum of Squares

Authors: Sengiyumva Kisole, Kunal Garg, Matthew Peet

Abstract: Finite-time stability (FTS) of a differential equation guarantees that solutions reach a given equilibrium point in finite time, where the time of convergence depends on the initial state of the system. For traditional stability notions such as exponential stability, the convex optimization framework of Sum-of-Squares (SoS) enables computation of polynomial Lyapunov functions to certify stability.… ▽ More Finite-time stability (FTS) of a differential equation guarantees that solutions reach a given equilibrium point in finite time, where the time of convergence depends on the initial state of the system. For traditional stability notions such as exponential stability, the convex optimization framework of Sum-of-Squares (SoS) enables computation of polynomial Lyapunov functions to certify stability. However, finite-time stable systems are characterized by non-Lipschitz, non-polynomial vector fields, rendering standard SoS methods inapplicable. To this end, we show that computation of a non-polynomial Lyapunov function certifying finite-time stability can be reformulated as feasibility of a set of polynomial inequalities under a particular transformation. As a result, SoS can be utilized to verify FTS and obtain a bound on the settling time. Numerical examples are used to demonstrate the accuracy of the conditions in both certifying finite-time stability and bounding the settling time. △ Less

Submitted 13 June, 2025; v1 submitted 19 January, 2025; originally announced January 2025.

Picard Iteration for Parameter Estimation in Nonlinear Ordinary Differential Equations

Authors: Aleksandr Talitckii, Matthew M. Peet

Abstract: We consider the problem of using experimental time-series data for parameter estimation in nonlinear ordinary differential equations, focusing on the case where the data is noisy, sparse, irregularly sampled, includes multiple experiments, and does not directly measure the system state or its time-derivative. To account for such low-quality data, we propose a new framework for gradient-based param… ▽ More We consider the problem of using experimental time-series data for parameter estimation in nonlinear ordinary differential equations, focusing on the case where the data is noisy, sparse, irregularly sampled, includes multiple experiments, and does not directly measure the system state or its time-derivative. To account for such low-quality data, we propose a new framework for gradient-based parameter estimation which uses the Picard operator to reformulate the problem as constrained optimization with infinite-dimensional variables and constraints. We then use the contractive properties of the Picard operator to propose a class of gradient-contractive algorithms and provide conditions under which such algorithms are guaranteed to converge to a local optima. The algorithms are then tested on a battery of models and variety of datasets in order to demonstrate robustness and improvement over alternative approaches. △ Less

Submitted 3 January, 2025; v1 submitted 28 December, 2024; originally announced December 2024.

$H_2$-Optimal Estimation of a Class of Linear PDE Systems using Partial Integral Equations

Authors: Danio Braghini, Sachin Shivakumar, Matthew M. Peet

Abstract: The $H_2$ norm is a commonly used performance metric in the design of estimators. However, $H_2$-optimal estimation of most PDEs is complicated by the lack of state-space and transfer function representations. To address this problem, we re-characterize the $H_2$-norm in terms of a map from initial condition to output. We then leverage the Partial Integral Equation (PIE) state-space representation… ▽ More The $H_2$ norm is a commonly used performance metric in the design of estimators. However, $H_2$-optimal estimation of most PDEs is complicated by the lack of state-space and transfer function representations. To address this problem, we re-characterize the $H_2$-norm in terms of a map from initial condition to output. We then leverage the Partial Integral Equation (PIE) state-space representation of systems of linear PDEs coupled with ODEs to recast this characterization of $H_2$ norm as a convex optimization problem defined in terms of Linear Partial Integral (LPI) inequalities. We then parameterize a class of PIE-based observers and formulate the associated $H_2$-optimal estimation problem. The optimal observer synthesis problem is then recast as an LPI, and the resulting observers are validated using numerical simulation. △ Less

Submitted 3 November, 2024; originally announced November 2024.

A Computational Method for $H_2$-optimal Estimator and State Feedback Controller Synthesis for PDEs

Authors: Sachin Shivakumar, Matthew Peet

Abstract: In this paper, we present solvable, convex formulations of $H_2$-optimal state estimation and state-feedback control problems for a general class of linear Partial Differential Equations (PDEs) with one spatial dimension. These convex formulations are derived by using an analysis and control framework called the `Partial Integral Equation' (PIE) framework, which utilizes the PIE representation of… ▽ More In this paper, we present solvable, convex formulations of $H_2$-optimal state estimation and state-feedback control problems for a general class of linear Partial Differential Equations (PDEs) with one spatial dimension. These convex formulations are derived by using an analysis and control framework called the `Partial Integral Equation' (PIE) framework, which utilizes the PIE representation of infinite-dimensional systems. Since PIEs are parameterized by Partial Integral (PI) operators that form an algebra, $H_2$-optimal estimation and control problems for PIEs can be formulated as Linear PI Inequalities (LPIs). Furthermore, if a PDE admits a PIE representation, then the stability and $H_2$ performance of the PIE system implies that of the PDE system. Consequently, the optimal estimator and controller obtained for a PIE using LPIs provide the same stability and performance when applied to the corresponding PDE. These LPI optimization problems can be solved computationally using semi-definite programming solvers because such problems can be formulated using Linear Matrix Inequalities by using positive matrices to parameterize a cone of positive PI operators. We illustrate the application of these methods by constructing observers and controllers for some standard PDE examples. △ Less

Submitted 25 April, 2024; v1 submitted 12 March, 2024; originally announced March 2024.

Model Predictive Bang-Bang Controller Synthesis via Approximate Value Functions

Authors: Morgan Jones, Yuanbo Nie, Matthew M. Peet

Abstract: In this paper, we propose a novel method for addressing Optimal Control Problems (OCPs) with input-affine dynamics and cost functions. This approach adopts a Model Predictive Control (MPC) strategy, wherein a controller is synthesized to handle an approximated OCP within a finite time horizon. Upon reaching this horizon, the controller is re-calibrated to tackle another approximation of the OCP, w… ▽ More In this paper, we propose a novel method for addressing Optimal Control Problems (OCPs) with input-affine dynamics and cost functions. This approach adopts a Model Predictive Control (MPC) strategy, wherein a controller is synthesized to handle an approximated OCP within a finite time horizon. Upon reaching this horizon, the controller is re-calibrated to tackle another approximation of the OCP, with the approximation updated based on the final state and time information. To tackle each OCP instance, all non-polynomial terms are Taylor-expanded about the current time and state and the resulting Hamilton-Jacobi-Bellman (HJB) PDE is solved via Sum-of-Squares (SOS) programming, providing us with an approximate polynomial value function that can be used to synthesize a bang-bang controller. △ Less

Submitted 16 June, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

$H_{\infty}$-Optimal Estimator Synthesis for Coupled Linear 2D PDEs using Convex Optimization

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: Any suitably well-posed PDE in two spatial dimensions can be represented as a Partial Integral Equation (PIE) -- with system dynamics parameterized using Partial Integral (PI) operators. Furthermore, $L_2$-gain analysis of PDEs with a PIE representation can be posed as a linear operator inequality, which can be solved using convex optimization. In this paper, these results are used to derive a con… ▽ More Any suitably well-posed PDE in two spatial dimensions can be represented as a Partial Integral Equation (PIE) -- with system dynamics parameterized using Partial Integral (PI) operators. Furthermore, $L_2$-gain analysis of PDEs with a PIE representation can be posed as a linear operator inequality, which can be solved using convex optimization. In this paper, these results are used to derive a convex-optimization-based test for constructing an $H_{\infty}$-optimal estimator for 2D PDEs. In particular, we first use PIEs to represent an arbitrary well-posed 2D PDE where sensor measurements occur along some boundary of the domain. An associated Luenberger-type estimator is then parameterized using a PI operator $\mathcal{L}$ as the observer gain. Examining the error dynamics of this estimator, it is proven that an upper bound on the $H_{\infty}$-norm of these error dynamics can be minimized by solving a linear operator inequality on PI operator variables. Finally, an analytical formula is proposed for inversion of a class of 2D PI operators, which is then used to reconstruct the Luenberger gain $\mathcal{L}$. Results are implemented in the PIETOOLS software suite -- applying the methodology and simulating the resulting observer for an unstable 2D heat equation with boundary observations. △ Less

Submitted 16 June, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

Constructive Representation of Functions in $N$-Dimensional Sobolev Space

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: A new representation is proposed for functions in a Sobolev space with dominating mixed smoothness on an $N$-dimensional hyperrectangle. In particular, it is shown that these functions can be expressed in terms of their highest-order mixed derivative, as well as their lower-order derivatives evaluated along suitable boundaries of the domain. The proposed expansion is proven to be invertible, uniqu… ▽ More A new representation is proposed for functions in a Sobolev space with dominating mixed smoothness on an $N$-dimensional hyperrectangle. In particular, it is shown that these functions can be expressed in terms of their highest-order mixed derivative, as well as their lower-order derivatives evaluated along suitable boundaries of the domain. The proposed expansion is proven to be invertible, uniquely identifying any function in the Sobolev space with its derivatives and boundary values. Since these boundary values are either finite-dimensional, or exist in the space of square-integrable functions, this offers a bijective relation between the Sobolev space and $L_{2}$. Using this bijection, it is shown how approximation of functions in Sobolev space can be performed in the less restrictive space $L_{2}$, reconstructing such an approximation of the function from an $L_{2}$-optimal projection of its boundary values and highest-order derivative. This approximation method is presented using a basis of Legendre polynomials and a basis of step functions, and results using both bases are demonstrated to exhibit better convergence behavior than a direct projection approach for two numerical examples. △ Less

Submitted 29 April, 2024; v1 submitted 15 November, 2023; originally announced December 2023.

Integral Quadratic Constraints with Infinite-Dimensional Channels

Authors: Aleksandr Talitckii, Peter Seiler, Matthew M. Peet

Abstract: Modern control theory provides us with a spectrum of methods for studying the interconnection of dynamic systems using input-output properties of the interconnected subsystems. Perhaps the most advanced framework for such input-output analysis is the use of Integral Quadratic Constraints (IQCs), which considers the interconnection of a nominal linear system with an unmodelled nonlinear or uncertai… ▽ More Modern control theory provides us with a spectrum of methods for studying the interconnection of dynamic systems using input-output properties of the interconnected subsystems. Perhaps the most advanced framework for such input-output analysis is the use of Integral Quadratic Constraints (IQCs), which considers the interconnection of a nominal linear system with an unmodelled nonlinear or uncertain subsystem with known input-output properties. Although these methods are widely used for Ordinary Differential Equations (ODEs), there have been fewer attempts to extend IQCs to infinite-dimensional systems. In this paper, we present an IQC-based framework for Partial Differential Equations (PDEs) and Delay Differential Equations (DDEs). First, we introduce infinite-dimensional signal spaces, operators, and feedback interconnections. Next, in the main result, we propose a formulation of hard IQC-based input-output stability conditions, allowing for infinite-dimensional multipliers. We then show how to test hard IQC conditions with infinite-dimensional multipliers on a nominal linear PDE or DDE system via the Partial Integral Equation (PIE) state-space representation using a sufficient version of the Kalman-Yakubovich-Popov lemma (KYP). The results are then illustrated using four example problems with uncertainty and nonlinearity. △ Less

Submitted 1 September, 2023; originally announced September 2023.

Efficient Convex Algorithms for Universal Kernel Learning

Authors: Aleksandr Talitckii, Brendon K. Colbert, Matthew M. Peet

Abstract: The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for tractability); be dense in the set of all kernels (for robustness); be universal (for accuracy). Recently, a framework was proposed for using positive matrices to param… ▽ More The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for tractability); be dense in the set of all kernels (for robustness); be universal (for accuracy). Recently, a framework was proposed for using positive matrices to parameterize a class of positive semi-separable kernels. Although this class can be shown to meet all three criteria, previous algorithms for optimization of such kernels were limited to classification and furthermore relied on computationally complex Semidefinite Programming (SDP) algorithms. In this paper, we pose the problem of learning semiseparable kernels as a minimax optimization problem and propose a SVD-QCQP primal-dual algorithm which dramatically reduces the computational complexity as compared with previous SDP-based approaches. Furthermore, we provide an efficient implementation of this algorithm for both classification and regression -- an implementation which enables us to solve problems with 100 features and up to 30,000 datums. Finally, when applied to benchmark data, the algorithm demonstrates the potential for significant improvement in accuracy over typical (but non-convex) approaches such as Neural Nets and Random Forest with similar or better computation time. △ Less

Submitted 28 October, 2024; v1 submitted 15 April, 2023; originally announced April 2023.

A PIE Representation of Scalar Quadratic PDEs and Global Stability Analysis Using SDP

Authors: Declan Jagt, Peter Seiler, Matthew Peet

Abstract: It has recently been shown that the evolution of a linear Partial Differential Equation (PDE) can be more conveniently represented in terms of the evolution of a higher spatial derivative of the state. This higher spatial derivative (termed the `fundamental state') lies in $L_2$ - requiring no auxiliary boundary conditions or continuity constraints. Such a representation (termed a Partial Integral… ▽ More It has recently been shown that the evolution of a linear Partial Differential Equation (PDE) can be more conveniently represented in terms of the evolution of a higher spatial derivative of the state. This higher spatial derivative (termed the `fundamental state') lies in $L_2$ - requiring no auxiliary boundary conditions or continuity constraints. Such a representation (termed a Partial Integral Equation or PIE) is then defined in terms of an algebra of bounded integral operators (termed Partial Integral (PI) operators) and is constructed by identifying a unitary map from the fundamental state to the state of the original PDE. Unfortunately, when the PDE is nonlinear, the dynamics of the associated fundamental state are no longer parameterized in terms of PI operators. However, in this paper, we show that such dynamics can be compactly represented using a new tensor algebra of partial integral operators acting on the tensor product of the fundamental state. We further show that this tensor product of the fundamental state forms a natural distributed equivalent of the monomial basis used in representation of polynomials on a finite-dimensional space. This new representation is then used to provide a simple SDP-based Lyapunov test of stability of quadratic PDEs. The test is applied to three illustrative examples of quadratic PDEs. △ Less

Submitted 9 September, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

Representation of linear PDEs with spatial integral terms as Partial Integral Equations

Authors: Sachin Shivakumar, Amritam Das, Matthew Peet

Abstract: In this paper, we present the Partial Integral Equation (PIE) representation of linear Partial Differential Equations (PDEs) in one spatial dimension, where the PDE has spatial integral terms appearing in the dynamics and the boundary conditions. The PIE representation is obtained by performing a change of variable where every PDE state is replaced by its highest, well-defined derivative using the… ▽ More In this paper, we present the Partial Integral Equation (PIE) representation of linear Partial Differential Equations (PDEs) in one spatial dimension, where the PDE has spatial integral terms appearing in the dynamics and the boundary conditions. The PIE representation is obtained by performing a change of variable where every PDE state is replaced by its highest, well-defined derivative using the Fundamental Theorem of Calculus to obtain a new equation (a PIE). We show that this conversion from PDE representation to PIE representation can be written in terms of explicit maps from the PDE parameters to PIE parameters. Lastly, we present numerical examples to demonstrate the application of the PIE representation by performing stability analysis of PDEs via convex optimization methods. △ Less

Submitted 15 December, 2022; originally announced December 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2204.00186

Representation of PDE Systems with Delay and Stability Analysis using Convex Optimization -- Extended Version

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: Partial Integral Equations (PIEs) have been used to represent both systems with delay and systems of Partial Differential Equations (PDEs) in one or two spatial dimensions. In this paper, we show that these results can be combined to obtain a PIE representation of any suitably well-posed 1D PDE model with constant delay. In particular, we represent these delayed PDE systems as coupled systems of 1… ▽ More Partial Integral Equations (PIEs) have been used to represent both systems with delay and systems of Partial Differential Equations (PDEs) in one or two spatial dimensions. In this paper, we show that these results can be combined to obtain a PIE representation of any suitably well-posed 1D PDE model with constant delay. In particular, we represent these delayed PDE systems as coupled systems of 1D and 2D PDEs, obtaining a PIE representation of both subsystems. Taking the feedback interconnection of these PIE subsystems, we then obtain a 2D PIE representation of the 1D PDE with delay. Next, based on the PIE representation, we formulate the problem of stability analysis as convex optimization of positive operators which can be solved using the PIETOOLS software suite. We apply the result to PDE examples with delay in the state and boundary conditions. △ Less

Submitted 21 November, 2023; v1 submitted 9 November, 2022; originally announced November 2022.

Journal ref: IEEE Control Systems Letters, vol 7, pp 3627-3632, 2023

Existence of Partially Quadratic Lyapunov Functions That Can Certify The Local Asymptotic Stability of Nonlinear Systems

Authors: Morgan Jones, Matthew M. Peet

Abstract: This paper proposes a method for certifying the local asymptotic stability of a given nonlinear Ordinary Differential Equation (ODE) by using Sum-of-Squares (SOS) programming to search for a partially quadratic Lyapunov Function (LF). The proposed method is particularly well suited to the stability analysis of ODEs with high dimensional state spaces. This is due to the fact that partially quadrati… ▽ More This paper proposes a method for certifying the local asymptotic stability of a given nonlinear Ordinary Differential Equation (ODE) by using Sum-of-Squares (SOS) programming to search for a partially quadratic Lyapunov Function (LF). The proposed method is particularly well suited to the stability analysis of ODEs with high dimensional state spaces. This is due to the fact that partially quadratic LFs are parametrized by fewer decision variables when compared with general SOS LFs. The main contribution of this paper is using the Center Manifold Theorem to show that partially quadratic LFs that certify the local asymptotic stability of a given ODE exist under certain conditions. △ Less

Submitted 15 September, 2022; originally announced September 2022.

Dual Representations and $H_{\infty}$-Optimal Control of Partial Differential Equations

Authors: Sachin Shivakumar, Amritam Das, Matthew Peet

Abstract: We consider $H_{\infty}$-optimal state-feedback control of the class of linear Partial Differential Equations (PDEs) class, which admit a Partial Integral Equation (PIE) representation. While linear matrix inequalities are commonly used for optimal control of Ordinary Differential Equations (ODEs), the absence of a universal state-space representation and suitable dual form prevents such methods f… ▽ More We consider $H_{\infty}$-optimal state-feedback control of the class of linear Partial Differential Equations (PDEs) class, which admit a Partial Integral Equation (PIE) representation. While linear matrix inequalities are commonly used for optimal control of Ordinary Differential Equations (ODEs), the absence of a universal state-space representation and suitable dual form prevents such methods from being applied to optimal control of PDEs. Specifically, for ODEs, the controller synthesis problem is defined in state-space, and duality is used to resolve the bilinearity of that synthesis problem. Recently, the PIE representation was proposed as a universal state-space representation for linear PDE systems. In this paper, we show that any PDE system represented by a PIE admits a dual PIE with identical stability and I/O properties. This result allows us to reformulate the stabilizing and optimal state-feedback control problems as convex optimization over the cone of positive Partial Integral (PI) operators. Operator inversion formulae then allow us to construct feedback gains for the original PDE system. The results are verified through application to several canonical problems in optimal control of PDEs. △ Less

Submitted 30 September, 2024; v1 submitted 27 August, 2022; originally announced August 2022.

Comments: arXiv admin note: text overlap with arXiv:2004.03638 Authors' note: This is an extended version of the conference paper which was previously uploaded as arXiv:2004.03638

Employing Feature Selection Algorithms to Determine the Immune State of a Mouse Model of Rheumatoid Arthritis

Authors: Brendon K. Colbert, Joslyn L. Mangal, Aleksandr Talitckii, Abhinav P. Acharya, Matthew M. Peet

Abstract: The immune response is a dynamic process by which the body determines whether an antigen is self or nonself. The state of this dynamic process is defined by the relative balance and population of inflammatory and regulatory actors which comprise this decision making process. The goal of immunotherapy as applied to, e.g. Rheumatoid Arthritis (RA), then, is to bias the immune state in favor of the r… ▽ More The immune response is a dynamic process by which the body determines whether an antigen is self or nonself. The state of this dynamic process is defined by the relative balance and population of inflammatory and regulatory actors which comprise this decision making process. The goal of immunotherapy as applied to, e.g. Rheumatoid Arthritis (RA), then, is to bias the immune state in favor of the regulatory actors - thereby shutting down autoimmune pathways in the response. While there are several known approaches to immunotherapy, the effectiveness of the therapy will depend on how this intervention alters the evolution of this state. Unfortunately, this process is determined not only by the dynamics of the process, but the state of the system at the time of intervention - a state which is difficult if not impossible to determine prior to application of the therapy. To identify such states we consider a mouse model of RA (Collagen-Induced Arthritis (CIA)) immunotherapy; collect high dimensional data on T cell markers and populations of mice after treatment with a recently developed immunotherapy for CIA; and use feature selection algorithms in order to select a lower dimensional subset of this data which can be used to predict both the full set of T cell markers and populations, along with the efficacy of immunotherapy treatment. △ Less

Submitted 21 October, 2023; v1 submitted 12 July, 2022; originally announced July 2022.

Extension of the Partial Integral Equation Representation to GPDE Input-Output Systems

Authors: Sachin Shivakumar, Amritam Das, Siep Weiland, Matthew Peet

Abstract: It has been shown that the existence of a Partial Integral Equation (PIE) representation of a Partial Differential Equation (PDE) simplifies many numerical aspects of analysis, simulation, and optimal control. However, the PIE representation has not previously been extended to many of the complex, higher-order PDEs such as may be encountered in speculative or data-based models. In this paper, we p… ▽ More It has been shown that the existence of a Partial Integral Equation (PIE) representation of a Partial Differential Equation (PDE) simplifies many numerical aspects of analysis, simulation, and optimal control. However, the PIE representation has not previously been extended to many of the complex, higher-order PDEs such as may be encountered in speculative or data-based models. In this paper, we propose PIE representations for a large class of such PDE models, including higher-order derivatives, boundary-valued inputs, and coupling with Ordinary Differential Equations. The main technical contribution which enables this extension is a generalization of Cauchy's rule for repeated integration. The process of conversion of a complex PDE model to a PIE is simplified through a PDE modeling interface in the open-source software PIETOOLS. Several numerical tests and illustrations are used to demonstrate the results. △ Less

Submitted 12 March, 2024; v1 submitted 7 May, 2022; originally announced May 2022.

Computational stability analysis of PDEs with integral terms using the PIE framework

Authors: Sachin Shivakumar, Matthew Peet

Abstract: The Partial Integral Equation (PIE) framework was developed to computationally analyze linear Partial Differential Equations (PDEs) where the PDE is first converted to a PIE and then the analysis problem is solved by solving operator-valued optimization problems. Previous works on the PIE framework focused on the analysis of PDEs with spatial derivatives up to $2^{nd}$-order. In this paper, we ext… ▽ More The Partial Integral Equation (PIE) framework was developed to computationally analyze linear Partial Differential Equations (PDEs) where the PDE is first converted to a PIE and then the analysis problem is solved by solving operator-valued optimization problems. Previous works on the PIE framework focused on the analysis of PDEs with spatial derivatives up to $2^{nd}$-order. In this paper, we extend the class of PDEs by including integral terms and performing stability analysis using the PIE framework. More specifically, we show that PDEs with the integral terms where the integration is with respect to the spatial variable and the kernel of the integral operator is matrix-valued polynomials can be converted to PIEs if the boundary conditions satisfy certain criteria. The conversion is performed by using a change of variable where every PDE state is substituted in terms of its highest derivative and boundary values to obtain a new equation (a PIE) in a variable that does not have any continuity requirements. Later, we show that this change of variable can be represented using explicit maps from the parameters of the PDE to the parameters of the PIE and the stability test can be posed as an optimization problem involving these parameters. Lastly, we present numerical examples to demonstrate the simplicity and application of this method. △ Less

Submitted 31 March, 2022; originally announced April 2022.

$L_2$-Gain Analysis of Coupled Linear 2D PDEs using Linear PI Inequalities

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: In this paper, we present a new method for estimating the $L_2$-gain of systems governed by 2nd order linear Partial Differential Equations (PDEs) in two spatial variables, using semidefinite programming. It has previously been shown that, for any such PDE, an equivalent Partial Integral Equation (PIE) can be derived. These PIEs are expressed in terms of Partial Integral (PI) operators mapping sta… ▽ More In this paper, we present a new method for estimating the $L_2$-gain of systems governed by 2nd order linear Partial Differential Equations (PDEs) in two spatial variables, using semidefinite programming. It has previously been shown that, for any such PDE, an equivalent Partial Integral Equation (PIE) can be derived. These PIEs are expressed in terms of Partial Integral (PI) operators mapping states in $L_2[Ω]$, and are free of the boundary and continuity constraints appearing in PDEs. In this paper, we extend the 2D PIE representation to include input and output signals in $\mathbb{R}^n$, deriving a bijective map between solutions of the PDE and the PIE, along with the necessary formulae to convert between the two representations. Next, using the algebraic properties of PI operators, we prove that an upper bound on the $L_2$-gain of PIEs can be verified by testing feasibility of a Linear PI Inequality (LPI), defined by a positivity constraint on a PI operator mapping $\mathbb{R}^n\times L_2[Ω]$. Finally, we use positive matrices to parameterize a cone of positive PI operators on $\mathbb{R}^n\times L_2[Ω]$, allowing feasibility of the $L_2$-gain LPI to be tested using semidefinite programming. We implement this test in the MATLAB toolbox PIETOOLS, and demonstrate that this approach allows an upper bound on the $L_2$-gain of PDEs to be estimated with little conservatism. △ Less

Submitted 11 September, 2022; v1 submitted 29 March, 2022; originally announced March 2022.

Journal ref: Proceedings of the 61st IEEE Conference on Decision and Control, 2022, pp. 6097-6104

Efficient Data Structures for Exploiting Sparsity and Structure in Representation of Polynomial Optimization Problems: Implementation in SOSTOOLS

Authors: Declan Jagt, Sachin Shivakumar, Peter Seiler, Matthew Peet

Abstract: We present a new data structure for representation of polynomial variables in the parsing of sum-of-squares (SOS) programs. In SOS programs, the variables $s(x;Q)$ are polynomial in the independent variables $x$, but linear in the decision variables $Q$. Current SOS parsers, however, fail to exploit the semi-linear structure of the polynomial variables, treating the decision variables as independe… ▽ More We present a new data structure for representation of polynomial variables in the parsing of sum-of-squares (SOS) programs. In SOS programs, the variables $s(x;Q)$ are polynomial in the independent variables $x$, but linear in the decision variables $Q$. Current SOS parsers, however, fail to exploit the semi-linear structure of the polynomial variables, treating the decision variables as independent variables in their representation. This results in unnecessary overhead in storage and manipulation of the polynomial variables, prohibiting the parser from addressing larger-scale optimization problems. To eliminate this computational overhead, we introduce a new representation of polynomial variables, the "dpvar" structure, that is affine in the decision variables. We show that the complexity of operations on variables in the dpvar representation scales favorably with the number of decision variables. We further show that the required memory for storing polynomial variables is relatively small using the dpvar structure, particularly when exploiting the MATLAB sparse storage structure. Finally, we incorporate the dpvar data structure into SOSTOOLS 4.00, and test the performance of the parser for several polynomial optimization problems. △ Less

Submitted 2 September, 2022; v1 submitted 3 March, 2022; originally announced March 2022.

Journal ref: IEEE Control Systems Letters, vol. 6, pp. 3493-3498, 2022

Combining Trajectory Data with Analytical Lyapunov Functions for Improved Region of Attraction Estimation

Authors: Lucas Lugnani, Morgan Jones, Luís F. C. Alberto, Mathew Peet, Daniel Dotta

Abstract: The increasing uptake of inverter based resources (IBRs) has resulted in many new challenges for power system operators around the world. The high level of complexity of IBR generators makes accurate classical model-based stability analysis a difficult task. This paper proposes a novel methodology for solving the problem of estimating the Region of Attraction (ROA) of a nonlinear system by combini… ▽ More The increasing uptake of inverter based resources (IBRs) has resulted in many new challenges for power system operators around the world. The high level of complexity of IBR generators makes accurate classical model-based stability analysis a difficult task. This paper proposes a novel methodology for solving the problem of estimating the Region of Attraction (ROA) of a nonlinear system by combining classical model based methods with modern data driven methods. Our method yields certifiable inner approximations of the ROA, typical to that of model based methods, but also harnesses trajectory data to yield an improved accurate ROA estimation. The method is carried out by using analytical Lyapunov functions, such as energy functions, in combination with data that is used to fit a converse Lyapunov function. Our methodology is independent of the function fitting method used. In this work, for implementation purposes, we use Bernstein polynomials to function fit. Several numerical examples of ROA estimation are provided, including the Single Machine Infinite Bus (SMIB) system, a three machine system and the Van-der-Pol system. △ Less

Submitted 20 June, 2022; v1 submitted 17 November, 2021; originally announced November 2021.

Comments: 6 pages, 4 figures

A Converse Sum of Squares Lyapunov Function for Outer Approximation of Minimal Attractor Sets of Nonlinear Systems

Authors: Morgan Jones, Matthew M. Peet

Abstract: Many dynamical systems described by nonlinear ODEs are unstable. Their associated solutions do not converge towards an equilibrium point, but rather converge towards some invariant subset of the state space called an attractor set. For a given ODE, in general, the existence, shape and structure of the attractor sets of the ODE are unknown. Fortunately, the sublevel sets of Lyapunov functions can p… ▽ More Many dynamical systems described by nonlinear ODEs are unstable. Their associated solutions do not converge towards an equilibrium point, but rather converge towards some invariant subset of the state space called an attractor set. For a given ODE, in general, the existence, shape and structure of the attractor sets of the ODE are unknown. Fortunately, the sublevel sets of Lyapunov functions can provide bounds on the attractor sets of ODEs. In this paper we propose a new Lyapunov characterization of attractor sets that is well suited to the problem of finding the minimal attractor set. We show our Lyapunov characterization is non-conservative even when restricted to Sum-of-Squares (SOS) Lyapunov functions. Given these results, we propose a SOS programming problem based on determinant maximization that yields an SOS Lyapunov function whose 1-sublevel set has minimal volume, is an attractor set itself, and provides an optimal outer approximation of the minimal attractor set of the ODE. Several numerical examples are presented including the Lorenz attractor and Van-der-Pol oscillator. △ Less

Submitted 3 May, 2023; v1 submitted 6 October, 2021; originally announced October 2021.

A PIE Representation of Coupled Linear 2D PDEs and Stability Analysis using LPIs

Authors: Declan S. Jagt, Matthew M. Peet

Abstract: We introduce a Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in two spatial variables. PIEs are an algebraic state-space representation of infinite-dimensional systems and have been used to model 1D PDEs and time-delay systems without continuity constraints or boundary conditions -- making these PIE representations amenable to stability analysis using conv… ▽ More We introduce a Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in two spatial variables. PIEs are an algebraic state-space representation of infinite-dimensional systems and have been used to model 1D PDEs and time-delay systems without continuity constraints or boundary conditions -- making these PIE representations amenable to stability analysis using convex optimization. To extend the PIE framework to 2D PDEs, we first construct an algebra of Partial Integral (PI) operators on the function space L_2[x,y], providing formulae for composition, adjoint, and inversion. We then extend this algebra to R^n x L_2[x] x L_2[y] x L_2[x,y] and demonstrate that, for any suitable coupled, linear PDE in 2 spatial variables, there exists an associated PIE whose solutions bijectively map to solutions of the original PDE -- providing conversion formulae between these representations. Next, we use positive matrices to parameterize the convex cone of 2D PI operators -- allowing us to optimize PI operators and solve Linear PI Inequality (LPI) feasibility problems. Finally, we use the 2D LPI framework to provide conditions for stability of 2D linear PDEs. We test these conditions on 2D heat and wave equations and demonstrate that the stability condition has little to no conservatism. △ Less

Submitted 2 September, 2022; v1 submitted 14 September, 2021; originally announced September 2021.

Journal ref: Proceedings of the 2022 American Control Conference, 2022, pp. 1659-1666

Converse Lyapunov Functions and Converging Inner Approximations to Maximal Regions of Attraction of Nonlinear Systems

Authors: Morgan Jones, Matthew M. Peet

Abstract: This paper considers the problem of approximating the "maximal" region of attraction (the set that contains all asymptotically stable sets) of any given set of locally exponentially stable nonlinear Ordinary Differential Equations (ODEs) with a sufficiently smooth vector field. Given a locally exponential stable ODE with a differentiable vector field, we show that there exists a globally Lipschitz… ▽ More This paper considers the problem of approximating the "maximal" region of attraction (the set that contains all asymptotically stable sets) of any given set of locally exponentially stable nonlinear Ordinary Differential Equations (ODEs) with a sufficiently smooth vector field. Given a locally exponential stable ODE with a differentiable vector field, we show that there exists a globally Lipschitz continuous converse Lyapunov function whose 1-sublevel set is equal to the maximal region of attraction of the ODE. We then propose a sequence of d-degree Sum-of-Squares (SOS) programming problems that yields a sequence of polynomials that converges to our proposed converse Lyapunov function uniformly from above in the L1 norm. We show that each member of the sequence of 1-sublevel sets of the polynomial solutions to our proposed sequence of SOS programming problems are certifiably contained inside the maximal region of attraction of the ODE, and moreover, we show that this sequence of sublevel sets converges to the maximal region of attraction of the ODE with respect to the volume metric. We provide numerical examples of estimations of the maximal region of attraction for the Van der Pol oscillator and a three dimensional servomechanism. △ Less

Submitted 3 September, 2022; v1 submitted 23 March, 2021; originally announced March 2021.

PIETOOLS 2022: User Manual

Authors: Sachin Shivakumar, Declan Jagt, Danilo Braghini, Amritam Das, Matthew Peet

Abstract: PIETOOLS 2022 manual is a document that describes all the features of the MATLAB toolbox for the analysis and control of Partial Integral Equations (PIEs). The manual is aimed to guide, with examples, the first time users to three fundamental features of PIETOOLS: converting coupled ODE-PDEs, DDEs, DDFs, etc., to PIE representation; analysis of stability and input-output properties of PIEs; design… ▽ More PIETOOLS 2022 manual is a document that describes all the features of the MATLAB toolbox for the analysis and control of Partial Integral Equations (PIEs). The manual is aimed to guide, with examples, the first time users to three fundamental features of PIETOOLS: converting coupled ODE-PDEs, DDEs, DDFs, etc., to PIE representation; analysis of stability and input-output properties of PIEs; design of optimal observers and controllers for PIEs. The use of PIETOOLS is not limited to the features described above. However, the manual focuses on these features to provide a holistic understanding of the workflow of PIETOOLS, which will serve as a foundation to develop more complicated programs, for example, the design of boundary feedback controllers, robust observers, robust controllers, etc. △ Less

Submitted 7 December, 2022; v1 submitted 5 January, 2021; originally announced January 2021.

A New Treatment of Boundary Conditions in PDE Solution with Galerkin Methods via Partial Integral Equation Framework

Authors: Yulia T. Peet, Matthew M. Peet

Abstract: We present a new analytical and numerical framework for solution of Partial Differential Equations (PDEs) that is based on an exact transformation that moves the boundary constraints into the dynamics of the corresponding governing equation. The framework is based on a Partial Integral Equation (PIE) representation of PDEs, where a PDE equation is transformed into an equivalent PIE formulation tha… ▽ More We present a new analytical and numerical framework for solution of Partial Differential Equations (PDEs) that is based on an exact transformation that moves the boundary constraints into the dynamics of the corresponding governing equation. The framework is based on a Partial Integral Equation (PIE) representation of PDEs, where a PDE equation is transformed into an equivalent PIE formulation that does not require boundary conditions on its solution state. The PDE-PIE framework allows for a development of a generalized PIE-Galerkin approximation methodology for a broad class of linear PDEs with non-constant coefficients governed by non-periodic boundary conditions, including, e.g., Dirichlet, Neumann and Robin boundaries. The significance of this result is that solution to almost any linear PDE can now be constructed in a form of an analytical approximation based on a series expansion using a suitable set of basis functions, such as, e.g., Chebyshev polynomials of the first kind, irrespective of the boundary conditions. In many cases involving homogeneous or simple time-dependent boundary inputs, an analytical integration in time is also possible. We present several PDE solution examples in one spatial variable implemented with the developed PIE-Galerkin methodology using both analytical and numerical integration in time. The developed framework can be naturally extended to multiple spatial dimensions and, potentially, to nonlinear problems. △ Less

Submitted 10 February, 2023; v1 submitted 30 November, 2020; originally announced December 2020.

Comments: 42 pages, 9 figures

MSC Class: 65M70; 65M22; 65M12

Polynomial Approximation of Value Functions and Nonlinear Controller Design with Performance Bounds

Authors: Morgan Jones, Matthew M. Peet

Abstract: For any suitable Optimal Control Problem (OCP) there exists a value function, defined as the unique viscosity solution to the Hamilton-Jacobi-Bellman (HJB) Partial-Differential-Equation (PDE), and which can be used to design an optimal feedback controller for the given OCP. In this paper, we approximately solve the HJB-PDE by proposing a sequence of Sum-Of-Squares (SOS) problems, each of which yie… ▽ More For any suitable Optimal Control Problem (OCP) there exists a value function, defined as the unique viscosity solution to the Hamilton-Jacobi-Bellman (HJB) Partial-Differential-Equation (PDE), and which can be used to design an optimal feedback controller for the given OCP. In this paper, we approximately solve the HJB-PDE by proposing a sequence of Sum-Of-Squares (SOS) problems, each of which yields a polynomial subsolution to the HJB-PDE. We show that the resulting sequence of polynomial sub-solutions converges to the value function of the OCP in the L1 norm. Furthermore, for each polynomial sub-solution in this sequence, we show that the associated sequence of sublevel sets converge to the sublevel set of the value function of the OCP in the volume metric. Next, for any approximate value function, obtained from an SOS program or any other method (e.g. discretization), we construct an associated feedback controller, and show that sub-optimality of this controller as applied to the OCP is bounded by the distance between the approximate and true value function of the OCP in the Sobolev norm. Finally, we demonstrate numerically that by solving our proposed SOS problem we are able to accurately approximate value functions, design controllers and estimate reachable sets. △ Less

Submitted 28 January, 2023; v1 submitted 14 October, 2020; originally announced October 2020.

The Orbital Mechanics of Space Elevator Launch Systems

Authors: Matthew M. Peet

Abstract: The construction of a space elevator would be an inspiring feat of planetary engineering of immense cost and risk. But would the benefit outweigh the costs and risks? What, precisely, is the purpose for building such a structure? For example, what if the space elevator could provide propellant-free (free release) orbital transfer to every planet in the solar system and beyond on a daily basis? In… ▽ More The construction of a space elevator would be an inspiring feat of planetary engineering of immense cost and risk. But would the benefit outweigh the costs and risks? What, precisely, is the purpose for building such a structure? For example, what if the space elevator could provide propellant-free (free release) orbital transfer to every planet in the solar system and beyond on a daily basis? In our view, this benefit might outweigh the costs and risks. But can a space elevator provide such a service? In this manuscript, we examine 3 tiers of space elevator launch system design and provide a detailed mathematical analysis of the orbital mechanics of spacecraft utilizing such designs. We find the limiting factor in all designs is the problem of transition to the ecliptic plane. For Tiers 1 and 2, we find that free release transfers to all the outer planets is possible, achieving velocities far beyond the ability of current Earth-based rocket technology, but with significant gaps in coverage due to planetary alignment. For Tier 3 elevators, however, we find that fast free release transfers to all planets in the solar system is possible on a daily basis. Finally, we show that Tier 2 and 3 space elevators can potentially use counterweights to perform staged slingshot maneuvers, providing a velocity multiplier which could dramatically reduce transit times to outer planets and interstellar destinations. △ Less

Submitted 15 August, 2020; v1 submitted 12 August, 2020; originally announced August 2020.

Comments: updated for final submission to journal Acta Astronautica

A Generalization of Bellman's Equation with Application to Path Planning, Obstacle Avoidance and Invariant Set Estimation

Authors: Morgan Jones, Matthew Peet

Abstract: The standard Dynamic Programming (DP) formulation can be used to solve Multi-Stage Optimization Problems (MSOP's) with additively separable objective functions. In this paper we consider a larger class of MSOP's with monotonically backward separable objective functions; additively separable functions being a special case of monotonically backward separable functions. We propose a necessary and suf… ▽ More The standard Dynamic Programming (DP) formulation can be used to solve Multi-Stage Optimization Problems (MSOP's) with additively separable objective functions. In this paper we consider a larger class of MSOP's with monotonically backward separable objective functions; additively separable functions being a special case of monotonically backward separable functions. We propose a necessary and sufficient condition, utilizing a generalization of Bellman's equation, for a solution of a MSOP, with a monotonically backward separable cost function, to be optimal. Moreover, we show that this proposed condition can be used to efficiently compute optimal solutions for two important MSOP's; the optimal path for Dubin's car with obstacle avoidance, and the maximal invariant set for discrete time systems. △ Less

Submitted 14 October, 2020; v1 submitted 15 June, 2020; originally announced June 2020.

Comments: Under review for Automatica

A New Algorithm for Tessellated Kernel Learning

Authors: Brendon K. Colbert, Matthew M. Peet

Abstract: The accuracy and complexity of machine learning algorithms based on kernel optimization are limited by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for tractability); be dense in the set of all kernels (for robustness); be universal (for accuracy). The recently proposed Tesselated Kernels (TKs) is currently the only known… ▽ More The accuracy and complexity of machine learning algorithms based on kernel optimization are limited by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for tractability); be dense in the set of all kernels (for robustness); be universal (for accuracy). The recently proposed Tesselated Kernels (TKs) is currently the only known class which meets all three criteria. However, previous algorithms for optimizing TKs were limited to classification and relied on Semidefinite Programming (SDP) - limiting them to relatively small datasets. By contrast, the 2-step algorithm proposed here scales to 10,000 data points and extends to the regression problem. Furthermore, when applied to benchmark data, the algorithm demonstrates significant improvement in performance over Neural Nets and SimpleMKL with similar computation time. △ Less

Submitted 13 June, 2020; originally announced June 2020.

Comments: 8 pages, 3 figures, pre-print

H\infty-Optimal Observer Design for Linear Systems with Delays in States, Outputs and Disturbances

Authors: Shuangshuang Wu, Sachin Shivakumar, Matthew M. Peet, Changchun Hua

Abstract: This paper considers the H\infty-optimal estimation problem for linear systems with multiple delays in states, output, and disturbances. First, we formulate the H\infty-optimal estimation problem in the Delay-Differential Equation (DDE) framework. Next, we construct an equivalent Partial Integral Equation (PIE) representation of the optimal estimator design framework. We then show that in the PIE… ▽ More This paper considers the H\infty-optimal estimation problem for linear systems with multiple delays in states, output, and disturbances. First, we formulate the H\infty-optimal estimation problem in the Delay-Differential Equation (DDE) framework. Next, we construct an equivalent Partial Integral Equation (PIE) representation of the optimal estimator design framework. We then show that in the PIE framework, the H\infty-optimal estimator synthesis problem can be posed as a Linear PI Inequality (LPI). LPIs are a generalization of LMIs to the algebra of Partial Integral (PI) operators and can be solved using the PIETOOLS toolbox. Finally, we convert the PIE representation of the optimal estimator back into an ODE-PDE representation - a form similar to a DDE, but with corrections to estimates of the infinite-dimensional state (the time-history). Numerical examples show that the synthesis condition we propose produces an estimator with provable H\infty-gain bound which is accurate to 4 decimal places when compared with results obtained using Pade-based discretization. △ Less

Submitted 9 April, 2020; originally announced April 2020.

Comments: 7 pages, 2 figures

Duality and $H_{\infty}$-Optimal Control Of Coupled ODE-PDE Systems

Authors: Sachin Shivakumar, Amritam Das, Siep Weiland, Matthew M. Peet

Abstract: In this paper, we present a convex formulation of $H_{\infty}$-optimal control problem for coupled linear ODE-PDE systems with one spatial dimension. First, we reformulate the coupled ODE-PDE system as a Partial Integral Equation (PIE) system and show that stability and $H_{\infty}$ performance of the PIE system implies that of the ODE-PDE system. We then construct a dual PIE system and show that… ▽ More In this paper, we present a convex formulation of $H_{\infty}$-optimal control problem for coupled linear ODE-PDE systems with one spatial dimension. First, we reformulate the coupled ODE-PDE system as a Partial Integral Equation (PIE) system and show that stability and $H_{\infty}$ performance of the PIE system implies that of the ODE-PDE system. We then construct a dual PIE system and show that asymptotic stability and $H_{\infty}$ performance of the dual system is equivalent to that of the primal PIE system. Next, we pose a convex dual formulation of the stability and $H_{\infty}$-performance problems using the Linear PI Inequality (LPI) framework. LPIs are a generalization of LMIs to Partial Integral (PI) operators and can be solved using PIETOOLS, a MATLAB toolbox. Next, we use our duality results to formulate the stabilization and $H_{\infty}$-optimal state-feedback control problems as LPIs. Finally, we illustrate the accuracy and scalability of the algorithms by constructing controllers for several numerical examples. △ Less

Submitted 24 June, 2020; v1 submitted 7 April, 2020; originally announced April 2020.

Sampling from Networks: Respondent-Driven Sampling

Authors: Mamadou Yauck, Erica E. M. Moodie, Herak Apelian, Marc-Messier Peet, Gilles Lambert, Daniel Grace, Nathan J. Lachowsky, Trevor Hart, Joseph Cox

Abstract: Respondent-Driven Sampling (RDS) is a variant of link-tracing, a sampling technique for surveying hard-to-reach communities that takes advantage of community members' social networks to reach potential participants. As a network-based sampling method, RDS is faced with the fundamental problem of sampling from population networks where features such as homophily (the tendency for individuals with s… ▽ More Respondent-Driven Sampling (RDS) is a variant of link-tracing, a sampling technique for surveying hard-to-reach communities that takes advantage of community members' social networks to reach potential participants. As a network-based sampling method, RDS is faced with the fundamental problem of sampling from population networks where features such as homophily (the tendency for individuals with similar traits to share social ties) and differential activity (the ratio of the average number of connections by attribute) are sensitive to the choice of a sampling method. Though not clearly described in the RDS literature, many simple methods exist to generate simulated RDS data, with specific levels of network features, where the focus is on estimating simple estimands. However, the accuracy of these methods in their abilities to consistently recover those targeted network features remains unclear. This is also motivated by recent findings that some population network parameters (e.g.~homophily) cannot be consistently estimated from the RDS data alone \citep{Crawford17}. In this paper, we conduct a simulation study to assess the accuracy of existing RDS simulation methods, in terms of their abilities to generate RDS samples with the desired levels of two network parameters: homophily and differential activity. The results show that (1) homophily cannot be consistently estimated from simulated RDS samples and (2) differential activity estimates are more precise when groups, defined by traits, are equally active and equally represented in the population. We use this approach to mimic features of the Engage Study, an RDS sample of gay, bisexual and other men who have sex with men in Montreal. △ Less

Submitted 14 August, 2020; v1 submitted 13 February, 2020; originally announced February 2020.

Representation of Networks and Systems with Delay: DDEs, DDFs, ODE-PDEs and PIEs

Authors: Matthew M. Peet

Abstract: Delay-Differential Equations (DDEs) are the most common representation for systems with delay. However, the DDE representation is limited. In network models with delay, the delayed channels are low-dimensional and accounting for this heterogeneity is not possible in the DDE framework. In addition, DDEs cannot be used to model difference equations. Furthermore, estimation and control of systems in… ▽ More Delay-Differential Equations (DDEs) are the most common representation for systems with delay. However, the DDE representation is limited. In network models with delay, the delayed channels are low-dimensional and accounting for this heterogeneity is not possible in the DDE framework. In addition, DDEs cannot be used to model difference equations. Furthermore, estimation and control of systems in DDE format has proven challenging, despite decades of study. In this paper, we examine alternative representations for systems with delay and provide formulae for conversion between representations. First, we examine the Differential-Difference (DDF) formulation which allows us to represent the low-dimensional nature of delayed information. Next, we examine the coupled ODE-PDE formulation, for which backstepping methods have recently become available. Finally, we consider the algebraic Partial-Integral Equation (PIE) representation, which allows the optimal estimation and control problems to be solved efficiently through the use of recent software packages such as PIETOOLS. In each case, we consider a very general class of delay systems, specifically accounting for all four possible sources of delay - state delay, input delay, output delay, and process delay. We then apply these representations to 3 archetypical network models. △ Less

Submitted 18 December, 2020; v1 submitted 9 October, 2019; originally announced October 2019.

PIETOOLS: A Matlab Toolbox for Manipulation and Optimization of Partial Integral Operators

Authors: Sachin Shivakumar, Amritam Das, Matthew M. Peet

Abstract: In this paper, we present PIETOOLS, a MATLAB toolbox for the construction and handling of Partial Integral (PI) operators. The toolbox introduces a new class of MATLAB object, opvar, for which standard MATLAB matrix operation syntax (e.g. +, *, ' e tc.) is defined. PI operators are a generalization of bounded linear operators on infinite-dimensional spaces that form a *-subalgebra with two binary… ▽ More In this paper, we present PIETOOLS, a MATLAB toolbox for the construction and handling of Partial Integral (PI) operators. The toolbox introduces a new class of MATLAB object, opvar, for which standard MATLAB matrix operation syntax (e.g. +, *, ' e tc.) is defined. PI operators are a generalization of bounded linear operators on infinite-dimensional spaces that form a *-subalgebra with two binary operations (addition and composition) on the space RxL2. These operators frequently appear in analysis and control of infinite-dimensional systems such as Partial Differential equations (PDE) and Time-delay systems (TDS). Furthermore, PIETOOLS can: declare opvar decision variables, add operator positivity constraints, declare an objective function, and solve the resulting optimization problem using a syntax similar to the sdpvar class in YALMIP. Use of the resulting Linear Operator Inequalities (LOIs) are demonstrated on several examples, including stability analysis of a PDE, bounding operator norms, and verifying integral inequalities. The result is that PIETOOLS, packaged with SOSTOOLS and MULTIPOLY, offers a scalable, user-friendly and computationally efficient toolbox for parsing, performing algebraic operations, setting up and solving convex optimization problems on PI operators. △ Less

Submitted 29 April, 2020; v1 submitted 3 October, 2019; originally announced October 2019.

Estimator-Based Output-Feedback Stabilization of Linear Multi-Delay Systems using SOS

Authors: Shuangshuang Wu, Matthew M. Peet, Changchun Hua

Abstract: In this paper, we investigate the estimator-based output feedback control problem of multi-delay systems. This work is an extension of recently developed operator-value LMI framework for infinite-dimensional time-delay systems. Based on the optimal convex state feedback controller and generalized Luenberger observer synthesis conditions we already have, the estimator-based output feedback controll… ▽ More In this paper, we investigate the estimator-based output feedback control problem of multi-delay systems. This work is an extension of recently developed operator-value LMI framework for infinite-dimensional time-delay systems. Based on the optimal convex state feedback controller and generalized Luenberger observer synthesis conditions we already have, the estimator-based output feedback controller is designed to contain the estimates of both the present state and history of the state. An output feedback controller synthesis condition is proposed using SOS method, which is expressed in a set of LMI/SDP constraints. The simulation examples are displayed to demonstrate the effectiveness and advantages of the proposed results. △ Less

Submitted 12 September, 2019; originally announced September 2019.

Comments: This is the accepted version of 59th IEEE CDC conference

A Generalized LMI Formulation for Input-Output Analysis of Linear Systems of ODEs Coupled with PDEs

Authors: Sachin Shivakumar, Amritam Das, Siep Weiland, Matthew M. Peet

Abstract: In this paper, we consider input-output properties of linear systems consisting of PDEs on a finite domain coupled with ODEs through the boundary conditions of the PDE. This framework can be used to represent e.g. a lumped mass fixed to a beam or a system with delay. This work generalizes the sufficiency proof of the KYP Lemma for ODEs to coupled ODE-PDE systems using a recently developed concept… ▽ More In this paper, we consider input-output properties of linear systems consisting of PDEs on a finite domain coupled with ODEs through the boundary conditions of the PDE. This framework can be used to represent e.g. a lumped mass fixed to a beam or a system with delay. This work generalizes the sufficiency proof of the KYP Lemma for ODEs to coupled ODE-PDE systems using a recently developed concept of fundamental state and the associated boundary-condition-free representation. The conditions of the generalized KYP are tested using the PQRS positive matrix parameterization of operators resulting in a finite-dimensional LMI, feasibility of which implies prima facie provable passivity or L2-gain of the system. No discretization or approximation is involved at any step and we use numerical examples to demonstrate that the bounds obtained are not conservative in any significant sense and that computational complexity is lower than existing methods involving finite-dimensional projection of PDEs. △ Less

Submitted 29 April, 2020; v1 submitted 22 April, 2019; originally announced April 2019.

Relaxing The Hamilton Jacobi Bellman Equation To Construct Inner And Outer Bounds On Reachable Sets

Authors: Morgan Jones, Matthew M. Peet

Abstract: We consider the problem of overbounding and underbounding both the backward and forward reachable set for a given polynomial vector field, nonlinear in both state and input, with a given semialgebriac set of initial conditions and with inputs constrained pointwise to lie in a semialgebraic set. Specifically, we represent the forward reachable set using the value function which gives the optimal co… ▽ More We consider the problem of overbounding and underbounding both the backward and forward reachable set for a given polynomial vector field, nonlinear in both state and input, with a given semialgebriac set of initial conditions and with inputs constrained pointwise to lie in a semialgebraic set. Specifically, we represent the forward reachable set using the value function which gives the optimal cost to go of an optimal control problems and if smooth satisfies the Hamilton-Jacobi- Bellman PDE. We then show that there exist polynomial upper and lower bounds to this value function and furthermore, these polynomial sub-value and super-value functions provide provable upper and lower bounds to the forward reachable set. Finally, by minimizing the distance between these sub-value and super-value functions in the L1-norm, we are able to construct inner and outer bounds for the reachable set and show numerically on several examples that for relatively small degree, the Hausdorff distance between these bounds is negligible. △ Less

Submitted 18 March, 2019; originally announced March 2019.

Journal ref: 2019 IEEE 58th Conference on Decision and Control (CDC)

Using SOS and Sublevel Set Volume Minimization for Estimation of Forward Reachable Sets

Authors: Morgan Jones, Matthew M. Peet

Abstract: In this paper we propose a convex Sum-of-Squares optimization problem for finding outer approximations of forward reachable sets for nonlinear uncertain Ordinary Differential Equations (ODE's) with either (or both) L2 or point-wise bounded input disturbances. To make our approximations tight we seek to minimize the volume of our approximation set. Our approach to volume minimization is based on th… ▽ More In this paper we propose a convex Sum-of-Squares optimization problem for finding outer approximations of forward reachable sets for nonlinear uncertain Ordinary Differential Equations (ODE's) with either (or both) L2 or point-wise bounded input disturbances. To make our approximations tight we seek to minimize the volume of our approximation set. Our approach to volume minimization is based on the use of a convex determinant-like objective function. We provide several numerical examples including the Lorenz system and the Van der Pol oscillator. △ Less

Submitted 30 January, 2019; originally announced January 2019.

Representation and Stability Analysis of PDE-ODE Coupled Systems

Authors: Amritam Das, Sachin Shivakumar, Siep Weiland, Matthew Peet

Abstract: In this work, we present a scalable Linear Matrix Inequality (LMI) based framework to verify the stability of a set of linear Partial Differential Equations (PDEs) in one spatial dimension coupled with a set of Ordinary Differential Equations (ODEs) via input-output based interconnection. Our approach extends the newly developed state space representation and stability analysis of coupled PDEs tha… ▽ More In this work, we present a scalable Linear Matrix Inequality (LMI) based framework to verify the stability of a set of linear Partial Differential Equations (PDEs) in one spatial dimension coupled with a set of Ordinary Differential Equations (ODEs) via input-output based interconnection. Our approach extends the newly developed state space representation and stability analysis of coupled PDEs that allows parametrizing the Lyapunov function on $L_2$ with multipliers and integral operators using polynomial kernels of semi-separable class. In particular, under arbitrary well-posed boundary conditions, we define the linear operator inequalities on $\mathbb{R}^n \times L_2$ and cast the stability condition as a feasibility problem constrained by LMIs. In this framework, no discretization or approximation is required to verify the stability conditions of PDE-ODE coupled systems. The developed algorithm has been implemented in MATLAB where the stability of example PDE-ODE coupled systems are verified. △ Less

Submitted 19 December, 2018; v1 submitted 18 December, 2018; originally announced December 2018.

A Partial Integral Equation (PIE) Representation of Coupled Linear PDEs and Scalable Stability Analysis using LMIs

Authors: Matthew M. Peet

Abstract: We present a new Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in which it is possible to use convex optimization to perform stability analysis with little or no conservatism. The first result gives a standardized representation for coupled linear PDEs in a single spatial variable and shows that any such PDE, suitably well-posed, admits an equivalent PIE r… ▽ More We present a new Partial Integral Equation (PIE) representation of Partial Differential Equations (PDEs) in which it is possible to use convex optimization to perform stability analysis with little or no conservatism. The first result gives a standardized representation for coupled linear PDEs in a single spatial variable and shows that any such PDE, suitably well-posed, admits an equivalent PIE representation, defined by the given conversion formulae. This leads to a new prima facie representation of the dynamics without the implicit constraints on system state imposed by boundary conditions. The second result is to show that for systems in this PIE representation, convex optimization may be used to verify stability without discretization. The resulting algorithms are implemented in the Matlab toolbox PIETOOLS, tested on several illustrative examples, compared with previous results, and the code has been posted on Code Ocean. Scalability testing indicates the algorithm can analyze systems of up to 40 coupled PDEs on a desktop computer. △ Less

Submitted 11 September, 2020; v1 submitted 14 December, 2018; originally announced December 2018.

Computing Input-Output Properties of Coupled PDE systems

Authors: Sachin Shivakumar, Matthew M. Peet

Abstract: In this paper, we propose an LMI-based approach to analyze input-output properties of coupled linear PDE systems. This work expands on a newly developed state-space theory for coupled PDEs and extends the positive-real and bounded-real lemmas to infinite dimensional systems. We show that conditions for passivity and bounded L2 gain can be expressed as linear operator inequalities on RxL2. A method… ▽ More In this paper, we propose an LMI-based approach to analyze input-output properties of coupled linear PDE systems. This work expands on a newly developed state-space theory for coupled PDEs and extends the positive-real and bounded-real lemmas to infinite dimensional systems. We show that conditions for passivity and bounded L2 gain can be expressed as linear operator inequalities on RxL2. A method to convert these operator inequalities to LMIs by using parameterization of the operator variables is proposed. This method does not rely on discretization and as such, the properties obtained are prima facie provable. We use numerical examples to demonstrate that the bounds obtained are not conservative in any significant sense and that the bounds are computable on desktop computers for systems consisting of up to 20 coupled PDEs. △ Less

Submitted 29 April, 2020; v1 submitted 12 December, 2018; originally announced December 2018.

Extensions of the Dynamic Programming Framework: Battery Scheduling, Demand Charges, and Renewable Integration

Authors: Morgan Jones, Matthew M. Peet

Abstract: We consider a general class of Dynamic Programming (DP) problems with non-separable objective functions. We show that for any problem in this class, there exists an augmented-state DP problem which satisfies the Principle of Optimality and the solutions to which yield solutions to the original problem. Furthermore, we identify a subclass of DP problems with Naturally Forward Separable (NFS) object… ▽ More We consider a general class of Dynamic Programming (DP) problems with non-separable objective functions. We show that for any problem in this class, there exists an augmented-state DP problem which satisfies the Principle of Optimality and the solutions to which yield solutions to the original problem. Furthermore, we identify a subclass of DP problems with Naturally Forward Separable (NFS) objective functions for which this state-augmentation scheme is tractable. We extend this framework to stochastic DP problems, proposing a suitable definition of the Principle of Optimality. We then apply the resulting algorithms to the problem of optimal battery scheduling with demand charges using a data-based stochastic model for electricity usage and solar generation by the consumer. △ Less

Submitted 9 June, 2020; v1 submitted 29 November, 2018; originally announced December 2018.

Comments: Latest TAC submission after second round of reviews 02/10/2020

Using SOS for Optimal Semialgebraic Representation of Sets: Finding Minimal Representations of Limit Cycles, Chaotic Attractors and Unions

Authors: Morgan Jones, Matthew M. Peet

Abstract: In this paper we show that Sum-of-Squares optimization can be used to find optimal semialgebraic representations of sets. These sets may be explicitly defined, as in the case of discrete points or unions of sets; or implicitly defined, as in the case of attractors of nonlinear systems. We define optimality in the sense of minimum volume, while satisfying constraints that can include set containmen… ▽ More In this paper we show that Sum-of-Squares optimization can be used to find optimal semialgebraic representations of sets. These sets may be explicitly defined, as in the case of discrete points or unions of sets; or implicitly defined, as in the case of attractors of nonlinear systems. We define optimality in the sense of minimum volume, while satisfying constraints that can include set containment, convexity, or Lyapunov stability conditions. Our admittedly heuristic approach to volume minimization is based on the use of a determinantlike objective function. We provide numerical examples for the Lorenz attractor and the Van der Pol limit cycle. △ Less

Submitted 26 September, 2018; originally announced September 2018.

A Convex Solution of the $H_\infty$-Optimal Controller Synthesis Problem for Multi-Delay Systems

Authors: Matthew M. Peet

Abstract: Optimal controller synthesis is a bilinear problem and hence difficult to solve in a computationally efficient manner. We are able to resolve this bilinearity for systems with delay by first convexifying the problem in infinite-dimensions - formulating the $H_\infty$ optimal state-feedback controller synthesis problem for distributed-parameter systems as a Linear Operator Inequality - a form of co… ▽ More Optimal controller synthesis is a bilinear problem and hence difficult to solve in a computationally efficient manner. We are able to resolve this bilinearity for systems with delay by first convexifying the problem in infinite-dimensions - formulating the $H_\infty$ optimal state-feedback controller synthesis problem for distributed-parameter systems as a Linear Operator Inequality - a form of convex optimization with operator variables. Next, we use positive matrices to parameterize positive `complete quadratic' operators - allowing the controller synthesis problem to be solved using Semidefinite Programming (SDP). We then use the solution to this SDP to calculate the feedback gains and provide effective methods for real-time implementation. Finally, we use several test cases to verify that the resulting controllers are \textit{optimal} to several decimal places as measured by the minimal achievable closed-loop $H_\infty$ norm, and as compared against controllers designed using high-order Padé approximations. △ Less

Submitted 12 July, 2018; v1 submitted 21 June, 2018; originally announced June 2018.

A New State-Space Representation of Lyapunov Stability for Coupled PDEs and Scalable Stability Analysis in the SOS Framework - with Lemma Proofs

Authors: Matthew M. Peet

Abstract: In this paper, we present a framework for Stability Analysis of Systems of Coupled Linear Partial-Differential Equations. The class of PDE systems considered in this paper includes parabolic, elliptic and hyperbolic systems with Dirichelet, Neuman and mixed boundary conditions. The results in this paper apply to systems with a single spatial variable and assume existence and continuity of solution… ▽ More In this paper, we present a framework for Stability Analysis of Systems of Coupled Linear Partial-Differential Equations. The class of PDE systems considered in this paper includes parabolic, elliptic and hyperbolic systems with Dirichelet, Neuman and mixed boundary conditions. The results in this paper apply to systems with a single spatial variable and assume existence and continuity of solutions except in such cases when existence and continuity can be inferred from existence of a Lyapunov function. Our approach is based on a new concept of state for PDE systems which allows us to express the derivative of the Lyapunov function as a Linear Operator Inequality directly on $L_2$ and allows for any type of suitably well-posed boundary conditions. This approach obviates the need for integration by parts, spacing functions or similar mathematical encumbrances. The resulting algorithms are implemented in Matlab, tested on several motivating examples, and the codes have been posted online. Numerical testing indicates the approach has little or no conservatism for a large class of systems. △ Less

Submitted 27 March, 2018; v1 submitted 20 March, 2018; originally announced March 2018.

Comments: This document contains both manuscript and proofs

A Dynamic Programming Approach to Evaluating Multivariate Gaussian Probabilities

Authors: Morgan Jones, Matthew M. Peet

Abstract: We propose a method of approximating multivariate Gaussian probabilities using dynamic programming. We show that solving the optimization problem associated with a class of discrete-time finite horizon Markov decision processes with non-Lipschitz cost functions is equivalent to integrating a Gaussian functions over polytopes. An approximation scheme for this class of MDPs is proposed and explicit… ▽ More We propose a method of approximating multivariate Gaussian probabilities using dynamic programming. We show that solving the optimization problem associated with a class of discrete-time finite horizon Markov decision processes with non-Lipschitz cost functions is equivalent to integrating a Gaussian functions over polytopes. An approximation scheme for this class of MDPs is proposed and explicit error bounds under the supremum norm for the optimal cost to go functions are derived. △ Less

Submitted 7 February, 2018; originally announced February 2018.

Comments: Submitted to MTNS

A Convex Parametrization of a New Class of Universal Kernel Functions

Authors: Brendon K. Colbert, Matthew M. Peet

Abstract: The accuracy and complexity of kernel learning algorithms is determined by the set of kernels over which it is able to optimize. An ideal set of kernels should: admit a linear parameterization (tractability); be dense in the set of all kernels (accuracy); and every member should be universal so that the hypothesis space is infinite-dimensional (scalability). Currently, there is no class of kernel… ▽ More The accuracy and complexity of kernel learning algorithms is determined by the set of kernels over which it is able to optimize. An ideal set of kernels should: admit a linear parameterization (tractability); be dense in the set of all kernels (accuracy); and every member should be universal so that the hypothesis space is infinite-dimensional (scalability). Currently, there is no class of kernel that meets all three criteria - e.g. Gaussians are not tractable or accurate; polynomials are not scalable. We propose a new class that meet all three criteria - the Tessellated Kernel (TK) class. Specifically, the TK class: admits a linear parameterization using positive matrices; is dense in all kernels; and every element in the class is universal. This implies that the use of TK kernels for learning the kernel can obviate the need for selecting candidate kernels in algorithms such as SimpleMKL and parameters such as the bandwidth. Numerical testing on soft margin Support Vector Machine (SVM) problems show that algorithms using TK kernels outperform other kernel learning algorithms and neural networks. Furthermore, our results show that when the ratio of the number of training data to features is high, the improvement of TK over MKL increases significantly. △ Less

Submitted 30 April, 2020; v1 submitted 15 November, 2017; originally announced November 2017.

Comments: 29 pages, 7 figures

Journal ref: Journal of Machine Learning Research 21.45 (2020): 1-29