-
Single-Molecule Water Motion on h-BN and Graphene: A Paradigm Shift in Understanding the Behaviour of Water on 2D Material Interfaces
Authors:
Philipp Seiler,
Anthony Payne,
Neubi F. Xavier Jr,
Louie Slocombe,
Marco Sacchi,
Anton Tamtögl
Abstract:
Understanding water behaviour on 2D materials is crucial for sensing, microfluidics, and tribology. While water/graphene interactions are well studied, water on hexagonal boron nitride (h-BN) remains largely unexplored. Despite structural similarity to graphene, h-BN's slightly polar B-N bonds impart a large band gap, high thermal conductivity, and chemical stability, making it promising for elect…
▽ More
Understanding water behaviour on 2D materials is crucial for sensing, microfluidics, and tribology. While water/graphene interactions are well studied, water on hexagonal boron nitride (h-BN) remains largely unexplored. Despite structural similarity to graphene, h-BN's slightly polar B-N bonds impart a large band gap, high thermal conductivity, and chemical stability, making it promising for electronics, lubricants, and coatings. Moreover, existing water studies often focus on multilayer water dynamics, overlooking single-molecular details. We bridge this gap by studying single-molecular water friction and diffusion on h-BN, comparing it with graphene using helium spin-echo experiments and ab initio calculations. Our findings show that water diffusion on h-BN/Ni follows a complex rotational-translational dynamic, unlike graphene. While conventional views treat water motion as discrete jumps between equivalent adsorption sites, we demonstrate that on h-BN, water molecules rotate freely around their centre of mass. Although the binding energies of water on h-BN and graphene are similar, the activation energy for water dynamics on h-BN is 2.5 times lower than on graphene, implying a much lower barrier for molecular mobility. The fundamentally different diffusion characteristics which classical models cannot capture, underscores the need to rethink how we model water on polar 2D materials. Moreover, our analysis reveals that the metal substrate strongly influences water friction, with h-BN/Ni showing a markedly lower friction than graphene/Ni, in stark contrast to the free-standing materials. These findings challenge assumptions about 2D material-water interactions, highlighting the crucial role of substrate effects in chemistry and material science and offer insights for designing next-generation microfluidic devices that require precise water mobility control.
△ Less
Submitted 17 February, 2025;
originally announced February 2025.
-
Stochastic LQR Design With Disturbance Preview
Authors:
Jietian Liu,
Laurent Lessard,
Peter Seiler
Abstract:
This paper considers the discrete-time, stochastic LQR problem with $p$ steps of disturbance preview information where $p$ is finite. We first derive the solution for this problem on a finite horizon with linear, time-varying dynamics and time-varying costs. Next, we derive the solution on the infinite horizon with linear, time-invariant dynamics and time-invariant costs. Our proofs rely on the we…
▽ More
This paper considers the discrete-time, stochastic LQR problem with $p$ steps of disturbance preview information where $p$ is finite. We first derive the solution for this problem on a finite horizon with linear, time-varying dynamics and time-varying costs. Next, we derive the solution on the infinite horizon with linear, time-invariant dynamics and time-invariant costs. Our proofs rely on the well-known principle of optimality. We provide an independent proof for the principle of optimality that relies only on nested information structure. Finally, we show that the finite preview controller converges to the optimal noncausal controller as the preview horizon $p$ tends to infinity. We also provide a simple example to illustrate both the finite and infinite horizon results.
△ Less
Submitted 26 April, 2025; v1 submitted 9 December, 2024;
originally announced December 2024.
-
Safety Filter for Robust Disturbance Rejection via Online Optimization
Authors:
Joyce Lai,
Peter Seiler
Abstract:
Disturbance rejection in high-precision control applications can be significantly improved upon via online convex optimization (OCO). This includes classical techniques such as recursive least squares (RLS) and more recent, regret-based formulations. However, these methods can cause instabilities in the presence of model uncertainty. This paper introduces a safety filter for systems with OCO in th…
▽ More
Disturbance rejection in high-precision control applications can be significantly improved upon via online convex optimization (OCO). This includes classical techniques such as recursive least squares (RLS) and more recent, regret-based formulations. However, these methods can cause instabilities in the presence of model uncertainty. This paper introduces a safety filter for systems with OCO in the form of adaptive finite impulse response (FIR) filtering to ensure robust disturbance rejection. The safety filter enforces a robust stability constraint on the FIR coefficients while minimally altering the OCO command in the $\infty$-norm cost. Additionally, we show that the induced $\ell_\infty$-norm allows for easy online implementation of the safety filter by directly limiting the OCO command. The constraint can be tuned to trade off robustness and performance. We provide a simple example to demonstrate the safety filter.
△ Less
Submitted 4 April, 2025; v1 submitted 14 November, 2024;
originally announced November 2024.
-
ControlAgent: Automating Control System Design via Novel Integration of LLM Agents and Domain Expertise
Authors:
Xingang Guo,
Darioush Keivan,
Usman Syed,
Lianhui Qin,
Huan Zhang,
Geir Dullerud,
Peter Seiler,
Bin Hu
Abstract:
Control system design is a crucial aspect of modern engineering with far-reaching applications across diverse sectors including aerospace, automotive systems, power grids, and robotics. Despite advances made by Large Language Models (LLMs) in various domains, their application in control system design remains limited due to the complexity and specificity of control theory. To bridge this gap, we i…
▽ More
Control system design is a crucial aspect of modern engineering with far-reaching applications across diverse sectors including aerospace, automotive systems, power grids, and robotics. Despite advances made by Large Language Models (LLMs) in various domains, their application in control system design remains limited due to the complexity and specificity of control theory. To bridge this gap, we introduce ControlAgent, a new paradigm that automates control system design via novel integration of LLM agents and control-oriented domain expertise. ControlAgent encodes expert control knowledge and emulates human iterative design processes by gradually tuning controller parameters to meet user-specified requirements for stability, performance, and robustness. ControlAgent integrates multiple collaborative LLM agents, including a central agent responsible for task distribution and task-specific agents dedicated to detailed controller design for various types of systems and requirements. ControlAgent also employs a Python computation agent that performs complex calculations and controller evaluations based on standard design information provided by task-specified LLM agents. Combined with a history and feedback module, the task-specific LLM agents iteratively refine controller parameters based on real-time feedback from prior designs. Overall, ControlAgent mimics the design processes used by (human) practicing engineers, but removes all the human efforts and can be run in a fully automated way to give end-to-end solutions for control system design with user-specified requirements. To validate ControlAgent's effectiveness, we develop ControlEval, an evaluation dataset that comprises 500 control tasks with various specific design goals. The effectiveness of ControlAgent is demonstrated via extensive comparative evaluations between LLM-based and traditional human-involved toolbox-based baselines.
△ Less
Submitted 17 October, 2024;
originally announced October 2024.
-
Stability Margins of Neural Network Controllers
Authors:
Neelay Junnarkar,
Murat Arcak,
Peter Seiler
Abstract:
We present a method to train neural network controllers with guaranteed stability margins. The method is applicable to linear time-invariant plants interconnected with uncertainties and nonlinearities that are described by integral quadratic constraints. The type of stability margin we consider is the disk margin. Our training method alternates between a training step to maximize reward and a stab…
▽ More
We present a method to train neural network controllers with guaranteed stability margins. The method is applicable to linear time-invariant plants interconnected with uncertainties and nonlinearities that are described by integral quadratic constraints. The type of stability margin we consider is the disk margin. Our training method alternates between a training step to maximize reward and a stability margin-enforcing step. In the stability margin enforcing-step, we solve a semidefinite program to project the controller into the set of controllers for which we can certify the desired disk margin.
△ Less
Submitted 13 September, 2024;
originally announced September 2024.
-
Structured Input-Output Modeling and Robust Stability Analysis of Compressible Flows
Authors:
Diganta Bhattacharjee,
Talha Mushtaq,
Peter Seiler,
Maziar S. Hemati
Abstract:
The recently introduced structured input-output analysis is a powerful method for capturing nonlinear phenomena associated with incompressible flows, and this paper extends that method to the compressible regime. The proposed method relies upon a reformulation of the compressible Navier-Stokes equations, which allows for an exact quadratic formulation of the dynamics of perturbations about a stead…
▽ More
The recently introduced structured input-output analysis is a powerful method for capturing nonlinear phenomena associated with incompressible flows, and this paper extends that method to the compressible regime. The proposed method relies upon a reformulation of the compressible Navier-Stokes equations, which allows for an exact quadratic formulation of the dynamics of perturbations about a steady base flow. To facilitate the structured input-output analysis, a pseudo-linear model for the quadratic nonlinearity is proposed and the structural information of the nonlinearity is embedded into a structured uncertainty comprising unknown `perturbations'. The structured singular value framework is employed to compute the input-output gain, which provides an estimate of the robust stability margin of the flow perturbations, as well as the forcing and response modes that are consistent with the nonlinearity structure. The analysis is then carried out on a plane, laminar compressible Couette flow over a range of Mach numbers. The structured input-output gains identify an instability mechanism, characterized by a spanwise elongated structure in the streamwise-spanwise wavenumber space at a subsonic Mach number, that takes the form of an oblique structure at sonic and supersonic Mach numbers. In addition, the structured input-output forcing and response modes provide insight into the thermodynamic and momentum characteristics associated with a source of instability. Comparisons with a resolvent/unstructured analysis reveal discrepancies in the distribution of input-output gains over the wavenumber space as well as in the modal behavior of an instability, thus highlighting the strong correlation between the structural information of the nonlinearity and the underlying flow physics.
△ Less
Submitted 5 March, 2025; v1 submitted 20 July, 2024;
originally announced July 2024.
-
A Complete Set of Quadratic Constraints for Repeated ReLU and Generalizations
Authors:
Sahel Vahedi Noori,
Bin Hu,
Geir Dullerud,
Peter Seiler
Abstract:
This paper derives a complete set of quadratic constraints (QCs) for the repeated ReLU. The complete set of QCs is described by a collection of matrix copositivity conditions. We also show that only two functions satisfy all QCs in our complete set: the repeated ReLU and flipped ReLU. Thus our complete set of QCs bounds the repeated ReLU as tight as possible up to the sign invariance inherent in q…
▽ More
This paper derives a complete set of quadratic constraints (QCs) for the repeated ReLU. The complete set of QCs is described by a collection of matrix copositivity conditions. We also show that only two functions satisfy all QCs in our complete set: the repeated ReLU and flipped ReLU. Thus our complete set of QCs bounds the repeated ReLU as tight as possible up to the sign invariance inherent in quadratic forms. We derive a similar complete set of incremental QCs for repeated ReLU, which can potentially lead to less conservative Lipschitz bounds for ReLU networks than the standard LipSDP approach. The basic constructions are also used to derive the complete sets of QCs for other piecewise linear activation functions such as leaky ReLU, MaxMin, and HouseHolder. Finally, we illustrate the use of the complete set of QCs to assess stability and performance for recurrent neural networks with ReLU activation functions. We rely on a standard copositivity relaxation to formulate the stability/performance condition as a semidefinite program. Simple examples are provided to illustrate that the complete sets of QCs and incremental QCs can yield less conservative bounds than existing sets.
△ Less
Submitted 22 August, 2024; v1 submitted 9 July, 2024;
originally announced July 2024.
-
Robust Online Convex Optimization for Disturbance Rejection
Authors:
Joyce Lai,
Peter Seiler
Abstract:
Online convex optimization (OCO) is a powerful tool for learning sequential data, making it ideal for high precision control applications where the disturbances are arbitrary and unknown in advance. However, the ability of OCO-based controllers to accurately learn the disturbance while maintaining closed-loop stability relies on having an accurate model of the plant. This paper studies the perform…
▽ More
Online convex optimization (OCO) is a powerful tool for learning sequential data, making it ideal for high precision control applications where the disturbances are arbitrary and unknown in advance. However, the ability of OCO-based controllers to accurately learn the disturbance while maintaining closed-loop stability relies on having an accurate model of the plant. This paper studies the performance of OCO-based controllers for linear time-invariant (LTI) systems subject to disturbance and model uncertainty. The model uncertainty can cause the closed-loop to become unstable. We provide a sufficient condition for robust stability based on the small gain theorem. This condition is easily incorporated as an on-line constraint in the OCO controller. Finally, we verify via numerical simulations that imposing the robust stability condition on the OCO controller ensures closed-loop stability.
△ Less
Submitted 11 May, 2024;
originally announced May 2024.
-
Stability and Performance Analysis of Discrete-Time ReLU Recurrent Neural Networks
Authors:
Sahel Vahedi Noori,
Bin Hu,
Geir Dullerud,
Peter Seiler
Abstract:
This paper presents sufficient conditions for the stability and $\ell_2$-gain performance of recurrent neural networks (RNNs) with ReLU activation functions. These conditions are derived by combining Lyapunov/dissipativity theory with Quadratic Constraints (QCs) satisfied by repeated ReLUs. We write a general class of QCs for repeated RELUs using known properties for the scalar ReLU. Our stability…
▽ More
This paper presents sufficient conditions for the stability and $\ell_2$-gain performance of recurrent neural networks (RNNs) with ReLU activation functions. These conditions are derived by combining Lyapunov/dissipativity theory with Quadratic Constraints (QCs) satisfied by repeated ReLUs. We write a general class of QCs for repeated RELUs using known properties for the scalar ReLU. Our stability and performance condition uses these QCs along with a "lifted" representation for the ReLU RNN. We show that the positive homogeneity property satisfied by a scalar ReLU does not expand the class of QCs for the repeated ReLU. We present examples to demonstrate the stability / performance condition and study the effect of the lifting horizon.
△ Less
Submitted 14 May, 2024; v1 submitted 8 May, 2024;
originally announced May 2024.
-
Fast Assignment in Asset-Guarding Engagements using Function Approximation
Authors:
Neelay Junnarkar,
Emmanuel Sin,
Peter Seiler,
Douglas Philbrick,
Murat Arcak
Abstract:
This letter considers assignment problems consisting of n pursuers attempting to intercept n targets. We consider stationary targets as well as targets maneuvering toward an asset. The assignment algorithm relies on an n x n cost matrix where entry (i, j) is the minimum time for pursuer i to intercept target j. Each entry of this matrix requires the solution of a nonlinear optimal control problem.…
▽ More
This letter considers assignment problems consisting of n pursuers attempting to intercept n targets. We consider stationary targets as well as targets maneuvering toward an asset. The assignment algorithm relies on an n x n cost matrix where entry (i, j) is the minimum time for pursuer i to intercept target j. Each entry of this matrix requires the solution of a nonlinear optimal control problem. This subproblem is computationally intensive and hence the computational cost of the assignment is dominated by the construction of the cost matrix. We propose to use neural networks for function approximation of the minimum time until intercept. The neural networks are trained offline, thus allowing for real-time online construction of cost matrices. Moreover, the function approximators have sufficient accuracy to obtain reasonable solutions to the assignment problem. In most cases, the approximators achieve assignments with optimal worst case intercept time. The proposed approach is demonstrated on several examples with increasing numbers of pursuers and targets.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Synthesizing Neural Network Controllers with Closed-Loop Dissipativity Guarantees
Authors:
Neelay Junnarkar,
Murat Arcak,
Peter Seiler
Abstract:
In this paper, a method is presented to synthesize neural network controllers such that the feedback system of plant and controller is dissipative, certifying performance requirements such as L2 gain bounds. The class of plants considered is that of linear time-invariant (LTI) systems interconnected with an uncertainty, including nonlinearities treated as an uncertainty for convenience of analysis…
▽ More
In this paper, a method is presented to synthesize neural network controllers such that the feedback system of plant and controller is dissipative, certifying performance requirements such as L2 gain bounds. The class of plants considered is that of linear time-invariant (LTI) systems interconnected with an uncertainty, including nonlinearities treated as an uncertainty for convenience of analysis. The uncertainty of the plant and the nonlinearities of the neural network are both described using integral quadratic constraints (IQCs). First, a dissipativity condition is derived for uncertain LTI systems. Second, this condition is used to construct a linear matrix inequality (LMI) which can be used to synthesize neural network controllers. Finally, this convex condition is used in a projection-based training method to synthesize neural network controllers with dissipativity guarantees. Numerical examples on an inverted pendulum and a flexible rod on a cart are provided to demonstrate the effectiveness of this approach.
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
-
Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra
Authors:
Darioush Kevian,
Usman Syed,
Xingang Guo,
Aaron Havens,
Geir Dullerud,
Peter Seiler,
Lianhui Qin,
Bin Hu
Abstract:
In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra in solving undergraduate-level control problems. Controls provides an interesting case study for LLM reasoning due to its combination of mathematical theory and engineering design. We introduce ControlBench, a benchmark dataset tailored to reflect the bread…
▽ More
In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra in solving undergraduate-level control problems. Controls provides an interesting case study for LLM reasoning due to its combination of mathematical theory and engineering design. We introduce ControlBench, a benchmark dataset tailored to reflect the breadth, depth, and complexity of classical control design. We use this dataset to study and evaluate the problem-solving abilities of these LLMs in the context of control engineering. We present evaluations conducted by a panel of human experts, providing insights into the accuracy, reasoning, and explanatory prowess of LLMs in control engineering. Our analysis reveals the strengths and limitations of each LLM in the context of classical control, and our results imply that Claude 3 Opus has become the state-of-the-art LLM for solving undergraduate control problems. Our study serves as an initial step towards the broader goal of employing artificial general intelligence in control engineering.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
Model-Free $μ$-Synthesis: A Nonsmooth Optimization Perspective
Authors:
Darioush Keivan,
Xingang Guo,
Peter Seiler,
Geir Dullerud,
Bin Hu
Abstract:
In this paper, we revisit model-free policy search on an important robust control benchmark, namely $μ$-synthesis. In the general output-feedback setting, there do not exist convex formulations for this problem, and hence global optimality guarantees are not expected. Apkarian (2011) presented a nonconvex nonsmooth policy optimization approach for this problem, and achieved state-of-the-art design…
▽ More
In this paper, we revisit model-free policy search on an important robust control benchmark, namely $μ$-synthesis. In the general output-feedback setting, there do not exist convex formulations for this problem, and hence global optimality guarantees are not expected. Apkarian (2011) presented a nonconvex nonsmooth policy optimization approach for this problem, and achieved state-of-the-art design results via using subgradient-based policy search algorithms which generate update directions in a model-based manner. Despite the lack of convexity and global optimality guarantees, these subgradient-based policy search methods have led to impressive numerical results in practice. Built upon such a policy optimization persepctive, our paper extends these subgradient-based search methods to a model-free setting. Specifically, we examine the effectiveness of two model-free policy optimization strategies: the model-free non-derivative sampling method and the zeroth-order policy search with uniform smoothing. We performed an extensive numerical study to demonstrate that both methods consistently replicate the design outcomes achieved by their model-based counterparts. Additionally, we provide some theoretical justifications showing that convergence guarantees to stationary points can be established for our model-free $μ$-synthesis under some assumptions related to the coerciveness of the cost function. Overall, our results demonstrate that derivative-free policy optimization offers a competitive and viable approach for solving general output-feedback $μ$-synthesis problems in the model-free setting.
△ Less
Submitted 18 February, 2024;
originally announced February 2024.
-
A Convex Optimization Approach to Compute Trapping Regions for Lossless Quadratic Systems
Authors:
Shih-Chi Liao,
A. Leonid Heide,
Maziar S. Hemati,
Peter J. Seiler
Abstract:
Quadratic systems with lossless quadratic terms arise in many applications, including models of atmosphere and incompressible fluid flows. Such systems have a trapping region if all trajectories eventually converge to and stay within a bounded set. Conditions for the existence and characterization of trapping regions have been established in prior works for boundedness analysis. However, prior sol…
▽ More
Quadratic systems with lossless quadratic terms arise in many applications, including models of atmosphere and incompressible fluid flows. Such systems have a trapping region if all trajectories eventually converge to and stay within a bounded set. Conditions for the existence and characterization of trapping regions have been established in prior works for boundedness analysis. However, prior solutions have used non-convex optimization methods, resulting in conservative estimates. In this paper, we build on this prior work and provide a convex semidefinite programming condition for the existence of a trapping region. The condition allows precise verification or falsification of the existence of a trapping region. If a trapping region exists, then we provide a second semidefinite program to compute the least conservative trapping region in the form of a ball. Two low-dimensional systems are provided as examples to illustrate the results. A third high-dimensional example is also included to demonstrate that the computation required for the analysis can be scaled to systems of up to $\sim O(100)$ states. The proposed method provides a precise and computationally efficient numerical approach for computing trapping regions. We anticipate this work will benefit future studies on modeling and control of lossless quadratic dynamical systems.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Frequency-domain Gaussian Process Models for $H_\infty$ Uncertainties
Authors:
Alex Devonport,
Peter Seiler,
Murat Arcak
Abstract:
Complex-valued Gaussian processes are commonly used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same model could be used for probabilistic robust control, allowing for robustly safe learning. We investigate sufficient conditions for a general complex-domain Gaussi…
▽ More
Complex-valued Gaussian processes are commonly used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same model could be used for probabilistic robust control, allowing for robustly safe learning. We investigate sufficient conditions for a general complex-domain Gaussian process to have this property. For the special case of processes whose Hermitian covariance is stationary, we provide an explicit parameterization of the covariance structure in terms of a summable sequence of nonnegative numbers. We then establish how an $H_\infty$ Gaussian process can serve as a prior for Bayesian system identification and as a probabilistic uncertainty model for probabilistic robust control. In particular, we compute formulas for refining the uncertainty model by conditioning on frequency-domain data and for upper-bounding the probability that the realizations of the process satisfy a given integral quadratic constraint.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Learning Reduced-Order Linear Parameter-Varying Models of Nonlinear Systems
Authors:
Patrick J. W. Koelewijn,
Rajiv Sing,
Peter Seiler,
Roland Tóth
Abstract:
In this paper, we consider the learning of a Reduced-Order Linear Parameter-Varying Model (ROLPVM) of a nonlinear dynamical system based on data. This is achieved by a two-step procedure. In the first step, we learn a projection to a lower dimensional state-space. In step two, an LPV model is learned on the reduced-order state-space using a novel, efficient parameterization in terms of neural netw…
▽ More
In this paper, we consider the learning of a Reduced-Order Linear Parameter-Varying Model (ROLPVM) of a nonlinear dynamical system based on data. This is achieved by a two-step procedure. In the first step, we learn a projection to a lower dimensional state-space. In step two, an LPV model is learned on the reduced-order state-space using a novel, efficient parameterization in terms of neural networks. The improved modeling accuracy of the method compared to an existing method is demonstrated by simulation examples.
△ Less
Submitted 20 May, 2024; v1 submitted 11 December, 2023;
originally announced December 2023.
-
Integral Quadratic Constraints with Infinite-Dimensional Channels
Authors:
Aleksandr Talitckii,
Peter Seiler,
Matthew M. Peet
Abstract:
Modern control theory provides us with a spectrum of methods for studying the interconnection of dynamic systems using input-output properties of the interconnected subsystems. Perhaps the most advanced framework for such input-output analysis is the use of Integral Quadratic Constraints (IQCs), which considers the interconnection of a nominal linear system with an unmodelled nonlinear or uncertai…
▽ More
Modern control theory provides us with a spectrum of methods for studying the interconnection of dynamic systems using input-output properties of the interconnected subsystems. Perhaps the most advanced framework for such input-output analysis is the use of Integral Quadratic Constraints (IQCs), which considers the interconnection of a nominal linear system with an unmodelled nonlinear or uncertain subsystem with known input-output properties. Although these methods are widely used for Ordinary Differential Equations (ODEs), there have been fewer attempts to extend IQCs to infinite-dimensional systems. In this paper, we present an IQC-based framework for Partial Differential Equations (PDEs) and Delay Differential Equations (DDEs). First, we introduce infinite-dimensional signal spaces, operators, and feedback interconnections. Next, in the main result, we propose a formulation of hard IQC-based input-output stability conditions, allowing for infinite-dimensional multipliers. We then show how to test hard IQC conditions with infinite-dimensional multipliers on a nominal linear PDE or DDE system via the Partial Integral Equation (PIE) state-space representation using a sufficient version of the Kalman-Yakubovich-Popov lemma (KYP). The results are then illustrated using four example problems with uncertainty and nonlinearity.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
Robust Regret Optimal Control
Authors:
Jietian Liu,
Peter Seiler
Abstract:
This paper presents a synthesis method for robust, regret optimal control. The plant is modeled in discrete-time by an uncertain linear time-invariant (LTI) system. An optimal non-causal controller is constructed using the nominal plant model and given full knowledge of the disturbance. Robust regret is defined relative to the performance of this optimal non-causal control. It is shown that a cont…
▽ More
This paper presents a synthesis method for robust, regret optimal control. The plant is modeled in discrete-time by an uncertain linear time-invariant (LTI) system. An optimal non-causal controller is constructed using the nominal plant model and given full knowledge of the disturbance. Robust regret is defined relative to the performance of this optimal non-causal control. It is shown that a controller achieves robust regret if and only if it satisfies a robust $H_\infty$ performance condition. DK-iteration can be used to synthesize a controller that satisfies this condition and hence achieve a given level of robust regret. The approach is demonstrated three examples: (i) a simple single-input, single-output classical design, (ii) a longitudinal control for a simplified model for a Boeing 747 model, and (iii) an active suspension for a quarter car model. All examples compare the robust regret optimal against regret optimal controllers designed without uncertainty.
△ Less
Submitted 3 January, 2024; v1 submitted 26 July, 2023;
originally announced July 2023.
-
On the convexity of static output feedback control synthesis for systems with lossless nonlinearities
Authors:
Talha Mushtaq,
Peter Seiler,
Maziar S. Hemati
Abstract:
Computing a stabilizing static output-feedback (SOF) controller is an NP-hard problem, in general. Yet, these controllers have amassed popularity in recent years because of their practical use in feedback control applications, such as fluid flow control and sensor/actuator selection. The inherent difficulty of synthesizing SOF controllers is rooted in solving a series of non-convex problems that m…
▽ More
Computing a stabilizing static output-feedback (SOF) controller is an NP-hard problem, in general. Yet, these controllers have amassed popularity in recent years because of their practical use in feedback control applications, such as fluid flow control and sensor/actuator selection. The inherent difficulty of synthesizing SOF controllers is rooted in solving a series of non-convex problems that make the solution computationally intractable. In this note, we show that SOF synthesis is a convex problem for the specific case of systems with a lossless (i.e., energy-conserving) nonlinearity. Our proposed method ensures asymptotic stability of an SOF controller by enforcing the lossless behavior of the nonlinearity using a quadratic constraint approach. In particular, we formulate a bilinear matrix inequality~(BMI) using the approach, then show that the resulting BMI can be recast as a linear matrix inequality (LMI). The resulting LMI is a convex problem whose feasible solution, if one exists, yields an asymptotically stabilizing SOF controller.
△ Less
Submitted 6 July, 2023;
originally announced July 2023.
-
Exact Solution for the Rank-One Structured Singular Value with Repeated Complex Full-Block Uncertainty
Authors:
Talha Mushtaq,
Peter Seiler,
Maziar S. Hemati
Abstract:
In this note, we present an exact solution for the structured singular value (SSV) of rank-one complex matrices with repeated complex full-block uncertainty. A key step in the proof is the use of Von Neumman's trace inequality. Previous works provided exact solutions for rank-one SSV when the uncertainty contains repeated (real or complex) scalars and/or non-repeated complex full-block uncertainti…
▽ More
In this note, we present an exact solution for the structured singular value (SSV) of rank-one complex matrices with repeated complex full-block uncertainty. A key step in the proof is the use of Von Neumman's trace inequality. Previous works provided exact solutions for rank-one SSV when the uncertainty contains repeated (real or complex) scalars and/or non-repeated complex full-block uncertainties. Our result with repeated complex full-blocks contains, as special cases, the previous results for repeated complex scalars and/or non-repeated complex full-block uncertainties. The repeated complex full-block uncertainty has recently gained attention in the context of incompressible fluid flows. Specifically, it has been used to analyze the effect of the convective nonlinearity in the incompressible Navier-Stokes equation (NSE). SSV analysis with repeated full-block uncertainty has led to an improved understanding of the underlying flow physics. We demonstrate our method on a turbulent channel flow model as an example.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
A PIE Representation of Scalar Quadratic PDEs and Global Stability Analysis Using SDP
Authors:
Declan Jagt,
Peter Seiler,
Matthew Peet
Abstract:
It has recently been shown that the evolution of a linear Partial Differential Equation (PDE) can be more conveniently represented in terms of the evolution of a higher spatial derivative of the state. This higher spatial derivative (termed the `fundamental state') lies in $L_2$ - requiring no auxiliary boundary conditions or continuity constraints. Such a representation (termed a Partial Integral…
▽ More
It has recently been shown that the evolution of a linear Partial Differential Equation (PDE) can be more conveniently represented in terms of the evolution of a higher spatial derivative of the state. This higher spatial derivative (termed the `fundamental state') lies in $L_2$ - requiring no auxiliary boundary conditions or continuity constraints. Such a representation (termed a Partial Integral Equation or PIE) is then defined in terms of an algebra of bounded integral operators (termed Partial Integral (PI) operators) and is constructed by identifying a unitary map from the fundamental state to the state of the original PDE. Unfortunately, when the PDE is nonlinear, the dynamics of the associated fundamental state are no longer parameterized in terms of PI operators. However, in this paper, we show that such dynamics can be compactly represented using a new tensor algebra of partial integral operators acting on the tensor product of the fundamental state. We further show that this tensor product of the fundamental state forms a natural distributed equivalent of the monomial basis used in representation of polynomials on a finite-dimensional space. This new representation is then used to provide a simple SDP-based Lyapunov test of stability of quadratic PDEs. The test is applied to three illustrative examples of quadratic PDEs.
△ Less
Submitted 9 September, 2023; v1 submitted 29 March, 2023;
originally announced March 2023.
-
Trajectory-based Robustness Analysis for Nonlinear Systems
Authors:
Peter Seiler,
Raghu Venkataraman
Abstract:
This paper considers the robustness of an uncertain nonlinear system along a finite-horizon trajectory. The uncertain system is modeled as a connection of a nonlinear system and a perturbation. The analysis relies on three ingredients. First, the nonlinear system is approximated by a linear time-varying (LTV) system via linearization along a trajectory. This linearization introduces an additional…
▽ More
This paper considers the robustness of an uncertain nonlinear system along a finite-horizon trajectory. The uncertain system is modeled as a connection of a nonlinear system and a perturbation. The analysis relies on three ingredients. First, the nonlinear system is approximated by a linear time-varying (LTV) system via linearization along a trajectory. This linearization introduces an additional forcing input due to the nominal trajectory. Second, the input/output behavior of the perturbation is described by time-domain, integral quadratic constraints (IQCs). Third, a dissipation inequality is formulated to bound the worst-case deviation of an output signal due to the uncertainty. These steps yield a differential linear matrix inequality (DLMI) condition to bound the worst-case performance. The robustness condition is then converted to an equivalent condition in terms of a Riccati Differential Equation. This yields a computational method that avoids heuristics often used to solve DLMIs, e.g. time gridding. The approach is demonstrated by a two-link robotic arm example.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
Frequency Domain Gaussian Process Models for $H^\infty$ Uncertainties
Authors:
Alex Devonport,
Peter Seiler,
Murat Arcak
Abstract:
Complex-valued Gaussian processes are used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same model could be used for probabilistic robust control, allowing for robustly safe learning. We investigate sufficient conditions for a general complex-domain Gaussian proces…
▽ More
Complex-valued Gaussian processes are used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same model could be used for probabilistic robust control, allowing for robustly safe learning. We investigate sufficient conditions for a general complex-domain Gaussian process to have this property. For the special case of processes whose Hermitian covariance is stationary, we provide an explicit parameterization of the covariance structure in terms of a summable sequence of nonnegative numbers.
△ Less
Submitted 28 November, 2022;
originally announced November 2022.
-
Structured Singular Value of a Repeated Complex Full-Block Uncertainty
Authors:
Talha Mushtaq,
Diganta Bhattacharjee,
Peter Seiler,
Maziar S. Hemati
Abstract:
The structured singular value (SSV), or mu, is used to assess the robust stability and performance of an uncertain linear time-invariant system. Existing algorithms compute upper and lower bounds on the SSV for structured uncertainties that contain repeated (real or complex) scalars and/or non-repeated complex full blocks. This paper presents algorithms to compute bounds on the SSV for the case of…
▽ More
The structured singular value (SSV), or mu, is used to assess the robust stability and performance of an uncertain linear time-invariant system. Existing algorithms compute upper and lower bounds on the SSV for structured uncertainties that contain repeated (real or complex) scalars and/or non-repeated complex full blocks. This paper presents algorithms to compute bounds on the SSV for the case of repeated complex full blocks. This specific class of uncertainty is relevant for the input output analysis of many convective systems, such as fluid flows. Specifically, we present a power iteration to compute a lower bound on SSV for the case of repeated complex full blocks. This generalizes existing power iterations for repeated complex scalar and non-repeated complex full blocks. The upper bound can be formulated as a semi-definite program (SDP), which we solve using a standard interior-point method to compute optimal scaling matrices associated with the repeated full blocks. Our implementation of the method only requires gradient information, which improves the computational efficiency of the method. Finally, we test our proposed algorithms on an example model of incompressible fluid flow. The proposed methods provide less conservative bounds as compared to prior results, which ignore the repeated full block structure.
△ Less
Submitted 5 January, 2024; v1 submitted 10 November, 2022;
originally announced November 2022.
-
Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints
Authors:
Ram Padmanabhan,
Peter Seiler
Abstract:
The framework of Integral Quadratic Constraints (IQCs) is used to perform an analysis of gradient descent with varying step sizes. Two performance metrics are considered: convergence rate and noise amplification. We assume that the step size is produced from a line search and varies in a known interval. Modeling the algorithm as a linear, parameter-varying (LPV) system, we construct a parameterize…
▽ More
The framework of Integral Quadratic Constraints (IQCs) is used to perform an analysis of gradient descent with varying step sizes. Two performance metrics are considered: convergence rate and noise amplification. We assume that the step size is produced from a line search and varies in a known interval. Modeling the algorithm as a linear, parameter-varying (LPV) system, we construct a parameterized linear matrix inequality (LMI) condition that certifies algorithm performance, which is solved using a result for polytopic LPV systems. Our results provide convergence rate guarantees when the step size lies within a restricted interval. Moreover, we recover existing rate bounds when this interval reduces to a single point, i.e. a constant step size. Finally, we note that the convergence rate depends only on the condition number of the problem. In contrast, the noise amplification performance depends on the individual values of the strong convexity and smoothness parameters, and varies inversely with them for a fixed condition number.
△ Less
Submitted 28 July, 2024; v1 submitted 2 October, 2022;
originally announced October 2022.
-
Quadratic Constraints for Local Stability Analysis of Quadratic Systems
Authors:
Shih-Chi Liao,
Maziar S. Hemati,
Peter Seiler
Abstract:
This paper proposes new quadratic constraints (QCs) to bound a quadratic polynomial. Such QCs can be used in dissipation ineqaulities to analyze the stability and performance of nonlinear systems with quadratic vector fields. The proposed QCs utilize the sign-indefiniteness of certain classes of quadratic polynomials. These new QCs provide a tight bound on the quadratic terms along specific direct…
▽ More
This paper proposes new quadratic constraints (QCs) to bound a quadratic polynomial. Such QCs can be used in dissipation ineqaulities to analyze the stability and performance of nonlinear systems with quadratic vector fields. The proposed QCs utilize the sign-indefiniteness of certain classes of quadratic polynomials. These new QCs provide a tight bound on the quadratic terms along specific directions. This reduces the conservatism of the QC bounds as compared to the QCs in previous work. Two numerical examples of local stability analysis are provided to demonstrate the effectiveness of the proposed QCs.
△ Less
Submitted 8 September, 2022;
originally announced September 2022.
-
Synthesis of Stabilizing Recurrent Equilibrium Network Controllers
Authors:
Neelay Junnarkar,
He Yin,
Fangda Gu,
Murat Arcak,
Peter Seiler
Abstract:
We propose a parameterization of a nonlinear dynamic controller based on the recurrent equilibrium network, a generalization of the recurrent neural network. We derive constraints on the parameterization under which the controller guarantees exponential stability of a partially observed dynamical system with sector bounded nonlinearities. Finally, we present a method to synthesize this controller…
▽ More
We propose a parameterization of a nonlinear dynamic controller based on the recurrent equilibrium network, a generalization of the recurrent neural network. We derive constraints on the parameterization under which the controller guarantees exponential stability of a partially observed dynamical system with sector bounded nonlinearities. Finally, we present a method to synthesize this controller using projected policy gradient methods to maximize a reward function with arbitrary structure. The projection step involves the solution of convex optimization problems. We demonstrate the proposed method with simulated examples of controlling nonlinear plants, including plants modeled with neural networks.
△ Less
Submitted 12 September, 2022; v1 submitted 31 March, 2022;
originally announced April 2022.
-
Efficient Data Structures for Exploiting Sparsity and Structure in Representation of Polynomial Optimization Problems: Implementation in SOSTOOLS
Authors:
Declan Jagt,
Sachin Shivakumar,
Peter Seiler,
Matthew Peet
Abstract:
We present a new data structure for representation of polynomial variables in the parsing of sum-of-squares (SOS) programs. In SOS programs, the variables $s(x;Q)$ are polynomial in the independent variables $x$, but linear in the decision variables $Q$. Current SOS parsers, however, fail to exploit the semi-linear structure of the polynomial variables, treating the decision variables as independe…
▽ More
We present a new data structure for representation of polynomial variables in the parsing of sum-of-squares (SOS) programs. In SOS programs, the variables $s(x;Q)$ are polynomial in the independent variables $x$, but linear in the decision variables $Q$. Current SOS parsers, however, fail to exploit the semi-linear structure of the polynomial variables, treating the decision variables as independent variables in their representation. This results in unnecessary overhead in storage and manipulation of the polynomial variables, prohibiting the parser from addressing larger-scale optimization problems. To eliminate this computational overhead, we introduce a new representation of polynomial variables, the "dpvar" structure, that is affine in the decision variables. We show that the complexity of operations on variables in the dpvar representation scales favorably with the number of decision variables. We further show that the required memory for storing polynomial variables is relatively small using the dpvar structure, particularly when exploiting the MATLAB sparse storage structure. Finally, we incorporate the dpvar data structure into SOSTOOLS 4.00, and test the performance of the parser for several polynomial optimization problems.
△ Less
Submitted 2 September, 2022; v1 submitted 3 March, 2022;
originally announced March 2022.
-
Dual-polarization multiplexing amorphous Si:H grating couplers for silicon photonic transmitters in the photonic BiCMOS backend of line
Authors:
Galina Georgieva,
Christian Mai,
Pascal M. Seiler,
Anna Peczek,
Lars Zimmermann
Abstract:
We report on polarization combining 2D grating couplers (2D GCs) on amorphous Si:H, fabricated in the backend of line of a photonic BiCMOS platform. The 2D GCs can be used as an interface of a hybrid silicon photonic coherent transmitter, which can be implemented on bulk Si wafers. The fabricated 2D GCs operate in the telecom C-band and show an experimental coupling efficiency of -5 dB with a wafe…
▽ More
We report on polarization combining 2D grating couplers (2D GCs) on amorphous Si:H, fabricated in the backend of line of a photonic BiCMOS platform. The 2D GCs can be used as an interface of a hybrid silicon photonic coherent transmitter, which can be implemented on bulk Si wafers. The fabricated 2D GCs operate in the telecom C-band and show an experimental coupling efficiency of -5 dB with a wafer variation of +/-1.2 dB. Possibilities for efficiency enhancement and improved performance stability in future design generations are outlined and extension towards O-band devices is investigated as well.
△ Less
Submitted 11 January, 2022;
originally announced January 2022.
-
Revisiting PGD Attacks for Stability Analysis of Large-Scale Nonlinear Systems and Perception-Based Control
Authors:
Aaron Havens,
Darioush Keivan,
Peter Seiler,
Geir Dullerud,
Bin Hu
Abstract:
Many existing region-of-attraction (ROA) analysis tools find difficulty in addressing feedback systems with large-scale neural network (NN) policies and/or high-dimensional sensing modalities such as cameras. In this paper, we tailor the projected gradient descent (PGD) attack method developed in the adversarial learning community as a general-purpose ROA analysis tool for large-scale nonlinear sy…
▽ More
Many existing region-of-attraction (ROA) analysis tools find difficulty in addressing feedback systems with large-scale neural network (NN) policies and/or high-dimensional sensing modalities such as cameras. In this paper, we tailor the projected gradient descent (PGD) attack method developed in the adversarial learning community as a general-purpose ROA analysis tool for large-scale nonlinear systems and end-to-end perception-based control. We show that the ROA analysis can be approximated as a constrained maximization problem whose goal is to find the worst-case initial condition which shifts the terminal state the most. Then we present two PGD-based iterative methods which can be used to solve the resultant constrained maximization problem. Our analysis is not based on Lyapunov theory, and hence requires minimum information of the problem structures. In the model-based setting, we show that the PGD updates can be efficiently performed using back-propagation. In the model-free setting (which is more relevant to ROA analysis of perception-based control), we propose a finite-difference PGD estimate which is general and only requires a black-box simulator for generating the trajectories of the closed-loop system given any initial state. We demonstrate the scalability and generality of our analysis tool on several numerical examples with large-scale NN policies and high-dimensional image observations. We believe that our proposed analysis serves as a meaningful initial step toward further understanding of closed-loop stability of large-scale nonlinear systems and perception-based control.
△ Less
Submitted 3 January, 2022;
originally announced January 2022.
-
On the Necessity and Sufficiency of Discrete-Time O'Shea-Zames-Falb Multipliers
Authors:
Lanlan Su,
Peter Seiler,
Joaquin Carrasco,
Sei Zhen Khong
Abstract:
This paper considers the robust stability of a discrete-time Lurye system consisting of the feedback interconnection between a linear system and a bounded and monotone nonlinearity. It has been conjectured that the existence of a suitable linear time-invariant (LTI) O'Shea-Zames-Falb multiplier is not only sufficient but also necessary. Roughly speaking, a successful proof of the conjecture would…
▽ More
This paper considers the robust stability of a discrete-time Lurye system consisting of the feedback interconnection between a linear system and a bounded and monotone nonlinearity. It has been conjectured that the existence of a suitable linear time-invariant (LTI) O'Shea-Zames-Falb multiplier is not only sufficient but also necessary. Roughly speaking, a successful proof of the conjecture would require: (a) a conic parameterization of a set of multipliers that describes exactly the set of nonlinearities, (b) a lossless S-procedure to show that the non-existence of a multiplier implies that the Lurye system is not uniformly robustly stable over the set of nonlinearities, and (c) the existence of a multiplier in the set of multipliers used in (a) implies the existence of an LTI multiplier. We investigate these three steps, showing the current bottlenecks for proving this conjecture. In addition, we provide an extension of the class of multipliers which may be used to disprove the conjecture.
△ Less
Submitted 14 December, 2021;
originally announced December 2021.
-
Model-Free $μ$ Synthesis via Adversarial Reinforcement Learning
Authors:
Darioush Keivan,
Aaron Havens,
Peter Seiler,
Geir Dullerud,
Bin Hu
Abstract:
Motivated by the recent empirical success of policy-based reinforcement learning (RL), there has been a research trend studying the performance of policy-based RL methods on standard control benchmark problems. In this paper, we examine the effectiveness of policy-based RL methods on an important robust control problem, namely $μ$ synthesis. We build a connection between robust adversarial RL and…
▽ More
Motivated by the recent empirical success of policy-based reinforcement learning (RL), there has been a research trend studying the performance of policy-based RL methods on standard control benchmark problems. In this paper, we examine the effectiveness of policy-based RL methods on an important robust control problem, namely $μ$ synthesis. We build a connection between robust adversarial RL and $μ$ synthesis, and develop a model-free version of the well-known $DK$-iteration for solving state-feedback $μ$ synthesis with static $D$-scaling. In the proposed algorithm, the $K$ step mimics the classical central path algorithm via incorporating a recently-developed double-loop adversarial RL method as a subroutine, and the $D$ step is based on model-free finite difference approximation. Extensive numerical study is also presented to demonstrate the utility of our proposed model-free algorithm. Our study sheds new light on the connections between adversarial RL and robust control.
△ Less
Submitted 8 June, 2022; v1 submitted 30 November, 2021;
originally announced November 2021.
-
Robustness against Adversarial Attacks in Neural Networks using Incremental Dissipativity
Authors:
Bernardo Aquino,
Arash Rahnama,
Peter Seiler,
Lizhen Lin,
Vijay Gupta
Abstract:
Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and formal guarantees. Recently, some robustness certificates have appeared in the literature based on system theoretic notions. This work proposes an incremental dissipativity-based robust…
▽ More
Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and formal guarantees. Recently, some robustness certificates have appeared in the literature based on system theoretic notions. This work proposes an incremental dissipativity-based robustness certificate for neural networks in the form of a linear matrix inequality for each layer. We also propose an equivalent spectral norm bound for this certificate which is scalable to neural networks with multiple layers. We demonstrate the improved performance against adversarial attacks on a feed-forward neural network trained on MNIST and an Alexnet trained using CIFAR-10.
△ Less
Submitted 13 February, 2022; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Recurrent Neural Network Controllers Synthesis with Stability Guarantees for Partially Observed Systems
Authors:
Fangda Gu,
He Yin,
Laurent El Ghaoui,
Murat Arcak,
Peter Seiler,
Ming Jin
Abstract:
Neural network controllers have become popular in control tasks thanks to their flexibility and expressivity. Stability is a crucial property for safety-critical dynamical systems, while stabilization of partially observed systems, in many cases, requires controllers to retain and process long-term memories of the past. We consider the important class of recurrent neural networks (RNN) as dynamic…
▽ More
Neural network controllers have become popular in control tasks thanks to their flexibility and expressivity. Stability is a crucial property for safety-critical dynamical systems, while stabilization of partially observed systems, in many cases, requires controllers to retain and process long-term memories of the past. We consider the important class of recurrent neural networks (RNN) as dynamic controllers for nonlinear uncertain partially-observed systems, and derive convex stability conditions based on integral quadratic constraints, S-lemma and sequential convexification. To ensure stability during the learning and control process, we propose a projected policy gradient method that iteratively enforces the stability conditions in the reparametrized space taking advantage of mild additional information on system dynamics. Numerical experiments show that our method learns stabilizing controllers while using fewer samples and achieving higher final performance compared with policy gradient.
△ Less
Submitted 7 December, 2021; v1 submitted 8 September, 2021;
originally announced September 2021.
-
Robust Control Barrier Functions with Sector-Bounded Uncertainties
Authors:
Jyot Buch,
Shih-Chi Liao,
Peter Seiler
Abstract:
This paper focuses on safety critical control with sector-bounded uncertainties at the plant input. The uncertainties can represent nonlinear and/or time-varying components. We propose a new robust control barrier function (RCBF) approach to enforce safety requirements in the presence of these uncertainties. The primary objective is to minimally alter the given baseline control command to guarante…
▽ More
This paper focuses on safety critical control with sector-bounded uncertainties at the plant input. The uncertainties can represent nonlinear and/or time-varying components. We propose a new robust control barrier function (RCBF) approach to enforce safety requirements in the presence of these uncertainties. The primary objective is to minimally alter the given baseline control command to guarantee safety in the presence of modeled uncertainty. The resulting min-norm optimization problem can be recast as a Second-Order Cone Program (SOCP) to enable online implementation. Properties of this controller are studied and a numerical example is provided to illustrate the effectiveness of this approach.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
Control Barrier Functions With Unmodeled Dynamics Using Integral Quadratic Constraints
Authors:
Peter Seiler,
Mrdjan Jankovic,
Erik Hellstrom
Abstract:
This paper presents a control design method that achieves safety for systems with unmodeled dynamics at the plant input. The proposed method combines control barrier functions (CBFs) and integral quadratic constraints (IQCs). Simplified, low-order models are often used in the design of the controller. Parasitic, unmodeled dynamics (e.g. actuator dynamics, time delays, etc) can lead to safety viola…
▽ More
This paper presents a control design method that achieves safety for systems with unmodeled dynamics at the plant input. The proposed method combines control barrier functions (CBFs) and integral quadratic constraints (IQCs). Simplified, low-order models are often used in the design of the controller. Parasitic, unmodeled dynamics (e.g. actuator dynamics, time delays, etc) can lead to safety violations. The proposed method bounds the input-output behavior of these unmodeled dynamics in the time-domain using an alpha-IQC. The alpha-IQC is then incorporated into the CBF constraint to ensure safety. The approach is demonstrated with a simple example.
△ Less
Submitted 23 August, 2021;
originally announced August 2021.
-
Magnetotransport of Functional Oxide Heterostructures Affected by Spin-Orbit Coupling: A Tale of Two-Dimensional Systems
Authors:
Robert Bartel,
Elias Lettl,
Patrick Seiler,
Thilo Kopp,
German Hammerl
Abstract:
Oxide heterostructures allow for detailed studies of 2D electronic transport phenomena. Herein, different facets of magnetotransport in selected spin-orbit-coupled systems are analyzed and characterized by their single-band and multiband behavior, respectively. Experimentally, temperature- and magnetic field-dependent measurements in the single-band system BaPbO$_3$/SrTiO$_3$ reveal strong interpl…
▽ More
Oxide heterostructures allow for detailed studies of 2D electronic transport phenomena. Herein, different facets of magnetotransport in selected spin-orbit-coupled systems are analyzed and characterized by their single-band and multiband behavior, respectively. Experimentally, temperature- and magnetic field-dependent measurements in the single-band system BaPbO$_3$/SrTiO$_3$ reveal strong interplay of weak antilocalization (WAL) and electron-electron interaction (EEI). Within a scheme which treats both, WAL and EEI, on an equal footing a strong contribution of EEI at low temperatures is found which suggests the emergence of a strongly correlated ground state. Furthermore, now considering multiband effects as they appear, e.g., in the model system LaAlO$_3$/SrTiO$_3$, theoretical investigations predict a huge impact of filling on the topological Hall effect in systems with intermingled bands. Already weak band coupling produces striking deviations from the well-known Hall conductivity that are explainable in a fully quantum mechanical treatment which builds upon the hybridization of intersecting Hofstadter bands.
△ Less
Submitted 13 October, 2021; v1 submitted 15 April, 2021;
originally announced April 2021.
-
Estimating Regions of Attraction for Transitional Flows using Quadratic Constraints
Authors:
Aniketh Kalur,
Talha Mushtaq,
Peter Seiler,
Maziar S. Hemati
Abstract:
This letter describes a method for estimating regions of attraction and bounds on permissible perturbation amplitudes in nonlinear fluids systems. The proposed approach exploits quadratic constraints between the inputs and outputs of the nonlinearity on elliptical sets. This approach reduces conservatism and improves estimates for regions of attraction and bounds on permissible perturbation amplit…
▽ More
This letter describes a method for estimating regions of attraction and bounds on permissible perturbation amplitudes in nonlinear fluids systems. The proposed approach exploits quadratic constraints between the inputs and outputs of the nonlinearity on elliptical sets. This approach reduces conservatism and improves estimates for regions of attraction and bounds on permissible perturbation amplitudes over related methods that employ quadratic constraints on spherical sets. We present and investigate two algorithms for performing the analysis: an iterative method that refines the analysis by solving a sequence of semi-definite programs, and another based on solving a generalized eigenvalue problem with lower computational complexity, but at the cost of some precision in the final solution. The proposed algorithms are demonstrated on low-order mechanistic models of transitional flows. We further compare accuracy and computational complexity with analysis based on sum-of-squares optimization and direct-adjoint looping methods.
△ Less
Submitted 17 May, 2021; v1 submitted 9 March, 2021;
originally announced March 2021.
-
Imitation Learning with Stability and Safety Guarantees
Authors:
He Yin,
Peter Seiler,
Ming Jin,
Murat Arcak
Abstract:
A method is presented to learn neural network (NN) controllers with stability and safety guarantees through imitation learning (IL). Convex stability and safety conditions are derived for linear time-invariant plant dynamics with NN controllers by merging Lyapunov theory with local quadratic constraints to bound the nonlinear activation functions in the NN. These conditions are incorporated in the…
▽ More
A method is presented to learn neural network (NN) controllers with stability and safety guarantees through imitation learning (IL). Convex stability and safety conditions are derived for linear time-invariant plant dynamics with NN controllers by merging Lyapunov theory with local quadratic constraints to bound the nonlinear activation functions in the NN. These conditions are incorporated in the IL process, which minimizes the IL loss, and maximizes the volume of the region of attraction associated with the NN controller simultaneously. An alternating direction method of multipliers based algorithm is proposed to solve the IL problem. The method is illustrated on an inverted pendulum system, aircraft longitudinal dynamics, and vehicle lateral dynamics.
△ Less
Submitted 7 April, 2021; v1 submitted 16 December, 2020;
originally announced December 2020.
-
The influence of strut waviness on the tensile response of lattice materials
Authors:
P. E. Seiler,
K. Li,
V. S. Deshpande,
N. A. Fleck
Abstract:
Recent advances in additive manufacturing methods make it possible, for the first time, to manufacture complex micro-architectured solids that achieve desired stress versus strain responses. Here, we report experimental measurements and associated finite element (FE) calculations on the effect of strut shape upon the tensile response of two-dimensional (2D) lattices made from low-carbon steel shee…
▽ More
Recent advances in additive manufacturing methods make it possible, for the first time, to manufacture complex micro-architectured solids that achieve desired stress versus strain responses. Here, we report experimental measurements and associated finite element (FE) calculations on the effect of strut shape upon the tensile response of two-dimensional (2D) lattices made from low-carbon steel sheets. Two lattice topologies are considered: (i) a stretching-dominated triangular lattice and (ii) a bending-dominated hexagonal lattice. It is found that strut waviness can enhance the ductility of each lattice, particularly for bending-dominated hexagonal lattices. Manufacturing imperfections such as undercuts have a small effect on the ductility of the lattices but can significantly reduce the ultimate tensile strength. FE simulations provide additional insight into these observations and are used to construct design maps to aid the design of lattices with specified strength and ductility.
△ Less
Submitted 15 November, 2020;
originally announced November 2020.
-
Iterative Best Response for Multi-Body Asset-Guarding Games
Authors:
Emmanuel Sin,
Murat Arcak,
Douglas Philbrick,
Peter Seiler
Abstract:
We present a numerical approach to finding optimal trajectories for players in a multi-body, asset-guarding game with nonlinear dynamics and non-convex constraints. Using the Iterative Best Response (IBR) scheme, we solve for each player's optimal strategy assuming the other players' trajectories are known and fixed. Leveraging recent advances in Sequential Convex Programming (SCP), we use SCP as…
▽ More
We present a numerical approach to finding optimal trajectories for players in a multi-body, asset-guarding game with nonlinear dynamics and non-convex constraints. Using the Iterative Best Response (IBR) scheme, we solve for each player's optimal strategy assuming the other players' trajectories are known and fixed. Leveraging recent advances in Sequential Convex Programming (SCP), we use SCP as a subroutine within the IBR algorithm to efficiently solve an approximation of each player's constrained trajectory optimization problem. We apply the approach to an asset-guarding game example involving multiple pursuers and a single evader (i.e., n-versus-1 engagements). Resulting evader trajectories are tested in simulation to verify successful evasion against pursuers using conventional intercept guidance laws.
△ Less
Submitted 3 November, 2020;
originally announced November 2020.
-
Regulation of notch sensitivity of lattice materials by strut topology
Authors:
K. Li,
P. E. Seiler,
V. S. Deshpande,
N. A. Fleck
Abstract:
We propose a local reinforcement technique for lattices in the vicinity of a stress-raiser such as a notch, in order to elevate the macroscopic strength and ductility. A spatially non-uniform waviness distribution of sinusoidally-shaped struts is assumed in the vicinity of the notch, and the sensitivity of macroscopic tensile response to strut waviness distribution is studied by finite element ana…
▽ More
We propose a local reinforcement technique for lattices in the vicinity of a stress-raiser such as a notch, in order to elevate the macroscopic strength and ductility. A spatially non-uniform waviness distribution of sinusoidally-shaped struts is assumed in the vicinity of the notch, and the sensitivity of macroscopic tensile response to strut waviness distribution is studied by finite element analysis. Optimized lattice structures are determined in order to maximise the macroscopic tensile strength or ductility from these various strut waviness distributions. Both hexagonal and triangular lattices are studied as these geometries are representative of bending-dominated and stretching-dominated lattices, respectively.
△ Less
Submitted 12 October, 2020;
originally announced October 2020.
-
Construction of Periodic Counterexamples to the Discrete-Time Kalman Conjecture
Authors:
Peter Seiler,
Joaquin Carrasco
Abstract:
This paper considers the Lurye system of a discrete-time, linear time-invariant plant in negative feedback with a nonlinearity. Both monotone and slope-restricted nonlinearities are considered. The main result is a procedure to construct destabilizing nonlinearities for the Lurye system. If the plant satisfies a certain phase condition then a monotone nonlinearity can be constructed so that the Lu…
▽ More
This paper considers the Lurye system of a discrete-time, linear time-invariant plant in negative feedback with a nonlinearity. Both monotone and slope-restricted nonlinearities are considered. The main result is a procedure to construct destabilizing nonlinearities for the Lurye system. If the plant satisfies a certain phase condition then a monotone nonlinearity can be constructed so that the Lurye system has a non-trivial periodic cycle. Several examples are provided to demonstrate the construction. This represents a contribution for absolute stability analysis since the constructed nonlinearity provides a less conservative upper bound than existing bounds in the literature.
△ Less
Submitted 5 September, 2020;
originally announced September 2020.
-
An Efficient Algorithm to Compute Norms for Finite Horizon, Linear Time-Varying Systems
Authors:
Jyot Buch,
Murat Arcak,
Peter Seiler
Abstract:
We present an efficient algorithm to compute the induced norms of finite-horizon Linear Time-Varying (LTV) systems. The formulation includes both induced $\mathcal{L}_2$ and terminal Euclidean norm penalties. Existing computational approaches include the power iteration and bisection of a Riccati Differential Equation (RDE). The power iteration has low computation time per iteration but overall co…
▽ More
We present an efficient algorithm to compute the induced norms of finite-horizon Linear Time-Varying (LTV) systems. The formulation includes both induced $\mathcal{L}_2$ and terminal Euclidean norm penalties. Existing computational approaches include the power iteration and bisection of a Riccati Differential Equation (RDE). The power iteration has low computation time per iteration but overall convergence can be slow. In contrast, the RDE condition provides guaranteed bounds on the induced gain but single RDE integration can be slow. The complementary features of these two algorithms are combined to develop a new algorithm that is both fast and provides provable upper and lower bounds on the induced norm within the desired tolerance. The algorithm also provides a worst-case disturbance input that achieves the lower bound on the norm. We also present a new proof which shows that the power iteration for this problem converges monotonically. Finally, we show a controllability Gramian based simpler computational method for induced $\mathcal{L}_2$-to-Euclidean norm. This can be used to compute the reachable set at any time on the horizon. Numerical examples are provided to demonstrate the proposed algorithm.
△ Less
Submitted 2 November, 2020; v1 submitted 31 August, 2020;
originally announced August 2020.
-
Cross-polarization effects in sheared 2D grating couplers in a photonic BiCMOS technology
Authors:
Galina Georgieva,
Karsten Voigt,
Christian Mai,
Pascal M. Seiler,
Klaus Petermann,
Lars Zimmermann
Abstract:
We investigate numerically and experimentally sheared 2D grating couplers in a photonic BiCMOS technology with a focus on their splitting behavior. Two realization forms of a waveguide-to-grating shear angle are considered. The cross-polarization used as a figure-of-merit is shown to be strongly dependent on the grating perturbation strength and is a crucial limitation not only for the grating spl…
▽ More
We investigate numerically and experimentally sheared 2D grating couplers in a photonic BiCMOS technology with a focus on their splitting behavior. Two realization forms of a waveguide-to-grating shear angle are considered. The cross-polarization used as a figure-of-merit is shown to be strongly dependent on the grating perturbation strength and is a crucial limitation not only for the grating splitting performance, but also for its coupling efficiency.
△ Less
Submitted 22 July, 2020;
originally announced July 2020.
-
Stability Analysis using Quadratic Constraints for Systems with Neural Network Controllers
Authors:
He Yin,
Peter Seiler,
Murat Arcak
Abstract:
A method is presented to analyze the stability of feedback systems with neural network controllers. Two stability theorems are given to prove asymptotic stability and to compute an ellipsoidal inner-approximation to the region of attraction (ROA). The first theorem addresses linear time-invariant systems, and merges Lyapunov theory with local (sector) quadratic constraints to bound the nonlinear a…
▽ More
A method is presented to analyze the stability of feedback systems with neural network controllers. Two stability theorems are given to prove asymptotic stability and to compute an ellipsoidal inner-approximation to the region of attraction (ROA). The first theorem addresses linear time-invariant systems, and merges Lyapunov theory with local (sector) quadratic constraints to bound the nonlinear activation functions in the neural network. The second theorem allows the system to include perturbations such as unmodeled dynamics, slope-restricted nonlinearities, and time delay, using integral quadratic constraint (IQCs) to capture their input/output behavior. This in turn allows for off-by-one IQCs to refine the description of activation functions by capturing their slope restrictions. Both results rely on semidefinite programming to approximate the ROA. The method is illustrated on systems with neural networks trained to stabilize a nonlinear inverted pendulum as well as vehicle lateral dynamics with actuator uncertainty.
△ Less
Submitted 26 January, 2021; v1 submitted 13 June, 2020;
originally announced June 2020.
-
Finite Horizon Robust Synthesis Using Integral Quadratic Constraints
Authors:
Jyot Buch,
Peter Seiler
Abstract:
We present a robust synthesis algorithm for uncertain linear time-varying (LTV) systems on finite horizons. The uncertain system is described as an interconnection of a known LTV system and a perturbation. The input-output behavior of the perturbation is specified by time-domain Integral Quadratic Constraints (IQCs). The objective is to synthesize a controller to minimize the worst-case performanc…
▽ More
We present a robust synthesis algorithm for uncertain linear time-varying (LTV) systems on finite horizons. The uncertain system is described as an interconnection of a known LTV system and a perturbation. The input-output behavior of the perturbation is specified by time-domain Integral Quadratic Constraints (IQCs). The objective is to synthesize a controller to minimize the worst-case performance. This leads to a non-convex optimization. The proposed approach alternates between an LTV synthesis step and an IQC analysis step. Both induced $\mathcal{L}_2$ and terminal Euclidean norm penalties on output are considered for finite horizon performance. The proposed algorithm ensures that the robust performance is non-increasing at each iteration step. The effectiveness of this method is demonstrated using numerical examples.
△ Less
Submitted 28 January, 2021; v1 submitted 2 June, 2020;
originally announced June 2020.
-
Optimal assignment of collaborating agents in multi-body asset-guarding games
Authors:
Emmanuel Sin,
Murat Arcak,
Andrew Packard,
Douglas Philbrick,
Peter Seiler
Abstract:
We study a multi-body asset-guarding game in missile defense where teams of interceptor missiles collaborate to defend a non-manuevering asset against a group of threat missiles. We approach the problem in two steps. We first formulate an assignment problem where we optimally assign subsets of collaborating interceptors to each threat so that all threats are intercepted as far away from the asset…
▽ More
We study a multi-body asset-guarding game in missile defense where teams of interceptor missiles collaborate to defend a non-manuevering asset against a group of threat missiles. We approach the problem in two steps. We first formulate an assignment problem where we optimally assign subsets of collaborating interceptors to each threat so that all threats are intercepted as far away from the asset as possible. We assume that each interceptor is controlled by a collaborative guidance law derived from linear quadratic dynamic games. Our results include a 6-DOF simulation of a 5-interceptor versus 3-threat missile engagement where each agent is modeled as a missile airframe controlled by an autopilot. Despite the assumption of linear dynamics in our collaborative guidance law and the unmodeled dynamics in the simulation environment (e.g., varying density and gravity), we show that the simulated trajectories match well with those predicted by our approach. Furthermore, we show that a more agile threat, with greater speed and acceleration, can be intercepted by inferior interceptors when they collaborate. We believe the concepts introduced in this paper may be applied in asymmetric missile defense scenarios, including defense against advanced cruise missiles and hypersonic vehicles.
△ Less
Submitted 25 May, 2020;
originally announced May 2020.
-
Finite Step Performance of First-order Methods Using Interpolation Conditions Without Function Evaluations
Authors:
Bruce Lee,
Peter Seiler
Abstract:
We present a procedure to numerically compute finite step worst case performance guarantees on a given algorithm for the unconstrained optimization of strongly convex functions with Lipschitz continuous gradients. The solution method provided serves as an alternative approach to that derived by Taylor, Hendrickx, and Glineur in [Math. Prog. 161 (1-2), 2017]. The difference lies in the fact that ou…
▽ More
We present a procedure to numerically compute finite step worst case performance guarantees on a given algorithm for the unconstrained optimization of strongly convex functions with Lipschitz continuous gradients. The solution method provided serves as an alternative approach to that derived by Taylor, Hendrickx, and Glineur in [Math. Prog. 161 (1-2), 2017]. The difference lies in the fact that our solution uses conditions for the interpolation of a set of points and gradient evaluations by the gradient of a function in the class of interest, whereas their solution uses conditions for the interpolation of a set of points, gradient evaluations, and function evaluations by a function in the class of interest. The motivation for this alternative solution is that, in many cases, neither the algorithm nor the performance metric of interest rely upon function evaluations. The primary development is a procedure to avoid suffering from the factorial growth in the number of these conditions with the size of the set to be interpolated when solving for the worst case performance.
△ Less
Submitted 18 May, 2020; v1 submitted 4 May, 2020;
originally announced May 2020.
-
Nonlinear Stability Analysis of Transitional Flows using Quadratic Constraints
Authors:
Aniketh Kalur,
Peter Seiler,
Maziar S. Hemati
Abstract:
The dynamics of transitional flows are governed by an interplay between the non-normal linear dynamics and quadratic nonlinearity in the incompressible Navier-Stokes equations. In this work, we propose a framework for nonlinear stability analysis that exploits the fact that nonlinear flow interactions are constrained by the physics encoded in the nonlinearity. In particular, we show that nonlinear…
▽ More
The dynamics of transitional flows are governed by an interplay between the non-normal linear dynamics and quadratic nonlinearity in the incompressible Navier-Stokes equations. In this work, we propose a framework for nonlinear stability analysis that exploits the fact that nonlinear flow interactions are constrained by the physics encoded in the nonlinearity. In particular, we show that nonlinear stability analysis problems can be posed as convex feasibility and optimization problems based on Lyapunov matrix inequalities, and a set of quadratic constraints that represent the nonlinear flow physics. The proposed framework can be used to conduct global stability, local stability, and transient energy growth analysis. The approach is demonstrated on the low-dimensional Waleffe-Kim-Hamilton model of transition and sustained turbulence. Our analysis correctly determines the critical Reynolds number for global instability. For local stability analysis, we show that the framework can estimate the size of the region of attraction as well as the amplitude of the largest permissible perturbation such that all trajectories converge back to the equilibrium point. Additionally, we show that the framework can predict bounds on the maximum transient energy growth. Finally, we show that careful analysis of the multipliers used to enforce the quadratic constraints can be used to extract dominant nonlinear flow interactions that drive the dynamics and associated instabilities.
△ Less
Submitted 29 March, 2021; v1 submitted 11 April, 2020;
originally announced April 2020.