Showing 1–44 of 44 results for author: Heemels, W P M H

Synthesis of Discrete-time Control Barrier Functions for Polynomial Systems Based on Sum-of-Squares Programming

Authors: Erfan Shakhesi, W. P. M. H. Heemels, Alexander Katriniok

Abstract: Discrete-time Control Barrier Functions (DTCBFs) are commonly utilized in the literature as a powerful tool for synthesizing control policies that guarantee safety of discrete-time dynamical systems. However, the systematic synthesis of DTCBFs in a computationally efficient way is at present an important open problem. This article first proposes a novel alternating-descent approach based on Sum-of… ▽ More Discrete-time Control Barrier Functions (DTCBFs) are commonly utilized in the literature as a powerful tool for synthesizing control policies that guarantee safety of discrete-time dynamical systems. However, the systematic synthesis of DTCBFs in a computationally efficient way is at present an important open problem. This article first proposes a novel alternating-descent approach based on Sum-of-Squares programming to synthesize quadratic DTCBFs and corresponding polynomial control policies for discrete-time control-affine polynomial systems with input constraints and semi-algebraic safe sets. Subsequently, two distinct approaches are introduced to extend the proposed method to the synthesis of higher-degree polynomial DTCBFs. To demonstrate its efficacy, we apply the proposed method to numerical case studies. △ Less

Submitted 29 April, 2025; v1 submitted 27 April, 2025; originally announced April 2025.

Leveraging Non-Steady-State Frequency-Domain Data in Willems' Fundamental Lemma

Authors: T. J. Meijer, M. Wind, V. S. Dolk, W. P. M. H. Heemels

Abstract: Willems' fundamental lemma enables data-driven analysis and control by characterizing an unknown system's behavior directly in terms of measured data. In this work, we extend a recent frequency-domain variant of this result--previously limited to steady-state data--to incorporate non-steady-state data including transient phenomena. This approach eliminates the need to wait for transients to decay… ▽ More Willems' fundamental lemma enables data-driven analysis and control by characterizing an unknown system's behavior directly in terms of measured data. In this work, we extend a recent frequency-domain variant of this result--previously limited to steady-state data--to incorporate non-steady-state data including transient phenomena. This approach eliminates the need to wait for transients to decay during data collection, significantly reducing the experiment duration. Unlike existing frequency-domain system identification methods, our approach integrates transient data without preprocessing, making it well-suited for direct data-driven analysis and control. We demonstrate its effectiveness by isolating transients in the collected data and performing FRF evaluation at arbitrary frequencies in a numerical case study including noise. △ Less

Submitted 8 April, 2025; originally announced April 2025.

Rhythmic neuromorphic control of a pendulum: A hybrid systems analysis

Authors: E. Petri, R. Postoyan, W. P. M. H. Heemels

Abstract: Neuromorphic engineering is an emerging research domain that aims to realize important implementation advantages that brain-inspired technologies can offer over classical digital technologies, including energy efficiency, adaptability, and robustness. For the field of systems and control, neuromorphic controllers could potentially bring many benefits, but their advancement is hampered by lack of s… ▽ More Neuromorphic engineering is an emerging research domain that aims to realize important implementation advantages that brain-inspired technologies can offer over classical digital technologies, including energy efficiency, adaptability, and robustness. For the field of systems and control, neuromorphic controllers could potentially bring many benefits, but their advancement is hampered by lack of systematic analysis and design tools. In this paper, the objective is to show that hybrid systems methods can aid in filling this gap. We do this by formally analyzing rhythmic neuromorphic control of a pendulum system, which was recently proposed as a prototypical setup. The neuromorphic controller generates spikes, which we model as a Dirac delta pulse, whenever the pendulum angular position crosses its resting position, with the goal of inducing a stable limit cycle. This leads to modeling the closed-loop system as a hybrid dynamical system, which in between spikes evolves in open loop and where the jumps correspond to the spiking control actions. Exploiting the hybrid system model, we formally prove the existence, uniqueness, and a stability property of the hybrid limit cycle for the closed-loop system. Numerical simulations illustrate our approach. We finally elaborate on a possible spiking adaptation mechanism on the pulse amplitude to generate a hybrid limit cycle of a desired maximal angular amplitude. △ Less

Submitted 8 April, 2025; originally announced April 2025.

Smart Exploration in Reinforcement Learning using Bounded Uncertainty Models

Authors: J. S. van Hulst, W. P. M. H. Heemels, D. J. Antunes

Abstract: Reinforcement learning (RL) is a powerful tool for decision-making in uncertain environments, but it often requires large amounts of data to learn an optimal policy. We propose using prior model knowledge to guide the exploration process to speed up this learning process. This model knowledge comes in the form of a model set to which the true transition kernel and reward function belong. We optimi… ▽ More Reinforcement learning (RL) is a powerful tool for decision-making in uncertain environments, but it often requires large amounts of data to learn an optimal policy. We propose using prior model knowledge to guide the exploration process to speed up this learning process. This model knowledge comes in the form of a model set to which the true transition kernel and reward function belong. We optimize over this model set to obtain upper and lower bounds on the Q-function, which are then used to guide the exploration of the agent. We provide theoretical guarantees on the convergence of the Q-function to the optimal Q-function under the proposed class of exploring policies. Furthermore, we also introduce a data-driven regularized version of the model set optimization problem that ensures the convergence of the class of exploring policies to the optimal policy. Lastly, we show that when the model set has a specific structure, namely the bounded-parameter MDP (BMDP) framework, the regularized model set optimization problem becomes convex and simple to implement. In this setting, we also show that we obtain finite-time convergence to the optimal policy under additional assumptions. We demonstrate the effectiveness of the proposed exploration strategy in a simulation study. The results indicate that the proposed method can significantly speed up the learning process in reinforcement learning. △ Less

Submitted 8 April, 2025; originally announced April 2025.

Comments: Submitted for publication

Feedback Optimization with State Constraints through Control Barrier Functions

Authors: Giannis Delimpaltadakis, Pol Mestres, Jorge Cortés, W. P. M. H. Heemels

Abstract: Recently, there has been a surge of research on a class of methods called feedback optimization. These are methods to steer the state of a control system to an equilibrium that arises as the solution of an optimization problem. Despite the growing literature on the topic, the important problem of enforcing state constraints at all times remains unaddressed. In this work, we present the first feedb… ▽ More Recently, there has been a surge of research on a class of methods called feedback optimization. These are methods to steer the state of a control system to an equilibrium that arises as the solution of an optimization problem. Despite the growing literature on the topic, the important problem of enforcing state constraints at all times remains unaddressed. In this work, we present the first feedback-optimization method that enforces state constraints. The method combines a class of dynamics called safe gradient flows with high-order control barrier functions. We provide a number of results on our proposed controller, including well-posedness guarantees, anytime constraint-satisfaction guarantees, equivalence between the closed-loop's equilibria and the optimization problem's critical points, and local asymptotic stability of optima. △ Less

Submitted 1 April, 2025; originally announced April 2025.

Distributed Design of Ultra Large-Scale Control Systems: Progress, Challenges, and Prospects

Authors: Leonardo Pedroso, Pedro Batista, W. P. M. H. Heemels

Abstract: The transition from large centralized complex control systems to distributed configurations that rely on a network of a very large number of interconnected simpler subsystems is ongoing and inevitable in many applications. It is attributed to the quest for resilience, flexibility, and scalability in a multitude of engineering fields with far-reaching societal impact. Although many design methods f… ▽ More The transition from large centralized complex control systems to distributed configurations that rely on a network of a very large number of interconnected simpler subsystems is ongoing and inevitable in many applications. It is attributed to the quest for resilience, flexibility, and scalability in a multitude of engineering fields with far-reaching societal impact. Although many design methods for distributed and decentralized control systems are available, most of them rely on a centralized design procedure requiring some form of global information of the whole system. Clearly, beyond a certain scale of the network, these centralized design procedures for distributed controllers are no longer feasible and we refer to the corresponding systems as ultra large-scale systems (ULSS). For these ULSS, design algorithms are needed that are distributed themselves among the subsystems and are subject to stringent requirements regarding communication, computation, and memory usage of each subsystem. In this paper, a set of requirements is provided that assures a feasible real-time implementation of all phases of a control solution on an ultra large scale. State-of-the-art approaches are reviewed in the light of these requirements and the challenges hampering the development of befitting control algorithms are pinpointed. Comparing the challenges with the current progress leads to the identification and motivation of promising research directions. △ Less

Submitted 30 March, 2025; originally announced March 2025.

Comments: (in press)

Journal ref: Annual Reviews in Control, vol. 59C, pp. 100987, 2025

Stabilization of singularly perturbed networked control systems over a single channel

Authors: Weixuan Wang, Alejandro I. Maass, Dragan Nešić, Ying Tan, Romain Postoyan, W. P. M. H. Heemels

Abstract: This paper studies the emulation-based stabilization of nonlinear networked control systems with two time scales. We address the challenge of using a single communication channel for transmitting both fast and slow variables between the plant and the controller. A novel dual clock mechanism is proposed to schedule transmissions for this purpose. The system is modeled as a hybrid singularly perturb… ▽ More This paper studies the emulation-based stabilization of nonlinear networked control systems with two time scales. We address the challenge of using a single communication channel for transmitting both fast and slow variables between the plant and the controller. A novel dual clock mechanism is proposed to schedule transmissions for this purpose. The system is modeled as a hybrid singularly perturbed dynamical system, and singular perturbation analysis is employed to determine individual maximum allowable transmission intervals for both fast and slow variables, ensuring semi-global practical asymptotic stability. Enhanced stability guarantees are also provided under stronger assumptions. The efficacy of the proposed method is illustrated through a numerical example. △ Less

Submitted 25 February, 2025; originally announced February 2025.

Comments: 16 pages, 2 figures, submitted to Automatica

From a Frequency-Domain Willems' Lemma to Data-Driven Predictive Control

Authors: T. J. Meijer, K. J. A. Scheres, S. A. N. Nouwens, V. S. Dolk, W. P. M. H. Heemels

Abstract: Willems' fundamental lemma has recently received an impressive amount of attention from the (data-driven) control community. In this paper, we formulate a version of this celebrated result based on frequency-domain data. In doing so, we bridge the gap between recent developments in data-driven analysis and control, and the readily-available techniques and extensive expertise for non-parametric fre… ▽ More Willems' fundamental lemma has recently received an impressive amount of attention from the (data-driven) control community. In this paper, we formulate a version of this celebrated result based on frequency-domain data. In doing so, we bridge the gap between recent developments in data-driven analysis and control, and the readily-available techniques and extensive expertise for non-parametric frequency-domain identification in academia and industry. In addition, we generalize our results to allow multiple frequency-domain data sets to be carefully combined to form a sufficiently rich data set. Building on these results, we propose a data-driven predictive control scheme based on measured frequency-domain data of the plant. This novel scheme provides a frequency-domain counterpart of the well-known data-enabled predictive control scheme DeePC based on time-domain data. We prove that, under appropriate conditions, the new frequency-domain data-driven predictive control (FreePC) scheme is equivalent to the corresponding DeePC scheme, and we demonstrate the benefits of FreePC and the use of frequency-domain data in a numerical case study. These benefits include the ability to collect data in closed loop with a pre-stabilizing controller, dealing with noisy data, without increasing computational complexity, and intuitively visualizing the uncertainty in the frequency-domain data. In addition, we further showcase the potential of our frequency-domain Willems' fundamental lemma in applications to data-driven simulation, and the linear-quadratic regulator (LQR) problem. Finally, we show that our results can be used to evaluate the transfer function of the system at a desired frequency based on a finite amount of frequency-domain data. △ Less

Submitted 31 January, 2025; originally announced January 2025.

High-Performance Model Predictive Control for Quadcopters with Formal Stability Guarantees

Authors: Maedeh Izadi, A. T. J. R. Cobbenhagen, Ruben Sommer, A. R. P. Andriën, Erjen Lefeber, W. P. M. H. Heemels

Abstract: In this paper, we present a novel cascade control structure with formal guarantees of uniform almost global asymptotic stability for the state tracking error dynamics of a quadcopter. The proposed approach features a model predictive control strategy for the outer loop, explicitly accounting for the non-zero total thrust constraint. The outer-loop controller generates an acceleration reference, wh… ▽ More In this paper, we present a novel cascade control structure with formal guarantees of uniform almost global asymptotic stability for the state tracking error dynamics of a quadcopter. The proposed approach features a model predictive control strategy for the outer loop, explicitly accounting for the non-zero total thrust constraint. The outer-loop controller generates an acceleration reference, which is then converted into attitude, angular velocity and acceleration references, subsequently tracked by a nonlinear inner-loop controller. The proposed cascade control strategy is validated through numerical case studies, underlying high-fidelity models, demonstrating its ability to track fast trajectories with small error. △ Less

Submitted 28 December, 2024; originally announced December 2024.

Constraint-adaptive MPC for large-scale systems: Satisfying state constraints without imposing them

Authors: S. A. N. Nouwens, B. de Jager, M. M. Paulides, W. P. M. H. Heemels

Abstract: Model Predictive Control (MPC) is a successful control methodology, which is applied to increasingly complex systems. However, real-time feasibility of MPC can be challenging for complex systems, certainly when an (extremely) large number of constraints have to be adhered to. For such scenarios with a large number of state constraints, this paper proposes two novel MPC schemes for general nonlinea… ▽ More Model Predictive Control (MPC) is a successful control methodology, which is applied to increasingly complex systems. However, real-time feasibility of MPC can be challenging for complex systems, certainly when an (extremely) large number of constraints have to be adhered to. For such scenarios with a large number of state constraints, this paper proposes two novel MPC schemes for general nonlinear systems, which we call constraint-adaptive MPC. These novel schemes dynamically select at each time step a (varying) set of constraints that are included in the on-line optimization problem. Carefully selecting the included constraints can significantly reduce, as we will demonstrate, the computational complexity with often only a slight impact on the closed-loop performance. Although not all (state) constraints are imposed in the on-line optimization, the schemes still guarantee recursive feasibility and constraint satisfaction. A numerical case study illustrates the proposed MPC schemes and demonstrates the achieved computation time improvements exceeding two orders of magnitude without loss of performance. △ Less

Submitted 24 October, 2024; originally announced October 2024.

Comments: 6 pages, 4 figures, IFAC NMPC 2021 conference

Accelerating soft-constrained MPC for linear systems through online constraint removal

Authors: S. A. N. Nouwens, M. M. Paulides, W. P. M. H. Heemels

Abstract: Optimization-based controllers, such as Model Predictive Control (MPC), have attracted significant research interest due to their intuitive concept, constraint handling capabilities, and natural application to multi-input multi-output systems. However, the computational complexity of solving a receding horizon problem at each time step remains a challenge for the deployment of MPC. This is particu… ▽ More Optimization-based controllers, such as Model Predictive Control (MPC), have attracted significant research interest due to their intuitive concept, constraint handling capabilities, and natural application to multi-input multi-output systems. However, the computational complexity of solving a receding horizon problem at each time step remains a challenge for the deployment of MPC. This is particularly the case for systems constrained by many inequalities. Recently, we introduced the concept of constraint-adaptive MPC (ca-MPC) to address this challenge for linear systems with hard constraints. In ca-MPC, at each time step, a subset of the constraints is removed from the optimization problem, thereby accelerating the optimization procedure, while resulting in identical closed-loop behavior. The present paper extends this framework to soft-constrained MPC by detecting and removing constraints based on sub-optimal predicted input sequences, which is rather easy for soft-constrained MPC due to the receding horizon principle and the inclusion of slack variables. We will translate these new ideas explicitly to an offset-free output tracking problem. The effectiveness of these ideas is demonstrated on a two-dimensional thermal transport model, showing a three order of magnitude improvement in online computational time of the MPC scheme. △ Less

Submitted 23 October, 2024; originally announced October 2024.

Comments: 6 pages, 5 figures, CDC 2023 conference

Approximate Kalman filtering for large-scale systems with an application to hyperthermia cancer treatments

Authors: S. A. N. Nouwens, M. M. Paulides, W. P. M. H. Heemels

Abstract: Accurate state estimates are required for increasingly complex systems, to enable, for example, feedback control. However, available state estimation schemes are not necessarily real-time feasible for certain large-scale systems. Therefore, we develop in this paper, a real-time feasible state-estimation scheme for a class of large-scale systems that approximates the steady state Kalman filter. In… ▽ More Accurate state estimates are required for increasingly complex systems, to enable, for example, feedback control. However, available state estimation schemes are not necessarily real-time feasible for certain large-scale systems. Therefore, we develop in this paper, a real-time feasible state-estimation scheme for a class of large-scale systems that approximates the steady state Kalman filter. In particular, we focus on systems where the state-vector is the result of discretizing the spatial domain, as typically seen in Partial Differential Equations. In such cases, the correlation between states in the state-vector often have an intuitive interpretation on the spatial domain, which can be exploited to obtain a significant reduction in computational complexity, while still providing accurate state estimates. We illustrate these strengths of our method through a hyperthermia cancer treatment case study. The results of the case study show significant improvements in the computation time, while simultaneously obtaining good state estimates, when compared to Ensemble Kalman filters and Kalman filters using reduced-order models. △ Less

Submitted 23 October, 2024; originally announced October 2024.

Comments: 6 pages, 6 figures, CDC 2022 conference

Constraint Removal for MPC with Performance Preservation and a Hyperthermia Cancer Treatment Case Study

Authors: S. A. N. Nouwens, B. de Jager, M. M. Paulides, W. P. M. H. Heemels

Abstract: Model predictive control (MPC) is an optimization-based control strategy with broad industrial adoption. Unfortunately, the required computation time to solve the receding-horizon MPC optimization problem can become prohibitively large for many applications with a large number of state constraints. This large number of state constraints can, for instance, originate from spatially discretizing a pa… ▽ More Model predictive control (MPC) is an optimization-based control strategy with broad industrial adoption. Unfortunately, the required computation time to solve the receding-horizon MPC optimization problem can become prohibitively large for many applications with a large number of state constraints. This large number of state constraints can, for instance, originate from spatially discretizing a partial differential equation of which the solution has to satisfy constraints over the full spatial domain. This is particularly the case in MPC for RF-based hyperthermia cancer treatments, which forms a strong motivation for this study. To address this problem, we propose a novel constraint-adaptive MPC framework for linear discrete-time systems. In this framework, we select at each time-step a subset of the state constraints that are included in the optimization problem, thereby reducing the online computational burden. Critically, our framework guarantees the same closed-loop performance, recursive feasibility, and constraint satisfaction properties as the original (non-reduced) MPC scheme. We achieve this result by efficiently exploiting reachable set computations and the MPC cost function. We will demonstrate our novel method using a hyperthermia cancer treatment case study showing a two-orders of magnitude improvement in computation time, with identical closed-loop performance as the original (non-reduced) MPC scheme. △ Less

Submitted 23 October, 2024; originally announced October 2024.

Comments: 6 pages, 3 figures, CDC 2021 conference

Cooperative nonlinear distributed model predictive control with dissimilar control horizons

Authors: Paula Chanfreut, José M. Maestre, Quanyan Zhu, W. P. M. H. Heemels

Abstract: In this paper, we introduce a nonlinear distributed model predictive control (DMPC) algorithm, which allows for dissimilar and time-varying control horizons among agents, thereby addressing a common limitation in current DMPC schemes. We consider cooperative agents with varying computational capabilities and operational objectives, each willing to manage varying numbers of optimization variables a… ▽ More In this paper, we introduce a nonlinear distributed model predictive control (DMPC) algorithm, which allows for dissimilar and time-varying control horizons among agents, thereby addressing a common limitation in current DMPC schemes. We consider cooperative agents with varying computational capabilities and operational objectives, each willing to manage varying numbers of optimization variables at each time step. Recursive feasibility and a non-increasing evolution of the optimal cost are proven for the proposed algorithm. Through numerical simulations on systems with three agents, we show that our approach effectively approximates the performance of traditional DMPC, while reducing the number of variables to be optimized. This advancement paves the way for a more decentralized yet coordinated control strategy in various applications, including power systems and traffic management. △ Less

Submitted 14 October, 2024; originally announced October 2024.

Comments: 6 pages

Optimization-based Verification of Discrete-time Control Barrier Functions: A Branch-and-Bound Approach

Authors: Erfan Shakhesi, W. P. M. H. Heemels, Alexander Katriniok

Abstract: Discrete-time Control Barrier Functions (DTCBFs) form a powerful control theoretic tool to guarantee safety and synthesize safe controllers for discrete-time dynamical systems. In this paper, we provide an optimization-based algorithm, inspired by the $α$BB algorithm, for the verification of a candidate DTCBF, i.e., either verifying a given candidate function as a valid DTCBF or falsifying it by p… ▽ More Discrete-time Control Barrier Functions (DTCBFs) form a powerful control theoretic tool to guarantee safety and synthesize safe controllers for discrete-time dynamical systems. In this paper, we provide an optimization-based algorithm, inspired by the $α$BB algorithm, for the verification of a candidate DTCBF, i.e., either verifying a given candidate function as a valid DTCBF or falsifying it by providing a counterexample for a general nonlinear discrete-time system with input constraints. This method is applicable whether a corresponding control policy is known or unknown. We apply our method to a numerical case study to illustrate its efficacy. △ Less

Submitted 23 September, 2024; originally announced September 2024.

Data-Efficient Quadratic Q-Learning Using LMIs

Authors: J. S. van Hulst, W. P. M. H. Heemels, D. J. Antunes

Abstract: Reinforcement learning (RL) has seen significant research and application results but often requires large amounts of training data. This paper proposes two data-efficient off-policy RL methods that use parametrized Q-learning. In these methods, the Q-function is chosen to be linear in the parameters and quadratic in selected basis functions in the state and control deviations from a base policy.… ▽ More Reinforcement learning (RL) has seen significant research and application results but often requires large amounts of training data. This paper proposes two data-efficient off-policy RL methods that use parametrized Q-learning. In these methods, the Q-function is chosen to be linear in the parameters and quadratic in selected basis functions in the state and control deviations from a base policy. A cost penalizing the $\ell_1$-norm of Bellman errors is minimized. We propose two methods: Linear Matrix Inequality Q-Learning (LMI-QL) and its iterative variant (LMI-QLi), which solve the resulting episodic optimization problem through convex optimization. LMI-QL relies on a convex relaxation that yields a semidefinite programming (SDP) problem with linear matrix inequalities (LMIs). LMI-QLi entails solving sequential iterations of an SDP problem. Both methods combine convex optimization with direct Q-function learning, significantly improving learning speed. A numerical case study demonstrates their advantages over existing parametrized Q-learning methods. △ Less

Submitted 18 September, 2024; originally announced September 2024.

Comments: Accepted for Presentation at 63rd IEEE Conference on Decision and Control, CDC 2024, Milan, Italy, 2024

Analysis of a Simple Neuromorphic Controller for Linear Systems: A Hybrid Systems Perspective

Authors: E. Petri, K. J. A. Scheres, E. Steur, W. P. M. H. Heemels

Abstract: In this paper we analyze a neuromorphic controller, inspired by the leaky integrate-and-fire neuronal model, in closed-loop with a single-input single-output linear time-invariant system. The controller consists of two neuron-like variables and generates a spiking control input whenever one of these variables reaches a threshold. The control input is different from zero only at the spiking instant… ▽ More In this paper we analyze a neuromorphic controller, inspired by the leaky integrate-and-fire neuronal model, in closed-loop with a single-input single-output linear time-invariant system. The controller consists of two neuron-like variables and generates a spiking control input whenever one of these variables reaches a threshold. The control input is different from zero only at the spiking instants and, hence, between two spiking times the system evolves in open-loop. Exploiting the hybrid nature of the integrate-and-fire neuronal dynamics, we present a hybrid modeling framework to design and analyze this new controller. In the particular case of single-state linear time-invariant plants, we prove a practical stability property for the closed-loop system, we ensure the existence of a strictly positive dwell-time between spikes, and we relate these properties to the parameters in the neurons. The results are illustrated in a numerical example. △ Less

Submitted 10 September, 2024; originally announced September 2024.

Filtering in Projection-based Integrators for Improved Phase Characteristics

Authors: Hoang Chu, S. J. A. M van den Eijnden, M. F. Heertjes, W. P. M. H. Heemels

Abstract: Projection-based integrators are effectively employed in high-precision systems with growing industrial success. By utilizing a projection operator, the resulting projection-based integrator keeps its input-output pair within a designated sector set, leading to unique freedom in control design that can be directly translated into performance benefits. This paper aims to enhance projection-based in… ▽ More Projection-based integrators are effectively employed in high-precision systems with growing industrial success. By utilizing a projection operator, the resulting projection-based integrator keeps its input-output pair within a designated sector set, leading to unique freedom in control design that can be directly translated into performance benefits. This paper aims to enhance projection-based integrators by incorporating well-crafted linear filters into its structure, resulting in a new class of projected integrators that includes the earlier ones, such as the hybrid-integrator gain systems (with and without pre-filtering) as special cases. The extra design freedom in the form of two filters in the input paths to the projection operator and the internal dynamics allows the controller to break away from the inherent limitations of the linear control design. The enhanced performance properties of the proposed structure are formally demonstrated through a (quasi-linear) describing function analysis, the absence of the gain-loss problem, and numerical case studies showcasing improved time-domain properties. The describing function analysis is supported by rigorously showing incremental properties of the new filtered projection-based integrators thereby guaranteeing that the computed steady-state responses are unique and asymptotically stable. △ Less

Submitted 30 August, 2024; originally announced August 2024.

Comments: to be presented at IEEE CDC 2024

Frequency-Domain Data-Driven Predictive Control

Authors: T. J. Meijer, S. A. N. Nouwens, K. J. A. Scheres, V. S. Dolk, W. P. M. H. Heemels

Abstract: In this paper, we propose a data-driven predictive control scheme based on measured frequency-domain data of the plant. This novel scheme complements the well-known data-driven predictive control (DeePC) approach based on time series data. To develop this new frequency-domain data-driven predictive control (FreePC) scheme, we introduce a novel version of Willems' fundamental lemma based on frequen… ▽ More In this paper, we propose a data-driven predictive control scheme based on measured frequency-domain data of the plant. This novel scheme complements the well-known data-driven predictive control (DeePC) approach based on time series data. To develop this new frequency-domain data-driven predictive control (FreePC) scheme, we introduce a novel version of Willems' fundamental lemma based on frequency-domain data. By exploiting frequency-domain data, we allow recent direct data-driven (predictive) control methodologies to benefit from the available expertise and techniques for non-parametric frequency-domain identification in academia and industry. We prove that, under appropriate conditions, the new FreePC scheme is equivalent to the corresponding DeePC scheme. The strengths of FreePC are demonstrated in a numerical case study. △ Less

Submitted 18 June, 2024; originally announced June 2024.

A Unified Non-Strict Finsler Lemma

Authors: T. J. Meijer, K. J. A. Scheres, S. van den Eijnden, T. Holicki, C. W. Scherer, W. P. M. H. Heemels

Abstract: In this paper, we present a unified general non-strict Finsler lemma. This result is general in the sense that it does not impose any restrictions on the involved matrices and, thereby, it encompasses all existing non-strict versions of Finsler's lemma that do impose such restrictions. To further illustrate its usefulness, we showcase applications of the non-strict Finsler's lemma in deriving a st… ▽ More In this paper, we present a unified general non-strict Finsler lemma. This result is general in the sense that it does not impose any restrictions on the involved matrices and, thereby, it encompasses all existing non-strict versions of Finsler's lemma that do impose such restrictions. To further illustrate its usefulness, we showcase applications of the non-strict Finsler's lemma in deriving a structured solution to a special case of the non-strict projection lemma, and we use the unified non-strict Finsler's lemma to prove a more general version of the matrix Finsler's lemma. △ Less

Submitted 18 June, 2024; v1 submitted 15 March, 2024; originally announced March 2024.

Fair Artificial Currency Incentives in Repeated Weighted Congestion Games: Equity vs. Equality

Authors: Leonardo Pedroso, Andrea Agazzi, W. P. M. H. Heemels, Mauro Salazar

Abstract: When users access shared resources in a selfish manner, the resulting societal cost and perceived users' cost is often higher than what would result from a centrally coordinated optimal allocation. While several contributions in mechanism design manage to steer the aggregate users choices to the desired optimum by using monetary tolls, such approaches bear the inherent drawback of discriminating a… ▽ More When users access shared resources in a selfish manner, the resulting societal cost and perceived users' cost is often higher than what would result from a centrally coordinated optimal allocation. While several contributions in mechanism design manage to steer the aggregate users choices to the desired optimum by using monetary tolls, such approaches bear the inherent drawback of discriminating against users with a lower income. More recently, incentive schemes based on artificial currencies have been studied with the goal of achieving a system-optimal resource allocation that is also fair. In this resource-sharing context, this paper focuses on repeated weighted congestion game with two resources, where users contribute to the congestion to different extents that are captured by individual weights. First, we address the broad concept of fairness by providing a rigorous mathematical characterization of the distinct societal metrics of equity and equality, i.e., the concepts of providing equal outcomes and equal opportunities, respectively. Second, we devise weight-dependent and time-invariant optimal pricing policies to maximize equity and equality, and prove convergence of the aggregate user choices to the system-optimum. In our framework it is always possible to achieve system-optimal allocations with perfect equity, while the maximum equality that can be reached may not be perfect, which is also shown via numerical simulations. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Continuous Approximations of Projected Dynamical Systems via Control Barrier Functions

Authors: Giannis Delimpaltadakis, Jorge Cortés, W. P. M. H. Heemels

Abstract: Projected Dynamical Systems (PDSs) form a class of discontinuous constrained dynamical systems, and have been used widely to solve optimization problems and variational inequalities. Recently, they have also gained significant attention for control purposes, such as high-performance integrators, saturated control and feedback optimization. In this work, we establish that locally Lipschitz continuo… ▽ More Projected Dynamical Systems (PDSs) form a class of discontinuous constrained dynamical systems, and have been used widely to solve optimization problems and variational inequalities. Recently, they have also gained significant attention for control purposes, such as high-performance integrators, saturated control and feedback optimization. In this work, we establish that locally Lipschitz continuous dynamics, involving Control Barrier Functions (CBFs), namely CBF-based dynamics, approximate PDSs. Specifically, we prove that trajectories of CBF-based dynamics uniformly converge to trajectories of PDSs, as a CBF-parameter approaches infinity. Towards this, we also prove that CBF-based dynamics are perturbations of PDSs, with quantitative bounds on the perturbation. Our results pave the way to implement discontinuous PDS-based controllers in a continuous fashion, employing CBFs. We demonstrate this on numerical examples on feedback optimization and synchronverter control. Moreover, our results can be employed to numerically simulate PDSs, overcoming disadvantages of existing discretization schemes, such as computing projections to possibly non-convex sets. Finally, this bridge between CBFs and PDSs may yield other potential benefits, including novel insights on stability. △ Less

Submitted 20 August, 2024; v1 submitted 1 March, 2024; originally announced March 2024.

Comments: Accepted to IEEE Transactions on Automatic Control (IEEE TAC). Compared to the accepted version, this version contains an additional numerical example on feedback optimization

Learning the cost-to-go for mixed-integer nonlinear model predictive control

Authors: Christopher A. Orrico, W. P. M. H. Heemels, Dinesh Krishnamoorthy

Abstract: Application of nonlinear model predictive control (NMPC) to problems with hybrid dynamical systems, disjoint constraints, or discrete controls often results in mixed-integer formulations with both continuous and discrete decision variables. However, solving mixed-integer nonlinear programming problems (MINLP) in real-time is challenging, which can be a limiting factor in many applications. To addr… ▽ More Application of nonlinear model predictive control (NMPC) to problems with hybrid dynamical systems, disjoint constraints, or discrete controls often results in mixed-integer formulations with both continuous and discrete decision variables. However, solving mixed-integer nonlinear programming problems (MINLP) in real-time is challenging, which can be a limiting factor in many applications. To address the computational complexity of solving mixed integer nonlinear model predictive control problem in real-time, this paper proposes an approximate mixed integer NMPC formulation based on value function approximation. Leveraging Bellman's principle of optimality, the key idea here is to divide the prediction horizon into two parts, where the optimal value function of the latter part of the prediction horizon is approximated offline using expert demonstrations. Doing so allows us to solve the MINMPC problem with a considerably shorter prediction horizon online, thereby reducing the online computation cost. The paper uses an inverted pendulum example with discrete controls to illustrate this approach. △ Less

Submitted 23 January, 2024; originally announced January 2024.

A Frequency-Domain Version of Willems' Fundamental Lemma

Authors: T. J. Meijer, S. A. N. Nouwens, V. S. Dolk, W. P. M. H. Heemels

Abstract: Willems' fundamental lemma has recently received an impressive amount of attention in the (data-driven) control community. In this paper, we formulate a frequency-domain equivalent of this lemma. In doing so, we bridge the gap between recent developments in data-driven analysis and control and the extensive knowledge on non-parametric frequency-domain identification that has accumulated, particula… ▽ More Willems' fundamental lemma has recently received an impressive amount of attention in the (data-driven) control community. In this paper, we formulate a frequency-domain equivalent of this lemma. In doing so, we bridge the gap between recent developments in data-driven analysis and control and the extensive knowledge on non-parametric frequency-domain identification that has accumulated, particularly in industry, through decades of working with classical (frequency-domain) control and identification techniques. Our formulation also allows for the combination of multiple data sets in the sense that, in the data, multiple input directions may be excited at the same frequency. We also illustrate the usefulness of our results by demonstrating how they can be applied to perform frequency-domain-data-driven simulation. △ Less

Submitted 26 November, 2023; originally announced November 2023.

The Safety Shell: an Architecture to Handle Functional Insufficiencies in Automated Driving

Authors: C. A. J. Hanselaar, E. Silvas, A. Terechko, W. P. M. H. Heemels

Abstract: To enable highly automated vehicles where the driver is no longer a safety backup, the vehicle must deal with various Functional Insufficiencies (FIs). Thus-far, there is no widely accepted functional architecture that maximizes the availability of autonomy and ensures safety in complex vehicle operational design domains. In this paper, we present a survey of existing methods that strive to preven… ▽ More To enable highly automated vehicles where the driver is no longer a safety backup, the vehicle must deal with various Functional Insufficiencies (FIs). Thus-far, there is no widely accepted functional architecture that maximizes the availability of autonomy and ensures safety in complex vehicle operational design domains. In this paper, we present a survey of existing methods that strive to prevent or handle FIs. We observe that current design-time methods of preventing FIs lack completeness guarantees. Complementary solutions for on-line handling cannot suitably increase safety without seriously impacting availability of journey continuing autonomous functionality. To fill this gap, we propose the Safety Shell, a scalable multi-channel architecture and arbitration design, built upon preexisting functional safety redundant channel architectures. We compare this novel approach to existing architectures using numerical case studies. The results show that the Safety Shell architecture allows the automated vehicle to be as safe or safer compared to alternatives, while simultaneously improving availability of vehicle autonomy, thereby increasing the possible coverage of on-line functional insufficiency handling. △ Less

Submitted 21 November, 2023; v1 submitted 20 October, 2023; originally announced November 2023.

Comments: 18 pages, 23 figures, 6 tables --> 21/11/2023 resubmitted with new content based on reviews, removed erroneously included formatting

Projection-based Controllers with Inherent Dissipativity Properties

Authors: Hoang Chu, S. J. A. M van den Eijnden, W. P. M. H. Heemels

Abstract: Projection-based Controllers (PBCs) are currently gaining traction in both scientific and engineering communities. In PBCs, the input-output signals of the controller are kept in sector-bounded sets by means of projection. In this paper, we will show how this projection operation can be used to induce useful passivity or general dissipativity properties on broad classes of (unprojected) nonlinear… ▽ More Projection-based Controllers (PBCs) are currently gaining traction in both scientific and engineering communities. In PBCs, the input-output signals of the controller are kept in sector-bounded sets by means of projection. In this paper, we will show how this projection operation can be used to induce useful passivity or general dissipativity properties on broad classes of (unprojected) nonlinear controllers that otherwise would not have these properties. The induced dissipativity properties of PBC will be exploited to guarantee asymptotic stability of negative feedback interconnections of passive nonlinear plants and suitably designed PBC, under mild conditions. Proper generalizations to so-called $(q,s,r)$-dissipativity will be presented as well. For illustrating the effectiveness of PBC control design via these passivity-based techniques, two numerical examples are provided. △ Less

Submitted 26 September, 2023; originally announced September 2023.

Comments: to be presented at IEEE CDC 2023 (Singapore)

Discrete-time Control Barrier Functions for Guaranteed Recursive Feasibility in Nonlinear MPC: An Application to Lane Merging

Authors: Alexander Katriniok, Erfan Shakhesi, W. P. M. H. Heemels

Abstract: In this paper, we present conditions under which the terminal ingredients, defined by discrete-time control barrier function (DTCBF) certificates, guarantee recursive feasibility in nonlinear MPC. Further, we introduce the notion of quasi-DTCBF (qDTCBF) certificates. Compared to DTCBFs, qDTCBF conditions can be satisfied with tighter control input bounds, which is highly advantageous if only limit… ▽ More In this paper, we present conditions under which the terminal ingredients, defined by discrete-time control barrier function (DTCBF) certificates, guarantee recursive feasibility in nonlinear MPC. Further, we introduce the notion of quasi-DTCBF (qDTCBF) certificates. Compared to DTCBFs, qDTCBF conditions can be satisfied with tighter control input bounds, which is highly advantageous if only limited actuation is possible. Both certificates encourage an earlier reaction of the control system and result in a lower cumulative MPC cost. The methodology is applied to a lane merging problem in automated driving, in which DTCBF and qDTCBF certificates subject to input constraints form the terminal ingredients to guarantee recursive feasibility of the nonlinear MPC scheme. A simulation study demonstrates the efficacy of the concept. △ Less

Submitted 20 September, 2023; v1 submitted 17 September, 2023; originally announced September 2023.

On the relationship between control barrier functions and projected dynamical systems

Authors: Giannis Delimpaltadakis, W. P. M. H. Heemels

Abstract: In this paper, we study the relationship between systems controlled via Control Barrier Function (CBF) approaches and a class of discontinuous dynamical systems, called Projected Dynamical Systems (PDSs). In particular, under appropriate assumptions, we show that the vector field of CBF-controlled systems is a Krasovskii-like perturbation of the set-valued map of a differential inclusion, that abs… ▽ More In this paper, we study the relationship between systems controlled via Control Barrier Function (CBF) approaches and a class of discontinuous dynamical systems, called Projected Dynamical Systems (PDSs). In particular, under appropriate assumptions, we show that the vector field of CBF-controlled systems is a Krasovskii-like perturbation of the set-valued map of a differential inclusion, that abstracts PDSs. This result provides a novel perspective to analyze and design CBF-based controllers. Specifically, we show how, in certain cases, it can be employed for designing CBF-based controllers that, while imposing safety, preserve asymptotic stability and do not introduce undesired equilibria or limit cycles. Finally, we briefly discuss about how it enables continuous implementations of certain projection-based controllers, that are gaining increasing popularity. △ Less

Submitted 8 September, 2023; originally announced September 2023.

Comments: To be presented at the 62nd IEEE Conference on Decision and Control, Dec. 13-15, 2023, Singapore

Mixed-Integer MPC Strategies for Fueling and Density Control in Fusion Tokamaks

Authors: Christopher A. Orrico, Matthijs van Berkel, Thomas O. S. J. Bosman, W. P. M. H. Heemels, Dinesh Krishnamoorthy

Abstract: Model predictive control (MPC) is promising for fueling and core density feedback control in nuclear fusion tokamaks, where the primary actuators, frozen hydrogen fuel pellets fired into the plasma, are discrete. Previous density feedback control approaches have only approximated pellet injection as a continuous input due to the complexity that it introduces. In this letter, we model plasma densit… ▽ More Model predictive control (MPC) is promising for fueling and core density feedback control in nuclear fusion tokamaks, where the primary actuators, frozen hydrogen fuel pellets fired into the plasma, are discrete. Previous density feedback control approaches have only approximated pellet injection as a continuous input due to the complexity that it introduces. In this letter, we model plasma density and pellet injection as a hybrid system and propose two MPC strategies for density control: mixed-integer (MI) MPC using a conventional mixed-integer programming (MIP) solver and MPC utilizing our novel modification of the penalty term homotopy (PTH) algorithm. By relaxing the integer requirements, the PTH algorithm transforms the MIP problem into a series of continuous optimization problems, reducing computational complexity. Our novel modification to the PTH algorithm ensures that it can handle path constraints, making it viable for constrained hybrid MPC in general. Both strategies perform well with regards to reference tracking without violating path constraints and satisfy the computation time limit for real-time control of the pellet injection system. However, the computation time of the PTH-based MPC strategy consistently outpaces the conventional MI-MPC strategy. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Certificates of Nonexistence for Lyapunov-Based Stability, Stabilizability and Detectability of LPV Systems

Authors: T. J. Meijer, V. S. Dolk, W. P. M. H. Heemels

Abstract: By computing Lyapunov functions of a certain, convenient structure, Lyapunov-based methods guarantee stability properties of the system or, when performing synthesis, of the relevant closed-loop or error dynamics. In doing so, they provide conclusive affirmative answers to many analysis and design questions in systems and control. When these methods fail to produce a feasible solution, however, th… ▽ More By computing Lyapunov functions of a certain, convenient structure, Lyapunov-based methods guarantee stability properties of the system or, when performing synthesis, of the relevant closed-loop or error dynamics. In doing so, they provide conclusive affirmative answers to many analysis and design questions in systems and control. When these methods fail to produce a feasible solution, however, they often remain inconclusive due to (a) the method being conservative or (b) the fact that there may be multiple causes for infeasibility, such as ill-conditioning, solver tolerances or true infeasibility. To overcome this, we develop LMI-based theorems of alternatives based upon which we can guarantee, by computing a so-called certificate of nonexistence, that no poly-quadratic Lyapunov function exists for a given linear parameter-varying system. We extend these ideas to also certify the nonexistence of controllers and observers for which the corresponding closed-loop/error dynamics admit a poly-quadratic Lyapunov function. Finally, we illustrate our results in some numerical case studies. △ Less

Submitted 25 May, 2023; originally announced May 2023.

The Non-Strict Projection Lemma

Authors: T. J. Meijer, T. Holicki, S. J. A. M. van den Eijnden, C. W. Scherer, W. P. M. H. Heemels

Abstract: The projection lemma (often also referred to as the elimination lemma) is one of the most powerful and useful tools in the context of linear matrix inequalities for system analysis and control. In its traditional formulation, the projection lemma only applies to strict inequalities, however, in many applications we naturally encounter non-strict inequalities. As such, we present, in this note, a n… ▽ More The projection lemma (often also referred to as the elimination lemma) is one of the most powerful and useful tools in the context of linear matrix inequalities for system analysis and control. In its traditional formulation, the projection lemma only applies to strict inequalities, however, in many applications we naturally encounter non-strict inequalities. As such, we present, in this note, a non-strict projection lemma that generalizes both its original strict formulation as well as an earlier non-strict version. We demonstrate several applications of our result in robust linear-matrix-inequality-based marginal stability analysis and stabilization, a matrix S-lemma, which is useful in (direct) data-driven control applications, and matrix dilation. △ Less

Submitted 15 March, 2024; v1 submitted 15 May, 2023; originally announced May 2023.

Comments: To appear in IEEE Transactions on Automatic Control

Direct Shaping of Minimum and Maximum Singular Values: An $\mathcal{H}_{-}/\mathcal{H}_{\infty}$ Synthesis Approach for Fault Detection Filters

Authors: Koen Classens, W. P. M. H. Heemels, Tom Oomen

Abstract: The performance of fault detection filters relies on a high sensitivity to faults and a low sensitivity to disturbances. The aim of this paper is to develop an approach to directly shape these sensitivities, expressed in terms of minimum and maximum singular values. The developed method offers an alternative solution to the $\mathcal{H}_{-}/\mathcal{H}_{\infty}$ synthesis problem, building upon tr… ▽ More The performance of fault detection filters relies on a high sensitivity to faults and a low sensitivity to disturbances. The aim of this paper is to develop an approach to directly shape these sensitivities, expressed in terms of minimum and maximum singular values. The developed method offers an alternative solution to the $\mathcal{H}_{-}/\mathcal{H}_{\infty}$ synthesis problem, building upon traditional multiobjective synthesis results. The result is an optimal filter synthesized via iterative convex optimization and the approach is particularly useful for fault diagnosis as illustrated by a numerical example. △ Less

Submitted 12 May, 2023; originally announced May 2023.

Unified Behavioral Data-Driven Performance Analysis: A Generalized Plant Approach

Authors: L. M. Spin, C. Verhoek, W. P. M. H. Heemels, N. van de Wouw, R. Tóth

Abstract: In this paper, we present a novel approach to combine data-driven non-parametric representations with model-based representations of dynamical systems. Based on a data-driven form of linear fractional transformations, we introduce a data-driven form of generalized plants. This form can be leveraged to accomplish performance characterizations, e.g., in the form of a mixed-sensitivity approach, and… ▽ More In this paper, we present a novel approach to combine data-driven non-parametric representations with model-based representations of dynamical systems. Based on a data-driven form of linear fractional transformations, we introduce a data-driven form of generalized plants. This form can be leveraged to accomplish performance characterizations, e.g., in the form of a mixed-sensitivity approach, and LMI-based conditions to verify finite-horizon dissipativity. In particular, we show how finite-horizon $\ell_2$-gain under weighting filter-based general performance specifications are verified for implemented controllers on systems for which only input-output data is available. The overall effectiveness of the proposed method is demonstrated by simulation examples. △ Less

Submitted 4 April, 2023; originally announced April 2023.

Comments: Submitted to the 62nd IEEE Conference on Decision and Control

Urgency-aware Routing in Single Origin-destination Itineraries through Artificial Currencies

Authors: Leonardo Pedroso, W. P. M. H. Heemels, Mauro Salazar

Abstract: Within mobility systems, the presence of self-interested users can lead to aggregate routing patterns that are far from the societal optimum which could be achieved by centrally controlling the users' choices. In this paper, we design a fair incentive mechanism to steer the selfish behavior of the users to align with the societally optimal aggregate routing. The proposed mechanism is based on an a… ▽ More Within mobility systems, the presence of self-interested users can lead to aggregate routing patterns that are far from the societal optimum which could be achieved by centrally controlling the users' choices. In this paper, we design a fair incentive mechanism to steer the selfish behavior of the users to align with the societally optimal aggregate routing. The proposed mechanism is based on an artificial currency that cannot be traded or bought, but only spent or received when traveling. Specifically, we consider a parallel-arc network with a single origin and destination node within a repeated game setting whereby each user chooses from one of the available arcs to reach their destination on a daily basis. In this framework, taking faster routes comes at a cost, whereas taking slower routes is incentivized by a reward. The users are thus playing against their future selves when choosing their present actions. To capture this complex behavior, we assume the users to be rational and to minimize an urgency-weighted combination of their immediate and future discomfort. To design the optimal pricing, we first derive a closed-form expression for the best individual response strategy. Second, we formulate the pricing design problem for each arc to achieve the societally optimal aggregate flows, and reformulate it so that it can be solved with gradient-free optimization methods. Our numerical simulations show that it is possible to achieve a near-optimal routing whilst significantly reducing the users' perceived discomfort when compared to a centralized optimal but urgency-unaware policy. △ Less

Submitted 29 March, 2023; originally announced March 2023.

Journal ref: 62nd IEEE Conference on Decision and Control (CDC), pp. 4142-4149, 2023

Constraint-Adaptive MPC for linear systems: A system-theoretic framework for speeding up MPC through online constraint removal

Authors: S. A. N. Nouwens, M. M. Paulides, W. P. M. H. Heemels

Abstract: Reducing the computation time of model predictive control (MPC) is important, especially for systems constrained by many state constraints. In this paper, we propose a new online constraint removal framework for linear systems, for which we coin the term constraint-adaptive MPC (ca-MPC). In so-called exact ca-MPC, we adapt the imposed constraints by removing, at each time-step, a subset of the sta… ▽ More Reducing the computation time of model predictive control (MPC) is important, especially for systems constrained by many state constraints. In this paper, we propose a new online constraint removal framework for linear systems, for which we coin the term constraint-adaptive MPC (ca-MPC). In so-called exact ca-MPC, we adapt the imposed constraints by removing, at each time-step, a subset of the state constraints in order to reduce the computational complexity of the receding-horizon optimal control problem, while ensuring that the closed-loop behavior is {\em identical} to that of the original MPC law. We also propose an approximate ca-MPC scheme in which a further reduction of computation time can be accomplished by a tradeoff with closed-loop performance, while still preserving recursive feasibility, stability, and constraint satisfaction properties. The online constraint removal exploits fast backward and forward reachability computations combined with optimality properties. △ Less

Submitted 13 July, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

Efficient Lyapunov-Based Stabilizability and Detectability Tests: From LTI to LPV Systems

Authors: T. J. Meijer, V. S. Dolk, W. P. M. H. Heemels

Abstract: In this technical note, we generalize the well-known Lyapunov-based stabilizability and detectability tests for linear time-invariant (LTI) systems to the context of discrete-time (DT) polytopic linear parameter-varying (LPV) systems. To do so, we exploit the mathematical structure of the class of poly-quadratic Lyapunov functions, which enables us to formulate conditions in the form of linear mat… ▽ More In this technical note, we generalize the well-known Lyapunov-based stabilizability and detectability tests for linear time-invariant (LTI) systems to the context of discrete-time (DT) polytopic linear parameter-varying (LPV) systems. To do so, we exploit the mathematical structure of the class of poly-quadratic Lyapunov functions, which enables us to formulate conditions in the form of linear matrix inequalities (LMIs). Our results differ from existing conditions in that we adopt weaker assumptions on the parameter dependence of the controllers/observers and our method does not require explicitly incorporating these gains, which renders the new conditions less computationally demanding. Interestingly, our results also have important implications for existing controller and observer synthesis techniques based on poly-QLFs. In fact, we show that existing observer synthesis results are stronger than was anticipated in the sense that they are necessary for a larger class of observers. Moreover, we also introduce new controller synthesis conditions and illustrate our results by means of a numerical case study. △ Less

Submitted 19 March, 2023; originally announced March 2023.

Decentralized event-triggered estimation of nonlinear systems

Authors: E. Petri, R. Postoyan, D. Astolfi, D. Nešić, W. P. M. H. Heemels

Abstract: We investigate the scenario where a perturbed nonlinear system transmits its output measurements to a remote observer via a packet-based communication network. The sensors are grouped into N nodes and each of these nodes decides when its measured data is transmitted over the network independently. The objective is to design both the observer and the local transmission policies in order to obtain a… ▽ More We investigate the scenario where a perturbed nonlinear system transmits its output measurements to a remote observer via a packet-based communication network. The sensors are grouped into N nodes and each of these nodes decides when its measured data is transmitted over the network independently. The objective is to design both the observer and the local transmission policies in order to obtain accurate state estimates, while only sporadically using the communication network. In particular, given a general nonlinear observer designed in continuous-time satisfying an input-to-state stability property, we explain how to systematically design a dynamic event-triggering rule for each sensor node that avoids the use of a copy of the observer, thereby keeping local calculation simple. We prove the practical convergence property of the estimation error to the origin and we show that there exists a uniform strictly positive minimum inter-event time for each local triggering rule under mild conditions on the plant. The efficiency of the proposed techniques is illustrated on a numerical case study of a flexible robotic arm. △ Less

Submitted 7 October, 2022; originally announced October 2022.

Switched-Actuator Systems with Setup Times: Efficient Modeling, MPC, and Application to Hyperthermia Therapy

Authors: D. A. Deenen, E. Maljaars, L. C. Sebeke, B. de Jager, E. Heijman, H. Grüll, W. P. M. H. Heemels

Abstract: Switched-actuator systems with setup times (SAcSSs) are systems in which the actuator configuration has to be switched during operation, and where the switching induces non-negligible actuator downtime. Optimally controlling SAcSSs requires the online solving of both a discrete actuator allocation problem, in which the switch-induced actuator downtime is taken into account, as well as an optimizat… ▽ More Switched-actuator systems with setup times (SAcSSs) are systems in which the actuator configuration has to be switched during operation, and where the switching induces non-negligible actuator downtime. Optimally controlling SAcSSs requires the online solving of both a discrete actuator allocation problem, in which the switch-induced actuator downtime is taken into account, as well as an optimization problem for the (typically continuous) control inputs. Mixed-integer model predictive control (MI-MPC) offers a powerful framework for tackling such problems. However, the efficient modeling of SAcSSs for MI-MPC is not straightforward, and real-time feasibility is often a major hurdle in practice. It is the objective of this paper to provide an intuitive and systematic modeling procedure tailored to SAcSSs, which is specifically designed to allow for user-friendly controller synthesis, and to yield efficient MI-MPCs. We apply these new results in a case study of large-volume magnetic-resonance-guided high-intensity focused ultrasound hyperthermia, which involves the heating of tumors (using real-valued local heating controls, as well as discrete range-extending actuator relocation during which no heating is allowed) to enhance the efficacy of radio- and chemotherapy. △ Less

Submitted 27 September, 2022; originally announced September 2022.

Comments: 34 pages, 9 figures

Robustifying Event-Triggered Control to Measurement Noise

Authors: Koen J. A. Scheres, Romain Postoyan, W. P. Maurice H. Heemels

Abstract: While many event-triggered control strategies are available in the literature, most of them are designed ignoring the presence of measurement noise. As measurement noise is omnipresent in practice and can have detrimental effects, for instance, by inducing Zeno behavior in the closed-loop system and with that the lack of a positive lower bound on the inter-event times, rendering the event-triggere… ▽ More While many event-triggered control strategies are available in the literature, most of them are designed ignoring the presence of measurement noise. As measurement noise is omnipresent in practice and can have detrimental effects, for instance, by inducing Zeno behavior in the closed-loop system and with that the lack of a positive lower bound on the inter-event times, rendering the event-triggered control design practically useless, it is of great importance to address this gap in the literature. To do so, we present a general framework for set stabilization of (distributed) event-triggered control systems affected by additive measurement noise. It is shown that, under general conditions, Zeno-free static as well as dynamic triggering rules can be designed such that the closed-loop system satisfies an input-to-state practical set stability property. We ensure Zeno-freeness by proving the existence of a uniform strictly positive lower-bound on the minimum inter-event time. The general framework is applied to point stabilization and consensus problems as particular cases, where we show that, under similar assumptions as the original work, existing schemes can be redesigned to robustify them to measurement noise. Consequently, using this framework, noise-robust triggering conditions can be designed both from the ground up and by simple redesign of several important existing schemes. Simulation results are provided that illustrate the strengths of this novel approach. △ Less

Submitted 2 September, 2022; originally announced September 2022.

Distributed Periodic Event-triggered Control of Nonlinear Multi-Agent Systems

Authors: Koen J. A. Scheres, Victor S. Dolk, Michelle S. Chong, Romain Postoyan, W. P. Maurice H. Heemels

Abstract: We present a general emulation-based framework to address the distributed control of multi-agent systems over packet-based networks. We consider the setup where information is only transmitted at (non-uniform) sampling times and where packets are received with unknown delays. We design local dynamic periodic event-triggering mechanisms to generate the transmissions. The triggering mechanisms can r… ▽ More We present a general emulation-based framework to address the distributed control of multi-agent systems over packet-based networks. We consider the setup where information is only transmitted at (non-uniform) sampling times and where packets are received with unknown delays. We design local dynamic periodic event-triggering mechanisms to generate the transmissions. The triggering mechanisms can run on non-synchronized digital platforms, i.e., we ensure that the conditions must only be verified at asynchronous sampling times, which may differ for each platform. Different stability and performance characteristics can be considered as we follow a general dissipativity-based approach. Moreover, Zeno-free properties are guaranteed by design. The results are illustrated on a consensus problem. △ Less

Submitted 23 May, 2022; v1 submitted 13 February, 2022; originally announced February 2022.

Comments: To appear in the proceedings of NecSys2022

Event-triggered observer design for linear systems

Authors: E. Petri, R. Postoyan, D. Astolfi, D. Nešić, W. P. M. H. Heemels

Abstract: We present an event-triggered observer design for linear time-invariant systems, where the measured output is sent to the observer only when a triggering condition is satisfied. We proceed by emulation and we first construct a continuous-time Luenberger observer. We then propose a dynamic rule to trigger transmissions, which only depends on the plant output and an auxiliary scalar state variable.… ▽ More We present an event-triggered observer design for linear time-invariant systems, where the measured output is sent to the observer only when a triggering condition is satisfied. We proceed by emulation and we first construct a continuous-time Luenberger observer. We then propose a dynamic rule to trigger transmissions, which only depends on the plant output and an auxiliary scalar state variable. The overall system is modeled as a hybrid system, for which a jump corresponds to an output transmission. We show that the proposed event-triggered observer guarantees global practical asymptotic stability for the estimation error dynamics. Moreover, under mild boundedness conditions on the plant state and its input, we prove that there exists a uniform strictly positive minimum inter-event time between any two consecutive transmissions, guaranteeing that the system does not exhibit Zeno solutions. Finally, the proposed approach is applied to a numerical case study of a lithium-ion battery. △ Less

Submitted 22 September, 2021; originally announced September 2021.

Event-Triggered State Estimation with Multiple Noisy Sensor Nodes

Authors: Koen J. A. Scheres, Michelle S. Chong, Romain Postoyan, W. P. Maurice H. Heemels

Abstract: General nonlinear continuous-time systems are considered for which its state is estimated via a packet-based communication network. We assume that the system has multiple sensor nodes, affected by measurement noise, which can transmit at discrete (non-equidistant) points in time. Moreover, each node can transmit asynchronously. For this setup, we develop a state estimation framework, where the tra… ▽ More General nonlinear continuous-time systems are considered for which its state is estimated via a packet-based communication network. We assume that the system has multiple sensor nodes, affected by measurement noise, which can transmit at discrete (non-equidistant) points in time. Moreover, each node can transmit asynchronously. For this setup, we develop a state estimation framework, where the transmission instances of the individual sensor nodes can be generated in either time-triggered or event-triggered fashions. In the latter case, we guarantee the absence of Zeno behavior by construction. It is shown that, under the provided design conditions, an input-to-state stability property is obtained for the estimation error with respect to the measurement noise and process disturbances and that the state is thus reconstructed asymptotically in the absence of noise. A numerical case study shows the strengths of the developed framework. △ Less

Submitted 8 December, 2021; v1 submitted 10 August, 2021; originally announced August 2021.

On the graphical stability of hybrid solutions with non-matching jump times: Extended Paper

Authors: J. J. B. Biemond, R. Postoyan, W. P. M. H. Heemels, N. van de Wouw

Abstract: We investigate stability of a solution of a hybrid system in the sense that the graphs of solutions from nearby initial conditions remain close and tend towards the graph of the given solution. In this manner, a small continuous-time mismatch is allowed between the jump times of neighbouring solutions and the `peaking phenomenon' is avoided. We provide conditions such that this stability notion is… ▽ More We investigate stability of a solution of a hybrid system in the sense that the graphs of solutions from nearby initial conditions remain close and tend towards the graph of the given solution. In this manner, a small continuous-time mismatch is allowed between the jump times of neighbouring solutions and the `peaking phenomenon' is avoided. We provide conditions such that this stability notion is implied by stability with respect to a specifically designed distance-like function. Hence, stability of solutions in the graphical sense can be analysed with existing Lyapunov techniques. △ Less

Submitted 5 June, 2019; originally announced June 2019.

On the Minimum Attention and the Anytime Attention Control Problems for Linear Systems: A Linear Programming Approach

Authors: M. C. F. Donkers, P. Tabuada, W. P. M. H. Heemels

Abstract: In this paper, we present two control laws that are tailored for control applications in which computational and/or communication resources are scarce. Namely, we consider minimum attention control, where the `attention' that a control task requires is minimised given certain performance requirements, and anytime attention control, where the performance under the `attention' given by a scheduler i… ▽ More In this paper, we present two control laws that are tailored for control applications in which computational and/or communication resources are scarce. Namely, we consider minimum attention control, where the `attention' that a control task requires is minimised given certain performance requirements, and anytime attention control, where the performance under the `attention' given by a scheduler is maximised. Here, we interpret `attention' as the inverse of the time elapsed between two consecutive executions of a control task. By focussing on linear plants, by allowing for only a finite number of possible intervals between two subsequent executions of the control task, by making a novel extension to the notion of control Lyapunov functions and taking these novel extended control Lyapunov function to be infinity-norm-based, we can formulate the aforementioned control problems as online linear programs, which can be solved efficiently. Furthermore, we provide techniques to construct suitable infinity-norm-based extended control Lyapunov functions for our purposes. Finally, we illustrate the resulting control laws using numerical examples. In particular, we show that minimum attention control outperforms an alternative implementation-aware control law available in the literature. △ Less

Submitted 10 September, 2011; v1 submitted 13 August, 2011; originally announced August 2011.

Comments: Report