Showing 1–50 of 83 results for author: Worthmann, K

On Model Predictive Funnel Control with Equilibrium Endpoint Constraints

Authors: Jens Göbel, Dario Dennstädt, Lukas Lanza, Karl Worthmann, Thomas Berger, Tobias Damm

Abstract: We propose model predictive funnel control, a novel model predictive control (MPC) scheme building upon recent results in funnel control. The latter is a high-gain feedback methodology that achieves evolution of the measured output within predefined error margins. The proposed method dynamically optimizes a parameter-dependent error boundary in a receding-horizon manner, thereby combining prescrib… ▽ More We propose model predictive funnel control, a novel model predictive control (MPC) scheme building upon recent results in funnel control. The latter is a high-gain feedback methodology that achieves evolution of the measured output within predefined error margins. The proposed method dynamically optimizes a parameter-dependent error boundary in a receding-horizon manner, thereby combining prescribed error guarantees from funnel control with the predictive advantages of MPC. On the one hand, this approach promises faster optimization times due to a reduced number of decision variables, whose number does not depend on the horizon length. On the other hand, the continuous feedback law improves the robustness and also explicitly takes care of the inter-sampling behavior. We focus on proving stability by leveraging results from MPC stability theory with terminal equality constraints. Moreover, we rigorously show initial and recursive feasibility. △ Less

Submitted 26 May, 2025; originally announced May 2025.

Comments: 14 pages, 2 figures

Two-component controller design to safeguard data-driven predictive control

Authors: Lea Bold, Lukas Lanza, Karl Worthmann

Abstract: We design a two-component controller to achieve reference tracking with output constraints - exemplified on systems of relative degree two. One component is a data-driven or learning-based predictive controller, which uses data samples to learn a model and predict the future behavior of the system. We exemplify this component concisely by data-enabled predictive control (DeePC) and by model predic… ▽ More We design a two-component controller to achieve reference tracking with output constraints - exemplified on systems of relative degree two. One component is a data-driven or learning-based predictive controller, which uses data samples to learn a model and predict the future behavior of the system. We exemplify this component concisely by data-enabled predictive control (DeePC) and by model predictive control based on extended dynamic mode decomposition (EDMD). The second component is a model-free high-gain feedback controller, which ensures satisfaction of the output constraints if that cannot be guaranteed by the predictive controller. This may be the case, for example, if too little data has been collected for learning or no (sufficient) guarantees on the approximation accuracy derived. In particular, the reactive/adaptive feedback controller can be used to support the learning process by leading safely through the state space to collect suitable data, e.g., to ensure a sufficiently-small fill distance. Numerical examples are provided to illustrate the combination of EDMD-based model predictive control and a safeguarding feedback for the set-point transitions including the transition between the set points within prescribed bounds. △ Less

Submitted 25 May, 2025; originally announced May 2025.

A model-free approach to control barrier functions using funnel control

Authors: Lukas Lanza, Johannes Köhler, Dario Dennstädt, Thomas Berger, Karl Worthmann

Abstract: Control barrier functions (CBFs) are a popular approach to design feedback laws that achieve safety guarantees for nonlinear systems. The CBF-based controller design relies on the availability of a model to select feasible inputs from the set of CBF-based controls. In this paper, we develop a model-free approach to design CBF-based control laws, eliminating the need for knowledge of system dynamic… ▽ More Control barrier functions (CBFs) are a popular approach to design feedback laws that achieve safety guarantees for nonlinear systems. The CBF-based controller design relies on the availability of a model to select feasible inputs from the set of CBF-based controls. In this paper, we develop a model-free approach to design CBF-based control laws, eliminating the need for knowledge of system dynamics or parameters. Specifically, we address safety requirements characterized by a time-varying distance to a reference trajectory in the output space and construct a CBF that depends only on the measured output. Utilizing this particular CBF, we determine a subset of CBF-based controls without relying on a model of the dynamics by using techniques from funnel control. The latter is a model-free high-gain adaptive control methodology, which achieves tracking guarantees via reactive feedback. In this paper, we discover and establish a connection between the modular controller synthesis via zeroing CBFs and model-free reactive feedback. The theoretical results are illustrated by a numerical simulation. △ Less

Submitted 23 May, 2025; originally announced May 2025.

Data-driven Model Predictive Control: Asymptotic Stability despite Approximation Errors exemplified in the Koopman framework

Authors: Irene Schimperna, Karl Worthmann, Manuel Schaller, Lea Bold, Lalo Magni

Abstract: In this paper, we analyze nonlinear model predictive control (MPC) using data-driven surrogates in the prediction and optimization step. First, we establish asymptotic stability of the origin, a controlled steady state, w.r.t. the MPC closed loop without stabilizing terminal conditions. To this end, we prove that cost controllability of the original system is preserved if proportional bounds on th… ▽ More In this paper, we analyze nonlinear model predictive control (MPC) using data-driven surrogates in the prediction and optimization step. First, we establish asymptotic stability of the origin, a controlled steady state, w.r.t. the MPC closed loop without stabilizing terminal conditions. To this end, we prove that cost controllability of the original system is preserved if proportional bounds on the approximation error hold. Here, proportional refers to state and control, while the respective constants depend on the approximation accuracy. The proportionality of the error bounds is a key element to derive asymptotic stability in presence of modeling errors and not only practical asymptotic stability. Second, we exemplarily verify the imposed assumptions for data-driven surrogates generated with kernel extended dynamic mode decomposition based on the Koopman operator. Hereby, we do not impose invariance assumptions on finite dictionaries, but rather derive all conditions under non-restrictive data requirements. Finally, we verify our findings with numerical simulations. △ Less

Submitted 9 May, 2025; originally announced May 2025.

Offset-free Nonlinear MPC with Koopman-based Surrogate Models

Authors: Irene Schimperna, Lea Bold, Karl Worthmann

Abstract: In this paper, we design offset-free nonlinear Model Predictive Control (MPC) for surrogate models based on Extended Dynamic Mode Decomposition (EDMD). The model used for prediction in MPC is augmented with a disturbance term, that is estimated by an observer. If the full information about the equilibrium of the real system is not available, a reference calculator is introduced in the algorithm to… ▽ More In this paper, we design offset-free nonlinear Model Predictive Control (MPC) for surrogate models based on Extended Dynamic Mode Decomposition (EDMD). The model used for prediction in MPC is augmented with a disturbance term, that is estimated by an observer. If the full information about the equilibrium of the real system is not available, a reference calculator is introduced in the algorithm to compute the MPC state and input references. The control algorithm guarantees offset-free tracking of the controlled output under the assumption that the modeling errors are asymptotically constant. The effectiveness of the proposed approach is showcased with numerical simulations for two popular benchmark systems: the van-der-Pol oscillator and the four-tanks process. △ Less

Submitted 30 April, 2025; v1 submitted 15 April, 2025; originally announced April 2025.

Comments: 10 pages, 3 figures

Kernel-based error bounds of bilinear Koopman surrogate models for nonlinear data-driven control

Authors: Robin Strässer, Manuel Schaller, Julian Berberich, Karl Worthmann, Frank Allgöwer

Abstract: We derive novel deterministic bounds on the approximation error of data-based bilinear surrogate models for unknown nonlinear systems. The surrogate models are constructed using kernel-based extended dynamic mode decomposition to approximate the Koopman operator in a reproducing kernel Hilbert space. Unlike previous methods that require restrictive assumptions on the invariance of the dictionary,… ▽ More We derive novel deterministic bounds on the approximation error of data-based bilinear surrogate models for unknown nonlinear systems. The surrogate models are constructed using kernel-based extended dynamic mode decomposition to approximate the Koopman operator in a reproducing kernel Hilbert space. Unlike previous methods that require restrictive assumptions on the invariance of the dictionary, our approach leverages kernel-based dictionaries that allow us to control the projection error via pointwise error bounds, overcoming a significant limitation of existing theoretical guarantees. The derived state- and input-dependent error bounds allow for direct integration into Koopman-based robust controller designs with closed-loop guarantees for the unknown nonlinear system. Numerical examples illustrate the effectiveness of the proposed framework. △ Less

Submitted 14 May, 2025; v1 submitted 17 March, 2025; originally announced March 2025.

Spatial decay of perturbations in hyperbolic equations with optimal boundary control

Authors: Benedikt Oppeneiger, Manuel Schaller, Karl Worthmann

Abstract: Recently, domain-uniform stabilizability and detectability has been the central assumption %in order robustness results on the to ensure robustness in the sense of exponential decay of spatially localized perturbations in optimally controlled evolution equations. In the present paper we analyze a chain of transport equations with boundary and point controls with regard to this property. Both for D… ▽ More Recently, domain-uniform stabilizability and detectability has been the central assumption %in order robustness results on the to ensure robustness in the sense of exponential decay of spatially localized perturbations in optimally controlled evolution equations. In the present paper we analyze a chain of transport equations with boundary and point controls with regard to this property. Both for Dirichlet and Neumann boundary and coupling conditions, we show a necessary and sufficient criterion on control domains which allow for the domain-uniform stabilization of this equation. We illustrate the results by means of a numerical example. △ Less

Submitted 17 February, 2025; originally announced February 2025.

Comments: 12 pages, 4 figures

Towards Data-Driven Multi-Stage OPF

Authors: Oleksii Molodchyk, Philipp Schmitz, Alexander Engelmann, Karl Worthmann, Timm Faulwasser

Abstract: The operation of large-scale power systems is usually scheduled ahead via numerical optimization. However, this requires models of grid topology, line parameters, and bus specifications. Classic approaches first identify the network topology, i.e., the graph of interconnections and the associated impedances. The power generation schedules are then computed by solving a multi-stage optimal power fl… ▽ More The operation of large-scale power systems is usually scheduled ahead via numerical optimization. However, this requires models of grid topology, line parameters, and bus specifications. Classic approaches first identify the network topology, i.e., the graph of interconnections and the associated impedances. The power generation schedules are then computed by solving a multi-stage optimal power flow (OPF) problem built around the model. In this paper, we explore the prospect of data-driven approaches to multi-stage optimal power flow. Specifically, we leverage recent findings from systems and control to bypass the identification step and to construct the optimization problem directly from data. We illustrate the performance of our method on a 118-bus system and compare it with the classical identification-based approach. △ Less

Submitted 3 February, 2025; originally announced February 2025.

Comments: 6 pages, 1 figure

Spatial exponential decay of perturbations in optimal control of general evolution equations

Authors: Simone Göttlich, Benedikt Oppeneiger, Manuel Schaller, Karl Worthmann

Abstract: We analyze the robustness of optimally controlled evolution equations with respect to spatially localized perturbations. We prove that if the involved operators are domain-uniformly stabilizable and detectable, then these localized perturbations only have a local effect on the optimal solution. We characterize this domain-uniform stabilizability and detectability for the transport equation with co… ▽ More We analyze the robustness of optimally controlled evolution equations with respect to spatially localized perturbations. We prove that if the involved operators are domain-uniformly stabilizable and detectable, then these localized perturbations only have a local effect on the optimal solution. We characterize this domain-uniform stabilizability and detectability for the transport equation with constant transport velocity, showing that even for unitary semigroups, optimality implies exponential damping. Finally, we extend our result to the case of a space-dependent transport velocity. Numerical examples in one space dimension complement the theoretical results. △ Less

Submitted 21 January, 2025; originally announced January 2025.

Comments: 46 pages, 5 figures

Kernel EDMD for data-driven nonlinear Koopman MPC with stability guarantees

Authors: Lea Bold, Manuel Schaller, Irene Schimperna, Karl Worthmann

Abstract: Extended dynamic mode decomposition (EDMD) is a popular data-driven method to predict the action of the Koopman operator, i.e., the evolution of an observable function along the flow of a dynamical system. In this paper, we leverage a recently-introduced kernel EDMD method for control systems for data-driven model predictive control. Building upon pointwise error bounds proportional in the state,… ▽ More Extended dynamic mode decomposition (EDMD) is a popular data-driven method to predict the action of the Koopman operator, i.e., the evolution of an observable function along the flow of a dynamical system. In this paper, we leverage a recently-introduced kernel EDMD method for control systems for data-driven model predictive control. Building upon pointwise error bounds proportional in the state, we rigorously show practical asymptotic stability of the origin w.r.t. the MPC closed loop without stabilizing terminal conditions. The key novelty is that we avoid restrictive invariance conditions. Last, we verify our findings by numerical simulations. △ Less

Submitted 14 March, 2025; v1 submitted 15 January, 2025; originally announced January 2025.

Comments: 12 pages, 2 figures

Kernel-based Koopman approximants for control: Flexible sampling, error analysis, and stability

Authors: Lea Bold, Friedrich M. Philipp, Manuel Schaller, Karl Worthmann

Abstract: Data-driven techniques for analysis, modeling, and control of complex dynamical systems are on the uptake. Koopman theory provides the theoretical foundation for the extremely popular kernel extended dynamic mode decomposition (kEDMD). In this work we propose a novel kEDMD scheme to approximate nonlinear control systems accompanied by an in-depth error analysis. The main features of the method are… ▽ More Data-driven techniques for analysis, modeling, and control of complex dynamical systems are on the uptake. Koopman theory provides the theoretical foundation for the extremely popular kernel extended dynamic mode decomposition (kEDMD). In this work we propose a novel kEDMD scheme to approximate nonlinear control systems accompanied by an in-depth error analysis. The main features of the method are flexible sampling, regularization-based robustness, and an adroit decomposition into micro and macro grids. In addition, we prove proportionality, i.e., explicit dependence on the distance to the (controlled) equilibrium, of the derived uniform bounds on the full approximation error. Leveraging this key property, we rigorously show that asymptotic stability of the data-driven surrogate (control) system implies asymptotic stability of the original (control) system and vice versa. △ Less

Submitted 3 December, 2024; originally announced December 2024.

Comments: 29 pages, 6 figures

Koopman-based control of nonlinear systems with closed-loop guarantees

Authors: Robin Strässer, Julian Berberich, Manuel Schaller, Karl Worthmann, Frank Allgöwer

Abstract: In this paper, we provide a tutorial overview and an extension of a recently developed framework for data-driven control of unknown nonlinear systems with rigorous closed-loop guarantees. The proposed approach relies on the Koopman operator representation of the nonlinear system, for which a bilinear surrogate model is estimated based on data. In contrast to existing Koopman-based estimation proce… ▽ More In this paper, we provide a tutorial overview and an extension of a recently developed framework for data-driven control of unknown nonlinear systems with rigorous closed-loop guarantees. The proposed approach relies on the Koopman operator representation of the nonlinear system, for which a bilinear surrogate model is estimated based on data. In contrast to existing Koopman-based estimation procedures, we state guaranteed bounds on the approximation error using the stability- and certificate-oriented extended dynamic mode decomposition (SafEDMD) framework. The resulting surrogate model and the uncertainty bounds allow us to design controllers via robust control theory and sum-of-squares optimization, guaranteeing desirable properties for the closed-loop system. We present results on stabilization both in discrete and continuous time, and we derive a method for controller design with performance objectives. The benefits of the presented framework over established approaches are demonstrated with a numerical example. △ Less

Submitted 18 March, 2025; v1 submitted 15 November, 2024; originally announced November 2024.

Comments: Accepted for publication in at-Automatisierungstechnik

Journal ref: at - Automatisierungstechnik, vol. 73, no. 6, pp. 413-428, 2025

Data-Driven Predictive Control of Nonholonomic Robots Based on a Bilinear Koopman Realization: Data Does Not Replace Geometry

Authors: Mario Rosenfelder, Lea Bold, Hannes Eschmann, Peter Eberhard, Karl Worthmann, Henrik Ebel

Abstract: Advances in machine learning and the growing trend towards effortless data generation in real-world systems has led to an increasing interest for data-inferred models and data-based control in robotics. It seems appealing to govern robots solely based on data, bypassing the traditional, more elaborate pipeline of system modeling through first-principles and subsequent controller design. One promis… ▽ More Advances in machine learning and the growing trend towards effortless data generation in real-world systems has led to an increasing interest for data-inferred models and data-based control in robotics. It seems appealing to govern robots solely based on data, bypassing the traditional, more elaborate pipeline of system modeling through first-principles and subsequent controller design. One promising data-driven approach is the Extended Dynamic Mode Decomposition (EDMD) for control-affine systems, a system class which contains many vehicles and machines of immense practical importance including, e.g., typical wheeled mobile robots. EDMD can be highly data-efficient, computationally inexpensive, can deal with nonlinear dynamics as prevalent in robotics and mechanics, and has a sound theoretical foundation rooted in Koopman theory. On this background, this present paper examines how EDMD models can be integrated into predictive controllers for nonholonomic mobile robots. In addition to the conventional kinematic mobile robot, we also cover the complete data-driven control pipeline - from data acquisition to control design - when the robot is not treated in terms of first-order kinematics but in a second-order manner, allowing to account for actuator dynamics. Using only real-world measurement data, it is shown in both simulations and hardware experiments that the surrogate models enable high-precision predictive controllers in the studied cases. However, the findings raise significant concerns about purely data-centric approaches that overlook the underlying geometry of nonholonomic systems, showing that, for nonholonomic systems, some geometric insight seems necessary and cannot be easily compensated for with large amounts of data. △ Less

Submitted 11 November, 2024; originally announced November 2024.

Comments: 23 pages, 12 figures

Group-Convolutional Extended Dynamic Mode Decomposition

Authors: Hans Harder, Feliks Nüske, Friedrich M. Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz

Abstract: This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by finite-dimensional surrogates, e.g., via extended dynamic mode decomposition (EDMD), is challenging for high-dimensional systems due to computational constraints. To… ▽ More This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by finite-dimensional surrogates, e.g., via extended dynamic mode decomposition (EDMD), is challenging for high-dimensional systems due to computational constraints. To tackle this problem with a particular focus on EDMD, we demonstrate -- under suitable equivarance assumptions on the system and the observables -- that the optimal EDMD matrix is equivariant. That is, its action on states can be described by group convolutions and the generalized Fourier transform. We show that this structural property has many advantages for equivariant systems, in particular, that it allows for data-efficient learning, fast predictions and fast eigenfunction approximations. We conduct numerical experiments on the Kuramoto-Sivashinsky equation and a $λ$-$ω$ spiraling wave system, both nonlinear partial differential equations, providing evidence of the effectiveness of this approach, and highlighting its potential for broader applications in dynamical systems analysis. △ Less

Submitted 26 May, 2025; v1 submitted 1 November, 2024; originally announced November 2024.

Existence of solutions to port-Hamiltonian systems: initial value problems and optimal control

Authors: Willem Esterhuizen, Bernhard Maschke, Till Preuster, Manuel Schaller, Karl Worthmann

Abstract: We investigate the existence of solutions of reversible and irreversible port-Hamiltonian systems. To this end, we utilize the associated exergy, a function that is composed of the system's Hamiltonian and entropy, to prove global existence in time for bounded control functions. The results are then leveraged to prove existence of solutions of energy- and entropy-optimal control problems. Last, we… ▽ More We investigate the existence of solutions of reversible and irreversible port-Hamiltonian systems. To this end, we utilize the associated exergy, a function that is composed of the system's Hamiltonian and entropy, to prove global existence in time for bounded control functions. The results are then leveraged to prove existence of solutions of energy- and entropy-optimal control problems. Last, we explore model predictive control tailored to irreversible port-Hamiltonian systems by means of a numerical case study with a heat exchanger network. △ Less

Submitted 24 October, 2024; originally announced October 2024.

Comments: 24 pages, 6 figures

MSC Class: 34A12; 49J15; 80M50; 93D20

Data-driven MPC with terminal conditions in the Koopman framework

Authors: Karl Worthmann, Robin Strässer, Manuel Schaller, Julian Berberich, Frank Allgöwer

Abstract: We investigate nonlinear model predictive control (MPC) with terminal conditions in the Koopman framework using extended dynamic mode decomposition (EDMD) to generate a data-based surrogate model for prediction and optimization. We rigorously show recursive feasibility and prove practical asymptotic stability w.r.t. the approximation accuracy. To this end, finite-data error bounds are employed. Th… ▽ More We investigate nonlinear model predictive control (MPC) with terminal conditions in the Koopman framework using extended dynamic mode decomposition (EDMD) to generate a data-based surrogate model for prediction and optimization. We rigorously show recursive feasibility and prove practical asymptotic stability w.r.t. the approximation accuracy. To this end, finite-data error bounds are employed. The construction of the terminal conditions is based on recently derived proportional error bounds to ensure the required Lyapunov decrease. Finally, we illustrate the effectiveness of the proposed data-driven predictive controller including the design procedure to construct the terminal region and controller. △ Less

Submitted 22 August, 2024; originally announced August 2024.

Comments: Accepted for presentation at the 63rd IEEE Conference on Decision and Control (CDC2024)

Journal ref: in Proc. 63rd IEEE Conference on Decision and Control (CDC), 2024, pp. 146-151

Modularized data-driven approximation of the Koopman operator and generator

Authors: Yang Guo, Manuel Schaller, Karl Worthmann, Stefan Streif

Abstract: Extended Dynamic Mode Decomposition (EDMD) is a widely-used data-driven approach to learn an approximation of the Koopman operator. Consequently, it provides a powerful tool for data-driven analysis, prediction, and control of nonlinear dynamical (control) systems. In this work, we propose a novel modularized EDMD scheme tailored to interconnected systems. To this end, we utilize the structure of… ▽ More Extended Dynamic Mode Decomposition (EDMD) is a widely-used data-driven approach to learn an approximation of the Koopman operator. Consequently, it provides a powerful tool for data-driven analysis, prediction, and control of nonlinear dynamical (control) systems. In this work, we propose a novel modularized EDMD scheme tailored to interconnected systems. To this end, we utilize the structure of the Koopman generator that allows to learn the dynamics of subsystems individually and thus alleviates the curse of dimensionality by considering observable functions on smaller state spaces. Moreover, our approach canonically enables transfer learning if a system encompasses multiple copies of a model as well as efficient adaption to topology changes without retraining. We provide finite-data bounds on the estimation error using tools from graph theory. The efficacy of the method is illustrated by means of various numerical examples. △ Less

Submitted 22 August, 2024; originally announced August 2024.

Comments: 31 pages, 11 figures

A continuous-time fundamental lemma and its application in data-driven optimal control

Authors: Philipp Schmitz, Timm Faulwasser, Paolo Rapisarda, Karl Worthmann

Abstract: Data-driven control of discrete-time and continuous-time systems is of tremendous research interest. In this paper, we explore data-driven optimal control of continuous-time linear systems using input-output data. Based on a density result, we rigorously derive error bounds for finite-order polynomial approximations of elements of the system behavior. To this end, we leverage a link between latent… ▽ More Data-driven control of discrete-time and continuous-time systems is of tremendous research interest. In this paper, we explore data-driven optimal control of continuous-time linear systems using input-output data. Based on a density result, we rigorously derive error bounds for finite-order polynomial approximations of elements of the system behavior. To this end, we leverage a link between latent variables and flat outputs of controllable systems. Combined with a continuous-time counterpart of the fundamental lemma by Willems et al., we characterize the suboptimality resulting from polynomial approximations in data-driven linear-quadratic optimal control problems. Finally, we draw upon a numerical example to illustrate our results. △ Less

Submitted 16 July, 2024; originally announced July 2024.

Invariance of Gaussian RKHSs under Koopman operators of stochastic differential equations with constant matrix coefficients

Authors: Friedrich Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz, Feliks Nüske

Abstract: We consider the Koopman operator semigroup $(K^t)_{t\ge 0}$ associated with stochastic differential equations of the form $dX_t = AX_t\,dt + B\,dW_t$ with constant matrices $A$ and $B$ and Brownian motion $W_t$. We prove that the reproducing kernel Hilbert space $\bH_C$ generated by a Gaussian kernel with a positive definite covariance matrix $C$ is invariant under each Koopman operator $K^t$ if t… ▽ More We consider the Koopman operator semigroup $(K^t)_{t\ge 0}$ associated with stochastic differential equations of the form $dX_t = AX_t\,dt + B\,dW_t$ with constant matrices $A$ and $B$ and Brownian motion $W_t$. We prove that the reproducing kernel Hilbert space $\bH_C$ generated by a Gaussian kernel with a positive definite covariance matrix $C$ is invariant under each Koopman operator $K^t$ if the matrices $A$, $B$, and $C$ satisfy the following Lyapunov-like matrix inequality: $AC^2 + C^2A^\top\le 2BB^\top$. In this course, we prove a characterization concerning the inclusion $\bH_{C_1}\subset\bH_{C_2}$ of Gaussian RKHSs for two positive definite matrices $C_1$ and $C_2$. The question of whether the sufficient Lyapunov-condition is also necessary is left as an open problem. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Comments: 11 pages

Distributed Optimization for Energy Grids: A Tutorial on ADMM and ALADIN

Authors: Lukas Lanza, Timm Faulwasser, Karl Worthmann

Abstract: The ongoing transition towards energy and power systems dominated by a large number of renewable power injections to the distribution grid poses substantial challenges for system operation, coordination, and control. Optimization-based methods for coordination and control are of substantial research interest in this context. Hence, this chapter provides a tutorial introduction of distributed optim… ▽ More The ongoing transition towards energy and power systems dominated by a large number of renewable power injections to the distribution grid poses substantial challenges for system operation, coordination, and control. Optimization-based methods for coordination and control are of substantial research interest in this context. Hence, this chapter provides a tutorial introduction of distributed optimization algorithms for energy systems with a large share of renewables. Specifically, we focus on the Alternating Direction Method of Multipliers (ADMM) and on the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method as both algorithms are frequently considered for coordination and control of power and energy systems. We discuss the application of ALADIN and ADMM to AC optimal power flow problems and to energy management problems. Moreover, we give an outlook on open problems. △ Less

Submitted 5 April, 2024; originally announced April 2024.

Towards Efficient Aggregation of Storage Flexibilities in Power Grids

Authors: Emrah Öztürk, Kevin Kaspar, Timm Faulwasser, Karl Worthmann, Peter Kepplinger, Klaus Rheinberger

Abstract: The increasing penetration of volatile renewables combined with increasing demands poses a challenge to modern power grids. Furthermore, distributed energy resources and flexible devices (electric vehicles, PV generation, ...) are becoming more widespread, making their aggregate usage for ancillary services interesting. However, accurately quantifying the aggregate flexibility of numerous flexible… ▽ More The increasing penetration of volatile renewables combined with increasing demands poses a challenge to modern power grids. Furthermore, distributed energy resources and flexible devices (electric vehicles, PV generation, ...) are becoming more widespread, making their aggregate usage for ancillary services interesting. However, accurately quantifying the aggregate flexibility of numerous flexible devices is known to be limited by the curse of dimensionality, i.e., it does not scale well computationally. This has led to the development of various approximation algorithms. In this study, we improve upon our previously proposed vertex-based inner approximation, extending it to more general storage devices. We demonstrate the efficacy and accuracy of the proposed method in a case study comparing our approach with an exact centralized control framework, where the flexibility of numerous electric vehicles is combined to reduce the peak load in a residential area. △ Less

Submitted 29 March, 2024; originally announced March 2024.

Comments: 5 pages, 4 figures, NEIS 2024 Conference on Sustainable Energy Supply and Energy Storage Systems

$L^\infty$-error bounds for approximations of the Koopman operator by kernel extended dynamic mode decomposition

Authors: Frederik Köhne, Friedrich M. Philipp, Manuel Schaller, Anton Schiela, Karl Worthmann

Abstract: Extended dynamic mode decomposition (EDMD) is a well-established method to generate a data-driven approximation of the Koopman operator for analysis and prediction of nonlinear dynamical systems. Recently, kernel EDMD (kEDMD) has gained popularity due to its ability to resolve the challenging task of choosing a suitable dictionary by using the kernel's canonical features and, thus, data-informed o… ▽ More Extended dynamic mode decomposition (EDMD) is a well-established method to generate a data-driven approximation of the Koopman operator for analysis and prediction of nonlinear dynamical systems. Recently, kernel EDMD (kEDMD) has gained popularity due to its ability to resolve the challenging task of choosing a suitable dictionary by using the kernel's canonical features and, thus, data-informed observables. In this paper, we provide the first pointwise bounds on the approximation error of kEDMD. The main idea consists of two steps. First, we show that the reproducing kernel Hilbert spaces of Wendland functions are invariant under the Koopman operator. Second, exploiting that the learning problem given by regression in the native norm can be recast as an interpolation problem, we prove our novel error bounds by using interpolation estimates. Finally, we validate our findings with numerical experiments. △ Less

Submitted 4 July, 2024; v1 submitted 27 March, 2024; originally announced March 2024.

Comments: 25 pages, 3 figures, 5 tables

MSC Class: 37M99; 41A05; 47B32; 47B33; 65D12

Perturbations in PDE-constrained optimal control decay exponentially in space

Authors: Simone Göttlich, Manuel Schaller, Karl Worthmann

Abstract: For linear-quadratic optimal control problems (OCPs) governed by elliptic and parabolic partial differential equations (PDEs), we investigate the impact of perturbations on optimal solutions. Local perturbations may occur, e.g., due to discretization of the optimality system or {disturbed} problem data. Whereas these perturbations may exhibit global effects in the uncontrolled case, we prove that… ▽ More For linear-quadratic optimal control problems (OCPs) governed by elliptic and parabolic partial differential equations (PDEs), we investigate the impact of perturbations on optimal solutions. Local perturbations may occur, e.g., due to discretization of the optimality system or {disturbed} problem data. Whereas these perturbations may exhibit global effects in the uncontrolled case, we prove that the ramifications are exponentially damped in space under stabilizability and detectability conditions. To this end, we prove a bound on the optimality condition's solution operator that is uniform in the domain size. Then, this uniformity is used in a scaling argument to show the exponential decay of perturbations in space. We numerically validate and illustrate our results by solving OCPs involving Helmholtz, Poisson, and advection-diffusion-reaction equations. △ Less

Submitted 5 October, 2024; v1 submitted 22 March, 2024; originally announced March 2024.

Comments: 27 pages, 9 figures

MSC Class: 35Q93; 49K40; 93D23

MPC without Terminal Ingredients Tailored to the SEIR Compartmental Epidemic Model

Authors: Willem Esterhuizen, Philipp Sauerteig, Stefan Streif, Karl Worthmann

Abstract: We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed… ▽ More We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed loop to the continuum of disease-free equilibrium points for suitably designed quadratic running cost and a sufficiently long prediction horizon (forecast window). Moreover, we establish the viability kernel (a.k.a. the admissible set) as a domain of attraction of the continuum of equilibria. △ Less

Submitted 10 June, 2024; v1 submitted 14 March, 2024; originally announced March 2024.

Comments: 28 pages, 6 figures, preprint under peer review

MSC Class: 93B45 (primary); 34H05; 49N90; 93C10

Fast and memory-efficient optimization for large-scale data-driven predictive control

Authors: Philipp Schmitz, Manuel Schaller, Matthias Voigt, Karl Worthmann

Abstract: Recently, data-enabled predictive control (DeePC) schemes based on Willems' fundamental lemma have attracted considerable attention. At the core are computations using Hankel-like matrices and their connection to the concept of persistency of excitation. We propose an iterative solver for the underlying data-driven optimal control problems resulting from linear discrete-time systems. To this end,… ▽ More Recently, data-enabled predictive control (DeePC) schemes based on Willems' fundamental lemma have attracted considerable attention. At the core are computations using Hankel-like matrices and their connection to the concept of persistency of excitation. We propose an iterative solver for the underlying data-driven optimal control problems resulting from linear discrete-time systems. To this end, we apply factorizations based on the discrete Fourier transform of the Hankel-like matrices, which enable fast and memory-efficient computations. To take advantage of this factorization in an optimal control solver and to reduce the effect of inherent bad conditioning of the Hankel-like matrices, we propose an augmented Lagrangian lBFGS-method. We illustrate the performance of our method by means of a numerical study. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Reinforcement Learning for Docking Maneuvers with Prescribed Performance

Authors: Simon Gottschalk, Lukas Lanza, Karl Worthmann, Kerstin Lux-Gottschalk

Abstract: We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an additional feedback law is implemented in the control unit, which guarantees the evolution of the system within predefined performance bounds. We define safe and safety… ▽ More We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an additional feedback law is implemented in the control unit, which guarantees the evolution of the system within predefined performance bounds. We define safe and safety-critical areas to train the feedback controller based on actual measurements. To avoid chattering, a dwell-time activation scheme is implemented. We provide numerical evidence for the performance of the proposed controller for a satellite docking maneuver with collision avoidance. △ Less

Submitted 29 July, 2024; v1 submitted 13 February, 2024; originally announced February 2024.

SafEDMD: A Koopman-based data-driven controller design framework for nonlinear dynamical systems

Authors: Robin Strässer, Manuel Schaller, Karl Worthmann, Julian Berberich, Frank Allgöwer

Abstract: The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose SafEDMD, a novel stability- and certificate-oriented EDMD-based controller design framework. Our approach leverages a reliable surrogate model generated in a data-driven f… ▽ More The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose SafEDMD, a novel stability- and certificate-oriented EDMD-based controller design framework. Our approach leverages a reliable surrogate model generated in a data-driven fashion in order to provide closed-loop guarantees. In particular, we establish a controller design based on semi-definite programming with guaranteed stabilization of the underlying nonlinear system. As central ingredient, we derive proportional error bounds that vanish at the origin and are tailored to control tasks. We illustrate the developed method by means of several benchmark examples and highlight the advantages over state-of-the-art methods. △ Less

Submitted 25 April, 2025; v1 submitted 5 February, 2024; originally announced February 2024.

Variance representations and convergence rates for data-driven approximations of Koopman operators

Authors: Friedrich M. Philipp, Manuel Schaller, Septimus Boshoff, Sebastian Peitz, Feliks Nüske, Karl Worthmann

Abstract: We rigorously derive novel error bounds for extended dynamic mode decomposition (EDMD) to approximate the Koopman operator for discrete- and continuous time (stochastic) systems; both for i.i.d. and ergodic sampling under non-restrictive assumptions. We show exponential convergence rates for i.i.d. sampling and provide the first superlinear convergence rates for ergodic sampling of deterministic s… ▽ More We rigorously derive novel error bounds for extended dynamic mode decomposition (EDMD) to approximate the Koopman operator for discrete- and continuous time (stochastic) systems; both for i.i.d. and ergodic sampling under non-restrictive assumptions. We show exponential convergence rates for i.i.d. sampling and provide the first superlinear convergence rates for ergodic sampling of deterministic systems. The proofs are based on novel exact variance representations for the empirical estimators of mass and stiffness matrix. Moreover, we verify the accuracy of the derived error bounds and convergence rates by means of numerical simulations for highly-complex dynamical systems including a nonlinear partial differential equation. △ Less

Submitted 23 May, 2024; v1 submitted 4 February, 2024; originally announced February 2024.

Comments: 24 pages

Error analysis of kernel EDMD for prediction and control in the Koopman framework

Authors: Friedrich Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz, Feliks Nüske

Abstract: Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This operator is linear and encompasses full information on the (expected stochastic) dynamics. In this paper, we analyze a kernel-based EDMD algorithm, known as kEDMD, where the dictionary consists of the canonical kernel features at th… ▽ More Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This operator is linear and encompasses full information on the (expected stochastic) dynamics. In this paper, we analyze a kernel-based EDMD algorithm, known as kEDMD, where the dictionary consists of the canonical kernel features at the data points. The latter are acquired by i.i.d. samples from a user-defined and application-driven distribution on a compact set. We prove bounds on the prediction error of the kEDMD estimator when sampling from this (not necessarily ergodic) distribution. The error analysis is further extended to control-affine systems, where the considered invariance of the Reproducing Kernel Hilbert Space is significantly less restrictive in comparison to invariance assumptions on an a-priori chosen dictionary. △ Less

Submitted 16 December, 2023; originally announced December 2023.

Comments: 26 pages

Safe data-driven reference tracking with prescribed performance

Authors: Philipp Schmitz, Lukas Lanza, Karl Worthmann

Abstract: We study output reference tracking for unknown continuous-time systems with arbitrary relative degree. The control objective is to keep the tracking error within predefined time-varying bounds while measurement data is only available at discrete sampling times. To achieve the control objective, we propose a two-component controller. One part is a recently developed sampled-data zero-order hold con… ▽ More We study output reference tracking for unknown continuous-time systems with arbitrary relative degree. The control objective is to keep the tracking error within predefined time-varying bounds while measurement data is only available at discrete sampling times. To achieve the control objective, we propose a two-component controller. One part is a recently developed sampled-data zero-order hold controller, which achieves reference tracking within prescribed error bounds. To further improve the control signal, we explore the system dynamics via input-output data, and include as the second component a data-driven MPC scheme based on Willems et al.'s fundamental lemma. This combination yields significantly improved input signals as illustrated by a numerical example. △ Less

Submitted 14 December, 2023; originally announced December 2023.

On model predictive control with sampled-data input for output tracking with prescribed performance

Authors: Dario Dennstädt, Lukas Lanza, Karl Worthmann

Abstract: We propose a model predictive control (MPC) scheme with sampled-data input which ensures output-reference tracking within prescribed error bounds for relative-degree-one systems. Hereby, we explicitly deduce bounds on the required maximal control input and sampling frequency such that the MPC scheme is both initially and recursively feasible. A key feature of the proposed approach is that neither… ▽ More We propose a model predictive control (MPC) scheme with sampled-data input which ensures output-reference tracking within prescribed error bounds for relative-degree-one systems. Hereby, we explicitly deduce bounds on the required maximal control input and sampling frequency such that the MPC scheme is both initially and recursively feasible. A key feature of the proposed approach is that neither terminal conditions nor a sufficiently-large prediction horizon are imposed, rendering the MPC scheme computationally efficient. We illustrate the MPC algorithm via a numerical example of a torsional oscillator. △ Less

Submitted 27 March, 2024; v1 submitted 12 December, 2023; originally announced December 2023.

Koopman-based feedback design with stability guarantees

Authors: Robin Strässer, Manuel Schaller, Karl Worthmann, Julian Berberich, Frank Allgöwer

Abstract: We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feed… ▽ More We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feedback design and its stability guarantees for single-input systems. Moreover, we extend this controller design to multi-input systems and more flexible nonlinear state-feedback controllers using gain-scheduling techniques to increase the guaranteed region of attraction. As the proposed controller design is framed as a semidefinite program, it allows for an efficient solution. Further, we enhance the geometry of the region of attraction through a heuristic algorithm that establishes a connection between the employed Koopman lifting and the dynamics of the system. Finally, we validate the proposed feedback design procedure by means of numerical examples. △ Less

Submitted 3 May, 2024; v1 submitted 3 December, 2023; originally announced December 2023.

Journal ref: IEEE Transactions on Automatic Control, vol. 70, no. 1, pp. 355-370, 2025

Alleviating the Curse of Dimensionality in Minkowski Sum Approximations of Storage Flexibility

Authors: Emrah Öztürk, Timm Faulwasser, Karl Worthmann, Markus Preißinger, Klaus Rheinberger

Abstract: Many real-world applications require the joint optimization of a large number of flexible devices over time. The flexibility of, e.g., multiple batteries, thermostatically controlled loads, or electric vehicles can be used to support grid operation and to reduce operation costs. Using piecewise constant power values, the flexibility of each device over $d$ time periods can be described as a polyto… ▽ More Many real-world applications require the joint optimization of a large number of flexible devices over time. The flexibility of, e.g., multiple batteries, thermostatically controlled loads, or electric vehicles can be used to support grid operation and to reduce operation costs. Using piecewise constant power values, the flexibility of each device over $d$ time periods can be described as a polytopic subset in power space. The aggregated flexibility is given by the Minkowski sum of these polytopes. As the computation of Minkowski sums is in general demanding, several approximations have been proposed in the literature. Yet, their application potential is often objective-dependent and limited by the curse of dimensionality. We show that up to $2^d$ vertices of each polytope can be computed efficiently and that the convex hull of their sums provides a computationally efficient inner approximation of the Minkowski sum. Via an extensive simulation study, we illustrate that our approach outperforms ten state-of-the-art inner approximations in terms of computational complexity and accuracy for different objectives. Moreover, we propose an efficient disaggregation method applicable to any vertex-based approximation. The proposed methods provide an efficient means to aggregate and to disaggregate energy storages in quarter-hourly periods over an entire day with reasonable accuracy for aggregated cost and for peak power optimization. △ Less

Submitted 28 February, 2024; v1 submitted 2 November, 2023; originally announced November 2023.

Comments: 11 pages, 5 figures

Data-driven MPC with stability guarantees using extended dynamic mode decomposition

Authors: Lea Bold, Lars Grüne, Manuel Schaller, Karl Worthmann

Abstract: For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium f… ▽ More For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium for EDMD-based model predictive control, in which the optimization step is conducted using the data-based surrogate model. To this end, we derive novel bounds on the estimation error that are proportional to the norm of state and control. This enables us to show that, if the underlying system is cost controllable, this stabilizablility property is preserved. We conduct numerical simulations illustrating the proven practical asymptotic stability. △ Less

Submitted 22 July, 2024; v1 submitted 1 August, 2023; originally announced August 2023.

Comments: 18 pages, 3 figures

Reprojection methods for Koopman-based modelling and prediction

Authors: Pieter van Goor, Robert Mahony, Manuel Schaller, Karl Worthmann

Abstract: Extended Dynamic Mode Decomposition (eDMD) is a powerful tool to generate data-driven surrogate models for the prediction and control of nonlinear dynamical systems in the Koopman framework. In eDMD a compression of the lifted system dynamics on the space spanned by finitely many observables is computed, in which the original space is embedded as a low-dimensional manifold. While this manifold is… ▽ More Extended Dynamic Mode Decomposition (eDMD) is a powerful tool to generate data-driven surrogate models for the prediction and control of nonlinear dynamical systems in the Koopman framework. In eDMD a compression of the lifted system dynamics on the space spanned by finitely many observables is computed, in which the original space is embedded as a low-dimensional manifold. While this manifold is invariant for the infinite-dimensional Koopman operator, this invariance is typically not preserved for its eDMD-based approximation. Hence, an additional (re-)projection step is often tacitly incorporated to improve the prediction capability. We propose a novel framework for consistent reprojectors respecting the underlying manifold structure. Further, we present a new geometric reprojector based on maximum-likelihood arguments, which significantly enhances the approximation accuracy and preserves known finite-data error bounds. △ Less

Submitted 30 July, 2023; originally announced July 2023.

Comments: 15 pages, 7 figures

Equivariance and partial observations in Koopman operator theory for partial differential equations

Authors: Sebastian Peitz, Hans Harder, Feliks Nüske, Friedrich Philipp, Manuel Schaller, Karl Worthmann

Abstract: The Koopman operator has become an essential tool for data-driven analysis, prediction and control of complex systems. The main reason is the enormous potential of identifying linear function space representations of nonlinear dynamics from measurements. This equally applies to ordinary, stochastic, and partial differential equations (PDEs). Until now, with a few exceptions only, the PDE case is m… ▽ More The Koopman operator has become an essential tool for data-driven analysis, prediction and control of complex systems. The main reason is the enormous potential of identifying linear function space representations of nonlinear dynamics from measurements. This equally applies to ordinary, stochastic, and partial differential equations (PDEs). Until now, with a few exceptions only, the PDE case is mostly treated rather superficially, and the specific structure of the underlying dynamics is largely ignored. In this paper, we show that symmetries in the system dynamics can be carried over to the Koopman operator, which allows us to significantly increase the model efficacy. Moreover, the situation where we only have access to partial observations (i.e., measurements, as is very common for experimental data) has not been treated to its full extent, either. Moreover, we address the highly-relevant case where we cannot measure the full state, where alternative approaches (e.g., delay coordinates) have to be considered. We derive rigorous statements on the required number of observables in this situation, based on embedding theory. We present numerical evidence using various numerical examples including the wave equation and the Kuramoto-Sivashinsky equation. △ Less

Submitted 5 November, 2024; v1 submitted 28 July, 2023; originally announced July 2023.

Energy-optimal control of adaptive structures

Authors: Manuel Schaller, Amelie Zeller, Michael Böhm, Oliver Sawodny, Cristina Tarín, Karl Worthmann

Abstract: Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active damping is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks… ▽ More Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active damping is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks physical interpretation and merely serves as a regularization term. Rather, we propose a controller, which achieves the goal of vibration damping while acting energy-optimal. Leveraging the port-Hamiltonian structure, we show that the optimal control is uniquely determined, even on singular arcs. Further, we prove a stable long-time behavior of optimal trajectories by means of a turnpike property. Last, the proposed controller's efficiency is evaluated in a numerical study. △ Less

Submitted 8 December, 2023; v1 submitted 23 June, 2023; originally announced June 2023.

Comments: 15 pages, 4 figures

Optimal control of port-Hamiltonian systems: energy, entropy, and exergy

Authors: Friedrich Philipp, Manuel Schaller, Karl Worthmann, Timm Faulwasser, Bernhard Maschke

Abstract: We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supp… ▽ More We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supply, entropy generation, or exergy supply. Our results establish the integral turnpike property towards the set of thermodynamic equilibria providing a rigorous connection of optimal system trajectories to optimal steady states. Throughout the paper, we illustrate our findings by means of two examples: a network of heat exchangers and a gas-piston system. △ Less

Submitted 5 October, 2024; v1 submitted 15 June, 2023; originally announced June 2023.

Comments: 24 pages, 5 figures

MSC Class: 80M50; 93D20; 37J25

Globally convergent homotopies for discrete-time optimal control

Authors: Willem Esterhuizen, Kathrin Flaßkamp, Matthias Hoffmann, Karl Worthmann

Abstract: Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the difficult original problem and a related, comparatively easy one. Then, the solution of the easier one is continuously perturbed along the zero curve towards the sough… ▽ More Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the difficult original problem and a related, comparatively easy one. Then, the solution of the easier one is continuously perturbed along the zero curve towards the sought-after solution of the original problem. We propose a methodology for the systematic construction of such zero curves for discrete-time optimal control problems drawing upon the theory of globally convergent homotopies for nonlinear programs. The proposed framework ensures that for almost every initial guess at a solution there exists a suitable homotopy path that is, in addition, numerically convenient to track. We demonstrate the results by solving optimal path planning problems for a linear system and the nonlinear nonholonomic car (Dubins' vehicle). △ Less

Submitted 7 December, 2024; v1 submitted 13 June, 2023; originally announced June 2023.

Comments: 25 pages, 11 figures, under review

MSC Class: 49K15; 49M99; 90C30; 93B40; 93C55

Hidden regularity in singular optimal control of port-Hamiltonian systems

Authors: Timm Faulwasser, Jonas Kirchhoff, Volker Mehrmann, Friedrich Philipp, Manuel Schaller, Karl Worthmann

Abstract: We study the problem of state transition on a finite time interval with minimal energy supply for linear port-Hamiltonian systems. While the cost functional of minimal energy supply is intrinsic to the port-Hamiltonian structure, the necessary conditions of optimality resulting from Pontryagin's maximum principle may yield singular arcs. The underlying reason is the linear dependence on the contro… ▽ More We study the problem of state transition on a finite time interval with minimal energy supply for linear port-Hamiltonian systems. While the cost functional of minimal energy supply is intrinsic to the port-Hamiltonian structure, the necessary conditions of optimality resulting from Pontryagin's maximum principle may yield singular arcs. The underlying reason is the linear dependence on the control, which makes the problem of determining the optimal control as a function of the state and the adjoint more complicated or even impossible. To resolve this issue, we fully characterize regularity of the (differential-algebraic) optimality system by using the interplay of the cost functional and the dynamics. In case of the optimality DAE being characterized by a regular matrix pencil, we fully determine the control on the singular arc. In case of singular matrix pencils of the optimality system, we propose an approach to compute rank-minimal quadratic perturbations of the objective such that the optimal control problem becomes regular. We illustrate the applicability of our results by a general second-order mechanical system and a discretized boundary-controlled heat equation. △ Less

Submitted 20 November, 2023; v1 submitted 5 May, 2023; originally announced May 2023.

Comments: 21 pages

Safe continual learning in model predictive control with prescribed bounds on the tracking error

Authors: Lukas Lanza, Dario Dennstädt, Thomas Berger, Karl Worthmann

Abstract: We develop a three-component Model Predictive Control (MPC) algorithm to achieve output-reference tracking with prescribed performance for continuous-time nonlinear systems. One component is so-called funnel MPC, which achieves reference tracking with prescribed performance for the model output for suitable models. Recently, this MPC algorithm has been combined with a model-free reactive feedback… ▽ More We develop a three-component Model Predictive Control (MPC) algorithm to achieve output-reference tracking with prescribed performance for continuous-time nonlinear systems. One component is so-called funnel MPC, which achieves reference tracking with prescribed performance for the model output for suitable models. Recently, this MPC algorithm has been combined with a model-free reactive feedback controller (second component) to account for model-plant mismatches, bounded disturbances, and uncertainties. By construction, this two-component controller defines a robust funnel MPC algorithm. It achieves output-reference tracking within prescribed bounds on the tracking error for a class of unknown nonlinear systems. In this paper, we extend the robust funnel MPC by a machine learning component to adapt the underlying model to the system data and, thus, improve the contribution of MPC. We derive sufficient structural conditions to define a class of models for funnel MPC, and provide a characterization of suitable learning schemes. Since robust funnel MPC is inherently robust and the evolution of the tracking error in the prescribed performance funnel is guaranteed, the additional learning component is able to perform the learning task online -- even without an initial model or offline training. △ Less

Submitted 15 February, 2025; v1 submitted 21 April, 2023; originally announced April 2023.

On Koopman-based surrogate models for non-holonomic robots

Authors: Lea Bold, Hannes Eschmann, Mario Rosenfelder, Henrik Ebel, Karl Worthmann

Abstract: Data-driven surrogate models of dynamical systems based on the extended dynamic mode decomposition are nowadays well-established and widespread in applications. Further, for non-holonomic systems exhibiting a multiplicative coupling between states and controls, the usage of bi-linear surrogate models has proven beneficial. However, an in-depth analysis of the approximation quality and its dependen… ▽ More Data-driven surrogate models of dynamical systems based on the extended dynamic mode decomposition are nowadays well-established and widespread in applications. Further, for non-holonomic systems exhibiting a multiplicative coupling between states and controls, the usage of bi-linear surrogate models has proven beneficial. However, an in-depth analysis of the approximation quality and its dependence on different hyperparameters based on both simulation and experimental data is still missing. We investigate a differential-drive mobile robot to close this gap and provide first guidelines on the systematic design of data-efficient surrogate models. △ Less

Submitted 16 March, 2023; originally announced March 2023.

Comments: 10 pages, 7 figures

MSC Class: 37Mxx; 68T40; 93C85; 93C15; 93C57

Sampled-data funnel control and its use for safe continual learning

Authors: Lukas Lanza, Dario Dennstädt, Karl Worthmann, Philipp Schmitz, Gökçen Devlet Şen, Stephan Trenn, Manuel Schaller

Abstract: We propose a novel sampled-data output-feedback controller for nonlinear systems of arbitrary relative degree that ensures reference tracking within prescribed error bounds. We provide explicit bounds on the maximum input signal and the required uniform sampling time. A key strength of this approach is its capability to serve as a safety filter for various learning-based controller designs, enabli… ▽ More We propose a novel sampled-data output-feedback controller for nonlinear systems of arbitrary relative degree that ensures reference tracking within prescribed error bounds. We provide explicit bounds on the maximum input signal and the required uniform sampling time. A key strength of this approach is its capability to serve as a safety filter for various learning-based controller designs, enabling the use of learning techniques in safety-critical applications. We illustrate its versatility by integrating it with two different controllers: a reinforcement learning controller and a non-parametric predictive controller based on Willems et al.'s fundamental lemma. Numerical simulations illustrate effectiveness of the combined controller design. △ Less

Submitted 4 February, 2025; v1 submitted 1 March, 2023; originally announced March 2023.

Robust Funnel Model Predictive Control for output tracking with prescribed performance

Authors: Thomas Berger, Dario Dennstädt, Lukas Lanza, Karl Worthmann

Abstract: We propose a novel robust Model Predictive Control (MPC) scheme for nonlinear multi-input multi-output systems of relative degree one with stable internal dynamics. The proposed algorithm is a combination of funnel MPC, i.e., MPC with a particular stage cost, and the model-free adaptive funnel controller. The new robust funnel MPC scheme guarantees output tracking of reference signals within presc… ▽ More We propose a novel robust Model Predictive Control (MPC) scheme for nonlinear multi-input multi-output systems of relative degree one with stable internal dynamics. The proposed algorithm is a combination of funnel MPC, i.e., MPC with a particular stage cost, and the model-free adaptive funnel controller. The new robust funnel MPC scheme guarantees output tracking of reference signals within prescribed performance bounds -- even in the presence of unknown disturbances and a structural model-plant mismatch. We show initial and recursive feasibility of the proposed control scheme without imposing terminal conditions or any requirements on the prediction horizon. Moreover, we allow for model updates at runtime. To this end, we propose a proper initialization strategy, which ensures that recursive feasibility is preserved. Finally, we validate the performance of the proposed robust MPC scheme by simulations. △ Less

Submitted 12 December, 2023; v1 submitted 3 February, 2023; originally announced February 2023.

MSC Class: 93B45; 93C40; 93B51; 93B52

Error bounds for kernel-based approximations of the Koopman operator

Authors: Friedrich Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz, Feliks Nüske

Abstract: We consider the data-driven approximation of the Koopman operator for stochastic differential equations on reproducing kernel Hilbert spaces (RKHS). Our focus is on the estimation error if the data are collected from long-term ergodic simulations. We derive both an exact expression for the variance of the kernel cross-covariance operator, measured in the Hilbert-Schmidt norm, and probabilistic bou… ▽ More We consider the data-driven approximation of the Koopman operator for stochastic differential equations on reproducing kernel Hilbert spaces (RKHS). Our focus is on the estimation error if the data are collected from long-term ergodic simulations. We derive both an exact expression for the variance of the kernel cross-covariance operator, measured in the Hilbert-Schmidt norm, and probabilistic bounds for the finite-data estimation error. Moreover, we derive a bound on the prediction error of observables in the RKHS using a finite Mercer series expansion. Further, assuming Koopman-invariance of the RKHS, we provide bounds on the full approximation error. Numerical experiments using the Ornstein-Uhlenbeck process illustrate our results. △ Less

Submitted 19 December, 2023; v1 submitted 20 January, 2023; originally announced January 2023.

Comments: 31 pages

MSC Class: 47D07; 47B32; 47B33; 62M15

Path Planning for Concentric Tube Robots: a Toolchain with Application to Stereotactic Neurosurgery

Authors: Matthias K. Hoffmann, Willem Esterhuizen, Karl Worthmann, Kathrin Flaßkamp

Abstract: We present a toolchain for solving path planning problems for concentric tube robots through obstacle fields. First, ellipsoidal sets representing the target area and obstacles are constructed from labelled point clouds. Then, the nonlinear and highly nonconvex optimal control problem is solved by introducing a homotopy on the obstacle positions where at one extreme of the parameter the obstacles… ▽ More We present a toolchain for solving path planning problems for concentric tube robots through obstacle fields. First, ellipsoidal sets representing the target area and obstacles are constructed from labelled point clouds. Then, the nonlinear and highly nonconvex optimal control problem is solved by introducing a homotopy on the obstacle positions where at one extreme of the parameter the obstacles are removed from the operating space, and at the other extreme they are located at their intended positions. We present a detailed example (with more than a thousand obstacles) from stereotactic neurosurgery with real-world data obtained from labelled MPRI scans. △ Less

Submitted 28 November, 2022; originally announced November 2022.

Comments: 8 pages, 7 figures. Paper under review

MSC Class: 49M20 65H20 92C50 70E60 34H05 ACM Class: I.6.3; J.2; J.3

Behavioral Theory for Stochastic Systems? A Data-driven Journey from Willems to Wiener and Back Again

Authors: Timm Faulwasser, Ruchuan Ou, Guanru Pan, Philipp Schmitz, Karl Worthmann

Abstract: The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory… ▽ More The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory of stochastic linear systems. We show that series expansions -- in particular Polynomial Chaos Expansions (PCE) of $L^2$-random variables, which date back to Norbert Wiener's seminal work -- enable equivalent behavioral characterizations of linear stochastic systems. Specifically, we prove that under mild assumptions the behavior of the dynamics of the $L^2$-random variables is equivalent to the behavior of the dynamics of the series expansion coefficients and that it entails the behavior composed of sampled realization trajectories. We also illustrate the short-comings of the behavior associated to the time-evolution of the statistical moments. The paper culminates in the formulation of the stochastic fundamental lemma for linear (descriptor) systems, which in turn enables numerically tractable formulations of data-driven stochastic optimal control combining Hankel matrices in realization data (i.e. in measurements) with PCE concepts. △ Less

Submitted 28 April, 2023; v1 submitted 14 September, 2022; originally announced September 2022.

Comments: 31 pages, 7 figures

State and parameter estimation for retinal laser treatment

Authors: Viktoria Kleyman, Manuel Schaller, Mario Mordmuller, Mitsuru Wilson, Ralf Brinkmann, Karl Worthmann, Matthias A. Muller

Abstract: Adequate therapeutic retinal laser irradiation needs to be adapted to the local absorption. This leads to time-consuming treatments as the laser power needs to be successively adjusted to avoid under- and overtreatment caused by too low or too high temperatures. Closed-loop control can overcome this burden by means of temperature measurements. To allow for model predictive control schemes, the cur… ▽ More Adequate therapeutic retinal laser irradiation needs to be adapted to the local absorption. This leads to time-consuming treatments as the laser power needs to be successively adjusted to avoid under- and overtreatment caused by too low or too high temperatures. Closed-loop control can overcome this burden by means of temperature measurements. To allow for model predictive control schemes, the current state and the spot-dependent absorption need to be estimated. In this paper, we thoroughly compare moving horizon estimator (MHE) and extended Kalman filter (EKF) designs for joint state and parameter estimation. We consider two different scenarios, the estimation of one or two unknown absorption coefficients. For one unknown parameter, both estimators perform very similar. For two unknown parameters, we found that the MHE benefits from active parameter constraints at the beginning of the estimation, whereas after a settling time both estimators perform again very similar as long as the parameters are inside the considered parameter bounds. △ Less

Submitted 23 March, 2022; originally announced March 2022.

Data-driven MPC of descriptor systems: A case study for power networks

Authors: Philipp Schmitz, Alexander Engelmann, Timm Faulwasser, Karl Worthmann

Abstract: Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete… ▽ More Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete-time descriptor model obtained by discretization of the power-swing equations for a nine-bus system. Our results shows the efficacy of the proposed control scheme and they underpin the prospect of the data-driven framework for control of descriptor systems. △ Less

Submitted 4 March, 2022; originally announced March 2022.

Parameter estimation and model reduction for retinal laser treatment

Authors: Manuel Schaller, Mitsuru Wilson, Viktoria Kleyman, Mario Mordmüller, Ralf Brinkmann, Matthias A. Müller, Karl Worthmann

Abstract: Laser photocoagulation is one of the most frequently used treatment approaches for retinal diseases such as diabetic retinopathy and macular edema. The use of model-based control, such as Model Predictive Control (MPC), enhances a safe and effective treatment by guaranteeing temperature bounds. In general, real-time requirements for model-based control designs are not met since the temperature dis… ▽ More Laser photocoagulation is one of the most frequently used treatment approaches for retinal diseases such as diabetic retinopathy and macular edema. The use of model-based control, such as Model Predictive Control (MPC), enhances a safe and effective treatment by guaranteeing temperature bounds. In general, real-time requirements for model-based control designs are not met since the temperature distribution in the eye fundus is governed by a heat equation with a nonlinear parameter dependency. This issue is circumvented by representing the model by a lower-dimensional system which well-approximates the original model, including the parametric dependency. We combine a global-basis approach with the discrete empirical interpolation method, tailor its hyperparameters to laser photocoagulation, and show its superiority in comparison to a recently proposed method based on Taylor-series approximation. Its effectiveness is measured in computation time for MPC. We further present a case study to estimate the range of absorption parameters in porcine eyes, and by means of a theoretical and numerical sensitivity analysis we show that the sensitivity of the temperature increase is higher with respect to the absorption coefficient of the retinal pigment epithelium (RPE) than of the choroid's. △ Less

Submitted 25 February, 2022; originally announced February 2022.