-
Maximum-likelihood reprojections for reliable Koopman-based predictions and bifurcation analysis of parametric dynamical systems
Authors:
Pieter van Goor,
Robert Mahony,
Manuel Schaller,
Karl Worthmann
Abstract:
Koopman-based methods leverage a nonlinear lifting to enable linear regression techniques. Consequently, data generation, learning and prediction is performed through the lens of this lifting, giving rise to a nonlinear manifold that is invariant under the Koopman operator. In data-driven approximation such as Extended Dynamic Mode Decomposition, this invariance is typically lost due to the presen…
▽ More
Koopman-based methods leverage a nonlinear lifting to enable linear regression techniques. Consequently, data generation, learning and prediction is performed through the lens of this lifting, giving rise to a nonlinear manifold that is invariant under the Koopman operator. In data-driven approximation such as Extended Dynamic Mode Decomposition, this invariance is typically lost due to the presence of (finite-data) approximation errors. In this work, we show that reprojections are crucial for reliable predictions. We provide an approach via closest-point projections that ensure consistency with this nonlinear manifold, which is strongly related to a Riemannian metric and maximum likelihood estimates. While these results are already novel for autonomous systems, we present our approach for parametric systems, providing the basis for data-driven bifurcation analysis and control applications.
△ Less
Submitted 21 June, 2025;
originally announced June 2025.
-
Offset-free Nonlinear MPC with Koopman-based Surrogate Models
Authors:
Irene Schimperna,
Lea Bold,
Karl Worthmann
Abstract:
In this paper, we design offset-free nonlinear Model Predictive Control (MPC) for surrogate models based on Extended Dynamic Mode Decomposition (EDMD). The model used for prediction in MPC is augmented with a disturbance term, that is estimated by an observer. If the full information about the equilibrium of the real system is not available, a reference calculator is introduced in the algorithm to…
▽ More
In this paper, we design offset-free nonlinear Model Predictive Control (MPC) for surrogate models based on Extended Dynamic Mode Decomposition (EDMD). The model used for prediction in MPC is augmented with a disturbance term, that is estimated by an observer. If the full information about the equilibrium of the real system is not available, a reference calculator is introduced in the algorithm to compute the MPC state and input references. The control algorithm guarantees offset-free tracking of the controlled output under the assumption that the modeling errors are asymptotically constant. The effectiveness of the proposed approach is showcased with numerical simulations for two popular benchmark systems: the van-der-Pol oscillator and the four-tanks process.
△ Less
Submitted 30 April, 2025; v1 submitted 15 April, 2025;
originally announced April 2025.
-
Kernel-based error bounds of bilinear Koopman surrogate models for nonlinear data-driven control
Authors:
Robin Strässer,
Manuel Schaller,
Julian Berberich,
Karl Worthmann,
Frank Allgöwer
Abstract:
We derive novel deterministic bounds on the approximation error of data-based bilinear surrogate models for unknown nonlinear systems. The surrogate models are constructed using kernel-based extended dynamic mode decomposition to approximate the Koopman operator in a reproducing kernel Hilbert space. Unlike previous methods that require restrictive assumptions on the invariance of the dictionary,…
▽ More
We derive novel deterministic bounds on the approximation error of data-based bilinear surrogate models for unknown nonlinear systems. The surrogate models are constructed using kernel-based extended dynamic mode decomposition to approximate the Koopman operator in a reproducing kernel Hilbert space. Unlike previous methods that require restrictive assumptions on the invariance of the dictionary, our approach leverages kernel-based dictionaries that allow us to control the projection error via pointwise error bounds, overcoming a significant limitation of existing theoretical guarantees. The derived state- and input-dependent error bounds allow for direct integration into Koopman-based robust controller designs with closed-loop guarantees for the unknown nonlinear system. Numerical examples illustrate the effectiveness of the proposed framework.
△ Less
Submitted 20 June, 2025; v1 submitted 17 March, 2025;
originally announced March 2025.
-
Spatial decay of perturbations in hyperbolic equations with optimal boundary control
Authors:
Benedikt Oppeneiger,
Manuel Schaller,
Karl Worthmann
Abstract:
Recently, domain-uniform stabilizability and detectability has been the central assumption %in order robustness results on the to ensure robustness in the sense of exponential decay of spatially localized perturbations in optimally controlled evolution equations. In the present paper we analyze a chain of transport equations with boundary and point controls with regard to this property. Both for D…
▽ More
Recently, domain-uniform stabilizability and detectability has been the central assumption %in order robustness results on the to ensure robustness in the sense of exponential decay of spatially localized perturbations in optimally controlled evolution equations. In the present paper we analyze a chain of transport equations with boundary and point controls with regard to this property. Both for Dirichlet and Neumann boundary and coupling conditions, we show a necessary and sufficient criterion on control domains which allow for the domain-uniform stabilization of this equation. We illustrate the results by means of a numerical example.
△ Less
Submitted 17 February, 2025;
originally announced February 2025.
-
Towards Data-Driven Multi-Stage OPF
Authors:
Oleksii Molodchyk,
Philipp Schmitz,
Alexander Engelmann,
Karl Worthmann,
Timm Faulwasser
Abstract:
The operation of large-scale power systems is usually scheduled ahead via numerical optimization. However, this requires models of grid topology, line parameters, and bus specifications. Classic approaches first identify the network topology, i.e., the graph of interconnections and the associated impedances. The power generation schedules are then computed by solving a multi-stage optimal power fl…
▽ More
The operation of large-scale power systems is usually scheduled ahead via numerical optimization. However, this requires models of grid topology, line parameters, and bus specifications. Classic approaches first identify the network topology, i.e., the graph of interconnections and the associated impedances. The power generation schedules are then computed by solving a multi-stage optimal power flow (OPF) problem built around the model. In this paper, we explore the prospect of data-driven approaches to multi-stage optimal power flow. Specifically, we leverage recent findings from systems and control to bypass the identification step and to construct the optimization problem directly from data. We illustrate the performance of our method on a 118-bus system and compare it with the classical identification-based approach.
△ Less
Submitted 3 February, 2025;
originally announced February 2025.
-
Spatial exponential decay of perturbations in optimal control of general evolution equations
Authors:
Simone Göttlich,
Benedikt Oppeneiger,
Manuel Schaller,
Karl Worthmann
Abstract:
We analyze the robustness of optimally controlled evolution equations with respect to spatially localized perturbations. We prove that if the involved operators are domain-uniformly stabilizable and detectable, then these localized perturbations only have a local effect on the optimal solution. We characterize this domain-uniform stabilizability and detectability for the transport equation with co…
▽ More
We analyze the robustness of optimally controlled evolution equations with respect to spatially localized perturbations. We prove that if the involved operators are domain-uniformly stabilizable and detectable, then these localized perturbations only have a local effect on the optimal solution. We characterize this domain-uniform stabilizability and detectability for the transport equation with constant transport velocity, showing that even for unitary semigroups, optimality implies exponential damping. Finally, we extend our result to the case of a space-dependent transport velocity. Numerical examples in one space dimension complement the theoretical results.
△ Less
Submitted 21 January, 2025;
originally announced January 2025.
-
Kernel-based Koopman approximants for control: Flexible sampling, error analysis, and stability
Authors:
Lea Bold,
Friedrich M. Philipp,
Manuel Schaller,
Karl Worthmann
Abstract:
Data-driven techniques for analysis, modeling, and control of complex dynamical systems are on the uptake. Koopman theory provides the theoretical foundation for the extremely popular kernel extended dynamic mode decomposition (kEDMD). In this work we propose a novel kEDMD scheme to approximate nonlinear control systems accompanied by an in-depth error analysis. The main features of the method are…
▽ More
Data-driven techniques for analysis, modeling, and control of complex dynamical systems are on the uptake. Koopman theory provides the theoretical foundation for the extremely popular kernel extended dynamic mode decomposition (kEDMD). In this work we propose a novel kEDMD scheme to approximate nonlinear control systems accompanied by an in-depth error analysis. The main features of the method are flexible sampling, regularization-based robustness, and an adroit decomposition into micro and macro grids. In addition, we prove proportionality, i.e., explicit dependence on the distance to the (controlled) equilibrium, of the derived uniform bounds on the full approximation error. Leveraging this key property, we rigorously show that asymptotic stability of the data-driven surrogate (control) system implies asymptotic stability of the original (control) system and vice versa.
△ Less
Submitted 3 December, 2024;
originally announced December 2024.
-
Koopman-based control of nonlinear systems with closed-loop guarantees
Authors:
Robin Strässer,
Julian Berberich,
Manuel Schaller,
Karl Worthmann,
Frank Allgöwer
Abstract:
In this paper, we provide a tutorial overview and an extension of a recently developed framework for data-driven control of unknown nonlinear systems with rigorous closed-loop guarantees. The proposed approach relies on the Koopman operator representation of the nonlinear system, for which a bilinear surrogate model is estimated based on data. In contrast to existing Koopman-based estimation proce…
▽ More
In this paper, we provide a tutorial overview and an extension of a recently developed framework for data-driven control of unknown nonlinear systems with rigorous closed-loop guarantees. The proposed approach relies on the Koopman operator representation of the nonlinear system, for which a bilinear surrogate model is estimated based on data. In contrast to existing Koopman-based estimation procedures, we state guaranteed bounds on the approximation error using the stability- and certificate-oriented extended dynamic mode decomposition (SafEDMD) framework. The resulting surrogate model and the uncertainty bounds allow us to design controllers via robust control theory and sum-of-squares optimization, guaranteeing desirable properties for the closed-loop system. We present results on stabilization both in discrete and continuous time, and we derive a method for controller design with performance objectives. The benefits of the presented framework over established approaches are demonstrated with a numerical example.
△ Less
Submitted 18 March, 2025; v1 submitted 15 November, 2024;
originally announced November 2024.
-
Data-Driven Predictive Control of Nonholonomic Robots Based on a Bilinear Koopman Realization: Data Does Not Replace Geometry
Authors:
Mario Rosenfelder,
Lea Bold,
Hannes Eschmann,
Peter Eberhard,
Karl Worthmann,
Henrik Ebel
Abstract:
Advances in machine learning and the growing trend towards effortless data generation in real-world systems has led to an increasing interest for data-inferred models and data-based control in robotics. It seems appealing to govern robots solely based on data, bypassing the traditional, more elaborate pipeline of system modeling through first-principles and subsequent controller design. One promis…
▽ More
Advances in machine learning and the growing trend towards effortless data generation in real-world systems has led to an increasing interest for data-inferred models and data-based control in robotics. It seems appealing to govern robots solely based on data, bypassing the traditional, more elaborate pipeline of system modeling through first-principles and subsequent controller design. One promising data-driven approach is the Extended Dynamic Mode Decomposition (EDMD) for control-affine systems, a system class which contains many vehicles and machines of immense practical importance including, e.g., typical wheeled mobile robots. EDMD can be highly data-efficient, computationally inexpensive, can deal with nonlinear dynamics as prevalent in robotics and mechanics, and has a sound theoretical foundation rooted in Koopman theory. On this background, this present paper examines how EDMD models can be integrated into predictive controllers for nonholonomic mobile robots. In addition to the conventional kinematic mobile robot, we also cover the complete data-driven control pipeline - from data acquisition to control design - when the robot is not treated in terms of first-order kinematics but in a second-order manner, allowing to account for actuator dynamics. Using only real-world measurement data, it is shown in both simulations and hardware experiments that the surrogate models enable high-precision predictive controllers in the studied cases. However, the findings raise significant concerns about purely data-centric approaches that overlook the underlying geometry of nonholonomic systems, showing that, for nonholonomic systems, some geometric insight seems necessary and cannot be easily compensated for with large amounts of data.
△ Less
Submitted 11 November, 2024;
originally announced November 2024.
-
Existence of solutions to port-Hamiltonian systems: initial value problems and optimal control
Authors:
Willem Esterhuizen,
Bernhard Maschke,
Till Preuster,
Manuel Schaller,
Karl Worthmann
Abstract:
We investigate the existence of solutions of reversible and irreversible port-Hamiltonian systems. To this end, we utilize the associated exergy, a function that is composed of the system's Hamiltonian and entropy, to prove global existence in time for bounded control functions. The results are then leveraged to prove existence of solutions of energy- and entropy-optimal control problems. Last, we…
▽ More
We investigate the existence of solutions of reversible and irreversible port-Hamiltonian systems. To this end, we utilize the associated exergy, a function that is composed of the system's Hamiltonian and entropy, to prove global existence in time for bounded control functions. The results are then leveraged to prove existence of solutions of energy- and entropy-optimal control problems. Last, we explore model predictive control tailored to irreversible port-Hamiltonian systems by means of a numerical case study with a heat exchanger network.
△ Less
Submitted 24 October, 2024;
originally announced October 2024.
-
Data-driven MPC with terminal conditions in the Koopman framework
Authors:
Karl Worthmann,
Robin Strässer,
Manuel Schaller,
Julian Berberich,
Frank Allgöwer
Abstract:
We investigate nonlinear model predictive control (MPC) with terminal conditions in the Koopman framework using extended dynamic mode decomposition (EDMD) to generate a data-based surrogate model for prediction and optimization. We rigorously show recursive feasibility and prove practical asymptotic stability w.r.t. the approximation accuracy. To this end, finite-data error bounds are employed. Th…
▽ More
We investigate nonlinear model predictive control (MPC) with terminal conditions in the Koopman framework using extended dynamic mode decomposition (EDMD) to generate a data-based surrogate model for prediction and optimization. We rigorously show recursive feasibility and prove practical asymptotic stability w.r.t. the approximation accuracy. To this end, finite-data error bounds are employed. The construction of the terminal conditions is based on recently derived proportional error bounds to ensure the required Lyapunov decrease. Finally, we illustrate the effectiveness of the proposed data-driven predictive controller including the design procedure to construct the terminal region and controller.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
Modularized data-driven approximation of the Koopman operator and generator
Authors:
Yang Guo,
Manuel Schaller,
Karl Worthmann,
Stefan Streif
Abstract:
Extended Dynamic Mode Decomposition (EDMD) is a widely-used data-driven approach to learn an approximation of the Koopman operator. Consequently, it provides a powerful tool for data-driven analysis, prediction, and control of nonlinear dynamical (control) systems. In this work, we propose a novel modularized EDMD scheme tailored to interconnected systems. To this end, we utilize the structure of…
▽ More
Extended Dynamic Mode Decomposition (EDMD) is a widely-used data-driven approach to learn an approximation of the Koopman operator. Consequently, it provides a powerful tool for data-driven analysis, prediction, and control of nonlinear dynamical (control) systems. In this work, we propose a novel modularized EDMD scheme tailored to interconnected systems. To this end, we utilize the structure of the Koopman generator that allows to learn the dynamics of subsystems individually and thus alleviates the curse of dimensionality by considering observable functions on smaller state spaces. Moreover, our approach canonically enables transfer learning if a system encompasses multiple copies of a model as well as efficient adaption to topology changes without retraining. We provide finite-data bounds on the estimation error using tools from graph theory. The efficacy of the method is illustrated by means of various numerical examples.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
MPC without Terminal Ingredients Tailored to the SEIR Compartmental Epidemic Model
Authors:
Willem Esterhuizen,
Philipp Sauerteig,
Stefan Streif,
Karl Worthmann
Abstract:
We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed…
▽ More
We consider the SEIR compartmental epidemic model subject to state and input constraints (a cap on the proportion of infectious individuals and limits on the allowed social distancing and quarantining measures, respectively). We present a tailored model predictive control (MPC) scheme without terminal conditions. We rigorously show recursive feasibility and asymptotic convergence of the MPC closed loop to the continuum of disease-free equilibrium points for suitably designed quadratic running cost and a sufficiently long prediction horizon (forecast window). Moreover, we establish the viability kernel (a.k.a. the admissible set) as a domain of attraction of the continuum of equilibria.
△ Less
Submitted 10 June, 2024; v1 submitted 14 March, 2024;
originally announced March 2024.
-
SafEDMD: A Koopman-based data-driven controller design framework for nonlinear dynamical systems
Authors:
Robin Strässer,
Manuel Schaller,
Karl Worthmann,
Julian Berberich,
Frank Allgöwer
Abstract:
The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose SafEDMD, a novel stability- and certificate-oriented EDMD-based controller design framework. Our approach leverages a reliable surrogate model generated in a data-driven f…
▽ More
The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose SafEDMD, a novel stability- and certificate-oriented EDMD-based controller design framework. Our approach leverages a reliable surrogate model generated in a data-driven fashion in order to provide closed-loop guarantees. In particular, we establish a controller design based on semi-definite programming with guaranteed stabilization of the underlying nonlinear system. As central ingredient, we derive proportional error bounds that vanish at the origin and are tailored to control tasks. We illustrate the developed method by means of several benchmark examples and highlight the advantages over state-of-the-art methods.
△ Less
Submitted 25 April, 2025; v1 submitted 5 February, 2024;
originally announced February 2024.
-
Koopman-based feedback design with stability guarantees
Authors:
Robin Strässer,
Manuel Schaller,
Karl Worthmann,
Julian Berberich,
Frank Allgöwer
Abstract:
We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feed…
▽ More
We present a method to design a state-feedback controller ensuring exponential stability for nonlinear systems using only measurement data. Our approach relies on Koopman-operator theory and uses robust control to explicitly account for approximation errors due to finitely many data samples. To simplify practical usage across various applications, we provide a tutorial-style exposition of the feedback design and its stability guarantees for single-input systems. Moreover, we extend this controller design to multi-input systems and more flexible nonlinear state-feedback controllers using gain-scheduling techniques to increase the guaranteed region of attraction. As the proposed controller design is framed as a semidefinite program, it allows for an efficient solution. Further, we enhance the geometry of the region of attraction through a heuristic algorithm that establishes a connection between the employed Koopman lifting and the dynamics of the system. Finally, we validate the proposed feedback design procedure by means of numerical examples.
△ Less
Submitted 3 May, 2024; v1 submitted 3 December, 2023;
originally announced December 2023.
-
Alleviating the Curse of Dimensionality in Minkowski Sum Approximations of Storage Flexibility
Authors:
Emrah Öztürk,
Timm Faulwasser,
Karl Worthmann,
Markus Preißinger,
Klaus Rheinberger
Abstract:
Many real-world applications require the joint optimization of a large number of flexible devices over time. The flexibility of, e.g., multiple batteries, thermostatically controlled loads, or electric vehicles can be used to support grid operation and to reduce operation costs. Using piecewise constant power values, the flexibility of each device over $d$ time periods can be described as a polyto…
▽ More
Many real-world applications require the joint optimization of a large number of flexible devices over time. The flexibility of, e.g., multiple batteries, thermostatically controlled loads, or electric vehicles can be used to support grid operation and to reduce operation costs. Using piecewise constant power values, the flexibility of each device over $d$ time periods can be described as a polytopic subset in power space. The aggregated flexibility is given by the Minkowski sum of these polytopes. As the computation of Minkowski sums is in general demanding, several approximations have been proposed in the literature. Yet, their application potential is often objective-dependent and limited by the curse of dimensionality. We show that up to $2^d$ vertices of each polytope can be computed efficiently and that the convex hull of their sums provides a computationally efficient inner approximation of the Minkowski sum. Via an extensive simulation study, we illustrate that our approach outperforms ten state-of-the-art inner approximations in terms of computational complexity and accuracy for different objectives. Moreover, we propose an efficient disaggregation method applicable to any vertex-based approximation. The proposed methods provide an efficient means to aggregate and to disaggregate energy storages in quarter-hourly periods over an entire day with reasonable accuracy for aggregated cost and for peak power optimization.
△ Less
Submitted 28 February, 2024; v1 submitted 2 November, 2023;
originally announced November 2023.
-
Data-driven MPC with stability guarantees using extended dynamic mode decomposition
Authors:
Lea Bold,
Lars Grüne,
Manuel Schaller,
Karl Worthmann
Abstract:
For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium f…
▽ More
For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium for EDMD-based model predictive control, in which the optimization step is conducted using the data-based surrogate model. To this end, we derive novel bounds on the estimation error that are proportional to the norm of state and control. This enables us to show that, if the underlying system is cost controllable, this stabilizablility property is preserved. We conduct numerical simulations illustrating the proven practical asymptotic stability.
△ Less
Submitted 22 July, 2024; v1 submitted 1 August, 2023;
originally announced August 2023.
-
Reprojection methods for Koopman-based modelling and prediction
Authors:
Pieter van Goor,
Robert Mahony,
Manuel Schaller,
Karl Worthmann
Abstract:
Extended Dynamic Mode Decomposition (eDMD) is a powerful tool to generate data-driven surrogate models for the prediction and control of nonlinear dynamical systems in the Koopman framework. In eDMD a compression of the lifted system dynamics on the space spanned by finitely many observables is computed, in which the original space is embedded as a low-dimensional manifold. While this manifold is…
▽ More
Extended Dynamic Mode Decomposition (eDMD) is a powerful tool to generate data-driven surrogate models for the prediction and control of nonlinear dynamical systems in the Koopman framework. In eDMD a compression of the lifted system dynamics on the space spanned by finitely many observables is computed, in which the original space is embedded as a low-dimensional manifold. While this manifold is invariant for the infinite-dimensional Koopman operator, this invariance is typically not preserved for its eDMD-based approximation. Hence, an additional (re-)projection step is often tacitly incorporated to improve the prediction capability. We propose a novel framework for consistent reprojectors respecting the underlying manifold structure. Further, we present a new geometric reprojector based on maximum-likelihood arguments, which significantly enhances the approximation accuracy and preserves known finite-data error bounds.
△ Less
Submitted 30 July, 2023;
originally announced July 2023.
-
Energy-optimal control of adaptive structures
Authors:
Manuel Schaller,
Amelie Zeller,
Michael Böhm,
Oliver Sawodny,
Cristina Tarín,
Karl Worthmann
Abstract:
Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active damping is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks…
▽ More
Adaptive structures are equipped with sensors and actuators to actively counteract external loads such as wind. This can significantly reduce resource consumption and emissions during the life cycle compared to conventional structures. A common approach for active damping is to derive a port-Hamiltonian model and to employ linear-quadratic control. However, the quadratic control penalization lacks physical interpretation and merely serves as a regularization term. Rather, we propose a controller, which achieves the goal of vibration damping while acting energy-optimal. Leveraging the port-Hamiltonian structure, we show that the optimal control is uniquely determined, even on singular arcs. Further, we prove a stable long-time behavior of optimal trajectories by means of a turnpike property. Last, the proposed controller's efficiency is evaluated in a numerical study.
△ Less
Submitted 8 December, 2023; v1 submitted 23 June, 2023;
originally announced June 2023.
-
Optimal control of port-Hamiltonian systems: energy, entropy, and exergy
Authors:
Friedrich Philipp,
Manuel Schaller,
Karl Worthmann,
Timm Faulwasser,
Bernhard Maschke
Abstract:
We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supp…
▽ More
We consider irreversible and coupled reversible-irreversible nonlinear port-Hamiltonian systems and the respective sets of thermodynamic equilibria. In particular, we are concerned with optimal state transitions and output stabilization on finite-time horizons. We analyze a class of optimal control problems, where the performance functional can be interpreted as a linear combination of energy supply, entropy generation, or exergy supply. Our results establish the integral turnpike property towards the set of thermodynamic equilibria providing a rigorous connection of optimal system trajectories to optimal steady states. Throughout the paper, we illustrate our findings by means of two examples: a network of heat exchangers and a gas-piston system.
△ Less
Submitted 5 October, 2024; v1 submitted 15 June, 2023;
originally announced June 2023.
-
Globally convergent homotopies for discrete-time optimal control
Authors:
Willem Esterhuizen,
Kathrin Flaßkamp,
Matthias Hoffmann,
Karl Worthmann
Abstract:
Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the difficult original problem and a related, comparatively easy one. Then, the solution of the easier one is continuously perturbed along the zero curve towards the sough…
▽ More
Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the difficult original problem and a related, comparatively easy one. Then, the solution of the easier one is continuously perturbed along the zero curve towards the sought-after solution of the original problem. We propose a methodology for the systematic construction of such zero curves for discrete-time optimal control problems drawing upon the theory of globally convergent homotopies for nonlinear programs. The proposed framework ensures that for almost every initial guess at a solution there exists a suitable homotopy path that is, in addition, numerically convenient to track. We demonstrate the results by solving optimal path planning problems for a linear system and the nonlinear nonholonomic car (Dubins' vehicle).
△ Less
Submitted 7 December, 2024; v1 submitted 13 June, 2023;
originally announced June 2023.
-
Path Planning for Concentric Tube Robots: a Toolchain with Application to Stereotactic Neurosurgery
Authors:
Matthias K. Hoffmann,
Willem Esterhuizen,
Karl Worthmann,
Kathrin Flaßkamp
Abstract:
We present a toolchain for solving path planning problems for concentric tube robots through obstacle fields. First, ellipsoidal sets representing the target area and obstacles are constructed from labelled point clouds. Then, the nonlinear and highly nonconvex optimal control problem is solved by introducing a homotopy on the obstacle positions where at one extreme of the parameter the obstacles…
▽ More
We present a toolchain for solving path planning problems for concentric tube robots through obstacle fields. First, ellipsoidal sets representing the target area and obstacles are constructed from labelled point clouds. Then, the nonlinear and highly nonconvex optimal control problem is solved by introducing a homotopy on the obstacle positions where at one extreme of the parameter the obstacles are removed from the operating space, and at the other extreme they are located at their intended positions. We present a detailed example (with more than a thousand obstacles) from stereotactic neurosurgery with real-world data obtained from labelled MPRI scans.
△ Less
Submitted 28 November, 2022;
originally announced November 2022.
-
Behavioral Theory for Stochastic Systems? A Data-driven Journey from Willems to Wiener and Back Again
Authors:
Timm Faulwasser,
Ruchuan Ou,
Guanru Pan,
Philipp Schmitz,
Karl Worthmann
Abstract:
The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory…
▽ More
The fundamental lemma by Jan C. Willems and co-workers, which is deeply rooted in behavioral systems theory, has become one of the supporting pillars of the recent progress on data-driven control and system analysis. This tutorial-style paper combines recent insights into stochastic and descriptor-system formulations of the lemma to further extend and broaden the formal basis for behavioral theory of stochastic linear systems. We show that series expansions -- in particular Polynomial Chaos Expansions (PCE) of $L^2$-random variables, which date back to Norbert Wiener's seminal work -- enable equivalent behavioral characterizations of linear stochastic systems. Specifically, we prove that under mild assumptions the behavior of the dynamics of the $L^2$-random variables is equivalent to the behavior of the dynamics of the series expansion coefficients and that it entails the behavior composed of sampled realization trajectories. We also illustrate the short-comings of the behavior associated to the time-evolution of the statistical moments. The paper culminates in the formulation of the stochastic fundamental lemma for linear (descriptor) systems, which in turn enables numerically tractable formulations of data-driven stochastic optimal control combining Hankel matrices in realization data (i.e. in measurements) with PCE concepts.
△ Less
Submitted 28 April, 2023; v1 submitted 14 September, 2022;
originally announced September 2022.
-
State and parameter estimation for retinal laser treatment
Authors:
Viktoria Kleyman,
Manuel Schaller,
Mario Mordmuller,
Mitsuru Wilson,
Ralf Brinkmann,
Karl Worthmann,
Matthias A. Muller
Abstract:
Adequate therapeutic retinal laser irradiation needs to be adapted to the local absorption. This leads to time-consuming treatments as the laser power needs to be successively adjusted to avoid under- and overtreatment caused by too low or too high temperatures. Closed-loop control can overcome this burden by means of temperature measurements. To allow for model predictive control schemes, the cur…
▽ More
Adequate therapeutic retinal laser irradiation needs to be adapted to the local absorption. This leads to time-consuming treatments as the laser power needs to be successively adjusted to avoid under- and overtreatment caused by too low or too high temperatures. Closed-loop control can overcome this burden by means of temperature measurements. To allow for model predictive control schemes, the current state and the spot-dependent absorption need to be estimated. In this paper, we thoroughly compare moving horizon estimator (MHE) and extended Kalman filter (EKF) designs for joint state and parameter estimation. We consider two different scenarios, the estimation of one or two unknown absorption coefficients. For one unknown parameter, both estimators perform very similar. For two unknown parameters, we found that the MHE benefits from active parameter constraints at the beginning of the estimation, whereas after a settling time both estimators perform again very similar as long as the parameters are inside the considered parameter bounds.
△ Less
Submitted 23 March, 2022;
originally announced March 2022.
-
Data-driven MPC of descriptor systems: A case study for power networks
Authors:
Philipp Schmitz,
Alexander Engelmann,
Timm Faulwasser,
Karl Worthmann
Abstract:
Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete…
▽ More
Recently, data-driven predictive control of linear systems has received wide-spread research attention. It hinges on the fundamental lemma by Willems et al. In a previous paper, we have shown how this framework can be applied to predictive control of linear time-invariant descriptor systems. In the present paper, we present a case study wherein we apply data-driven predictive control to a discrete-time descriptor model obtained by discretization of the power-swing equations for a nine-bus system. Our results shows the efficacy of the proposed control scheme and they underpin the prospect of the data-driven framework for control of descriptor systems.
△ Less
Submitted 4 March, 2022;
originally announced March 2022.
-
Parameter estimation and model reduction for retinal laser treatment
Authors:
Manuel Schaller,
Mitsuru Wilson,
Viktoria Kleyman,
Mario Mordmüller,
Ralf Brinkmann,
Matthias A. Müller,
Karl Worthmann
Abstract:
Laser photocoagulation is one of the most frequently used treatment approaches for retinal diseases such as diabetic retinopathy and macular edema. The use of model-based control, such as Model Predictive Control (MPC), enhances a safe and effective treatment by guaranteeing temperature bounds. In general, real-time requirements for model-based control designs are not met since the temperature dis…
▽ More
Laser photocoagulation is one of the most frequently used treatment approaches for retinal diseases such as diabetic retinopathy and macular edema. The use of model-based control, such as Model Predictive Control (MPC), enhances a safe and effective treatment by guaranteeing temperature bounds. In general, real-time requirements for model-based control designs are not met since the temperature distribution in the eye fundus is governed by a heat equation with a nonlinear parameter dependency. This issue is circumvented by representing the model by a lower-dimensional system which well-approximates the original model, including the parametric dependency. We combine a global-basis approach with the discrete empirical interpolation method, tailor its hyperparameters to laser photocoagulation, and show its superiority in comparison to a recently proposed method based on Taylor-series approximation. Its effectiveness is measured in computation time for MPC. We further present a case study to estimate the range of absorption parameters in porcine eyes, and by means of a theoretical and numerical sensitivity analysis we show that the sensitivity of the temperature increase is higher with respect to the absorption coefficient of the retinal pigment epithelium (RPE) than of the choroid's.
△ Less
Submitted 25 February, 2022;
originally announced February 2022.
-
Model predictive control for retinal laser treatment at 1 kHz
Authors:
Manuel Schaller,
Viktoria Kleyman,
Mario Mordmüller,
Christian Schmidt,
Mitsuru Wilson,
Ralf Brinkmann,
Matthias A. Müller,
Karl Worthmann
Abstract:
Laser photocoagulation is a technique applied in the treatment of retinal diseases. While this is often done manually or using simple control schemes, we pursue an optimization-based approach, namely Model Predictive Control (MPC), to enforce bounds on the peak temperature and, thus, safety during the medical treatment procedure - despite the spot-dependent absorption of the tissue. To this end, a…
▽ More
Laser photocoagulation is a technique applied in the treatment of retinal diseases. While this is often done manually or using simple control schemes, we pursue an optimization-based approach, namely Model Predictive Control (MPC), to enforce bounds on the peak temperature and, thus, safety during the medical treatment procedure - despite the spot-dependent absorption of the tissue. To this end, a repetition rate of 1 kHz is desirable rendering the real-time requirements a major challenge. We present a tailored MPC scheme using parametric model reduction, an extended Kalman filter for the parameter and state estimation, and suitably constructed stage costs and verify its applicability both in simulation and experiments with porcine eyes. Moreover, we give some insight on the implementation specifically tailored for fast numerical computations.
△ Less
Submitted 24 March, 2022; v1 submitted 25 February, 2022;
originally announced February 2022.
-
Willems' fundamental lemma for linear descriptor systems and its use for data-driven output-feedback MPC
Authors:
Philipp Schmitz,
Timm Faulwasser,
Karl Worthmann
Abstract:
In this paper we investigate data-driven predictive control of discrete-time linear descriptor systems. Specifically, we give a tailored variant of Willems' fundamental lemma, which shows that for descriptor systems the non-parametric modelling via a Hankel matrix requires less data compared to linear time-invariant systems without algebraic constraints. Moreover, we use this description to propos…
▽ More
In this paper we investigate data-driven predictive control of discrete-time linear descriptor systems. Specifically, we give a tailored variant of Willems' fundamental lemma, which shows that for descriptor systems the non-parametric modelling via a Hankel matrix requires less data compared to linear time-invariant systems without algebraic constraints. Moreover, we use this description to propose a data-driven framework for optimal control and predictive control of discrete-time linear descriptor systems. For the latter, we provide a sufficient stability condition for receding-horizon control before we illustrate our findings with an example.
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
State and parameter estimation for model-based retinal laser treatment
Authors:
Viktoria Kleyman,
Manuel Schaller,
Mitsuru Wilson,
Mario Mordmüller,
Ralf Brinkmann,
Karl Worthmann,
Matthias A. Müller
Abstract:
We present an approach for state and parameter estimation in retinal laser treatment by a novel setup where both measurement and heating is performed by a single laser. In this medical application, the temperature that is induced by the laser in the patient's eye is critical for a successful and safe treatment. To this end, we pursue a model-based approach using a model given by a heat diffusion e…
▽ More
We present an approach for state and parameter estimation in retinal laser treatment by a novel setup where both measurement and heating is performed by a single laser. In this medical application, the temperature that is induced by the laser in the patient's eye is critical for a successful and safe treatment. To this end, we pursue a model-based approach using a model given by a heat diffusion equation on a cylindrical domain, where the source term is given by the absorbed laser power. The model is parametric in the sense that it involves an absorption coefficient, which depends on the treatment spot and plays a central role in the input-output behavior of the system. After discretization, we apply a particularly suited parametric model order reduction to ensure real-time tractability while retaining parameter dependence. We augment known state estimation techniques, i.e., extended Kalman filtering and moving horizon estimation, with parameter estimation to estimate the absorption coefficient and the current state of the system. Eventually, we show first results for simulated and experimental data from porcine eyes. We find that, regarding convergence speed, the moving horizon estimation slightly outperforms the extended Kalman filter on measurement data in terms of parameter and state estimation, however, on simulated data the results are very similar.
△ Less
Submitted 4 March, 2021;
originally announced March 2021.
-
On MPC without terminal conditions for dynamic non-holonomic robots
Authors:
Franz Rußwurm,
Willem Esterhuizen,
Karl Worthmann,
Stefan Streif
Abstract:
We consider an input-constrained differential-drive robot with actuator dynamics. For this system, we establish asymptotic stability of the origin on arbitrary compact, convex sets using Model Predictive Control (MPC) without stabilizing terminal conditions despite the presence of state constraints and actuator dynamics. We note that the problem without those two additional ingredients was essenti…
▽ More
We consider an input-constrained differential-drive robot with actuator dynamics. For this system, we establish asymptotic stability of the origin on arbitrary compact, convex sets using Model Predictive Control (MPC) without stabilizing terminal conditions despite the presence of state constraints and actuator dynamics. We note that the problem without those two additional ingredients was essentially solved beforehand, despite the fact that the linearization is not stabilizable. We propose an approach successfully solving the task at hand by combining the theory of barriers to characterize the viability kernel and an MPC framework based on so-called cost controllability. Moreover, we present a numerical case study to derive quantitative bounds on the required length of the prediction horizon. To this end, we investigate the boundary of the viability kernel and a neighbourhood of the origin, i.e. the most interesting areas.
△ Less
Submitted 3 June, 2021; v1 submitted 18 February, 2021;
originally announced February 2021.
-
Distributed Optimization using ALADIN for MPC in Smart Grids
Authors:
Yuning Jiang,
Philipp Sauerteig,
Boris Houska,
Karl Worthmann
Abstract:
This paper presents a distributed optimization algorithm tailored to solve optimization problems arising in smart grids. In detail, we propose a variant of the Augmented Lagrangian based Alternating Direction Inexact Newton (ALADIN) method, which comes along with global convergence guarantees for the considered class of linear-quadratic optimization problems. We establish local quadratic convergen…
▽ More
This paper presents a distributed optimization algorithm tailored to solve optimization problems arising in smart grids. In detail, we propose a variant of the Augmented Lagrangian based Alternating Direction Inexact Newton (ALADIN) method, which comes along with global convergence guarantees for the considered class of linear-quadratic optimization problems. We establish local quadratic convergence of the proposed scheme and elaborate its advantages compared to the Alternating Direction Method of Multipliers (ADMM). In particular, we show that, at the cost of more communication, ALADIN requires fewer iterations to achieve the desired accuracy. Furthermore, it is numerically demonstrated that the number of iterations is independent of the number of subsystems. The effectiveness of the proposed scheme is illustrated by running both an ALADIN and an ADMM based model predictive controller on a benchmark case study.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
A Dissipativity Characterization of Velocity Turnpikes in Optimal Control Problems for Mechanical Systems
Authors:
Timm Faulwasser,
Kathrin Flaßkamp,
Sina Ober-Blöbaum,
Karl Worthmann
Abstract:
Turnpikes have recently gained significant research interest in optimal control, since they allow for pivotal insights into the structure of solutions to optimal control problems. So far, mainly steady state solutions which serve as optimal operation points, are studied. This is in contrast to time-varying turnpikes, which are in the focus of this paper. More concretely, we analyze symmetry-induce…
▽ More
Turnpikes have recently gained significant research interest in optimal control, since they allow for pivotal insights into the structure of solutions to optimal control problems. So far, mainly steady state solutions which serve as optimal operation points, are studied. This is in contrast to time-varying turnpikes, which are in the focus of this paper. More concretely, we analyze symmetry-induced velocity turnpikes, i.e. controlled relative equilibria, called trim primitives, which are optimal operation points regarding the given cost criterion. We characterize velocity turnpikes by means of dissipativity inequalities. Moreover, we study the equivalence between optimal control problems and steady-state problems via the corresponding necessary optimality conditions. An academic example is given for illustration.
△ Less
Submitted 11 February, 2020;
originally announced February 2020.
-
Distributed Control Enforcing Group Sparsity in Smart Grids
Authors:
Philipp Sauerteig,
Yuning Jiang,
Boris Houska,
Karl Worthmann
Abstract:
In modern smart grids, charging of local energy storage devices is coordinated on a residential level to compensate the volatile aggregated power demand on the time interval of interest. However, this results in a perpetual usage of all batteries which reduces their lifetime. We enforce group sparsity by using an $\ell_{p,q}$-regularization on the control to counteract this phenomenon. This leads…
▽ More
In modern smart grids, charging of local energy storage devices is coordinated on a residential level to compensate the volatile aggregated power demand on the time interval of interest. However, this results in a perpetual usage of all batteries which reduces their lifetime. We enforce group sparsity by using an $\ell_{p,q}$-regularization on the control to counteract this phenomenon. This leads to a non-smooth convex optimization problem, for which we propose a tailored Alternating Direction Method of Multipliers algorithm. We elaborate further how to embed it in a Model Predictive Control framework. We show that the proposed scheme yields sparse control while achieving reasonable overall peak shaving by numerical simulations.
△ Less
Submitted 9 February, 2020;
originally announced February 2020.
-
Ensuring Stability in Networked Systems with Nonlinear MPC for Continuous Time Systems
Authors:
Lars Grüne,
Jürgen Pannek,
Karl Worthmann
Abstract:
For networked systems, the control law is typically subject to network flaws such as delays and packet dropouts. Hence, the time in between updates of the control law varies unexpectedly. Here, we present a stability theorem for nonlinear model predictive control with varying control horizon in a continuous time setting without stabilizing terminal constraints or costs. It turns out that stability…
▽ More
For networked systems, the control law is typically subject to network flaws such as delays and packet dropouts. Hence, the time in between updates of the control law varies unexpectedly. Here, we present a stability theorem for nonlinear model predictive control with varying control horizon in a continuous time setting without stabilizing terminal constraints or costs. It turns out that stability can be concluded under the same conditions as for a (short) fixed control horizon.
△ Less
Submitted 29 August, 2012; v1 submitted 30 March, 2012;
originally announced March 2012.
-
Reducing the Prediction Horizon in NMPC: An Algorithm Based Approach
Authors:
Jürgen Pannek,
Karl Worthmann
Abstract:
In order to guarantee stability, known results for MPC without additional terminal costs or endpoint constraints often require rather large prediction horizons. Still, stable behavior of closed loop solutions can often be observed even for shorter horizons. Here, we make use of the recent observation that stability can be guaranteed for smaller prediction horizons via Lyapunov arguments if more th…
▽ More
In order to guarantee stability, known results for MPC without additional terminal costs or endpoint constraints often require rather large prediction horizons. Still, stable behavior of closed loop solutions can often be observed even for shorter horizons. Here, we make use of the recent observation that stability can be guaranteed for smaller prediction horizons via Lyapunov arguments if more than only the first control is implemented. Since such a procedure may be harmful in terms of robustness, we derive conditions which allow to increase the rate at which state measurements are used for feedback while maintaining stability and desired performance specifications. Our main contribution consists in developing two algorithms based on the deduced conditions and a corresponding stability theorem which ensures asymptotic stability for the MPC closed loop for significantly shorter prediction horizons.
△ Less
Submitted 16 May, 2011;
originally announced May 2011.
