-
Relevance-driven Input Dropout: an Explanation-guided Regularization Technique
Authors:
Shreyas Gururaj,
Lars Grüne,
Wojciech Samek,
Sebastian Lapuschkin,
Leander Weber
Abstract:
Overfitting is a well-known issue extending even to state-of-the-art (SOTA) Machine Learning (ML) models, resulting in reduced generalization, and a significant train-test performance gap. Mitigation measures include a combination of dropout, data augmentation, weight decay, and other regularization techniques. Among the various data augmentation strategies, occlusion is a prominent technique that…
▽ More
Overfitting is a well-known issue extending even to state-of-the-art (SOTA) Machine Learning (ML) models, resulting in reduced generalization, and a significant train-test performance gap. Mitigation measures include a combination of dropout, data augmentation, weight decay, and other regularization techniques. Among the various data augmentation strategies, occlusion is a prominent technique that typically focuses on randomly masking regions of the input during training. Most of the existing literature emphasizes randomness in selecting and modifying the input features instead of regions that strongly influence model decisions. We propose Relevance-driven Input Dropout (RelDrop), a novel data augmentation method which selectively occludes the most relevant regions of the input, nudging the model to use other important features in the prediction process, thus improving model generalization through informed regularization. We further conduct qualitative and quantitative analyses to study how Relevance-driven Input Dropout (RelDrop) affects model decision-making. Through a series of experiments on benchmark datasets, we demonstrate that our approach improves robustness towards occlusion, results in models utilizing more features within the region of interest, and boosts inference time generalization performance. Our code is available at https://github.com/Shreyas-Gururaj/LRP_Relevance_Dropout.
△ Less
Submitted 27 May, 2025;
originally announced May 2025.
-
Negative feedback and oscillations in a model for mRNA translation
Authors:
Aliza Ehrman,
Thomas Kriecherbauer,
Lars Gruene,
Michael Margaliot
Abstract:
The ribosome flow model (RFM) is a phenomenological model for the unidirectional flow of particles along a 1D chain of $n$ sites. The RFM has been extensively used to study the dynamics of ribosome flow along a single mRNA molecule during translation. In this case, the particles model ribosomes and each site corresponds to a consecutive group of codons. Networks of interconnected RFMs have been us…
▽ More
The ribosome flow model (RFM) is a phenomenological model for the unidirectional flow of particles along a 1D chain of $n$ sites. The RFM has been extensively used to study the dynamics of ribosome flow along a single mRNA molecule during translation. In this case, the particles model ribosomes and each site corresponds to a consecutive group of codons. Networks of interconnected RFMs have been used to model and analyze large-scale translation in the cell and, in particular, the effects of competition for shared resources. Here, we analyze the RFM with a negative feedback connection from the protein production rate to the initiation rate. This models, for example, the production of proteins that inhibit the translation of their own mRNA. Using tools from the theory of 2-cooperative dynamical systems, we provide a simple condition guaranteeing that the closed-loop system admits at least one non-trivial periodic solution. When this condition holds, we also explicitly characterize a large set of initial conditions such that any solution emanating from this set converges to a non-trivial periodic solution. Such a solution corresponds to a periodic pattern of ribosome densities along the mRNA, and to a periodic pattern of protein production.
△ Less
Submitted 16 April, 2025;
originally announced April 2025.
-
Towards turnpike-based performance analysis of risk-averse stochastic predictive control
Authors:
Jonas Schießl,
Ruchuan Ou,
Michael H. Baumann,
Timm Faulwasser,
Lars Grüne
Abstract:
In this paper, we present performance estimates for stochastic economic MPC schemes with risk-averse cost formulations. For MPC algorithms with costs given by the expectation of stage cost evaluated in random variables, it was recently shown that the guaranteed near-optimal performance of abstract MPC in random variables coincides with its implementable variant coincide using measure path-wise fee…
▽ More
In this paper, we present performance estimates for stochastic economic MPC schemes with risk-averse cost formulations. For MPC algorithms with costs given by the expectation of stage cost evaluated in random variables, it was recently shown that the guaranteed near-optimal performance of abstract MPC in random variables coincides with its implementable variant coincide using measure path-wise feedback. In general, this property does not extend to costs formulated in terms of risk measures. However, through a turnpike-based analysis, this paper demonstrates that for a particular class of risk measures, this result can still be leveraged to formulate an implementable risk-averse MPC scheme, resulting in near-optimal averaged performance.
△ Less
Submitted 1 April, 2025;
originally announced April 2025.
-
Separable Approximations of Optimal Value Functions and Their Representation by Neural Networks
Authors:
Mario Sperl,
Luca Saluzzi,
Dante Kalise,
Lars Grüne
Abstract:
The use of separable approximations is proposed to mitigate the curse of dimensionality related to the approximation of high-dimensional value functions in optimal control. The separable approximation exploits intrinsic decaying sensitivity properties of the system, where the influence of a state variable on another diminishes as their spatial, temporal, or graph-based distance grows. This propert…
▽ More
The use of separable approximations is proposed to mitigate the curse of dimensionality related to the approximation of high-dimensional value functions in optimal control. The separable approximation exploits intrinsic decaying sensitivity properties of the system, where the influence of a state variable on another diminishes as their spatial, temporal, or graph-based distance grows. This property allows the efficient representation of global functions as a sum of localized contributions. A theoretical framework for constructing separable approximations in the context of optimal control is proposed by leveraging decaying sensitivity in both discrete and continuous time. Results extend prior work on decay properties of solutions to Lyapunov and Riccati equations, offering new insights into polynomial and exponential decay regimes. Connections to neural networks are explored, demonstrating how separable structures enable scalable representations of high-dimensional value functions while preserving computational efficiency.
△ Less
Submitted 12 February, 2025;
originally announced February 2025.
-
Performance guarantees for optimization-based state estimation using turnpike properties
Authors:
Julian D. Schiller,
Lars Grüne,
and Matthias A. Müller
Abstract:
In this paper, we develop novel accuracy and performance guarantees for optimal state estimation of general nonlinear systems (in particular, moving horizon estimation, MHE). Our results rely on a turnpike property of the optimal state estimation problem, which essentially states that the omniscient infinite-horizon solution involving all past and future data serves as turnpike for the solutions o…
▽ More
In this paper, we develop novel accuracy and performance guarantees for optimal state estimation of general nonlinear systems (in particular, moving horizon estimation, MHE). Our results rely on a turnpike property of the optimal state estimation problem, which essentially states that the omniscient infinite-horizon solution involving all past and future data serves as turnpike for the solutions of finite-horizon estimation problems involving a subset of the data. This leads to the surprising observation that MHE problems naturally exhibit a leaving arc, which may have a strong negative impact on the estimation accuracy. To address this, we propose a delayed MHE scheme, and we show that the resulting performance (both averaged and non-averaged) is approximately optimal and achieves bounded dynamic regret with respect to the infinite-horizon solution, with error terms that can be made arbitrarily small by an appropriate choice of the delay. In various simulation examples, we observe that already a very small delay in the MHE scheme is sufficient to significantly improve the overall estimation error by 20-25 % compared to standard MHE (without delay). This finding is of great importance for practical applications (especially for monitoring, fault detection, and parameter estimation) where a small delay in the estimation is rather irrelevant but may significantly improve the estimation results.
△ Less
Submitted 30 January, 2025;
originally announced January 2025.
-
Random attraction in TASEP with time-varying hopping rates
Authors:
Lars Grüne,
Kilian Pioch,
Thomas Kriecherbauer,
Michael Margaliot
Abstract:
The totally asymmetric simple exclusion principle (TASEP) is a fundamental model in nonequilibrium statistical mechanics. It describes the stochastic unidirectional movement of particles along a 1D chain of ordered sites. We consider the continuous-time version of TASEP with a finite number of sites and with time-varying hopping rates between the sites. We show how to formulate this model as a non…
▽ More
The totally asymmetric simple exclusion principle (TASEP) is a fundamental model in nonequilibrium statistical mechanics. It describes the stochastic unidirectional movement of particles along a 1D chain of ordered sites. We consider the continuous-time version of TASEP with a finite number of sites and with time-varying hopping rates between the sites. We show how to formulate this model as a nonautonomous random dynamical system (NRDS) with a finite state-space. We provide conditions guaranteeing that random pullback and forward attractors of such an NRDS exist and consist of singletons. In the context of the nonautonomous TASEP these conditions imply almost sure synchronization of the individual random paths. This implies in particular that perturbations that change the state of the particles along the chain are "filtered out" in the long run. We demonstrate that the required conditions are tight by providing examples where these conditions do not hold and consequently the forward attractor does not exist or the pullback attractor is not a singleton. The results in this paper generalize our earlier results for autonomous TASEP in https://doi.org/10.1137/20M131446X and contain these as a special case.
△ Less
Submitted 28 January, 2025;
originally announced January 2025.
-
Stabilization of Strictly Pre-Dissipative Receding Horizon Linear Quadratic Control by Terminal Costs
Authors:
Mario Zanon,
Lars Grüne
Abstract:
Asymptotic stability in receding horizon control is obtained under a strict pre-dissipativity assumption, in the presence of suitable state constraints. In this paper we analyze how terminal constraints can be replaced by suitable terminal costs. We restrict to the linear-quadratic setting as that allows us to obtain stronger results, while we analyze the full nonlinear case in a separate contribu…
▽ More
Asymptotic stability in receding horizon control is obtained under a strict pre-dissipativity assumption, in the presence of suitable state constraints. In this paper we analyze how terminal constraints can be replaced by suitable terminal costs. We restrict to the linear-quadratic setting as that allows us to obtain stronger results, while we analyze the full nonlinear case in a separate contribution.
△ Less
Submitted 7 January, 2025;
originally announced January 2025.
-
Stabilization of strictly pre-dissipative nonlinear receding horizon control by terminal costs
Authors:
Lars Grüne,
Mario Zanon
Abstract:
It is known that receding horizon control with a strictly pre-dissipative optimal control problem yields a practically asymptotically stable closed loop when suitable state constraints are imposed. In this note we show that alternatively suitably bounded terminal costs can be used for stabilizing the closed loop.
It is known that receding horizon control with a strictly pre-dissipative optimal control problem yields a practically asymptotically stable closed loop when suitable state constraints are imposed. In this note we show that alternatively suitably bounded terminal costs can be used for stabilizing the closed loop.
△ Less
Submitted 9 January, 2025; v1 submitted 18 December, 2024;
originally announced December 2024.
-
Optimal state estimation: Turnpike analysis and performance results
Authors:
Julian D. Schiller,
Lars Grüne,
Matthias A. Müller
Abstract:
In this paper, we introduce turnpike arguments in the context of optimal state estimation. In particular, we show that the optimal solution of the state estimation problem involving all available past data serves as turnpike for the solutions of truncated problems involving only a subset of the data. We consider two different mathematical characterizations of this phenomenon and provide correspond…
▽ More
In this paper, we introduce turnpike arguments in the context of optimal state estimation. In particular, we show that the optimal solution of the state estimation problem involving all available past data serves as turnpike for the solutions of truncated problems involving only a subset of the data. We consider two different mathematical characterizations of this phenomenon and provide corresponding sufficient conditions that rely on strict dissipativity and decaying sensitivity. As second contribution, we show how a specific turnpike property can be used to establish performance guarantees when approximating the optimal solution of the full problem by a sequence of truncated problems, and we show that the resulting performance (both averaged and non-averaged) is approximately optimal with error terms that can be made arbitrarily small by an appropriate choice of the horizon length. In addition, we discuss interesting implications of these results for the practically relevant case of moving horizon estimation and illustrate our results with a numerical example.
△ Less
Submitted 23 September, 2024;
originally announced September 2024.
-
Near-optimal performance of stochastic economic MPC
Authors:
Jonas Schießl,
Ruchuan Ou,
Timm Faulwasser,
Michael H. Baumann,
Lars Grüne
Abstract:
This paper presents first results for near optimality in expectation of the closed-loop solutions for stochastic economic MPC. The approach relies on a recently developed turnpike property for stochastic optimal control problems at an optimal stationary process, combined with techniques for analyzing time-varying economic MPC schemes. We obtain near optimality in finite time as well as overtaking…
▽ More
This paper presents first results for near optimality in expectation of the closed-loop solutions for stochastic economic MPC. The approach relies on a recently developed turnpike property for stochastic optimal control problems at an optimal stationary process, combined with techniques for analyzing time-varying economic MPC schemes. We obtain near optimality in finite time as well as overtaking and average near optimality on infinite time horizons.
△ Less
Submitted 21 August, 2024; v1 submitted 22 March, 2024;
originally announced March 2024.
-
Model order reduction for the TASEP Master equation
Authors:
Kilian Pioch,
Thomas Kriecherbauer,
Michael Margaliot,
Lars Grüne
Abstract:
The totally asymmetric simple exclusion process (TASEP) is a stochastic model for the unidirectional dynamics of interacting particles on a $1$D-lattice that is much used in systems biology and statistical physics. Its master equation describes the evolution of the probability distribution on the state space. The size of the master equation grows exponentially with the length of the lattice. It is…
▽ More
The totally asymmetric simple exclusion process (TASEP) is a stochastic model for the unidirectional dynamics of interacting particles on a $1$D-lattice that is much used in systems biology and statistical physics. Its master equation describes the evolution of the probability distribution on the state space. The size of the master equation grows exponentially with the length of the lattice. It is known that the complexity of the system may be reduced using mean field approximations. We provide a rigorous derivation and a stochastic interpretation of these approximations and present numerical results on their accuracy for a number of relevant cases.
△ Less
Submitted 31 July, 2024; v1 submitted 12 February, 2024;
originally announced February 2024.
-
A Polynomial Chaos Approach to Stochastic LQ Optimal Control: Error Bounds and Infinite-Horizon Results
Authors:
Ruchuan Ou,
Jonas Schießl,
Michael Heinrich Baumann,
Lars Grüne,
Timm Faulwasser
Abstract:
The stochastic linear--quadratic regulator problem subject to Gaussian disturbances is well known and usually addressed via a moment-based reformulation. Here, we leverage polynomial chaos expansions, which model random variables via series expansions in a suitable $\mathcal{L}^2$ probability space, to tackle the non-Gaussian case. We present the optimal solutions for finite and infinite horizons…
▽ More
The stochastic linear--quadratic regulator problem subject to Gaussian disturbances is well known and usually addressed via a moment-based reformulation. Here, we leverage polynomial chaos expansions, which model random variables via series expansions in a suitable $\mathcal{L}^2$ probability space, to tackle the non-Gaussian case. We present the optimal solutions for finite and infinite horizons and we analyze the infinite-horizon asymptotics. We show that the limit of the optimal state-input trajectory is the unique solution to a corresponding stochastic stationary optimization problem in the sense of probability measures. Moreover, we provide a constructive error analysis for finite-dimensional polynomial chaos approximations of the optimal solutions and of the optimal stationary pair in non-Gaussian settings. A numerical example illustrates our findings.
△ Less
Submitted 13 February, 2025; v1 submitted 29 November, 2023;
originally announced November 2023.
-
On the relationship between stochastic turnpike and dissipativity notions
Authors:
Jonas Schießl,
Michael H. Baumann,
Timm Faulwasser,
Lars Grüne
Abstract:
In this paper, we introduce and study different dissipativity notions and different turnpike properties for discrete-time stochastic nonlinear optimal control problems. The proposed stochastic dissipativity notions extend the classic notion of Jan C. Willems to $L^r$ random variables and to probability measures. Our stochastic turnpike properties range from a formulation for random variables via t…
▽ More
In this paper, we introduce and study different dissipativity notions and different turnpike properties for discrete-time stochastic nonlinear optimal control problems. The proposed stochastic dissipativity notions extend the classic notion of Jan C. Willems to $L^r$ random variables and to probability measures. Our stochastic turnpike properties range from a formulation for random variables via turnpike phenomena in probability and in probability measures to the turnpike property for the moments. Moreover, we investigate how different metrics (such as Wasserstein or Lévy-Prokhorov) can be leveraged in the analysis. Our results are built upon stationarity concepts in distribution and in random variables and on the formulation of the stochastic optimal control problem as a finite-horizon Markov decision process. We investigate how the proposed dissipativity notions connect to the various stochastic turnpike properties and we work out the link between different forms of dissipativity.
△ Less
Submitted 21 August, 2024; v1 submitted 13 November, 2023;
originally announced November 2023.
-
Turnpike and dissipativity in generalized discrete-time stochastic linear-quadratic optimal control
Authors:
Jonas Schießl,
Ruchuan Ou,
Timm Faulwasser,
Michael Heinrich Baumann,
Lars Grüne
Abstract:
We investigate different turnpike phenomena of generalized discrete-time stochastic linear-quadratic optimal control problems. Our analysis is based on a novel strict dissipativity notion for such problems, in which a stationary stochastic process replaces the optimal steady state of the deterministic setting. We show that from this time-varying dissipativity notion, we can conclude turnpike behav…
▽ More
We investigate different turnpike phenomena of generalized discrete-time stochastic linear-quadratic optimal control problems. Our analysis is based on a novel strict dissipativity notion for such problems, in which a stationary stochastic process replaces the optimal steady state of the deterministic setting. We show that from this time-varying dissipativity notion, we can conclude turnpike behaviors concerning different objects like distributions, moments, or sample paths of the stochastic system and that the distributions of the stationary pair can be characterized by a stationary optimization problem. The analytical findings are illustrated by numerical simulations.
△ Less
Submitted 1 April, 2025; v1 submitted 11 September, 2023;
originally announced September 2023.
-
Data-driven MPC with stability guarantees using extended dynamic mode decomposition
Authors:
Lea Bold,
Lars Grüne,
Manuel Schaller,
Karl Worthmann
Abstract:
For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium f…
▽ More
For nonlinear (control) systems, extended dynamic mode decomposition (EDMD) is a popular method to obtain data-driven surrogate models. Its theoretical foundation is the Koopman framework, in which one propagates observable functions of the state to obtain a linear representation in an infinite-dimensional space. In this work, we prove practical asymptotic stability of a (controlled) equilibrium for EDMD-based model predictive control, in which the optimization step is conducted using the data-based surrogate model. To this end, we derive novel bounds on the estimation error that are proportional to the norm of state and control. This enables us to show that, if the underlying system is cost controllable, this stabilizablility property is preserved. We conduct numerical simulations illustrating the proven practical asymptotic stability.
△ Less
Submitted 22 July, 2024; v1 submitted 1 August, 2023;
originally announced August 2023.
-
On the gain of entrainment in a class of weakly contractive bilinear control systems with applications to the master equation and the ribosome flow model
Authors:
Rami Katz,
Thomas Kriecherbauer,
Lars Grüne,
Michael Margaliot
Abstract:
We consider a class of bilinear weakly contractive systems that entrain to periodic excitations. Entrainment is important in many natural and artificial processes. For example, in order to function properly synchronous generators must entrain to the frequency of the electrical grid, and biological organisms must entrain to the 24h solar day. A dynamical system has a positive gain of entrainment (G…
▽ More
We consider a class of bilinear weakly contractive systems that entrain to periodic excitations. Entrainment is important in many natural and artificial processes. For example, in order to function properly synchronous generators must entrain to the frequency of the electrical grid, and biological organisms must entrain to the 24h solar day. A dynamical system has a positive gain of entrainment (GOE) if entrainment also yields a larger output, on average. This property is important in many applications from the periodic operation of bioreactors to the periodic production of proteins during the cell cycle division process. We derive a closed-form formula for the GOE to first-order in the control perturbation. This is used to show that in the class of systems that we consider the GOE is always a higher-order phenomenon. We demonstrate the theoretical results using two applications: the master equation and a model from systems biology called the ribosome flow model, both with time-varying and periodic transition rates.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Dissipativity in infinite horizon optimal control and dynamic programming
Authors:
David Angeli,
Lars Grüne
Abstract:
In this paper we extend dynamic programming techniques to the study of discrete-time infinite horizon optimal control problems on compact control invariant sets with state-independent best asymptotic average cost. To this end we analyse the interplay of dissipativity and optimal control, and propose novel recursive approaches for the solution of so called shifted Bellman Equations.
In this paper we extend dynamic programming techniques to the study of discrete-time infinite horizon optimal control problems on compact control invariant sets with state-independent best asymptotic average cost. To this end we analyse the interplay of dissipativity and optimal control, and propose novel recursive approaches for the solution of so called shifted Bellman Equations.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
Separable approximations of optimal value functions under a decaying sensitivity assumption
Authors:
Mario Sperl,
Luca Saluzzi,
Lars Grüne,
Dante Kalise
Abstract:
An efficient approach for the construction of separable approximations of optimal value functions from interconnected optimal control problems is presented. The approach is based on assuming decaying sensitivities between subsystems, enabling a curse-of-dimensionality free approximation, for instance by deep neural networks.
An efficient approach for the construction of separable approximations of optimal value functions from interconnected optimal control problems is presented. The approach is based on assuming decaying sensitivities between subsystems, enabling a curse-of-dimensionality free approximation, for instance by deep neural networks.
△ Less
Submitted 15 January, 2025; v1 submitted 13 April, 2023;
originally announced April 2023.
-
Pathwise turnpike and dissipativity results for discrete-time stochastic linear-quadratic optimal control problems
Authors:
Jonas Schießl,
Ruchuan Ou,
Timm Faulwasser,
Michael Heinrich Baumann,
Lars Grüne
Abstract:
We investigate pathwise turnpike behavior of discrete-time stochastic linear-quadratic optimal control problems. Our analysis is based on a novel strict dissipativity notion for such problems, in which a stationary stochastic process replaces the optimal steady state of the deterministic setting. The analytical findings are illustrated by a numerical example.
We investigate pathwise turnpike behavior of discrete-time stochastic linear-quadratic optimal control problems. Our analysis is based on a novel strict dissipativity notion for such problems, in which a stationary stochastic process replaces the optimal steady state of the deterministic setting. The analytical findings are illustrated by a numerical example.
△ Less
Submitted 21 August, 2023; v1 submitted 28 March, 2023;
originally announced March 2023.
-
Transient Performance of MPC for Tracking
Authors:
Matthias Köhler,
Lisa Krügel,
Lars Grüne,
Matthias A. Müller,
Frank Allgöwer
Abstract:
We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any externally supplied reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and t…
▽ More
We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any externally supplied reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and to formulate generalised terminal ingredients with respect to it. In addition, its offset is penalised in the MPC optimisation problem, leading to closed-loop convergence to the best reachable reference. In this paper, we provide a transient performance bound on the closed loop using MPC for tracking. We employ mild assumptions on the offset cost and scale it with the prediction horizon. In this case, an increasing horizon in MPC for tracking recovers the infinite horizon optimal solution.
△ Less
Submitted 24 January, 2024; v1 submitted 17 March, 2023;
originally announced March 2023.
-
On the gain of entrainment in the $n$-dimensional ribosome flow model
Authors:
Ron Ofir,
Thomas Kriecherbauer,
Lars Grüne,
Michael Margaliot
Abstract:
The ribosome flow model (RFM) is a phenomenological model for the flow of particles along a 1D chain of $n$ sites. It has been extensively used to study ribosome flow along the mRNA molecule during translation. When the transition rates along the chain are time-varying and jointly $T$-periodic the RFM entrains, i.e., every trajectory of the RFM converges to a unique $T$-periodic solution that depe…
▽ More
The ribosome flow model (RFM) is a phenomenological model for the flow of particles along a 1D chain of $n$ sites. It has been extensively used to study ribosome flow along the mRNA molecule during translation. When the transition rates along the chain are time-varying and jointly $T$-periodic the RFM entrains, i.e., every trajectory of the RFM converges to a unique $T$-periodic solution that depends on the transition rates, but not on the initial condition. In general, entrainment to periodic excitations like the 24h solar day or the 50Hz frequency of the electric grid is important in numerous natural and artificial systems. An interesting question, called the gain of entrainment (GOE) in the RFM, is whether proper coordination of the periodic translation rates along the mRNA can lead to a larger average protein production rate. Analyzing the GOE in the RFM is non-trivial and partial results exist only for the RFM with dimensions $n=1,2$. We use a new approach to derive several results on the GOE in the general $n$-dimensional RFM. Perhaps surprisingly, we rigorously characterize several cases where there is no GOE, so to maximize the average production rate in these cases, the best choice is to use constant transition rates all along the chain.
△ Less
Submitted 11 January, 2023; v1 submitted 19 October, 2022;
originally announced October 2022.
-
Multiobjective strict dissipativity via a weighted sum approach
Authors:
Lars Grüne,
Lisa Krügel,
Matthias A. Müller
Abstract:
We consider nonlinear model predictive control (MPC) with multiple competing cost functions. This leads to the formulation of multiobjective optimal control problems (MO OCPs). Since the design of MPC algorithms for directly solving multiobjective problems is rather complicated, particularly if terminal conditions shall be avoided, we use an indirect approach via a weighted sum formulation for sol…
▽ More
We consider nonlinear model predictive control (MPC) with multiple competing cost functions. This leads to the formulation of multiobjective optimal control problems (MO OCPs). Since the design of MPC algorithms for directly solving multiobjective problems is rather complicated, particularly if terminal conditions shall be avoided, we use an indirect approach via a weighted sum formulation for solving these MO OCPs. This way, for each set of weights we obtain an optimal control problem with a single objective. In economic MPC it is known that strict dissipativity is the key assumption for concluding performance and stability results. We thus investigate under which conditions a convex combination of strictly dissipative stage costs is strictly dissipative again. We first give conditions for problems with linear dynamics and then move on to consider fully nonlinear optimal control problems. We derive both necessary and sufficient conditions on the individual cost functions and on the weights to conclude strict dissipativity and illustrate our findings with numerical examples.
△ Less
Submitted 22 November, 2022; v1 submitted 1 July, 2022;
originally announced July 2022.
-
Relaxed dissipativity assumptions and a simplified algorithm for multiobjective MPC
Authors:
Gabriele Eichfelder,
Lars Grüne,
Lisa Krügel,
Jonas Schießl
Abstract:
We consider nonlinear model predictive control (MPC) with multiple competing cost functions. In each step of the scheme, a multiobjective optimal control problem with a nonlinear system and terminal conditions is solved. We propose an algorithm and give performance guarantees for the resulting MPC closed loop system. Thereby, we significantly simplify the assumptions made in the literature so far…
▽ More
We consider nonlinear model predictive control (MPC) with multiple competing cost functions. In each step of the scheme, a multiobjective optimal control problem with a nonlinear system and terminal conditions is solved. We propose an algorithm and give performance guarantees for the resulting MPC closed loop system. Thereby, we significantly simplify the assumptions made in the literature so far by assuming strict dissipativity and the existence of a compatible terminal cost for one of the competing objective functions only. We give conditions which ensure asymptotic stability of the closed loop and, what is more, obtain performance estimates for all cost criteria. Numerical simulations on various instances illustrate our findings. The proposed algorithm requires the selection of an efficient solution in each iteration, thus we examine several selection rules and their impact on the results.
△ Less
Submitted 30 June, 2022; v1 submitted 17 February, 2022;
originally announced February 2022.
-
Strict dissipativity for generalized linear-quadratic problems in infinite dimensions
Authors:
Lars Grüne,
Friedrich Philipp,
Manuel Schaller
Abstract:
We analyze strict dissipativity of generalized linear quadratic optimal control problems on Hilbert spaces. Here, the term ``generalized'' refers to cost functions containing both quadratic and linear terms. We characterize strict pre-dissipativity with a quadratic storage function via coercivity of a particular Lyapunov-like quadratic form. Further, we show that under an additional algebraic assu…
▽ More
We analyze strict dissipativity of generalized linear quadratic optimal control problems on Hilbert spaces. Here, the term ``generalized'' refers to cost functions containing both quadratic and linear terms. We characterize strict pre-dissipativity with a quadratic storage function via coercivity of a particular Lyapunov-like quadratic form. Further, we show that under an additional algebraic assumption, strict pre-dissipativity can be strengthened to strict dissipativity. Last, we relate the obtained characterizations of dissipativity with exponential detectability.
△ Less
Submitted 16 February, 2022;
originally announced February 2022.
-
Stability and performance analysis of NMPC: Detectable stage costs and general terminal costs
Authors:
Johannes Köhler,
Melanie N. Zeilinger,
Lars Grüne
Abstract:
We provide a stability and performance analysis for nonlinear model predictive control (NMPC) schemes subject to input constraints. Given an exponential stabilizability and detectability condition w.r.t. the employed state cost, we provide a sufficiently long prediction horizon to ensure asymptotic stability and a desired performance bound w.r.t. the infinite-horizon optimal controller. Compared t…
▽ More
We provide a stability and performance analysis for nonlinear model predictive control (NMPC) schemes subject to input constraints. Given an exponential stabilizability and detectability condition w.r.t. the employed state cost, we provide a sufficiently long prediction horizon to ensure asymptotic stability and a desired performance bound w.r.t. the infinite-horizon optimal controller. Compared to existing results, the provided analysis is applicable to positive semi-definite (detectable) cost functions, provides tight bounds using a linear programming analysis, and allows for a seamless integration of general positive-definite terminal cost functions in the analysis. The practical applicability of the derived theoretical results are demonstrated with numerical examples.
△ Less
Submitted 5 January, 2023; v1 submitted 21 October, 2021;
originally announced October 2021.
-
Conditions for strict dissipativity of infinite-dimensional generalized linear-quadratic problems
Authors:
Lars Grüne,
David Muff,
Manuel Schaller
Abstract:
We derive sufficient conditions for strict dissipativity for optimal control of linear evolution equations on Hilbert spaces with a cost functional including linear and quadratic terms. We show that strict dissipativity with a particular storage function is equivalent to ellipticity of a Lyapunov-like operator. Further we prove under a spectral decomposition assumption of the underlying generator…
▽ More
We derive sufficient conditions for strict dissipativity for optimal control of linear evolution equations on Hilbert spaces with a cost functional including linear and quadratic terms. We show that strict dissipativity with a particular storage function is equivalent to ellipticity of a Lyapunov-like operator. Further we prove under a spectral decomposition assumption of the underlying generator and an orthogonality condition of the resulting subspaces that this ellipticity property holds under a detectability assumption. We illustrate our result by means of an example involving a heat equation on a one-dimensional domain.
△ Less
Submitted 26 July, 2021; v1 submitted 20 April, 2021;
originally announced April 2021.
-
Finite-dimensional output stabilization for a class of linear distributed parameter systems -- a small-gain approach
Authors:
Lars Grüne,
Thomas Meurer
Abstract:
A small-gain approach is proposed to analyze closed-loop stability of linear diffusion-reaction systems under finite-dimensional observer-based state feedback control. For this, the decomposition of the infinite-dimensional system into a finite-dimensional slow subsystem used for design and an infinite-dimensional residual fast subsystem is considered. The effect of observer spillover in terms of…
▽ More
A small-gain approach is proposed to analyze closed-loop stability of linear diffusion-reaction systems under finite-dimensional observer-based state feedback control. For this, the decomposition of the infinite-dimensional system into a finite-dimensional slow subsystem used for design and an infinite-dimensional residual fast subsystem is considered. The effect of observer spillover in terms of a particular (dynamic) interconnection of the subsystems is thoroughly analyzed for in-domain and boundary control as well as sensing. This leads to the application of a small-gain theorem for interconnected systems based on input-to-output stability and unbounded observability properties. Moreover, an approach is presented for the computation of the required dimension of the slow subsystem used for controller design. Simulation scenarios for both scalar and coupled linear diffusion-reaction systems are used to underline the theoretical assessment and to give insight into the resulting properties of the interconnected systems.
△ Less
Submitted 11 February, 2022; v1 submitted 13 April, 2021;
originally announced April 2021.
-
Dissipativity and optimal control
Authors:
Lars Grüne
Abstract:
The close link between dissipativity and optimal control is already apparent in Jan C. Willems' first papers on the subject. In recent years, research on this link has been revived with a particular focus on nonlinear problems and applications in model predictive control (MPC). This paper surveys these recent developments and some of Willems' and other authors' earlier results.
The close link between dissipativity and optimal control is already apparent in Jan C. Willems' first papers on the subject. In recent years, research on this link has been revived with a particular focus on nonlinear problems and applications in model predictive control (MPC). This paper surveys these recent developments and some of Willems' and other authors' earlier results.
△ Less
Submitted 31 March, 2021; v1 submitted 29 January, 2021;
originally announced January 2021.
-
Local turnpike analysis using local dissipativity for discrete time discounted optimal control
Authors:
Lars Grüne,
Lisa Krügel
Abstract:
Recent results in the literature have provided connections between the so-called turnpike property, near optimality of closed-loop solutions, and strict dissipativity. Motivated by applications in economics, optimal control problems with discounted stage cost are of great interest. In contrast to non-discounted optimal control problems, it is more likely that several asymptotically stable optimal…
▽ More
Recent results in the literature have provided connections between the so-called turnpike property, near optimality of closed-loop solutions, and strict dissipativity. Motivated by applications in economics, optimal control problems with discounted stage cost are of great interest. In contrast to non-discounted optimal control problems, it is more likely that several asymptotically stable optimal equilibria coexist. Due to the discounting and transition cost from a local to the global equilibrium, it may be more favourable staying in a local equilibrium than moving to the global - cheaper - equilibrium. In the literature, strict dissipativity was shown to provide criteria for global asymptotic stability of optimal equilibria and turnpike behavior. In this paper, we propose a local notion of discounted strict dissipativity and a local turnpike property, both depending on the discount factor. Using these concepts, we investigate the local behaviour of (near-)optimal trajectories and develop conditions on the discount factor to ensure convergence to a local asymptotically stable optimal equilibrium.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
Behavior of Totally Positive Differential Systems Near a Periodic Solution
Authors:
Chengshuai Wu,
Lars Gruene,
Thomas Kriecherbauer,
Michael Margaliot
Abstract:
A time-varying nonlinear dynamical system is called a totally positive differential system (TPDS) if its Jacobian admits a special sign pattern: it is tri-diagonal with positive entries on the super- and sub-diagonals. If the vector field of a TPDS is T-periodic then every bounded trajectory converges to a T-periodic solution. In particular, when the vector field is time-invariant every bounded tr…
▽ More
A time-varying nonlinear dynamical system is called a totally positive differential system (TPDS) if its Jacobian admits a special sign pattern: it is tri-diagonal with positive entries on the super- and sub-diagonals. If the vector field of a TPDS is T-periodic then every bounded trajectory converges to a T-periodic solution. In particular, when the vector field is time-invariant every bounded trajectory of a TPDS converges to an equlbrium. Here, we use the spectral theory of oscillatory matrices to analyze the behavior near a periodic solution of a TPDS. This yields information on the perturbation directions that lead to the fastest and slowest convergence to or divergence from the periodic solution. We demonstrate the theoretical results using a model from systems biology called the ribosome flow model.
△ Less
Submitted 15 January, 2021;
originally announced January 2021.
-
Parallelized POD-based Suboptimal Economic Model Predictive Control of a State-Constrained Boussinesq approximation
Authors:
Julian Andrej,
Lars Grüne,
Luca Mechelli,
Thomas Meurer,
Simon Pirkelmann,
Stefan Volkwein
Abstract:
Motivated by an energy efficient building application, we want to optimize a quadratic cost functional subject to the Boussinesq approximation of the Navier-Stokes equations and to bilateral state and control constraints. Since the computation of such an optimal solution is numerically costly, we design an efficient strategy to compute a sub-optimal (but applicationally acceptable) solution with s…
▽ More
Motivated by an energy efficient building application, we want to optimize a quadratic cost functional subject to the Boussinesq approximation of the Navier-Stokes equations and to bilateral state and control constraints. Since the computation of such an optimal solution is numerically costly, we design an efficient strategy to compute a sub-optimal (but applicationally acceptable) solution with significantly reduced computational effort. We employ an economic Model Predictive Control (MPC) strategy to obtain a feedback control. The MPC sub-problems are based on a linear-quadratic optimal control problem subjected to mixed control and state constraints and a convection-diffusion equation, reduced with proper orthogonal decomposition. To solve each sub-problem, we apply a primal-dual active set strategy. The method can be fully parallelized, which enables the solution of large problems with real-world parameters.
△ Less
Submitted 12 January, 2021;
originally announced January 2021.
-
Turnpike Properties in Optimal Control: An Overview of Discrete-Time and Continuous-Time Results
Authors:
Timm Faulwasser,
Lars Grüne
Abstract:
The turnpike property refers to the phenomenon that in many optimal control problems, the solutions for different initial conditions and varying horizons approach a neighborhood of a specific steady state, then stay in this neighborhood for the major part of the time horizon, until they may finally depart. While early observations of the phenomenon can be traced back to works of Ramsey and von Neu…
▽ More
The turnpike property refers to the phenomenon that in many optimal control problems, the solutions for different initial conditions and varying horizons approach a neighborhood of a specific steady state, then stay in this neighborhood for the major part of the time horizon, until they may finally depart. While early observations of the phenomenon can be traced back to works of Ramsey and von Neumann on problems in economics in 1928 and 1938, the turnpike property received continuous interest in economics since the 1960s and recent interest in systems and control. The present chapter provides an introductory overview of discrete-time and continuous-time results in finite and infinite-dimensions. We comment on dissipativity-based approaches and infinite-horizon results, which enable the exploitation of turnpike properties for the numerical solution of problems with long and infinite horizons. After drawing upon numerical examples, the chapter concludes with an outlook on time-varying, discounted, and open problems.
△ Less
Submitted 16 March, 2021; v1 submitted 27 November, 2020;
originally announced November 2020.
-
A Simulation Study on Turnpikes in Stochastic LQ Optimal Control
Authors:
Ruchuan Ou,
Michael Heinrich Baumann,
Lars Grüne,
Timm Faulwasser
Abstract:
This paper presents a simulation study on turnpike phenomena in stochastic optimal control problems. We employ the framework of Polynomial Chaos Expansions (PCE) to investigate the presence of turnpikes in stochastic LQ problems. Our findings indicate that turnpikes can be observed in the evolution of PCE coefficients as well as in the evolution of statistical moments. Moreover, the turnpike pheno…
▽ More
This paper presents a simulation study on turnpike phenomena in stochastic optimal control problems. We employ the framework of Polynomial Chaos Expansions (PCE) to investigate the presence of turnpikes in stochastic LQ problems. Our findings indicate that turnpikes can be observed in the evolution of PCE coefficients as well as in the evolution of statistical moments. Moreover, the turnpike phenomenon can be observed for optimal realization trajectories and with respect to the optimal stationary distribution. Finally, while adding variance penalization to the objective alters the turnpike, it does not destroy the phenomenon.
△ Less
Submitted 23 October, 2020;
originally announced October 2020.
-
Abstract nonlinear sensitivity and turnpike analysis and an application to semilinear parabolic PDEs
Authors:
Lars Grüne,
Manuel Schaller,
Anton Schiela
Abstract:
We analyze the sensitivity of the extremal equations that arise from the first order necessary optimality conditions of nonlinear optimal control problems with respect to perturbations of the dynamics and of the initial data. To this end, we present an abstract implicit function approach with scaled spaces. We will apply this abstract approach to problems governed by semilinear PDEs. In that conte…
▽ More
We analyze the sensitivity of the extremal equations that arise from the first order necessary optimality conditions of nonlinear optimal control problems with respect to perturbations of the dynamics and of the initial data. To this end, we present an abstract implicit function approach with scaled spaces. We will apply this abstract approach to problems governed by semilinear PDEs. In that context, we prove an exponential turnpike result and show that perturbations of the extremal equation's dynamics, e.g., discretization errors decay exponentially in time. The latter can be used for very efficient discretization schemes in a Model Predictive Controller, where only a part of the solution needs to be computed accurately. We showcase the theoretical results by means of two examples with a nonlinear heat equation on a two-dimensional domain.
△ Less
Submitted 1 March, 2022; v1 submitted 29 August, 2020;
originally announced August 2020.
-
Efficient Model Predictive Control for Parabolic PDEs with Goal Oriented Error Estimation
Authors:
Lars Grüne,
Manuel Schaller,
Anton Schiela
Abstract:
We show how a posteriori goal oriented error estimation can be used to efficiently solve the subproblems occurring in a Model Predictive Control (MPC) algorithm. In MPC, only an initial part of a computed solution is implemented as a feedback, which motivates grid refinement particularly tailored to this context. To this end, we present a truncated cost functional as objective for goal oriented ad…
▽ More
We show how a posteriori goal oriented error estimation can be used to efficiently solve the subproblems occurring in a Model Predictive Control (MPC) algorithm. In MPC, only an initial part of a computed solution is implemented as a feedback, which motivates grid refinement particularly tailored to this context. To this end, we present a truncated cost functional as objective for goal oriented adaptivity and prove under stabilizability assumptions that error indicators decay exponentially outside the support of this quantity. This leads to very efficient time and space discretizations for MPC, which we will illustrate by means of various numerical examples.
△ Less
Submitted 1 March, 2022; v1 submitted 28 July, 2020;
originally announced July 2020.
-
The interval turnpike property for adjoints
Authors:
Timm Faulwasser,
Lars Grüne,
Jukka-Pekka Humaloja,
Manuel Schaller
Abstract:
In this work we derive an interval turnpike result for adjoints of finite- and infinite-dimensional nonlinear optimal control problems under the assumption of an interval turnpike on states and controls. We consider stabilizable dynamics governed by a generator of a semigroup with finite-dimensional unstable part satisfying a spectral decomposition condition and show the desired turnpike property…
▽ More
In this work we derive an interval turnpike result for adjoints of finite- and infinite-dimensional nonlinear optimal control problems under the assumption of an interval turnpike on states and controls. We consider stabilizable dynamics governed by a generator of a semigroup with finite-dimensional unstable part satisfying a spectral decomposition condition and show the desired turnpike property under continuity assumptions on the first-order optimality conditions. We further give stronger estimates for analytic semigroups and provide a numerical example with a boundary controlled semilinear heat equation to illustrate the results.
△ Less
Submitted 25 May, 2020;
originally announced May 2020.
-
Computing Lyapunov functions using deep neural networks
Authors:
Lars Grüne
Abstract:
We propose a deep neural network architecture and a training algorithm for computing approximate Lyapunov functions of systems of nonlinear ordinary differential equations. Under the assumption that the system admits a compositional Lyapunov function, we prove that the number of neurons needed for an approximation of a Lyapunov function with fixed accuracy grows only polynomially in the state dime…
▽ More
We propose a deep neural network architecture and a training algorithm for computing approximate Lyapunov functions of systems of nonlinear ordinary differential equations. Under the assumption that the system admits a compositional Lyapunov function, we prove that the number of neurons needed for an approximation of a Lyapunov function with fixed accuracy grows only polynomially in the state dimension, i.e., the proposed approach is able to overcome the curse of dimensionality. We show that nonlinear systems satisfying a small-gain condition admit compositional Lyapunov functions. Numerical examples in up to ten space dimensions illustrate the performance of the training scheme.
△ Less
Submitted 30 November, 2020; v1 submitted 18 May, 2020;
originally announced May 2020.
-
An Optimal Control Model of Mouse Pointing Using the LQR
Authors:
Florian Fischer,
Arthur Fleig,
Markus Klar,
Lars Gruene,
Joerg Mueller
Abstract:
In this paper we explore the Linear-Quadratic Regulator (LQR) to model movement of the mouse pointer. We propose a model in which users are assumed to behave optimally with respect to a certain cost function. Users try to minimize the distance of the mouse pointer to the target smoothly and with minimal effort, by simultaneously minimizing the jerk of the movement. We identify parameters of our mo…
▽ More
In this paper we explore the Linear-Quadratic Regulator (LQR) to model movement of the mouse pointer. We propose a model in which users are assumed to behave optimally with respect to a certain cost function. Users try to minimize the distance of the mouse pointer to the target smoothly and with minimal effort, by simultaneously minimizing the jerk of the movement. We identify parameters of our model from a dataset of reciprocal pointing with the mouse. We compare our model to the classical minimum-jerk and second-order lag models on data from 12 users with a total of 7702 movements. Our results show that our approach explains the data significantly better than either of these previous models.
△ Less
Submitted 26 February, 2020;
originally announced February 2020.
-
Overcoming the curse of dimensionality for approximating Lyapunov functions with deep neural networks under a small-gain condition
Authors:
Lars Grüne
Abstract:
We propose a deep neural network architecture for storing approximate Lyapunov functions of systems of ordinary differential equations. Under a small-gain condition on the system, the number of neurons needed for an approximation of a Lyapunov function with fixed accuracy grows only polynomially in the state dimension, i.e., the proposed approach is able to overcome the curse of dimensionality.
We propose a deep neural network architecture for storing approximate Lyapunov functions of systems of ordinary differential equations. Under a small-gain condition on the system, the number of neurons needed for an approximation of a Lyapunov function with fixed accuracy grows only polynomially in the state dimension, i.e., the proposed approach is able to overcome the curse of dimensionality.
△ Less
Submitted 19 May, 2020; v1 submitted 23 January, 2020;
originally announced January 2020.
-
Random attraction in the TASEP model
Authors:
Lars Grüne,
Thomas Kriecherbauer,
Michael Margaliot
Abstract:
The totally asymmetric simple exclusion process (TASEP) is a basic model of statistical mechanics that has found numerous applications. We consider the case of TASEP with a finite chain where particles may enter from the left and leave to the right at prescribed rates.
This model can be formulated as a Markov process with a finite number of states. Due to the irreducibility of the process it is…
▽ More
The totally asymmetric simple exclusion process (TASEP) is a basic model of statistical mechanics that has found numerous applications. We consider the case of TASEP with a finite chain where particles may enter from the left and leave to the right at prescribed rates.
This model can be formulated as a Markov process with a finite number of states. Due to the irreducibility of the process it is well-known that the probability distribution on the states is globally attracted to a unique equilibrium distribution.
We extend this result to the more detailed level of individual trajectories. To do so we formulate TASEP as a random dynamical system. Our main result is that the trajectories from all possible initial conditions contract to each other yielding the existence of a random attractor that consists of a single trajectory almost surely. This implies that in the long run TASEP ``filters out'' any perturbation that changes the state of the particles along the chain.
In order to prove our main result we first establish that any random dynamical system on a finite state space possesses both a global random pullback attractor and a global random forward attractor. This observation appears to be missing in the literature. We then provide sufficient and necessary conditions for these attractors to be singletons. Finally, we show that TASEP satisfies one of these conditions.
△ Less
Submitted 21 June, 2020; v1 submitted 21 January, 2020;
originally announced January 2020.
-
Control of discrete-time nonlinear systems via finite-step control Lyapunov functions
Authors:
Navid Noroozi,
Roman Geiselhart,
Lars Grüne,
Fabian R. Wirth
Abstract:
In this work, we establish different control design approaches for discrete-time systems, which build upon the notion of finite-step control Lyapunov functions (fs-CLFs). The design approaches are formulated as optimization problems and solved in a model predictive control (MPC) fashion. In particular, we establish contractive multi-step MPC with and without reoptimization and compare it to classi…
▽ More
In this work, we establish different control design approaches for discrete-time systems, which build upon the notion of finite-step control Lyapunov functions (fs-CLFs). The design approaches are formulated as optimization problems and solved in a model predictive control (MPC) fashion. In particular, we establish contractive multi-step MPC with and without reoptimization and compare it to classic MPC. The idea behind these approaches is to use the fs-CLF as running cost. These new design approaches are particularly relevant in situations where information exchange between plant and controller cannot be ensured at all time instants. An example shows the different behavior of the proposed controller design approaches.
△ Less
Submitted 26 August, 2019;
originally announced August 2019.
-
Model Predictive Control, Cost Controllability, and Homogeneity *
Authors:
Jean-Michel Coron,
Lars Grüne,
Karl Worthmann
Abstract:
We are concerned with the design of Model Predictive Control (MPC) schemes such that asymptotic stability of the resulting closed loop is guaranteed even if the linearization at the desired set point fails to be stabilizable. Therefore, we propose to construct the stage cost based on the homogeneous approximation and rigorously show that applying MPC yields an asymp-totically stable closed-loop be…
▽ More
We are concerned with the design of Model Predictive Control (MPC) schemes such that asymptotic stability of the resulting closed loop is guaranteed even if the linearization at the desired set point fails to be stabilizable. Therefore, we propose to construct the stage cost based on the homogeneous approximation and rigorously show that applying MPC yields an asymp-totically stable closed-loop behavior if the homogeneous approximation is asymptotically null controllable. To this end, we verify cost controllability-a condition relating the current state, the stage cost, and the growth of the value function w.r.t. time-for this class of systems in order to provide stability and performance guarantees for the proposed MPC scheme without stabilizing terminal costs or constraints.
△ Less
Submitted 11 December, 2019; v1 submitted 12 June, 2019;
originally announced June 2019.
-
Synthesis of control Lyapunov functions and stabilizing feedback strategies using exit-time optimal control
Authors:
Ivan Yegorov,
Peter M. Dower,
Lars Grüne
Abstract:
This paper studies the problem of constructing control Lyapunov functions (CLFs) and feedback stabilization strategies for deterministic nonlinear control systems described by ordinary differential equations. Many numerical methods for solving the Hamilton-Jacobi-Bellman partial differential equations specifying CLFs typically require dense state space discretizations and consequently suffer from…
▽ More
This paper studies the problem of constructing control Lyapunov functions (CLFs) and feedback stabilization strategies for deterministic nonlinear control systems described by ordinary differential equations. Many numerical methods for solving the Hamilton-Jacobi-Bellman partial differential equations specifying CLFs typically require dense state space discretizations and consequently suffer from the curse of dimensionality. A relevant direction of attenuating the curse of dimensionality concerns reducing the computation of the values of CLFs and associated feedbacks at any selected states to finite-dimensional nonlinear programming problems. In this work, exit-time optimal control is used for that purpose. First, we state an exit-time optimal control problem with respect to a sublevel set of an appropriate local CLF and establish that, under a number of reasonable conditions, the concatenation of the corresponding value function and the local CLF is a global CLF in the whole domain of asymptotic null-controllability. This leads to a curse-of-dimensionality-free approach to feedback stabilization. We also investigate the formulated optimal control problem. A modification of these constructions for the case when one does not find a suitable local CLF is provided as well. Supporting numerical simulation results that illustrate our development are subsequently presented and discussed. Furthermore, it is pointed out that the curse of complexity may cause significant issues in practical implementation even if the curse of dimensionality is mitigated.
△ Less
Submitted 6 June, 2019;
originally announced June 2019.
-
A linear programming approach to approximating the infinite time reachable set of strictly stable linear control systems
Authors:
Andreas Ernst,
Lars Grüne,
Janosch Rieger
Abstract:
We develop a new numerical method for approximating the infinite time reachable set of strictly stable linear control systems. By solving a linear program with a constraint that incorporates the system dynamics, we compute a polytope with fixed facet normals as an outer approximation of the limit set. In particular, this approach does not rely on forward iteration of finite-time reachable sets.
We develop a new numerical method for approximating the infinite time reachable set of strictly stable linear control systems. By solving a linear program with a constraint that incorporates the system dynamics, we compute a polytope with fixed facet normals as an outer approximation of the limit set. In particular, this approach does not rely on forward iteration of finite-time reachable sets.
△ Less
Submitted 1 April, 2019; v1 submitted 14 February, 2019;
originally announced February 2019.
-
Feedback, Dynamics, and Optimal Control in Climate Economics
Authors:
Christopher M. Kellett,
Steven R. Weller,
Timm Faulwasser,
Lars Grüne,
Willi Semmler
Abstract:
For his work in the economics of climate change, Professor William Nordhaus was a co-recipient of the 2018 Nobel Memorial Prize for Economic Sciences. A core component of the work undertaken by Nordhaus is the Dynamic Integrated model of Climate and Economy, known as the DICE model. The DICE model is a discrete-time model with two control inputs and is primarily used in conjunction with a particul…
▽ More
For his work in the economics of climate change, Professor William Nordhaus was a co-recipient of the 2018 Nobel Memorial Prize for Economic Sciences. A core component of the work undertaken by Nordhaus is the Dynamic Integrated model of Climate and Economy, known as the DICE model. The DICE model is a discrete-time model with two control inputs and is primarily used in conjunction with a particular optimal control problem in order to estimate optimal pathways for reducing greenhouse gas emissions. In this paper, we provide a tutorial introduction to the DICE model and we indicate challenges and open problems of potential interest for the systems and control community.
△ Less
Submitted 19 March, 2019; v1 submitted 19 December, 2018;
originally announced December 2018.
-
Entrainment in the Master Equation
Authors:
Michael Margaliot,
Lars Grüne,
Thomas Kriecherbauer
Abstract:
The master equation plays an important role in many scientific fields including physics, chemistry, systems biology, physical finance, and sociodynamics. We consider the master equation with periodic transition rates. This may represent an external periodic excitation like the 24h solar day in biological systems or periodic traffic lights in a model of vehicular traffic. Using tools from systems a…
▽ More
The master equation plays an important role in many scientific fields including physics, chemistry, systems biology, physical finance, and sociodynamics. We consider the master equation with periodic transition rates. This may represent an external periodic excitation like the 24h solar day in biological systems or periodic traffic lights in a model of vehicular traffic. Using tools from systems and control theory, we prove that under mild technical conditions every solution of the master equation converges to a periodic solution with the same period as the rates. In other words, the master equation entrains (or phase locks) to periodic excitations. We describe two applications of our theoretical results to important models from statistical mechanics and epidemiology.
△ Less
Submitted 19 October, 2017;
originally announced October 2017.
-
Non-conservative discrete-time ISS small-gain conditions for closed sets
Authors:
Navid Noroozi,
Roman Geiselhart,
Lars Grüne,
Björn S. Rüffer,
Fabian R. Wirth
Abstract:
This paper presents a unification and a generalization of the small-gain theory subsuming a wide range of existing small-gain theorems. In particular, we introduce small-gain conditions that are necessary and sufficient to ensure input-to-state stability (ISS) with respect to closed sets. Toward this end, we first develop a Lyapunov characterization of $ω$ISS via finite-step $ω$ISS Lyapunov functi…
▽ More
This paper presents a unification and a generalization of the small-gain theory subsuming a wide range of existing small-gain theorems. In particular, we introduce small-gain conditions that are necessary and sufficient to ensure input-to-state stability (ISS) with respect to closed sets. Toward this end, we first develop a Lyapunov characterization of $ω$ISS via finite-step $ω$ISS Lyapunov functions. Then, we provide the small-gain conditions to guarantee $ω$ISS of a network of systems. Finally, applications of our results to partial input-to-state stability, ISS of time-varying systems, synchronization problems, incremental stability, and distributed observers are given.
△ Less
Submitted 21 August, 2017; v1 submitted 12 December, 2016;
originally announced December 2016.
-
Ensuring Stability in Networked Systems with Nonlinear MPC for Continuous Time Systems
Authors:
Lars Grüne,
Jürgen Pannek,
Karl Worthmann
Abstract:
For networked systems, the control law is typically subject to network flaws such as delays and packet dropouts. Hence, the time in between updates of the control law varies unexpectedly. Here, we present a stability theorem for nonlinear model predictive control with varying control horizon in a continuous time setting without stabilizing terminal constraints or costs. It turns out that stability…
▽ More
For networked systems, the control law is typically subject to network flaws such as delays and packet dropouts. Hence, the time in between updates of the control law varies unexpectedly. Here, we present a stability theorem for nonlinear model predictive control with varying control horizon in a continuous time setting without stabilizing terminal constraints or costs. It turns out that stability can be concluded under the same conditions as for a (short) fixed control horizon.
△ Less
Submitted 29 August, 2012; v1 submitted 30 March, 2012;
originally announced March 2012.
-
Analysis of Unconstrained Nonlinear MPC Schemes with Time Varying Control Horizons
Authors:
Lars Grüne,
Jürgen Pannek,
Martin Seehafer,
Karl Worthmann
Abstract:
For nonlinear discrete time systems satisfying a controllability condition, we present a stability condition for model predictive control without stabilizing terminal constraints or costs. The condition is given in terms of an analytical formula which can be employed in order to determine a prediction horizon length for which asymptotic stability or a performance guarantee is ensured. Based on thi…
▽ More
For nonlinear discrete time systems satisfying a controllability condition, we present a stability condition for model predictive control without stabilizing terminal constraints or costs. The condition is given in terms of an analytical formula which can be employed in order to determine a prediction horizon length for which asymptotic stability or a performance guarantee is ensured. Based on this formula a sensitivity analysis with respect to the prediction and the possibly time varying control horizon is carried out.
△ Less
Submitted 30 March, 2012;
originally announced March 2012.
-
Optimal Camera Placement to measure Distances Conservativly Regarding Static and Dynamic Obstacles
Authors:
Maria Hänel,
Stefan Kuhn,
Dominik Henrich,
Lars Grüne,
Jürgen Pannek
Abstract:
In modern production facilities industrial robots and humans are supposed to interact sharing a common working area. In order to avoid collisions, the distances between objects need to be measured conservatively which can be done by a camera network. To estimate the acquired distance, unmodelled objects, e.g., an interacting human, need to be modelled and distinguished from premodelled objects lik…
▽ More
In modern production facilities industrial robots and humans are supposed to interact sharing a common working area. In order to avoid collisions, the distances between objects need to be measured conservatively which can be done by a camera network. To estimate the acquired distance, unmodelled objects, e.g., an interacting human, need to be modelled and distinguished from premodelled objects like workbenches or robots by image processing such as the background subtraction method.
The quality of such an approach massively depends on the settings of the camera network, that is the positions and orientations of the individual cameras. Of particular interest in this context is the minimization of the error of the distance using the objects modelled by the background subtraction method instead of the real objects. Here, we show how this minimization can be formulated as an abstract optimization problem. Moreover, we state various aspects on the implementation as well as reasons for the selection of a suitable optimization method, analyze the complexity of the proposed method and present a basic version used for extensive experiments.
△ Less
Submitted 16 May, 2011;
originally announced May 2011.
