-
Adjoint-based optimal control of jump-diffusion processes
Authors:
Jan Bartsch,
Alfio Borzi,
Gabriele Ciaramella,
Jan Reichle
Abstract:
Stochastic differential equations (SDEs) using jump-diffusion processes describe many natural phenomena at the microscopic level. Since they are commonly used to model economic and financial evolutions, the calibration and optimal control of such processes are of interest to many communities and have been the subject of extensive research. In this work, we develop an optimization method working at…
▽ More
Stochastic differential equations (SDEs) using jump-diffusion processes describe many natural phenomena at the microscopic level. Since they are commonly used to model economic and financial evolutions, the calibration and optimal control of such processes are of interest to many communities and have been the subject of extensive research. In this work, we develop an optimization method working at the microscopic level. This allows us also to reduce computational time since we can parallelize the calculations and do not encounter the so-called curse of dimensionality that occurs when lifting the problem to its macroscopic counterpart using partial differential equations (PDEs). Using a discretize-then-optimize approach, we derive an adjoint process and an optimality system in the Lagrange framework. Then, we apply Monte Carlo methods to solve all the arising equations. We validate our optimization strategy by extensive numerical experiments. We also successfully test a optimization procedure that avoids storing the information of the forward equation.
△ Less
Submitted 7 May, 2025;
originally announced May 2025.
-
Reconstructing the system coefficients for coupled harmonic oscillators
Authors:
Jan Bartsch,
Ahmed A. Barakat,
Simon Buchwald,
Gabriele Ciaramella,
Stefan Volkwein,
Eva M. Weig
Abstract:
Physical models often contain unknown functions and relations. In order to gain more insights into the nature of physical processes, these unknown functions have to be identified or reconstructed. Mathematically, we can formulate this research question within the framework of inverse problems. In this work, we consider optimization techniques to solve the inverse problem using Tikhonov regularizat…
▽ More
Physical models often contain unknown functions and relations. In order to gain more insights into the nature of physical processes, these unknown functions have to be identified or reconstructed. Mathematically, we can formulate this research question within the framework of inverse problems. In this work, we consider optimization techniques to solve the inverse problem using Tikhonov regularization and data from laboratory experiments. We propose an iterative strategy that eliminates the need for laboratory experiments. Our method is applied to identify the coupling and damping coefficients in a system of oscillators, ensuring an efficient and experiment-free approach. We present our results and compare them with those obtained from an alternative, purely experimental approach. By employing our proposed strategy, we demonstrate a significant reduction in the number of laboratory experiments required.
△ Less
Submitted 10 December, 2024;
originally announced December 2024.
-
Reconstruction of unknown monotone nonlinear operators in semilinear elliptic models using optimal inputs
Authors:
Jan Bartsch,
Simon Buchwald,
Gabriele Ciaramella,
Stefan Volkwein
Abstract:
Physical models often contain unknown functions and relations. The goal of our work is to answer the question of how one should excite or control a system under consideration in an appropriate way to be able to reconstruct an unknown nonlinear relation. To answer this question, we propose a greedy reconstruction algorithm within an offline-online strategy. We apply this strategy to a two-dimension…
▽ More
Physical models often contain unknown functions and relations. The goal of our work is to answer the question of how one should excite or control a system under consideration in an appropriate way to be able to reconstruct an unknown nonlinear relation. To answer this question, we propose a greedy reconstruction algorithm within an offline-online strategy. We apply this strategy to a two-dimensional semilinear elliptic model. Our identification is based on the application of several space-dependent excitations (also called controls). These specific controls are designed by the algorithm in order to obtain a deeper insight into the underlying physical problem and a more precise reconstruction of the unknown relation. We perform numerical simulations that demonstrate the effectiveness of our approach which is not limited to the current type of equation. Since our algorithm provides not only a way to determine unknown operators by existing data but also protocols for new experiments, it is a holistic concept to tackle the problem of improving physical models.
△ Less
Submitted 3 February, 2025; v1 submitted 20 May, 2024;
originally announced May 2024.
-
Adjoint-based calibration of nonlinear stochastic differential equations
Authors:
Jan Bartsch,
Robert Denk,
Stefan Volkwein
Abstract:
To study the nonlinear properties of complex natural phenomena, the evolution of the quantity of interest can be often represented by systems of coupled nonlinear stochastic differential equations (SDEs). These SDEs typically contain several parameters which have to be chosen carefully to match the experimental data and to validate the effectiveness of the model. In the present paper the calibrati…
▽ More
To study the nonlinear properties of complex natural phenomena, the evolution of the quantity of interest can be often represented by systems of coupled nonlinear stochastic differential equations (SDEs). These SDEs typically contain several parameters which have to be chosen carefully to match the experimental data and to validate the effectiveness of the model. In the present paper the calibration of these parameters is described by nonlinear SDE-constrained optimization problems. In the optimize-before-discretize setting a rigorous analysis is carried out to ensure the existence of optimal solutions and to derive necessary first-order optimality conditions. For the numerical solution a Monte-Carlo method is applied using parallelization strategies to compensate for the high computational time. In the numerical examples an Ornstein-Uhlenbeck and a stochastic Prandtl-Tomlinson bath model are considered.
△ Less
Submitted 21 October, 2024; v1 submitted 30 November, 2023;
originally announced November 2023.
-
On the stabilization of a kinetic model by feedback-like control fields in a Monte Carlo framework
Authors:
Jan Bartsch,
Alfio Borzi
Abstract:
The construction of feedback-like control fields for a kinetic model in phase space is investigated. The purpose of these controls is to drive an initial density of particles in the phase space to reach a desired cyclic trajectory and follow it in a stable way. For this purpose, an ensemble optimal control problem governed by the kinetic model is formulated in a way that is amenable to a Monte Car…
▽ More
The construction of feedback-like control fields for a kinetic model in phase space is investigated. The purpose of these controls is to drive an initial density of particles in the phase space to reach a desired cyclic trajectory and follow it in a stable way. For this purpose, an ensemble optimal control problem governed by the kinetic model is formulated in a way that is amenable to a Monte Carlo approach. The proposed formulation allows to define a one-shot solution procedure consisting in a backward solve of an augmented adjoint kinetic model. Results of numerical experiments demonstrate the effectiveness of the proposed control strategy.
△ Less
Submitted 12 February, 2024; v1 submitted 2 September, 2023;
originally announced September 2023.
-
Controlling a Vlasov-Poisson plasma by a Particle-In-Cell method based on a Monte Carlo framework
Authors:
Jan Bartsch,
Patrik Knopf,
Stefania Scheurer,
Jörg Weber
Abstract:
The Vlasov-Poisson system describes the time evolution of a plasma in the so-called collisionless regime. The investigation of a high-temperature plasma that is influenced by an exterior magnetic field is one of the most significant aspects of thermonuclear fusion research. In this paper, we formulate and analyze a kinetic optimal control problem for the Vlasov-Poisson system where the control is…
▽ More
The Vlasov-Poisson system describes the time evolution of a plasma in the so-called collisionless regime. The investigation of a high-temperature plasma that is influenced by an exterior magnetic field is one of the most significant aspects of thermonuclear fusion research. In this paper, we formulate and analyze a kinetic optimal control problem for the Vlasov-Poisson system where the control is represented by an external magnetic field. The main goal of such optimal control problems is to confine the plasma in a certain region in phase space. We first investigate the optimal control problem in terms of mathematical analysis, i.e., we show the existence of at least one global minimizer and we rigorously derive a first-order necessary optimality condition for local minimizers by the adjoint approach. Then, we build a Monte Carlo framework to solve the state equations as well as the adjoint equations by means of a Particle-In-Cell method, and we apply a nonlinear conjugate gradient method to solve the optimization problem. Eventually, we present numerical experiments that successfully validate our optimization framework.
△ Less
Submitted 3 July, 2024; v1 submitted 4 April, 2023;
originally announced April 2023.
-
A theoretical investigation of Brockett's ensemble optimal control problems
Authors:
Jan Bartsch,
Alfio Borzì,
Francesco Fanelli,
Souvik Roy
Abstract:
This paper is devoted to the analysis of problems of optimal control of ensembles governed by the Liouville (or continuity) equation. The formulation and study of these problems have been put forward in recent years by R.W. Brockett, with the motivation that ensemble control may provide a more general and robust control framework.
Following Brockett's formulation of ensemble control, a Liouville…
▽ More
This paper is devoted to the analysis of problems of optimal control of ensembles governed by the Liouville (or continuity) equation. The formulation and study of these problems have been put forward in recent years by R.W. Brockett, with the motivation that ensemble control may provide a more general and robust control framework.
Following Brockett's formulation of ensemble control, a Liouville equation with unbounded drift function, and a class of cost functionals that include tracking of ensembles and different control costs is considered. For the theoretical investigation of the resulting optimal control problems, a well-posedness theory in weighted Sobolev spaces is presented for the Liouville and transport equations. Then, a class of non-smooth optimal control problems governed by the Liouville equation is formulated and existence of optimal controls is proved. Furthermore, optimal controls are characterised as solutions to optimality systems; such a characterisation is the key to get (under suitable assumptions) also uniqueness of optimal controls.
△ Less
Submitted 26 September, 2018;
originally announced September 2018.
