-
Constructive approximate transport maps with normalizing flows
Authors:
Antonio Álvarez-López,
Borjan Geshkovski,
Domènec Ruiz-Balet
Abstract:
We study an approximate controllability problem for the continuity equation and its application to constructing transport maps with normalizing flows. Specifically, we construct time-dependent controls $θ=(w, a, b)$ in the vector field $x\mapsto w(a^\top x + b)_+$ to approximately transport a known base density $ρ_{\mathrm{B}}$ to a target density $ρ_*$. The approximation error is measured in rela…
▽ More
We study an approximate controllability problem for the continuity equation and its application to constructing transport maps with normalizing flows. Specifically, we construct time-dependent controls $θ=(w, a, b)$ in the vector field $x\mapsto w(a^\top x + b)_+$ to approximately transport a known base density $ρ_{\mathrm{B}}$ to a target density $ρ_*$. The approximation error is measured in relative entropy, and $θ$ are constructed piecewise constant, with bounds on the number of switches being provided. Our main result relies on an assumption on the relative tail decay of $ρ_*$ and $ρ_{\mathrm{B}}$, and provides hints on characterizing the reachable space of the continuity equation in relative entropy.
△ Less
Submitted 23 January, 2025; v1 submitted 26 December, 2024;
originally announced December 2024.
-
A Total Variation Flow Scheme for Ergodic Mean Field Games
Authors:
Dante Kalise,
Alessio Oliviero,
Domènec Ruiz-Balet
Abstract:
Motivated by recent developments in mean-field games in ecology, in this paper we introduce a connection between the best response dynamics in evolutionary game theory, the minimization of the highest income of a game, and minimizing movement schemes. The aim of this work is to develop a variational approach to compute solutions of first order ergodic mean-field games that may not possess a priori…
▽ More
Motivated by recent developments in mean-field games in ecology, in this paper we introduce a connection between the best response dynamics in evolutionary game theory, the minimization of the highest income of a game, and minimizing movement schemes. The aim of this work is to develop a variational approach to compute solutions of first order ergodic mean-field games that may not possess a priori a variational structure. The study is complemented by a discussion and successful implementation of the algorithms, and comparisons between them in a variety of cases
△ Less
Submitted 11 November, 2024;
originally announced November 2024.
-
Measure-to-measure interpolation using Transformers
Authors:
Borjan Geshkovski,
Philippe Rigollet,
Domènec Ruiz-Balet
Abstract:
Transformers are deep neural network architectures that underpin the recent successes of large language models. Unlike more classical architectures that can be viewed as point-to-point maps, a Transformer acts as a measure-to-measure map implemented as specific interacting particle system on the unit sphere: the input is the empirical measure of tokens in a prompt and its evolution is governed by…
▽ More
Transformers are deep neural network architectures that underpin the recent successes of large language models. Unlike more classical architectures that can be viewed as point-to-point maps, a Transformer acts as a measure-to-measure map implemented as specific interacting particle system on the unit sphere: the input is the empirical measure of tokens in a prompt and its evolution is governed by the continuity equation. In fact, Transformers are not limited to empirical measures and can in principle process any input measure. As the nature of data processed by Transformers is expanding rapidly, it is important to investigate their expressive power as maps from an arbitrary measure to another arbitrary measure. To that end, we provide an explicit choice of parameters that allows a single Transformer to match $N$ arbitrary input measures to $N$ arbitrary target measures, under the minimal assumption that every pair of input-target measures can be matched by some transport map.
△ Less
Submitted 7 November, 2024;
originally announced November 2024.
-
Pattern control via Diffussion interaction
Authors:
Domènec Ruiz-Balet,
Enrique Zuazua
Abstract:
We analyse a dynamic control problem for scalar reaction-diffusion equations, focusing on the emulation of pattern formation through the selection of appropriate active controls. While boundary controls alone prove inadequate for replicating the complex patterns seen in biological systems, particularly under natural point-wise constraints of the system state, their combination with the regulation…
▽ More
We analyse a dynamic control problem for scalar reaction-diffusion equations, focusing on the emulation of pattern formation through the selection of appropriate active controls. While boundary controls alone prove inadequate for replicating the complex patterns seen in biological systems, particularly under natural point-wise constraints of the system state, their combination with the regulation of the diffusion coefficient enables the successful generation of such patterns.
Our study demonstrates that the set of steady-states is path-connected, facilitating the use of the staircase method. This approach allows any admissible initial configuration to evolve into any stationary pattern over a sufficiently long time while maintaining the system's natural bilateral constraints. We provide also examples of complex patterns that steady-state configurations can adopt.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Mean-field games for harvesting problems: Uniqueness, long-time behaviour and weak KAM theory
Authors:
Ziad Kobeissi,
Idriss Mazari-Fouquer,
Domènec Ruiz-Balet
Abstract:
The goal of this paper is to study a Mean Field Game (MFG) system stemming from the harvesting of resources. Modelling the latter through a reaction-diffusion equation and the harvesters as competing rational agents, we are led to a non-local (in time and space) MFG system that consists of three equations, the study of which is quite delicate. The main focus of this paper is on the derivation of a…
▽ More
The goal of this paper is to study a Mean Field Game (MFG) system stemming from the harvesting of resources. Modelling the latter through a reaction-diffusion equation and the harvesters as competing rational agents, we are led to a non-local (in time and space) MFG system that consists of three equations, the study of which is quite delicate. The main focus of this paper is on the derivation of analytical results (e.g existence, uniqueness) and of long time behaviour (here, convergence to the ergodic system). We provide some explicit solutions to this ergodic system.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Control of neural transport for normalizing flows
Authors:
Domènec Ruiz-Balet,
Enrique Zuazua
Abstract:
Inspired by normalizing flows, we analyze the bilinear control of neural transport equations by means of time-dependent velocity fields restricted to fulfill, at any time instance, a simple neural network ansatz. The L^1 approximate controllability property is proved, showing that any probability density can be driven arbitrarily close to any other one in any time horizon. The control vector field…
▽ More
Inspired by normalizing flows, we analyze the bilinear control of neural transport equations by means of time-dependent velocity fields restricted to fulfill, at any time instance, a simple neural network ansatz. The L^1 approximate controllability property is proved, showing that any probability density can be driven arbitrarily close to any other one in any time horizon. The control vector fields are built explicitly and inductively and this provides quantitative estimates on their complexity and amplitude. This also leads to statistical error bounds when only random samples of the target probability density are available.
△ Less
Submitted 2 August, 2023; v1 submitted 15 July, 2023;
originally announced July 2023.
-
The tragedy of the commons: A Mean-Field Game approach to the reversal of travelling waves
Authors:
Ziad Kobeissi,
Idriss Mazari-Fouquer,
Domenec Ruiz-Balet
Abstract:
The goal of this paper is to investigate an instance of the tragedy of the commons in spatially distributed harvesting games. The model we choose is that of a fishes' population that is governed by a parabolic bistable equation and that fishermen harvest. We assume that, when no fisherman is present, the fishes' population is invading (mathematically, there is an invading travelling front). Is it…
▽ More
The goal of this paper is to investigate an instance of the tragedy of the commons in spatially distributed harvesting games. The model we choose is that of a fishes' population that is governed by a parabolic bistable equation and that fishermen harvest. We assume that, when no fisherman is present, the fishes' population is invading (mathematically, there is an invading travelling front). Is it possible that fishermen, when acting selfishly, each in his or her own best interest, might lead to a reversal of the travelling wave and, consequently, to an extinction of the global population? To answer this question, we model the behaviour of individual fishermen using a Mean Field Game approach, and we show that the answer is yes. We then show that, at least in some cases, if the fishermen coordinated instead of acting selfishly, each of them could make more benefit, while still guaranteeing the survival of the population. Our study is illustrated by several numerical simulations.
△ Less
Submitted 3 March, 2023; v1 submitted 2 March, 2023;
originally announced March 2023.
-
Spatial ecology, optimal control and game theoretical fishing problems
Authors:
Idriss Mazari,
Domènec Ruiz-Balet
Abstract:
Of paramount importance in both ecological systems and economic policies are the problems of harvesting of natural resources. A paradigmatic situation where this question is raised is that of fishing strategies. Indeed, overfishing is a well-known problem in the management of live-stocks, as being too greedy may lead to an overall dramatic depletion of the population we are harvesting. A closely r…
▽ More
Of paramount importance in both ecological systems and economic policies are the problems of harvesting of natural resources. A paradigmatic situation where this question is raised is that of fishing strategies. Indeed, overfishing is a well-known problem in the management of live-stocks, as being too greedy may lead to an overall dramatic depletion of the population we are harvesting. A closely related topic is that of Nash equilibria in the context of fishing policies. Namely, two players being in competition for the same pool of resources, is it possible for them to find an equilibrium situation? The goal of this paper is to provide a detailed analysis of these two queries (\emph{i.e} optimal fishing strategies for single-player models and study of Nash equilibria for multiple players games) by using a basic yet instructive mathematical model, the logistic-diffusive equation. In this framework, the underlying model simply reads $-μΔθ=θ(K(x)-α(x)-θ)$ where $K$ accounts for natural resources, $θ$ for the density of the population that is being harvested and $α=α(x)$ encodes either the single player fishing strategy or, when dealing with Nash equilibria, a combination of the fishing strategies of both players. This article consists of two main parts. The first one gives a very fine characterisation of the optimisers for the single-player game. In the case where two players are involved, we aim at finding a Nash equilibrium. We prove the existence of Nash equilibria in several different regimes \textcolor{black}{and investigate several related qualitative queries}.Our study is completed by a variety of numerical simulations that illustrate our results and allow us to formulate open questions and conjectures.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
Interpolation and approximation via Momentum ResNets and Neural ODEs
Authors:
Domènec Ruiz-Balet,
Elisa Affili,
Enrique Zuazua
Abstract:
In this article, we explore the effects of memory terms in continuous-layer Deep Residual Networks by studying Neural ODEs (NODEs). We investigate two types of models. On one side, we consider the case of Residual Neural Networks with dependence on multiple layers, more precisely Momentum ResNets. On the other side, we analyze a Neural ODE with auxiliary states playing the role of memory states. W…
▽ More
In this article, we explore the effects of memory terms in continuous-layer Deep Residual Networks by studying Neural ODEs (NODEs). We investigate two types of models. On one side, we consider the case of Residual Neural Networks with dependence on multiple layers, more precisely Momentum ResNets. On the other side, we analyze a Neural ODE with auxiliary states playing the role of memory states. We examine the interpolation and universal approximation properties for both architectures through a simultaneous control perspective. We also prove the ability of the second model to represent sophisticated maps, such as parametrizations of time-dependent functions. Numerical simulations complement our study.
△ Less
Submitted 17 October, 2021;
originally announced October 2021.
-
Neural ODE control for classification, approximation and transport
Authors:
Domènec Ruiz-Balet,
Enrique Zuazua
Abstract:
We analyze Neural Ordinary Differential Equations (NODEs) from a control theoretical perspective to address some of the main properties and paradigms of Deep Learning (DL), in particular, data classification and universal approximation. These objectives are tackled and achieved from the perspective of the simultaneous control of systems of NODEs. For instance, in the context of classification, eac…
▽ More
We analyze Neural Ordinary Differential Equations (NODEs) from a control theoretical perspective to address some of the main properties and paradigms of Deep Learning (DL), in particular, data classification and universal approximation. These objectives are tackled and achieved from the perspective of the simultaneous control of systems of NODEs. For instance, in the context of classification, each item to be classified corresponds to a different initial datum for the control problem of the NODE, to be classified, all of them by the same common control, to the location (a subdomain of the euclidean space) associated to each label. Our proofs are genuinely nonlinear and constructive, allowing us to estimate the complexity of the control strategies we develop. The nonlinear nature of the activation functions governing the dynamics of NODEs under consideration plays a key role in our proofs, since it allows deforming half of the phase space while the other half remains invariant, a property that classical models in mechanics do not fulfill. This very property allows to build elementary controls inducing specific dynamics and transformations whose concatenation, along with properly chosen hyperplanes, allows achieving our goals in finitely many steps. The nonlinearity of the dynamics is assumed to be Lipschitz. Therefore, our results apply also in the particular case of the ReLU activation function. We also present the counterparts in the context of the control of neural transport equations, establishing a link between optimal transport and deep neural networks.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.
-
Quantitative stability for eigenvalues of Schrödinger operator, Quantitative bathtub principle \& Application to the turnpike property for a bilinear optimal control problem
Authors:
Idriss Mazari,
Domenec Ruiz-Balet
Abstract:
This work is concerned with two optimisation problems that we tackle from a qualitative perspective. The first one deals with quantitative inequalities for spectral optimisation problems for Schrödinger operators in general domains, the second one deals with the turnpike property for optimal bilinear control problems. In the first part of this article, we prove, under mild technical assumptions, q…
▽ More
This work is concerned with two optimisation problems that we tackle from a qualitative perspective. The first one deals with quantitative inequalities for spectral optimisation problems for Schrödinger operators in general domains, the second one deals with the turnpike property for optimal bilinear control problems. In the first part of this article, we prove, under mild technical assumptions, quantitative inequalities for the optimisation of the first eigenvalue of $-Δ-V$ with Dirichlet boundary conditions with respect to the potential $V$, under $L^\infty$ and $L^1$ constraints. This is done using a new method of proof which relies on in a crucial way on a quantitative bathtub principle. We believe our approach susceptible of being generalised to other steady elliptic optimisation problems. In the second part of this paper, we use this inequality to tackle a turnpike problem. Namely, considering a bilinear control system of the form $u_t-Δu=\mathcal V u$, $\mathcal V=\mathcal V(t,x)$ being the control, can we give qualitative information, under $L^\infty$ and $L^1$ constraints on $\mathcal V$, on the solutions of the optimisation problem $\sup \int_Ωu(T,x)dx$? We prove that the quantitative inequality for eigenvalues implies an integral turnpike property: defining $\mathcal I^*$ as the set of optimal potentials for the eigenvalue optimisation problem and $\mathcal V_T^*$ as a solution of the bilinear optimal control problem, the quantity $\int_0^T \operatorname{dist}_{L^1}(\mathcal V_T^*(t,\cdot)\,, \mathcal I^*)^2$ is bounded uniformly in $T$.
△ Less
Submitted 21 October, 2020;
originally announced October 2020.
-
Constrained control of gene-flow models
Authors:
Idriss Mazari,
Domenec Ruiz-Balet,
Enrique Zuazua
Abstract:
In ecology and population dynamics, gene-flow refers to the transfer of a trait from one population to another. This phenomenon appears in studying the evolution of social features, such as languages. From the mathematical point of view, gene-flow is modelled using bistable reaction-diffusion equations. The unknown is the proportion $p$ of the population possessing a certain trait, within a popula…
▽ More
In ecology and population dynamics, gene-flow refers to the transfer of a trait from one population to another. This phenomenon appears in studying the evolution of social features, such as languages. From the mathematical point of view, gene-flow is modelled using bistable reaction-diffusion equations. The unknown is the proportion $p$ of the population possessing a certain trait, within a population $N$. Gene-flow is taken into account by assuming that the population density $N$ depends either on $p$ or on the location $x$. Recent applications stemming from mosquito-borne disease control problems or from the study of bilingualism have called for the investigation of the controllability properties of these models. At the mathematical level, this corresponds to boundary control problems and, since we are working with proportions, the control $u$ has to satisfy the constraints $0\leq u \leq 1$. In this article, we provide a thorough analysis of the influence of the gene-flow effect on boundary controllability properties. We prove that, when the population density $N$ only depends on the trait proportion $p$, the geometry of the domain is the only criterion that has to be considered. We then tackle the case of population densities $N$ varying in $x$. We first prove that, when $N$ varies slowly in $x$ and when the domain is narrow enough, controllability always holds. We then consider the case of sharp fluctuations in $N$: we give examples that prove that controllability may fail. Conversely, we give examples of $N$ such that controllability will always be guaranteed. All negative controllability results are proved by showing the existence of non-trivial stationary states, which act as barriers. The existence of such solutions and the methods of proof are of independent interest. Our article is completed by several numerical experiments that confirm our analysis.
△ Less
Submitted 20 October, 2021; v1 submitted 19 May, 2020;
originally announced May 2020.
-
A fragmentation phenomenon for a non-energetic optimal control problem: optimisation of the total population size in logistic diffusive models
Authors:
Idriss Mazari,
Domenec Ruiz-Balet
Abstract:
Following some recent works, we investigate the problem of optimising the total population size for logistic diffusive models with respect to resources distributions. Using the spatially heterogeneous Fisher-KPP equation, we obtain a surprising fragmentation phenomenon: depending on the scale of diffusivity (i.e the dispersal rate), it is better to either concentrate or fragment resources. Our mai…
▽ More
Following some recent works, we investigate the problem of optimising the total population size for logistic diffusive models with respect to resources distributions. Using the spatially heterogeneous Fisher-KPP equation, we obtain a surprising fragmentation phenomenon: depending on the scale of diffusivity (i.e the dispersal rate), it is better to either concentrate or fragment resources. Our main result is that, the smaller the dispersal rate of the species in the domain, the more optimal resources distributions tend to oscillate. This is in sharp contrast with other criteria in population dynamics, such as the classical problem of optimising the survival ability of a species, where concentrating resources is always favourable, regardless of the diffusivity. Our study is completed by numerous numerical simulations that confirm our results.
△ Less
Submitted 21 October, 2020; v1 submitted 18 May, 2020;
originally announced May 2020.
-
Control under constraints for multi-dimensional reaction-diffusion monostable and bistable equations
Authors:
Domènec Ruiz-Balet,
Enrique Zuazua
Abstract:
Dynamic phenomena in social and biological sciences can often be modeled by employing reaction-diffusion equations. When addressing the control of these modes, from a mathematical viewpoint one of the main challenges is that, because of the intrinsic nature of the models under consideration, the solution, typically a proportion or a density function, needs to preserve given lower and upper bounds.…
▽ More
Dynamic phenomena in social and biological sciences can often be modeled by employing reaction-diffusion equations. When addressing the control of these modes, from a mathematical viewpoint one of the main challenges is that, because of the intrinsic nature of the models under consideration, the solution, typically a proportion or a density function, needs to preserve given lower and upper bounds. Controlling the system to the desired final configuration then becomes complex, and sometimes even impossible. In the present work, we analyze the controllability to constant steady-states of spatially homogeneous semilinear heat equations, with constraints in the state, and using boundary controls, which is indeed a natural way of acting on the system in the present context. The nonlinearities considered are among the most frequent: monostable and bistable ones. We prove that controlling the system to a constant steady-state may become impossible when the diffusivity is too small (or when the domain is large), due to the existence of barrier functions. When such an obstruction does not arise, we build sophisticated control strategies combining the dissipativity of the system, the existence of traveling waves and some connectivity of the set of steady-states. This connectivity allows building paths that the controlled trajectories can follow, in a long time, with small oscillations, preserving the natural constraints of the system. This kind of strategy was successfully implemented in one-space dimension, where phase plane analysis techniques allowed to decode the nature of the set of steady-states. These techniques fail in the present multi-dimensional setting. We employ a fictitious domain technique, extending the system to a larger ball, and building paths of radially symmetric solution that can then be restricted to the original domain.
△ Less
Submitted 31 May, 2020; v1 submitted 30 December, 2019;
originally announced December 2019.
-
A parabolic approach to the control of opinion spreading
Authors:
Domènec Ruiz-Balet,
Enrique Zuazua
Abstract:
We analyze the problem of controlling to consensus a nonlinear system modeling opinion spreading. We derive explicit exponential estimates on the cost of approximately controlling these systems to consensus, as a function of the number of agents N and the control time-horizon T. Our strategy makes use of known results on the controllability of spatially discretized semilinear parabolic equations.…
▽ More
We analyze the problem of controlling to consensus a nonlinear system modeling opinion spreading. We derive explicit exponential estimates on the cost of approximately controlling these systems to consensus, as a function of the number of agents N and the control time-horizon T. Our strategy makes use of known results on the controllability of spatially discretized semilinear parabolic equations. Both systems can be linked through time-rescaling
△ Less
Submitted 19 June, 2019; v1 submitted 20 March, 2019;
originally announced March 2019.
