-
Extended mean field control: a global numerical solution via finite-dimensional approximation
Authors:
Athena Picarelli,
Marco Scaratti,
Jonathan Tam
Abstract:
We present a finite-dimensional numerical approximation for a class of extended mean field control problems. Our algorithm learns the value function on the whole Wasserstein domain, as opposed to a fixed initial condition. We leverage the approximation of the mean field problem by a finite-player cooperative optimisation problem, due to the propagation of chaos, together with the usage of finite-d…
▽ More
We present a finite-dimensional numerical approximation for a class of extended mean field control problems. Our algorithm learns the value function on the whole Wasserstein domain, as opposed to a fixed initial condition. We leverage the approximation of the mean field problem by a finite-player cooperative optimisation problem, due to the propagation of chaos, together with the usage of finite-dimensional solvers. This avoids the need to directly approximate functions on an infinite-dimensional domain, and allows for more efficient memory usage and faster computation.
△ Less
Submitted 26 June, 2025; v1 submitted 26 March, 2025;
originally announced March 2025.
-
Mean-field games of speedy information access with observation costs
Authors:
Dirk Becherer,
Christoph Reisinger,
Jonathan Tam
Abstract:
We investigate mean-field games (MFG) in which agents can actively control their speed of access to information. Specifically, the agents can dynamically decide to obtain observations with reduced delay by accepting higher observation costs. Agents seek to exploit their active information acquisition by making further decisions to influence their state dynamics so as to maximise rewards. In a mean…
▽ More
We investigate mean-field games (MFG) in which agents can actively control their speed of access to information. Specifically, the agents can dynamically decide to obtain observations with reduced delay by accepting higher observation costs. Agents seek to exploit their active information acquisition by making further decisions to influence their state dynamics so as to maximise rewards. In a mean-field equilibrium, each generic agent solves individually a partially observed Markov decision problem in which the way partial observations are obtained is itself subject to dynamic control actions, while no agent can improve unilaterally given the actions of all others. We formulate the mean-field game with controlled costly information access as an equivalent standard mean-field game on an augmented space, by utilizing a parameterisation of the belief state by a finite number of variables. With sufficient entropy regularisation, a fixed point iteration converges to the unique MFG equilibrium. Moreover, we derive an approximate $\varepsilon$-Nash equilibrium for a large but finite population size and small regularisation parameter. We illustrate our (extended) MFG of information access and of controls by an example from epidemiology, where medical testing results can be procured at different speeds and costs.
△ Less
Submitted 1 June, 2025; v1 submitted 14 September, 2023;
originally announced September 2023.
-
Markov decision processes with observation costs: framework and computation with a penalty scheme
Authors:
Christoph Reisinger,
Jonathan Tam
Abstract:
We consider Markov decision processes where the state of the chain is only given at chosen observation times and of a cost. Optimal strategies involve the optimisation of observation times as well as the subsequent action values. We consider the finite horizon and discounted infinite horizon problems, as well as an extension with parameter uncertainty. By including the time elapsed from observatio…
▽ More
We consider Markov decision processes where the state of the chain is only given at chosen observation times and of a cost. Optimal strategies involve the optimisation of observation times as well as the subsequent action values. We consider the finite horizon and discounted infinite horizon problems, as well as an extension with parameter uncertainty. By including the time elapsed from observations as part of the augmented Markov system, the value function satisfies a system of quasi-variational inequalities (QVIs). Such a class of QVIs can be seen as an extension to the interconnected obstacle problem. We prove a comparison principle for this class of QVIs, which implies uniqueness of solutions to our proposed problem. Penalty methods are then utilised to obtain arbitrarily accurate solutions. Finally, we perform numerical experiments on three applications which illustrate our framework.
△ Less
Submitted 5 December, 2023; v1 submitted 19 January, 2022;
originally announced January 2022.
-
Ecosystem Viable Yields
Authors:
Michel De Lara,
Eladio Ocana Anaya,
Ricardo Oliveros--Ramos,
Jorge Tam
Abstract:
The World Summit on Sustainable Development (Johannesburg, 2002) encouraged the application of the ecosystem approach by 2010. However, at the same Summit, the signatory States undertook to restore and exploit their stocks at maximum sustainable yield (MSY), a concept and practice without ecosystemic dimension, since MSY is computed species by species, on the basis of a monospecific model. Acknowl…
▽ More
The World Summit on Sustainable Development (Johannesburg, 2002) encouraged the application of the ecosystem approach by 2010. However, at the same Summit, the signatory States undertook to restore and exploit their stocks at maximum sustainable yield (MSY), a concept and practice without ecosystemic dimension, since MSY is computed species by species, on the basis of a monospecific model. Acknowledging this gap, we propose a definition of "ecosystem viable yields" (EVY) as yields compatible i) with guaranteed biological safety levels for all time and ii) with an ecosystem dynamics. To the difference of MSY, this notion is not based on equilibrium, but on viability theory, which offers advantages for robustness. For a generic class of multispecies models with harvesting, we provide explicit expressions for the EVY. We apply our approach to the anchovy--hake couple in the Peruvian upwelling ecosystem.
△ Less
Submitted 30 November, 2011; v1 submitted 21 April, 2011;
originally announced April 2011.
-
Viability Kernel for Ecosystem Management Models
Authors:
Eladio Ocana Anaya,
Michel De Lara,
Ricardo Oliveros--Ramos,
Jorge Tam
Abstract:
We consider sustainable management issues formulated within the framework of control theory. The problem is one of controlling a discrete--time dynamical system (e.g. population model) in the presence of state and control constraints, representing conflicting economic and ecological issues for instance. The viability kernel is known to play a basic role for the analysis of such problems and the…
▽ More
We consider sustainable management issues formulated within the framework of control theory. The problem is one of controlling a discrete--time dynamical system (e.g. population model) in the presence of state and control constraints, representing conflicting economic and ecological issues for instance. The viability kernel is known to play a basic role for the analysis of such problems and the design of viable control feedbacks, but its computation is not an easy task in general. We study the viability of nonlinear generic ecosystem models under preservation and production constraints. Under simple conditions on the growth rates at the boundary constraints, we provide an explicit description of the viability kernel. A numerical illustration is given for the hake--anchovy couple in the Peruvian upwelling ecosystem.
△ Less
Submitted 18 June, 2009;
originally announced June 2009.
