-
Mimicking and Conditional Control with Hard Killing
Authors:
Rene Carmona,
Daniel Lacker
Abstract:
We first prove a mimicking theorem (also known as a Markovian projection theorem) for the marginal distributions of an Ito process conditioned to not have exited a given domain. We then apply this new result to the proof of a conjecture of P.L. Lions for the optimal control of conditioned processes.
We first prove a mimicking theorem (also known as a Markovian projection theorem) for the marginal distributions of an Ito process conditioned to not have exited a given domain. We then apply this new result to the proof of a conjecture of P.L. Lions for the optimal control of conditioned processes.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
Quantitative propagation of chaos for non-exchangeable diffusions via first-passage percolation
Authors:
Daniel Lacker,
Lane Chun Yeung,
Fuzhong Zhou
Abstract:
This paper develops a non-asymptotic approach to mean field approximations for systems of $n$ diffusive particles interacting pairwise. The interaction strengths are not identical, making the particle system non-exchangeable. The marginal law of any subset of particles is compared to a suitably chosen product measure, and we find sharp relative entropy estimates between the two. Building upon prio…
▽ More
This paper develops a non-asymptotic approach to mean field approximations for systems of $n$ diffusive particles interacting pairwise. The interaction strengths are not identical, making the particle system non-exchangeable. The marginal law of any subset of particles is compared to a suitably chosen product measure, and we find sharp relative entropy estimates between the two. Building upon prior work of the first author in the exchangeable setting, we use a generalized form of the BBGKY hierarchy to derive a hierarchy of differential inequalities for the relative entropies. Our analysis of this complicated hierarchy exploits an unexpected but crucial connection with first-passage percolation, which lets us bound the marginal entropies in terms of expectations of functionals of this percolation process.
△ Less
Submitted 13 September, 2024;
originally announced September 2024.
-
Convergence of coordinate ascent variational inference for log-concave measures via optimal transport
Authors:
Manuel Arnese,
Daniel Lacker
Abstract:
Mean field variational inference (VI) is the problem of finding the closest product (factorized) measure, in the sense of relative entropy, to a given high-dimensional probability measure $ρ$. The well known Coordinate Ascent Variational Inference (CAVI) algorithm aims to approximate this product measure by iteratively optimizing over one coordinate (factor) at a time, which can be done explicitly…
▽ More
Mean field variational inference (VI) is the problem of finding the closest product (factorized) measure, in the sense of relative entropy, to a given high-dimensional probability measure $ρ$. The well known Coordinate Ascent Variational Inference (CAVI) algorithm aims to approximate this product measure by iteratively optimizing over one coordinate (factor) at a time, which can be done explicitly. Despite its popularity, the convergence of CAVI remains poorly understood. In this paper, we prove the convergence of CAVI for log-concave densities $ρ$. If additionally $\log ρ$ has Lipschitz gradient, we find a linear rate of convergence, and if also $ρ$ is strongly log-concave, we find an exponential rate. Our analysis starts from the observation that mean field VI, while notoriously non-convex in the usual sense, is in fact displacement convex in the sense of optimal transport when $ρ$ is log-concave. This allows us to adapt techniques from the optimization literature on coordinate descent algorithms in Euclidean space.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Independent projections of diffusions: Gradient flows for variational inference and optimal mean field approximations
Authors:
Daniel Lacker
Abstract:
What is the optimal way to approximate a high-dimensional diffusion process by one in which the coordinates are independent? This paper presents a construction, called the \emph{independent projection}, which is optimal for two natural criteria. First, when the original diffusion is reversible with invariant measure $ρ_*$, the independent projection serves as the Wasserstein gradient flow for the…
▽ More
What is the optimal way to approximate a high-dimensional diffusion process by one in which the coordinates are independent? This paper presents a construction, called the \emph{independent projection}, which is optimal for two natural criteria. First, when the original diffusion is reversible with invariant measure $ρ_*$, the independent projection serves as the Wasserstein gradient flow for the relative entropy $H(\cdot\,|\,ρ_*)$ constrained to the space of product measures. This is related to recent Langevin-based sampling schemes proposed in the statistical literature on mean field variational inference. In addition, we provide both qualitative and quantitative results on the long-time convergence of the independent projection, with quantitative results in the log-concave case derived via a new variant of the logarithmic Sobolev inequality. Second, among all processes with independent coordinates, the independent projection is shown to exhibit the slowest growth rate of path-space entropy relative to the original diffusion. This sheds new light on the classical McKean-Vlasov equation and recent variants proposed for non-exchangeable systems, which can be viewed as special cases of the independent projection.
△ Less
Submitted 9 October, 2024; v1 submitted 23 September, 2023;
originally announced September 2023.
-
Projected Langevin dynamics and a gradient flow for entropic optimal transport
Authors:
Giovanni Conforti,
Daniel Lacker,
Soumik Pal
Abstract:
The classical (overdamped) Langevin dynamics provide a natural algorithm for sampling from its invariant measure, which uniquely minimizes an energy functional over the space of probability measures, and which concentrates around the minimizer(s) of the associated potential when the noise parameter is small. We introduce analogous diffusion dynamics that sample from an entropy-regularized optimal…
▽ More
The classical (overdamped) Langevin dynamics provide a natural algorithm for sampling from its invariant measure, which uniquely minimizes an energy functional over the space of probability measures, and which concentrates around the minimizer(s) of the associated potential when the noise parameter is small. We introduce analogous diffusion dynamics that sample from an entropy-regularized optimal transport, which uniquely minimizes the same energy functional but constrained to the set $Π(μ,ν)$ of couplings of two given marginal probability measures $μ$ and $ν$ on $\mathbb{R}^d$, and which concentrates around the optimal transport coupling(s) for small regularization parameter. More specifically, our process satisfies two key properties: First, the law of the solution at each time stays in $Π(μ,ν)$ if it is initialized there. Second, the long-time limit is the unique solution of an entropic optimal transport problem. In addition, we show by means of a new log-Sobolev-type inequality that the convergence holds exponentially fast, for sufficiently large regularization parameter and for a class of marginals which strictly includes all strongly log-concave measures. By studying the induced Wasserstein geometry of the submanifold $Π(μ,ν)$, we argue that the SDE can be viewed as a Wasserstein gradient flow on this space of couplings, at least when $d=1$, and we identify a conjectural gradient flow for $d \ge 2$. The main technical difficulties stems from the appearance of conditional expectation terms which serve to constrain the dynamics to $Π(μ,ν)$.
△ Less
Submitted 15 September, 2023;
originally announced September 2023.
-
Approximately optimal distributed stochastic controls beyond the mean field setting
Authors:
Joe Jackson,
Daniel Lacker
Abstract:
We study high-dimensional stochastic optimal control problems in which many agents cooperate to minimize a convex cost functional. We consider both the full-information problem, in which each agent observes the states of all other agents, and the distributed problem, in which each agent observes only its own state. Our main results are sharp non-asymptotic bounds on the gap between these two probl…
▽ More
We study high-dimensional stochastic optimal control problems in which many agents cooperate to minimize a convex cost functional. We consider both the full-information problem, in which each agent observes the states of all other agents, and the distributed problem, in which each agent observes only its own state. Our main results are sharp non-asymptotic bounds on the gap between these two problems, measured both in terms of their value functions and optimal states. Along the way, we develop theory for distributed optimal stochastic control in parallel with the classical setting, by characterizing optimizers in terms of an associated stochastic maximum principle and a Hamilton-Jacobi-type equation. By specializing these results to the setting of mean field control, in which costs are (symmetric) functions of the empirical distribution of states, we derive the optimal rate for the convergence problem in the displacement convex regime.
△ Less
Submitted 7 January, 2023;
originally announced January 2023.
-
Mean field approximations via log-concavity
Authors:
Daniel Lacker,
Sumit Mukherjee,
Lane Chun Yeung
Abstract:
We propose a new approach to deriving quantitative mean field approximations for any probability measure $P$ on $\mathbb{R}^n$ with density proportional to $e^{f(x)}$, for $f$ strongly concave. We bound the mean field approximation for the log partition function $\log \int e^{f(x)}dx$ in terms of $\sum_{i \neq j}\mathbb{E}_{Q^*}|\partial_{ij}f|^2$, for a semi-explicit probability measure $Q^*$ cha…
▽ More
We propose a new approach to deriving quantitative mean field approximations for any probability measure $P$ on $\mathbb{R}^n$ with density proportional to $e^{f(x)}$, for $f$ strongly concave. We bound the mean field approximation for the log partition function $\log \int e^{f(x)}dx$ in terms of $\sum_{i \neq j}\mathbb{E}_{Q^*}|\partial_{ij}f|^2$, for a semi-explicit probability measure $Q^*$ characterized as the unique mean field optimizer, or equivalently as the minimizer of the relative entropy $H(\cdot\,|\,P)$ over product measures. This notably does not involve metric-entropy or gradient-complexity concepts which are common in prior work on nonlinear large deviations. Three implications are discussed, in the contexts of continuous Gibbs measures on large graphs, high-dimensional Bayesian linear regression, and the construction of decentralized near-optimizers in high-dimensional stochastic control problems. Our arguments are based primarily on functional inequalities and the notion of displacement convexity from optimal transport.
△ Less
Submitted 2 June, 2022;
originally announced June 2022.
-
Sharp uniform-in-time propagation of chaos
Authors:
Daniel Lacker,
Luc Le Flem
Abstract:
We prove the optimal rate of quantitative propagation of chaos, uniformly in time, for interacting diffusions. Our main examples are interactions governed by convex potentials and models on the torus with small interactions. We show that the distance between the $k$-particle marginal of the $n$-particle system and its limiting product measure is $O((k/n)^2)$, uniformly in time, with distance measu…
▽ More
We prove the optimal rate of quantitative propagation of chaos, uniformly in time, for interacting diffusions. Our main examples are interactions governed by convex potentials and models on the torus with small interactions. We show that the distance between the $k$-particle marginal of the $n$-particle system and its limiting product measure is $O((k/n)^2)$, uniformly in time, with distance measured either by relative entropy, squared quadratic Wasserstein metric, or squared total variation. Our proof is based on an analysis of relative entropy through the BBGKY hierarchy, adapting prior work of the first author to the time-uniform case by means of log-Sobolev inequalities.
△ Less
Submitted 20 January, 2023; v1 submitted 24 May, 2022;
originally announced May 2022.
-
A label-state formulation of stochastic graphon games and approximate equilibria on large networks
Authors:
Daniel Lacker,
Agathe Soret
Abstract:
This paper studies stochastic games on large graphs and their graphon limits. We propose a new formulation of graphon games based on a single typical player's label-state distribution. In contrast, other recently proposed models of graphon games work directly with a continuum of players, which involves serious measure-theoretic technicalities. In fact, by viewing the label as a component of the st…
▽ More
This paper studies stochastic games on large graphs and their graphon limits. We propose a new formulation of graphon games based on a single typical player's label-state distribution. In contrast, other recently proposed models of graphon games work directly with a continuum of players, which involves serious measure-theoretic technicalities. In fact, by viewing the label as a component of the state process, we show in our formulation that graphon games are a special case of mean field games, albeit with certain inevitable degeneracies and discontinuities that make most existing results on mean field games inapplicable. Nonetheless, we prove existence of Markovian graphon equilibria under fairly general assumptions, as well as uniqueness under a monotonicity condition. Most imporantly, we show how our notion of graphon equilibrium can be used to construct approximate equilibria for large finite games set on any (weighted, directed) graph which converges in cut norm. The lack of players' exchangeability necessitates a careful definition of approximate equilibrium, allowing heterogeneity among the players' approximation errors, and we show how various regularity properties of the model inputs and underlying graphon lead naturally to different strengths of approximation.
△ Less
Submitted 20 April, 2022;
originally announced April 2022.
-
Stationary solutions and local equations for interacting diffusions on regular trees
Authors:
Daniel Lacker,
Jiacheng Zhang
Abstract:
We study the invariant measures of infinite systems of stochastic differential equations (SDEs) indexed by the vertices of a regular tree. These invariant measures correspond to Gibbs measures associated with certain continuous specifications, and we focus specifically on those measures which are homogeneous Markov random fields. We characterize the joint law at any two adjacent vertices in terms…
▽ More
We study the invariant measures of infinite systems of stochastic differential equations (SDEs) indexed by the vertices of a regular tree. These invariant measures correspond to Gibbs measures associated with certain continuous specifications, and we focus specifically on those measures which are homogeneous Markov random fields. We characterize the joint law at any two adjacent vertices in terms of a new two-dimensional SDE system, called the "local equation", which exhibits an unusual dependence on a conditional law. Exploiting an alternative characterization in terms of an eigenfunction-type fixed point problem, we derive existence and uniqueness results for invariant measures of the local equation and infinite SDE system. This machinery is put to use in two examples. First, we give a detailed analysis of the surprisingly subtle case of linear coefficients, which yields a new way to derive the famous Kesten-McKay law for the spectral measure of the regular tree. Second, we construct solutions of tree-indexed SDE systems with nearest-neighbor repulsion effects, similar to Dyson's Brownian motion.
△ Less
Submitted 4 December, 2021; v1 submitted 9 November, 2021;
originally announced November 2021.
-
Closed-loop convergence for mean field games with common noise
Authors:
Daniel Lacker,
Luc Le Flem
Abstract:
This paper studies the convergence problem for mean field games with common noise. We define a suitable notion of weak mean field equilibria, which we prove captures all subsequential limit points, as $n\to\infty$, of closed-loop approximate equilibria from the corresponding $n$-player games. This extends to the common noise setting a recent result of the first author, while also simplifying a key…
▽ More
This paper studies the convergence problem for mean field games with common noise. We define a suitable notion of weak mean field equilibria, which we prove captures all subsequential limit points, as $n\to\infty$, of closed-loop approximate equilibria from the corresponding $n$-player games. This extends to the common noise setting a recent result of the first author, while also simplifying a key step in the proof and allowing unbounded coefficients and non-i.i.d. initial conditions. Conversely, we show that every weak mean field equilibrium arises as the limit of some sequence of approximate equilibria for the $n$-player games, as long as the latter are formulated over a broader class of closed-loop strategies which may depend on an additional common signal.
△ Less
Submitted 19 August, 2022; v1 submitted 7 July, 2021;
originally announced July 2021.
-
Quantitative approximate independence for continuous mean field Gibbs measures
Authors:
Daniel Lacker
Abstract:
Many Gibbs measures with mean field interactions are known to be chaotic, in the sense that any collection of $k$ particles in the $n$-particle system are asymptotically independent, as $n\to\infty$ with $k$ fixed or perhaps $k=o(n)$. This paper quantifies this notion for a class of continuous Gibbs measures on Euclidean space with pairwise interactions, with main examples being systems governed b…
▽ More
Many Gibbs measures with mean field interactions are known to be chaotic, in the sense that any collection of $k$ particles in the $n$-particle system are asymptotically independent, as $n\to\infty$ with $k$ fixed or perhaps $k=o(n)$. This paper quantifies this notion for a class of continuous Gibbs measures on Euclidean space with pairwise interactions, with main examples being systems governed by convex interactions and uniformly convex confinement potentials. The distance between the marginal law of $k$ particles and its limiting product measure is shown to be $O((k/n)^{c \wedge 2})$, with $c$ proportional to the squared temperature. In the high temperature case, this improves upon prior results based on subadditivity of entropy, which yield $O(k/n)$ at best. The bound $O((k/n)^2)$ cannot be improved, as a Gaussian example demonstrates. The results are non-asymptotic, and distance is quantified via relative Fisher information, relative entropy, or the squared quadratic Wasserstein metric. The method relies on an a priori functional inequality for the limiting measure, used to derive an estimate for the $k$-particle distance in terms of the $(k+1)$-particle distance.
△ Less
Submitted 7 May, 2021;
originally announced May 2021.
-
Hierarchies, entropy, and quantitative propagation of chaos for mean field diffusions
Authors:
Daniel Lacker
Abstract:
This paper develops a non-asymptotic, local approach to quantitative propagation of chaos for a wide class of mean field diffusive dynamics. For a system of $n$ interacting particles, the relative entropy between the marginal law of $k$ particles and its limiting product measure is shown to be $O((k/n)^2)$ at each time, as long as the same is true at time zero. A simple Gaussian example shows that…
▽ More
This paper develops a non-asymptotic, local approach to quantitative propagation of chaos for a wide class of mean field diffusive dynamics. For a system of $n$ interacting particles, the relative entropy between the marginal law of $k$ particles and its limiting product measure is shown to be $O((k/n)^2)$ at each time, as long as the same is true at time zero. A simple Gaussian example shows that this rate is optimal. The main assumption is that the limiting measure obeys a certain functional inequality, which is shown to encompass many potentially irregular but not too singular finite-range interactions, as well as some infinite-range interactions. This unifies the previously disparate cases of Lipschitz versus bounded measurable interactions, improving the best prior bounds of $O(k/n)$ which were deduced from global estimates involving all $n$ particles. We also cover a class of models for which qualitative propagation of chaos and even well-posedness of the McKean-Vlasov equation were previously unknown. At the center of a new approach is a differential inequality, derived from a form of the BBGKY hierarchy, which bounds the $k$-particle entropy in terms of the $(k+1)$-particle entropy.
△ Less
Submitted 16 March, 2022; v1 submitted 6 May, 2021;
originally announced May 2021.
-
A characterization of transportation-information inequalities for Markov processes in terms of dimension-free concentration
Authors:
Daniel Lacker,
Lane Chun Yeung
Abstract:
Inequalities between transportation costs and Fisher information are known to characterize certain concentration properties of Markov processes around their invariant measures. This note provides a new characterization of the quadratic transportation-information inequality $W_2I$ in terms of a dimension-free concentration property for i.i.d. (conditionally on the initial positions) copies of the u…
▽ More
Inequalities between transportation costs and Fisher information are known to characterize certain concentration properties of Markov processes around their invariant measures. This note provides a new characterization of the quadratic transportation-information inequality $W_2I$ in terms of a dimension-free concentration property for i.i.d. (conditionally on the initial positions) copies of the underlying Markov process. This parallels Gozlan's characterization of the quadratic transportation-entropy inequality $W_2H$. The proof is based on a new Laplace-type principle for the operator norms of Feynman-Kac semigroups, which is of independent interest. Lastly, we illustrate how both our theorem and (a form of) Gozlan's are instances of a general convex-analytic tensorization principle.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Marginal dynamics of interacting diffusions on unimodular Galton-Watson trees
Authors:
Daniel Lacker,
Kavita Ramanan,
Ruoyu Wu
Abstract:
Consider a system of homogeneous interacting diffusive particles labeled by the nodes of a unimodular Galton-Watson (UGW) tree, where the state of each node evolves like a d-dimensional diffusion whose drift coefficient depends on (the histories of) its own state and the states of neighboring nodes, and whose diffusion coefficient depends only on (the history of) its own state. Under suitable regu…
▽ More
Consider a system of homogeneous interacting diffusive particles labeled by the nodes of a unimodular Galton-Watson (UGW) tree, where the state of each node evolves like a d-dimensional diffusion whose drift coefficient depends on (the histories of) its own state and the states of neighboring nodes, and whose diffusion coefficient depends only on (the history of) its own state. Under suitable regularity assumptions on the coefficients, an autonomous characterization is obtained for the marginal distribution of the dynamics of the neighborhood of a typical node in terms of a certain local equation, which is a new kind of SDE that is nonlinear in the sense of McKean. This equation describes a finite-dimensional non-Markovian stochastic process whose evolution at any time depends not only on the structure and current state of the neighborhood, but also on the conditional law of the current state given the past of the states of neighborhing nodes. Such marginal distributions are of interest because they arise as weak limits of both marginal distributions and empirical measures of interacting diffusions on many sequences of sparse random graphs, including the configuration model and Erdos-Renyi graphs whose average degrees converge to a finite non-zero limit. The results obtained complement classical results in the mean-field regime, which characterize the limiting dynamics of homogeneous interacting diffusions on complete graphs, as the number of nodes goes to infinity, in terms of a corresponding nonlinear Markov process. However, in the sparse graph setting, the topology of the graph strongly influences the dynamics, and the analysis requires a completely different approach. The proofs of existence and uniqueness of the local equation rely on delicate new conditional independence and symmetry properties of particle trajectories on UGW trees, as well as judicious use of changes of measure.
△ Less
Submitted 15 July, 2021; v1 submitted 23 September, 2020;
originally announced September 2020.
-
A case study on stochastic games on large graphs in mean field and sparse regimes
Authors:
Daniel Lacker,
Agathe Soret
Abstract:
We study a class of linear-quadratic stochastic differential games in which each player interacts directly only with its nearest neighbors in a given graph. We find a semi-explicit Markovian equilibrium for any transitive graph, in terms of the empirical eigenvalue distribution of the graph's normalized Laplacian matrix. This facilitates large-population asymptotics for various graph sequences, wi…
▽ More
We study a class of linear-quadratic stochastic differential games in which each player interacts directly only with its nearest neighbors in a given graph. We find a semi-explicit Markovian equilibrium for any transitive graph, in terms of the empirical eigenvalue distribution of the graph's normalized Laplacian matrix. This facilitates large-population asymptotics for various graph sequences, with several sparse and dense examples discussed in detail. In particular, the mean field game is the correct limit only in the dense graph case, i.e., when the degrees diverge in a suitable sense. Even though equilibrium strategies are nonlocal, depending on the behavior of all players, we use a correlation decay estimate to prove a propagation of chaos result in both the dense and sparse regimes, with the sparse case owing to the large distances between typical vertices. Without assuming the graphs are transitive, we show also that the mean field game solution can be used to construct decentralized approximate equilibria on any sufficiently dense graph sequence.
△ Less
Submitted 23 September, 2021; v1 submitted 28 May, 2020;
originally announced May 2020.
-
Superposition and mimicking theorems for conditional McKean-Vlasov equations
Authors:
Daniel Lacker,
Mykhaylo Shkolnikov,
Jiacheng Zhang
Abstract:
We consider conditional McKean-Vlasov stochastic differential equations (SDEs), such as the ones arising in the large-system limit of mean field games and particle systems with mean field interactions when common noise is present. The conditional time-marginals of the solutions to these SDEs satisfy non-linear stochastic partial differential equations (SPDEs) of the second order, whereas the laws…
▽ More
We consider conditional McKean-Vlasov stochastic differential equations (SDEs), such as the ones arising in the large-system limit of mean field games and particle systems with mean field interactions when common noise is present. The conditional time-marginals of the solutions to these SDEs satisfy non-linear stochastic partial differential equations (SPDEs) of the second order, whereas the laws of the conditional time-marginals follow Fokker-Planck equations on the space of probability measures. We prove two superposition principles: The first establishes that any solution of the SPDE can be lifted to a solution of the conditional McKean-Vlasov SDE, and the second guarantees that any solution of the Fokker-Planck equation on the space of probability measures can be lifted to a solution of the SPDE. We use these results to obtain a mimicking theorem which shows that the conditional time-marginals of an Ito process can be emulated by those of a solution to a conditional McKean-Vlasov SDE with Markovian coefficients. This yields, in particular, a tool for converting open-loop controls into Markovian ones in the context of controlled McKean-Vlasov dynamics.
△ Less
Submitted 31 March, 2020;
originally announced April 2020.
-
Locally interacting diffusions as space-time Markov random fields
Authors:
Daniel Lacker,
Kavita Ramanan,
Ruoyu Wu
Abstract:
We consider a countable system of interacting (possibly non-Markovian) stochastic differential equations driven by independent Brownian motions and indexed by the vertices of a locally finite graph $G = (V,E)$. The drift of the process at each vertex is influenced by the states of that vertex and its neighbors, and the diffusion coefficient depends on the state of only that vertex. Such processes…
▽ More
We consider a countable system of interacting (possibly non-Markovian) stochastic differential equations driven by independent Brownian motions and indexed by the vertices of a locally finite graph $G = (V,E)$. The drift of the process at each vertex is influenced by the states of that vertex and its neighbors, and the diffusion coefficient depends on the state of only that vertex. Such processes arise in a variety of applications including statistical physics, neuroscience, engineering and math finance. Under general conditions on the coefficients, we show that if the initial conditions form a second-order Markov random field on $d$-dimensional Euclidean space, then at any positive time, the collection of histories of the processes at different vertices forms a second-order Markov random field on path space. We also establish a bijection between (second-order) Gibbs measures on $(\R^d)^V$ (with finite second moments) and a set of space-time (second-order) Gibbs measures on path space, corresponding respectively to the initial law and the law of the solution to the stochastic differential equation. As a corollary, we establish a Gibbs uniqueness property that shows that for infinite graphs the joint distribution of the paths is completely determined by the initial condition and the specifications, namely the family of conditional distributions on finite vertex sets given the configuration on the complement. Along the way, we establish various approximation and projection results for Markov random fields on locally finite graphs that may be of independent interest.
△ Less
Submitted 25 September, 2020; v1 submitted 4 November, 2019;
originally announced November 2019.
-
Many-player games of optimal consumption and investment under relative performance criteria
Authors:
Daniel Lacker,
Agathe Soret
Abstract:
We study a portfolio optimization problem for competitive agents with CRRA utilities and a common finite time horizon. The utility of an agent depends not only on her absolute wealth and consumption but also on her relative wealth and consumption when compared to the averages among the other agents. We derive a closed form solution for the $n$-player game and the corresponding mean field game. Thi…
▽ More
We study a portfolio optimization problem for competitive agents with CRRA utilities and a common finite time horizon. The utility of an agent depends not only on her absolute wealth and consumption but also on her relative wealth and consumption when compared to the averages among the other agents. We derive a closed form solution for the $n$-player game and the corresponding mean field game. This solution is unique in the class of equilibria with constant investment and continuous time-dependent consumption, both independent of the wealth of the agent. Compared to the classical Merton problem with one agent, the competitive model exhibits a wide range of highly nonlinear and non-monotone dependence on the agents' risk tolerance and competitiveness parameters. Counter-intuitively, competitive agents with high risk tolerance may behave like non-competitive agents with low risk tolerance.
△ Less
Submitted 28 May, 2019;
originally announced May 2019.
-
Inverting the Markovian projection, with an application to local stochastic volatility models
Authors:
Daniel Lacker,
Mykhaylo Shkolnikov,
Jiacheng Zhang
Abstract:
We study two-dimensional stochastic differential equations (SDEs) of McKean--Vlasov type in which the conditional distribution of the second component of the solution given the first enters the equation for the first component of the solution. Such SDEs arise when one tries to invert the Markovian projection developed by Gyöngy (1986), typically to produce an Itô process with the fixed-time margin…
▽ More
We study two-dimensional stochastic differential equations (SDEs) of McKean--Vlasov type in which the conditional distribution of the second component of the solution given the first enters the equation for the first component of the solution. Such SDEs arise when one tries to invert the Markovian projection developed by Gyöngy (1986), typically to produce an Itô process with the fixed-time marginal distributions of a given one-dimensional diffusion but richer dynamical features. We prove the strong existence of stationary solutions for these SDEs, as well as their strong uniqueness in an important special case. Variants of the SDEs discussed in this paper enjoy frequent application in the calibration of local stochastic volatility models in finance, despite the very limited theoretical understanding.
△ Less
Submitted 15 May, 2019;
originally announced May 2019.
-
Local weak convergence for sparse networks of interacting processes
Authors:
Daniel Lacker,
Kavita Ramanan,
Ruoyu Wu
Abstract:
We study the limiting behavior of interacting particle systems indexed by large sparse graphs, which evolve either according to a discrete time Markov chain or a diffusion, in which particles interact directly only with their nearest neighbors in the graph. To encode sparsity we work in the framework of local weak convergence of marked (random) graphs. We show that the joint law of the particle sy…
▽ More
We study the limiting behavior of interacting particle systems indexed by large sparse graphs, which evolve either according to a discrete time Markov chain or a diffusion, in which particles interact directly only with their nearest neighbors in the graph. To encode sparsity we work in the framework of local weak convergence of marked (random) graphs. We show that the joint law of the particle system varies continuously with respect to local weak convergence of the underlying graph marked with the initial conditions. In addition, we show that the global empirical measure converges to a non-random limit for a large class of graph sequences including sparse Erdös-Rényi graphs and configuration models, whereas the empirical measure of the connected component of a uniformly random vertex converges to a random limit. Along the way, we develop some related results on the time-propagation of ergodicity and empirical field convergence, as well as some general results on local weak convergence of Gibbs measures in the uniqueness regime which appear to be new. The results obtained here are also useful for obtaining autonomous descriptions of marginal dynamics of interacting diffusions and Markov chains on sparse graphs. While limits of interacting particle systems on dense graphs have been extensively studied, there are relatively few works that have studied the sparse regime in generality.
△ Less
Submitted 16 May, 2022; v1 submitted 4 April, 2019;
originally announced April 2019.
-
Non-exponential Sanov and Schilder theorems on Wiener space: BSDEs, Schrödinger problems and Control
Authors:
Julio Backhoff-Veraguas,
Daniel Lacker,
Ludovic Tangpi
Abstract:
We derive new limit theorems for Brownian motion, which can be seen as non-exponential analogues of the large deviation theorems of Sanov and Schilder in their Laplace principle forms. As a first application, we obtain novel scaling limits of backward stochastic differential equations and their related partial differential equations. As a second application, we extend prior results on the small-no…
▽ More
We derive new limit theorems for Brownian motion, which can be seen as non-exponential analogues of the large deviation theorems of Sanov and Schilder in their Laplace principle forms. As a first application, we obtain novel scaling limits of backward stochastic differential equations and their related partial differential equations. As a second application, we extend prior results on the small-noise limit of the Schrödinger problem as an optimal transport cost, unifying the control-theoretic and probabilistic approaches initiated respectively by T. Mikami and C. Léonard. Lastly, our results suggest a new scheme for the computation of mean field optimal control problems, distinct from the conventional particle approximation. A key ingredient in our analysis is an extension of the classical variational formula (often attributed to Borell or Boué-Dupuis) for the Laplace transform of Wiener measure.
△ Less
Submitted 3 October, 2018;
originally announced October 2018.
-
On the convergence of closed-loop Nash equilibria to the mean field game limit
Authors:
Daniel Lacker
Abstract:
This paper continues the study of the mean field game (MFG) convergence problem: In what sense do the Nash equilibria of $n$-player stochastic differential games converge to the mean field game as $n\rightarrow\infty$? Previous work on this problem took two forms. First, when the $n$-player equilibria are open-loop, compactness arguments permit a characterization of all limit points of $n$-player…
▽ More
This paper continues the study of the mean field game (MFG) convergence problem: In what sense do the Nash equilibria of $n$-player stochastic differential games converge to the mean field game as $n\rightarrow\infty$? Previous work on this problem took two forms. First, when the $n$-player equilibria are open-loop, compactness arguments permit a characterization of all limit points of $n$-player equilibria as weak MFG equilibria, which contain additional randomness compared to the standard (strong) equilibrium concept. On the other hand, when the $n$-player equilibria are closed-loop, the convergence to the MFG equilibrium is known only when the MFG equilibrium is unique and the associated "master equation" is solvable and sufficiently smooth. This paper adapts the compactness arguments to the closed-loop case, proving a convergence theorem that holds even when the MFG equilibrium is non-unique. Every limit point of $n$-player equilibria is shown to be the same kind of weak MFG equilibrium as in the open-loop case. Some partial results and examples are discussed for the converse question, regarding which of the weak MFG equilibria can arise as the limit of $n$-player (approximate) equilibria.
△ Less
Submitted 8 August, 2018;
originally announced August 2018.
-
On a strong form of propagation of chaos for McKean-Vlasov equations
Authors:
Daniel Lacker
Abstract:
This note shows how to considerably strengthen the usual mode of convergence of an $n$-particle system to its McKean-Vlasov limit, often known as propagation of chaos, when the volatility coefficient is nondegenerate and involves no interaction term. Notably, the empirical measure converges in a much stronger topology than weak convergence, and any fixed $k$ particles converge in total variation t…
▽ More
This note shows how to considerably strengthen the usual mode of convergence of an $n$-particle system to its McKean-Vlasov limit, often known as propagation of chaos, when the volatility coefficient is nondegenerate and involves no interaction term. Notably, the empirical measure converges in a much stronger topology than weak convergence, and any fixed $k$ particles converge in total variation to their limit law as $n\rightarrow\infty$. This requires minimal continuity for the drift in both the space and measure variables. The proofs are purely probabilistic and rather short, relying on Girsanov's and Sanov's theorems. Along the way, some modest new existence and uniqueness results for McKean-Vlasov equations are derived.
△ Less
Submitted 11 May, 2018;
originally announced May 2018.
-
Denseness of adapted processes among causal couplings
Authors:
Mathias Beiglböck,
Daniel Lacker
Abstract:
It is well known that any pair of random variables $(X,Y)$ with values in Polish spaces, provided that $Y$ is nonatomic, can be approximated in joint law by random variables of the form $(X',Y)$ where $X'$ is $Y$-measurable and $X' \stackrel{d}{=} X$. This article surveys and extends some recent dynamic analogues of this result. For example, if $X$ and $Y$ are stochastic processes in discrete or c…
▽ More
It is well known that any pair of random variables $(X,Y)$ with values in Polish spaces, provided that $Y$ is nonatomic, can be approximated in joint law by random variables of the form $(X',Y)$ where $X'$ is $Y$-measurable and $X' \stackrel{d}{=} X$. This article surveys and extends some recent dynamic analogues of this result. For example, if $X$ and $Y$ are stochastic processes in discrete or continuous time, then, under a nonatomic assumption as well as a necessary and sufficient causality (or compatibility) condition, one can approximate $(X,Y)$ in law in path space by processes of the form $(X',Y)$, where $X'$ is adapted to the filtration generated by $Y$. In addition, in finite discrete time, we can take $X'$ to have the same law as $X$. A similar approximation is valid for randomized stopping times, without the first marginal fixed. Natural applications include relaxations of (mean field) stochastic control and causal optimal transport problems as well as new characterizations of the immersion property for progressively enlarged filtrations.
△ Less
Submitted 27 May, 2020; v1 submitted 8 May, 2018;
originally announced May 2018.
-
From the master equation to mean field game limit theory: Large deviations and concentration of measure
Authors:
Francois Delarue,
Daniel Lacker,
Kavita Ramanan
Abstract:
We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitab…
▽ More
We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitable regularity conditions, in the absence of common noise, we complement this law of large numbers result with non-asymptotic concentration bounds for the Wasserstein distance between the $n$-player Nash equilibrium empirical measure and the mean field equilibrium. We also show that the sequence of Nash equilibrium empirical measures satisfies a weak large deviation principle, which can be strengthened to a full large deviation principle only in the absence of common noise. For both sets of results, we first use the master equation, an infinite-dimensional partial differential equation that characterizes the value function of the mean field game, to construct an associated McKean-Vlasov interacting $n$-particle system that is exponentially close to the Nash equilibrium dynamics of the $n$-player game for large $n$, by refining estimates obtained in our companion paper. Then we establish a weak large deviation principle for McKean-Vlasov systems in the presence of common noise. In the absence of common noise, we upgrade this to a full large deviation principle and obtain new concentration estimates for McKean-Vlasov systems. Finally, in two specific examples that do not satisfy the assumptions of our main theorems, we show how to adapt our methodology to establish large deviations and concentration results.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
From the master equation to mean field game limit theory: A central limit theorem
Authors:
Francois Delarue,
Daniel Lacker,
Kavita Ramanan
Abstract:
Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG…
▽ More
Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG equilibrium arises as the limit of the sequence of empirical measures of the $n$-player game Nash equilibria, including the case when player dynamics are driven by both idiosyncratic and common sources of noise. The proof of convergence relies on the so-called master equation for the value function of the MFG, a partial differential equation on the space of probability measures. In this work, under additional assumptions, we establish a functional central limit theorem (CLT) that characterizes the limiting fluctuations around the LLN limit as the unique solution of a linear stochastic PDE. The key idea is to use the solution to the master equation to construct an associated McKean-Vlasov interacting $n$-particle system that is sufficiently close to the Nash equilibrium dynamics of the $n$-player game for large $n$. We then derive the CLT for the latter from the CLT for the former. Along the way, we obtain a new multidimensional CLT for McKean-Vlasov systems. We also illustrate the broader applicability of our methodology by applying it to establish a CLT for a specific linear-quadratic example that does not satisfy our main assumptions, and we explicitly solve the resulting stochastic PDE in this case.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
Rare Nash Equilibria and the Price of Anarchy in Large Static Games
Authors:
Daniel Lacker,
Kavita Ramanan
Abstract:
We study a static game played by a finite number of agents, in which agents are assigned independent and identically distributed random types and each agent minimizes its objective function by choosing from a set of admissible actions that depends on its type. The game is anonymous in the sense that the objective function of each agent depends on the actions of other agents only through the empiri…
▽ More
We study a static game played by a finite number of agents, in which agents are assigned independent and identically distributed random types and each agent minimizes its objective function by choosing from a set of admissible actions that depends on its type. The game is anonymous in the sense that the objective function of each agent depends on the actions of other agents only through the empirical distribution of their type-action pairs. We study the asymptotic behavior of Nash equilibria, as the number of agents tends to infinity, first by deriving laws of large numbers characterizes almost sure limit points of Nash equilibria in terms of so-called Cournot-Nash equilibria of an associated nonatomic game. Our main results are large deviation principles that characterize the probability of rare Nash equilibria and associated conditional limit theorems describing the behavior of equilibria conditioned on a rare event. The results cover situations when neither the finite-player game nor the associated nonatomic game has a unique equilibrium. In addition, we study the asymptotic behavior of the price of anarchy, complementing existing worst-case bounds with new probabilistic bounds in the context of congestion games, which are used to model traffic routing in networks.
△ Less
Submitted 7 February, 2017;
originally announced February 2017.
-
Limit theory for controlled McKean-Vlasov dynamics
Authors:
Daniel Lacker
Abstract:
This paper rigorously connects the problem of optimal control of McKean-Vlasov dynamics with large systems of interacting controlled state processes. Precisely, the empirical distributions of near-optimal control-state pairs for the $n$-state systems, as $n$ tends to infinity, admit limit points in distribution (if the objective functions are suitably coercive), and every such limit is supported o…
▽ More
This paper rigorously connects the problem of optimal control of McKean-Vlasov dynamics with large systems of interacting controlled state processes. Precisely, the empirical distributions of near-optimal control-state pairs for the $n$-state systems, as $n$ tends to infinity, admit limit points in distribution (if the objective functions are suitably coercive), and every such limit is supported on the set of optimal control-state pairs for the McKean-Vlasov problem. Conversely, any distribution on the set of optimal control-state pairs for the McKean-Vlasov problem can be realized as a limit in this manner. Arguments are based on controlled martingale problems, which lend themselves naturally to existence proofs; along the way it is shown that a large class of McKean-Vlasov control problems admit optimal Markovian controls.
△ Less
Submitted 26 September, 2016;
originally announced September 2016.
-
A non-exponential extension of Sanov's theorem via convex duality
Authors:
Daniel Lacker
Abstract:
This work is devoted to a vast extension of Sanov's theorem, in Laplace principle form, based on alternatives to the classical convex dual pair of relative entropy and cumulant generating functional. The abstract results give rise to a number of probabilistic limit theorems and asymptotics. For instance, widely applicable non-exponential large deviation upper bounds are derived for empirical distr…
▽ More
This work is devoted to a vast extension of Sanov's theorem, in Laplace principle form, based on alternatives to the classical convex dual pair of relative entropy and cumulant generating functional. The abstract results give rise to a number of probabilistic limit theorems and asymptotics. For instance, widely applicable non-exponential large deviation upper bounds are derived for empirical distributions and averages of i.i.d. samples under minimal integrability assumptions, notably accommodating heavy-tailed distributions. Other interesting manifestations of the abstract results include new results on the rate of convergence of empirical measures in Wasserstein distance, uniform large deviation bounds, and variational problems involving optimal transport costs, as well as an application to error estimates for approximate solutions of stochastic optimization problems. The proofs build on the Dupuis-Ellis weak convergence approach to large deviations as well as the duality theory for convex risk measures.
△ Less
Submitted 11 December, 2019; v1 submitted 15 September, 2016;
originally announced September 2016.
-
Mean field games of timing and models for bank runs
Authors:
Rene Carmona,
Francois Delarue,
Daniel Lacker
Abstract:
The goal of the paper is to introduce a set of problems which we call mean field games of timing. We motivate the formulation by a dynamic model of bank run in a continuous-time setting. We briefly review the economic and game theoretic contributions at the root of our effort, and we develop a mathematical theory for continuous-time stochastic games where the strategic decisions of the players are…
▽ More
The goal of the paper is to introduce a set of problems which we call mean field games of timing. We motivate the formulation by a dynamic model of bank run in a continuous-time setting. We briefly review the economic and game theoretic contributions at the root of our effort, and we develop a mathematical theory for continuous-time stochastic games where the strategic decisions of the players are merely choices of times at which they leave the game, and the interaction between the strategic players is of a mean field nature.
△ Less
Submitted 23 January, 2017; v1 submitted 12 June, 2016;
originally announced June 2016.
-
Liquidity, risk measures, and concentration of measure
Authors:
Daniel Lacker
Abstract:
Expanding on techniques of concentration of measure, we develop a quantitative framework for modeling liquidity risk using convex risk measures. The fundamental objects of study are curves of the form $(ρ(λX))_{λ\ge 0}$, where $ρ$ is a convex risk measure and $X$ a random variable, and we call such a curve a \emph{liquidity risk profile}. The shape of a liquidity risk profile is intimately linked…
▽ More
Expanding on techniques of concentration of measure, we develop a quantitative framework for modeling liquidity risk using convex risk measures. The fundamental objects of study are curves of the form $(ρ(λX))_{λ\ge 0}$, where $ρ$ is a convex risk measure and $X$ a random variable, and we call such a curve a \emph{liquidity risk profile}. The shape of a liquidity risk profile is intimately linked with the tail behavior of the underlying $X$ for some notable classes of risk measures, namely shortfall risk measures. We exploit this link to systematically bound liquidity risk profiles from above by other real functions $γ$, deriving tractable necessary and sufficient conditions for \emph{concentration inequalities} of the form $ρ(λX) \le γ(λ)$, for all $λ\ge 0$. These concentration inequalities admit useful dual representations related to transport inequalities, and this leads to efficient uniform bounds for liquidity risk profiles for large classes of $X$. On the other hand, some modest new mathematical results emerge from this analysis, including a new characterization of some classical transport-entropy inequalities. Lastly, the analysis is deepened by means of a surprising connection between time consistency properties of law invariant risk measures and the tensorization of concentration inequalities.
△ Less
Submitted 27 October, 2015; v1 submitted 23 October, 2015;
originally announced October 2015.
-
Law invariant risk measures and information divergences
Authors:
Daniel Lacker
Abstract:
A one-to-one correspondence is drawn between law invariant risk measures and divergences, which we define as functionals of pairs of probability measures on arbitrary standard Borel spaces satisfying a few natural properties. Divergences include many classical information divergence measures, such as relative entropy and $f$-divergences. Several properties of divergence and their duality with law…
▽ More
A one-to-one correspondence is drawn between law invariant risk measures and divergences, which we define as functionals of pairs of probability measures on arbitrary standard Borel spaces satisfying a few natural properties. Divergences include many classical information divergence measures, such as relative entropy and $f$-divergences. Several properties of divergence and their duality with law invariant risk measures are developed, most notably relating their chain rules or additivity properties with certain notions of time consistency for dynamic law invariant risk measures known as acceptance and rejection consistency. These properties are linked also to a peculiar property of the acceptance sets on the level of distributions, analogous to results of Weber on weak acceptance and rejection consistency. Finally, the examples of shortfall risk measures and optimized certainty equivalents are discussed in some detail, and it is shown that the relative entropy is essentially the only divergence satisfying the chain rule.
△ Less
Submitted 4 June, 2016; v1 submitted 23 October, 2015;
originally announced October 2015.
-
Translation invariant mean field games with common noise
Authors:
Daniel Lacker,
Kevin Webster
Abstract:
This note highlights a special class of mean field games in which the coefficients satisfy a convolution-type structural condition. A mean field game of this type with common noise is related to a certain mean field game without common noise by a simple transformation, which permits a tractable construction of a solution of the problem with common noise from a solution of the problem without.
This note highlights a special class of mean field games in which the coefficients satisfy a convolution-type structural condition. A mean field game of this type with common noise is related to a certain mean field game without common noise by a simple transformation, which permits a tractable construction of a solution of the problem with common noise from a solution of the problem without.
△ Less
Submitted 25 September, 2014;
originally announced September 2014.
-
A general characterization of the mean field limit for stochastic differential games
Authors:
Daniel Lacker
Abstract:
The mean field limit of large-population symmetric stochastic differential games is derived in a general setting, with and without common noise, on a finite time horizon. Minimal assumptions are imposed on equilibrium strategies, which may be asymmetric and based on full information. It is shown that approximate Nash equilibria in the $n$-player games admit certain weak limits as $n$ tends to infi…
▽ More
The mean field limit of large-population symmetric stochastic differential games is derived in a general setting, with and without common noise, on a finite time horizon. Minimal assumptions are imposed on equilibrium strategies, which may be asymmetric and based on full information. It is shown that approximate Nash equilibria in the $n$-player games admit certain weak limits as $n$ tends to infinity, and every limit is a weak solution of the mean field game (MFG). Conversely, every weak MFG solution can be obtained as the limit of a sequence of approximate Nash equilibria in the $n$-player games. Thus, the MFG precisely characterizes the possible limiting equilibrium behavior of the $n$-player games. Even in the setting without common noise, the empirical state distributions may admit stochastic limits which cannot be described by the usual notion of MFG solution.
△ Less
Submitted 12 August, 2014;
originally announced August 2014.
-
Mean field games with common noise
Authors:
Rene Carmona,
Francois Delarue,
Daniel Lacker
Abstract:
A theory of existence and uniqueness is developed for general stochastic differential mean field games with common noise. The concepts of strong and weak solutions are introduced in analogy with the theory of stochastic differential equations, and existence of weak solutions for mean field games is shown to hold under very general assumptions. Examples and counter-examples are provided to enlighte…
▽ More
A theory of existence and uniqueness is developed for general stochastic differential mean field games with common noise. The concepts of strong and weak solutions are introduced in analogy with the theory of stochastic differential equations, and existence of weak solutions for mean field games is shown to hold under very general assumptions. Examples and counter-examples are provided to enlighten the underpinnings of the existence theory. Finally, an analog of the famous result of Yamada and Watanabe is derived, and it is used to prove existence and uniqueness of a strong solution under additional assumptions.
△ Less
Submitted 20 May, 2015; v1 submitted 23 July, 2014;
originally announced July 2014.
-
Mean field games via controlled martingale problems: Existence of Markovian equilibria
Authors:
Daniel Lacker
Abstract:
Mean field games are studied in the framework of controlled martingale problems, and general existence theorems are proven in which the equilibrium control is Markovian. The framework is flexible enough to include degenerate volatility, which may depend on both the control and the mean field. The objectives need not be strictly convex, and the mean field interactions considered are nonlocal and Wa…
▽ More
Mean field games are studied in the framework of controlled martingale problems, and general existence theorems are proven in which the equilibrium control is Markovian. The framework is flexible enough to include degenerate volatility, which may depend on both the control and the mean field. The objectives need not be strictly convex, and the mean field interactions considered are nonlocal and Wasserstein-continuous. When the volatility is nondegenerate, continuity assumptions may be weakened considerably. The proofs first use relaxed controls to establish existence. Then, using a convexity assumption and measurable selection arguments, strict (non-relaxed) Markovian equilibria are constructed from relaxed equilibria.
△ Less
Submitted 7 April, 2015; v1 submitted 9 April, 2014;
originally announced April 2014.
-
A probabilistic weak formulation of mean field games and applications
Authors:
Rene Carmona,
Daniel Lacker
Abstract:
Mean field games are studied by means of the weak formulation of stochastic optimal control. This approach allows the mean field interactions to enter through both state and control processes and take a form which is general enough to include rank and nearest-neighbor effects. Moreover, the data may depend discontinuously on the state variable, and more generally its entire history. Existence and…
▽ More
Mean field games are studied by means of the weak formulation of stochastic optimal control. This approach allows the mean field interactions to enter through both state and control processes and take a form which is general enough to include rank and nearest-neighbor effects. Moreover, the data may depend discontinuously on the state variable, and more generally its entire history. Existence and uniqueness results are proven, along with a procedure for identifying and constructing distributed strategies which provide approximate Nash equlibria for finite-player games. Our results are applied to a new class of multi-agent price impact models and a class of flocking models for which we prove existence of equilibria.
△ Less
Submitted 15 April, 2014; v1 submitted 3 July, 2013;
originally announced July 2013.
