-
Broker-Trader Partial Information Nash-Equilibria
Authors:
Xuchen Wu,
Sebastian Jaimungal
Abstract:
We study partial information Nash equilibrium between a broker and an informed trader. In this setting, the informed trader, who possesses knowledge of a trading signal, trades multiple assets with the broker in a dealer market. Simultaneously, the broker offloads these assets in a lit exchange where their actions impact the asset prices. The broker, however, only observes aggregate prices and can…
▽ More
We study partial information Nash equilibrium between a broker and an informed trader. In this setting, the informed trader, who possesses knowledge of a trading signal, trades multiple assets with the broker in a dealer market. Simultaneously, the broker offloads these assets in a lit exchange where their actions impact the asset prices. The broker, however, only observes aggregate prices and cannot distinguish between underlying trends and volatility. Both the broker and the informed trader aim to maximize their penalized expected wealth. Using convex analysis, we characterize the Nash equilibrium and demonstrate its existence and uniqueness. Furthermore, we establish that this equilibrium corresponds to the solution of a nonstandard system of forward-backward stochastic differential equations (FBSDEs) that involves the two differing filtrations. For short enough time horizons, we prove that a unique solution of this system exists. Finally, under quite general assumptions, we show that the solution to the FBSDE system admits a polynomial approximation in the strength of the transient impact to arbitrary order, and prove that the error is controlled.
△ Less
Submitted 1 April, 2025; v1 submitted 23 December, 2024;
originally announced December 2024.
-
Kullback-Leibler Barycentre of Stochastic Processes
Authors:
Sebastian Jaimungal,
Silvana M. Pesenti
Abstract:
We consider the problem where an agent aims to combine the views and insights of different experts' models. Specifically, each expert proposes a diffusion process over a finite time horizon. The agent then combines the experts' models by minimising the weighted Kullback--Leibler divergence to each of the experts' models. We show existence and uniqueness of the barycentre model and prove an explici…
▽ More
We consider the problem where an agent aims to combine the views and insights of different experts' models. Specifically, each expert proposes a diffusion process over a finite time horizon. The agent then combines the experts' models by minimising the weighted Kullback--Leibler divergence to each of the experts' models. We show existence and uniqueness of the barycentre model and prove an explicit representation of the Radon--Nikodym derivative relative to the average drift model. We further allow the agent to include their own constraints, resulting in an optimal model that can be seen as a distortion of the experts' barycentre model to incorporate the agent's constraints. We propose two deep learning algorithms to approximate the optimal drift of the combined model, allowing for efficient simulations. The first algorithm aims at learning the optimal drift by matching the change of measure, whereas the second algorithm leverages the notion of elicitability to directly estimate the value function. The paper concludes with an extended application to combine implied volatility smile models that were estimated on different datasets.
△ Less
Submitted 11 April, 2025; v1 submitted 5 July, 2024;
originally announced July 2024.
-
Learning conditional distributions on continuous spaces
Authors:
Cyril Bénézet,
Ziteng Cheng,
Sebastian Jaimungal
Abstract:
We investigate sample-based learning of conditional distributions on multi-dimensional unit boxes, allowing for different dimensions of the feature and target spaces. Our approach involves clustering data near varying query points in the feature space to create empirical measures in the target space. We employ two distinct clustering schemes: one based on a fixed-radius ball and the other on neare…
▽ More
We investigate sample-based learning of conditional distributions on multi-dimensional unit boxes, allowing for different dimensions of the feature and target spaces. Our approach involves clustering data near varying query points in the feature space to create empirical measures in the target space. We employ two distinct clustering schemes: one based on a fixed-radius ball and the other on nearest neighbors. We establish upper bounds for the convergence rates of both methods and, from these bounds, deduce optimal configurations for the radius and the number of neighbors. We propose to incorporate the nearest neighbors method into neural network training, as our empirical analysis indicates it has better performance in practice. For efficiency, our training process utilizes approximate nearest neighbors search with random binary space partitioning. Additionally, we employ the Sinkhorn algorithm and a sparsity-enforced transport plan. Our empirical findings demonstrate that, with a suitably designed structure, the neural network has the ability to adapt to a suitable level of Lipschitz continuity locally. For reproducibility, our code is available at \url{https://github.com/zcheng-a/LCD_kNN}.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Risk-averse mean field games: exploitability and non-asymptotic analysis
Authors:
Ziteng Cheng,
Sebastian Jaimungal
Abstract:
In this paper, we use mean field games (MFGs) to investigate approximations of $N$-player games with uniformly symmetrically continuous heterogeneous closed-loop actions. To incorporate agents' risk aversion (beyond the classical expected utility of total costs), we use an abstract evaluation functional for their performance criteria. Centered around the notion of exploitability, we conduct non-as…
▽ More
In this paper, we use mean field games (MFGs) to investigate approximations of $N$-player games with uniformly symmetrically continuous heterogeneous closed-loop actions. To incorporate agents' risk aversion (beyond the classical expected utility of total costs), we use an abstract evaluation functional for their performance criteria. Centered around the notion of exploitability, we conduct non-asymptotic analysis on the approximation capability of MFGs from the perspective of state-action distributions without requiring the uniqueness of equilibria. Under suitable assumptions, we first show that scenarios in the $N$-player games with large $N$ and small average exploitabilities can be well approximated by approximate solutions of MFGs with relatively small exploitabilities. We then show that $δ$-mean field equilibria can be used to construct $\varepsilon$-equilibria in $N$-player games. Furthermore, in this general setting, we prove the existence of mean field equilibria. This proof reveals a possible avenue for incorporating penalization for randomized action into MFGs.
△ Less
Submitted 25 September, 2024; v1 submitted 17 January, 2023;
originally announced January 2023.
-
Minimal Kullback-Leibler Divergence for Constrained Lévy-Itô Processes
Authors:
Sebastian Jaimungal,
Silvana M. Pesenti,
Leandro Sánchez-Betancourt
Abstract:
Given an n-dimensional stochastic process X driven by P-Brownian motions and Poisson random measures, we seek the probability measure Q, with minimal relative entropy to P, such that the Q-expectations of some terminal and running costs are constrained. We prove existence and uniqueness of the optimal probability measure, derive the explicit form of the measure change, and characterise the optimal…
▽ More
Given an n-dimensional stochastic process X driven by P-Brownian motions and Poisson random measures, we seek the probability measure Q, with minimal relative entropy to P, such that the Q-expectations of some terminal and running costs are constrained. We prove existence and uniqueness of the optimal probability measure, derive the explicit form of the measure change, and characterise the optimal drift and compensator adjustments under the optimal measure. We provide an analytical solution for Value-at-Risk (quantile) constraints, discuss how to perturb a Brownian motion to have arbitrary variance, and show that pinned measures arise as a limiting case of optimal measures. The results are illustrated in a risk management setting -- including an algorithm to simulate under the optimal measure -- where an agent seeks to answer the question: what dynamics are induced by a perturbation of the Value-at-Risk and the average time spent below a barrier on the reference process?
△ Less
Submitted 2 August, 2022; v1 submitted 29 June, 2022;
originally announced June 2022.
-
Risk-Averse Markov Decision Processes through a Distributional Lens
Authors:
Ziteng Cheng,
Sebastian Jaimungal
Abstract:
By adopting a distributional viewpoint on law-invariant convex risk measures, we construct dynamics risk measures (DRMs) at the distributional level. We then apply these DRMs to investigate Markov decision processes, incorporating latent costs, random actions, and weakly continuous transition kernels. Furthermore, the proposed DRMs allow risk aversion to change dynamically. Under mild assumptions,…
▽ More
By adopting a distributional viewpoint on law-invariant convex risk measures, we construct dynamics risk measures (DRMs) at the distributional level. We then apply these DRMs to investigate Markov decision processes, incorporating latent costs, random actions, and weakly continuous transition kernels. Furthermore, the proposed DRMs allow risk aversion to change dynamically. Under mild assumptions, we derive a dynamic programming principle and show the existence of an optimal policy in both finite and infinite time horizons. Moreover, we provide a sufficient condition for the optimality of deterministic actions. For illustration, we conclude the paper with examples from optimal liquidation with limit order books and autonomous driving.
△ Less
Submitted 23 April, 2024; v1 submitted 17 March, 2022;
originally announced March 2022.
-
Exploratory LQG Mean Field Games with Entropy Regularization
Authors:
Dena Firoozi,
Sebastian Jaimungal
Abstract:
We study a general class of entropy-regularized multi-variate LQG mean field games (MFGs) in continuous time with $K$ distinct sub-population of agents. We extend the notion of actions to action distributions (exploratory actions), and explicitly derive the optimal action distributions for individual agents in the limiting MFG. We demonstrate that the optimal set of action distributions yields an…
▽ More
We study a general class of entropy-regularized multi-variate LQG mean field games (MFGs) in continuous time with $K$ distinct sub-population of agents. We extend the notion of actions to action distributions (exploratory actions), and explicitly derive the optimal action distributions for individual agents in the limiting MFG. We demonstrate that the optimal set of action distributions yields an $ε$-Nash equilibrium for the finite-population entropy-regularized MFG. Furthermore, we compare the resulting solutions with those of classical LQG MFGs and establish the equivalence of their existence.
△ Less
Submitted 29 November, 2021; v1 submitted 25 November, 2020;
originally announced November 2020.
-
A Mean-Field Game Approach to Equilibrium Pricing in Solar Renewable Energy Certificate Markets
Authors:
Arvind Shrivats,
Dena Firoozi,
Sebastian Jaimungal
Abstract:
Solar Renewable Energy Certificate (SREC) markets are a market-based system that incentivizes solar energy generation. A regulatory body imposes a lower bound on the amount of energy each regulated firm must generate via solar means, providing them with a tradeable certificate for each MWh generated. Firms seek to navigate the market optimally by modulating their SREC generation and trading rates.…
▽ More
Solar Renewable Energy Certificate (SREC) markets are a market-based system that incentivizes solar energy generation. A regulatory body imposes a lower bound on the amount of energy each regulated firm must generate via solar means, providing them with a tradeable certificate for each MWh generated. Firms seek to navigate the market optimally by modulating their SREC generation and trading rates. As such, the SREC market can be viewed as a stochastic game, where agents interact through the SREC price. We study this stochastic game by solving the mean-field game (MFG) limit with sub-populations of heterogeneous agents. Market participants optimize costs accounting for trading frictions, cost of generation, non-linear non-compliance costs, and generation uncertainty. Moreover, we endogenize SREC price through market clearing. We characterize firms' optimal controls as the solution of McKean-Vlasov (MV) FBSDEs and determine the equilibrium SREC price. We establish the existence and uniqueness of a solution to this MV-FBSDE, and prove that the MFG strategies form an $ε$-Nash equilibrium for the finite player game. Finally, we develop a numerical scheme for solving the MV-FBSDEs and conduct a simulation study.
△ Less
Submitted 9 August, 2021; v1 submitted 10 March, 2020;
originally announced March 2020.
-
Convex Analysis for LQG Systems with Applications to Major Minor LQG Mean-Field Game Systems
Authors:
Dena Firoozi,
Sebastian Jaimungal,
Peter E. Caines
Abstract:
We develop a convex analysis approach for solving LQG optimal control problems and apply it to major-minor (MM) LQG mean-field game (MFG) systems. The approach retrieves the best response strategies for the major agent and all minor agents that attain an $ε$-Nash equilibrium. An important and distinctive advantage to this approach is that unlike the classical approach in the literature, we are abl…
▽ More
We develop a convex analysis approach for solving LQG optimal control problems and apply it to major-minor (MM) LQG mean-field game (MFG) systems. The approach retrieves the best response strategies for the major agent and all minor agents that attain an $ε$-Nash equilibrium. An important and distinctive advantage to this approach is that unlike the classical approach in the literature, we are able to avoid imposing assumptions on the evolution of the mean-field. In particular, this provides a tool for dealing with complex and non-standard systems.
△ Less
Submitted 11 June, 2020; v1 submitted 15 October, 2018;
originally announced October 2018.
-
Mean Field Game Systems with Common Noise and Markovian Latent Processes
Authors:
Dena Firoozi,
Peter E. Caines,
Sebastian Jaimungal
Abstract:
In many stochastic games stemming from financial models, the environment evolves with latent factors and there may be common noise across agents' states. Two classic examples are: (i) multi-agent trading on electronic exchanges, and (ii) systemic risk induced through inter-bank lending/borrowing. Moreover, agents' actions often affect the environment, and some agent's may be small while others lar…
▽ More
In many stochastic games stemming from financial models, the environment evolves with latent factors and there may be common noise across agents' states. Two classic examples are: (i) multi-agent trading on electronic exchanges, and (ii) systemic risk induced through inter-bank lending/borrowing. Moreover, agents' actions often affect the environment, and some agent's may be small while others large. Hence sub-population of agents may act as minor agents, while another class may act as major agents. To capture the essence of such problems, here, we introduce a general class of non-cooperative heterogeneous stochastic games with one major agent and a large population of minor agents where agents interact with an observed common process impacted by the mean field. A latent Markov chain and a latent Wiener process (common noise) modulate the common process, and agents cannot observe them. We use filtering techniques coupled with a convex analysis approach to (i) solve the mean field game limit of the problem, (ii) demonstrate that the best response strategies generate an $ε$-Nash equilibrium for finite populations, and (iii) obtain explicit characterisations of the best response strategies.
△ Less
Submitted 23 July, 2019; v1 submitted 20 September, 2018;
originally announced September 2018.
-
Mean Field Games with Partial Information for Algorithmic Trading
Authors:
Philippe Casgrain,
Sebastian Jaimungal
Abstract:
Financial markets are often driven by latent factors which traders cannot observe. Here, we address an algorithmic trading problem with collections of heterogeneous agents who aim to perform optimal execution or statistical arbitrage, where all agents filter the latent states of the world, and their trading actions have permanent and temporary price impact. This leads to a large stochastic game wi…
▽ More
Financial markets are often driven by latent factors which traders cannot observe. Here, we address an algorithmic trading problem with collections of heterogeneous agents who aim to perform optimal execution or statistical arbitrage, where all agents filter the latent states of the world, and their trading actions have permanent and temporary price impact. This leads to a large stochastic game with heterogeneous agents. We solve the stochastic game by investigating its mean-field game (MFG) limit, with sub-populations of heterogeneous agents, and, using a convex analysis approach, we show that the solution is characterized by a vector-valued forward-backward stochastic differential equation (FBSDE). We demonstrate that the FBSDE admits a unique solution, obtain it in closed-form, and characterize the optimal behaviour of the agents in the MFG equilibrium. Moreover, we prove the MFG equilibrium provides an $ε$-Nash equilibrium for the finite player game. We conclude by illustrating the behaviour of agents using the optimal MFG strategy through simulated examples.
△ Less
Submitted 31 March, 2019; v1 submitted 11 March, 2018;
originally announced March 2018.
-
The Generalized Shiryaev's Problem and Skorohod Embedding
Authors:
Sebastian Jaimungal,
Alexander Kreinin,
Angel Valov
Abstract:
In this paper we consider a connection between the famous Skorohod embedding problem and the Shiryaev inverse problem for the first hitting time distribution of a Brownian motion: given a probability distribution, $F$, find a boundary such that the first hitting time distribution is $F$. By randomizing the initial state of the process we show that the inverse problem becomes analytically tractable…
▽ More
In this paper we consider a connection between the famous Skorohod embedding problem and the Shiryaev inverse problem for the first hitting time distribution of a Brownian motion: given a probability distribution, $F$, find a boundary such that the first hitting time distribution is $F$. By randomizing the initial state of the process we show that the inverse problem becomes analytically tractable. The randomization of the initial state allows us to significantly extend the class of target distributions in the case of a linear boundary and moreover allows us to establish connection with the Skorohod embedding problem.
△ Less
Submitted 30 October, 2011;
originally announced October 2011.
-
Randomized First Passage Times
Authors:
Sebastian Jaimungal,
Alex Kreinin,
Angelo Valov
Abstract:
In this article we study a problem related to the first passage and inverse first passage time problems for Brownian motions originally formulated by Jackson, Kreinin and Zhang (2009). Specifically, define $τ_X = \inf\{t>0:W_t + X \le b(t) \}$ where $W_t$ is a standard Brownian motion, then given a boundary function $b:[0,\infty) \to \RR$ and a target measure $μ$ on $[0,\infty)$, we seek the ran…
▽ More
In this article we study a problem related to the first passage and inverse first passage time problems for Brownian motions originally formulated by Jackson, Kreinin and Zhang (2009). Specifically, define $τ_X = \inf\{t>0:W_t + X \le b(t) \}$ where $W_t$ is a standard Brownian motion, then given a boundary function $b:[0,\infty) \to \RR$ and a target measure $μ$ on $[0,\infty)$, we seek the random variable $X$ such that the law of $τ_X$ is given by $μ$. We characterize the solutions, prove uniqueness and existence and provide several key examples associated with the linear boundary.
△ Less
Submitted 21 November, 2009;
originally announced November 2009.
-
Integral Equations and the First Passage Time of Brownian Motions
Authors:
Sebastian Jaimungal,
Alex Kreinin,
Angelo Valov
Abstract:
The first passage time problem for Brownian motions hitting a barrier has been extensively studied in the literature. In particular, many incarnations of integral equations which link the density of the hitting time to the equation for the barrier itself have appeared. Most interestingly, Peskir(2002b) demonstrates that a master integral equation can be used to generate a countable number of new…
▽ More
The first passage time problem for Brownian motions hitting a barrier has been extensively studied in the literature. In particular, many incarnations of integral equations which link the density of the hitting time to the equation for the barrier itself have appeared. Most interestingly, Peskir(2002b) demonstrates that a master integral equation can be used to generate a countable number of new equations via differentiation or integration by parts. In this article, we generalize Peskir's results and provide a more powerful unifying framework for generating integral equations through a new class of martingales. We obtain a continuum of Volterra type integral equations of the first kind and prove uniqueness for a subclass. Furthermore, through the integral equations, we demonstrate how certain functional transforms of the boundary affect the density function. Finally, we demonstrate a fundamental connection between the Volterra integral equations and a class of Fredholm integral equations.
△ Less
Submitted 24 February, 2009; v1 submitted 16 February, 2009;
originally announced February 2009.