Showing 1–5 of 5 results for author: Mguni, D

Stochastic Potential Games

Authors: David Mguni

Abstract: Computing the Nash equilibrium (NE) for N-player non-zerosum stochastic games is a formidable challenge. Currently, algorithmic methods in stochastic game theory are unable to compute NE for stochastic games (SGs) for settings in all but extreme cases in which the players either play as a team or have diametrically opposed objectives in a two-player setting. This greatly impedes the application of… ▽ More Computing the Nash equilibrium (NE) for N-player non-zerosum stochastic games is a formidable challenge. Currently, algorithmic methods in stochastic game theory are unable to compute NE for stochastic games (SGs) for settings in all but extreme cases in which the players either play as a team or have diametrically opposed objectives in a two-player setting. This greatly impedes the application of the SG framework to numerous problems within economics and practical systems of interest. In this paper, we provide a method of computing Nash equilibria in nonzero-sum settings and for populations of players more than two. In particular, we identify a subset of SGs known as stochastic potential games (SPGs) for which the (Markov perfect) Nash equilibrium can be computed tractably and in polynomial time. Unlike SGs for which, in general, computing the NE is PSPACE-hard, we show that SGs with the potential property are P-Complete. We further demonstrate that for each SPG there is a dual Markov decision process whose solution coincides with the MP-NE of the SPG. We lastly provide algorithms that tractably compute the MP-NE for SGs with more than two players. △ Less

Submitted 24 March, 2021; v1 submitted 27 May, 2020; originally announced May 2020.

Comments: The submission contains an overlap with and has been superseded by arXiv:2103.09284

Duopoly Investment Problems with Minimally Bounded Adjustment Costs

Authors: David Mguni

Abstract: In this paper, we study two-player investment problems with investment costs that are bounded below by some fixed positive constant. We seek a description of optimal investment strategies for a duopoly problem in which two firms invest in advertising projects to abstract market share from the rival firm. We show that the problem can be formulated as a stochastic differential game in which players… ▽ More In this paper, we study two-player investment problems with investment costs that are bounded below by some fixed positive constant. We seek a description of optimal investment strategies for a duopoly problem in which two firms invest in advertising projects to abstract market share from the rival firm. We show that the problem can be formulated as a stochastic differential game in which players modify a jump-diffusion process using impulse controls. We prove that the value of the game may be represented as a solution to a double obstacle quasi-variational inequality and derive a PDE characterisation (HJBI equation) of the value of the game. We characterise both the saddle point equilibrium and a Nash equilibrium for the zero-sum and non-zero-sum payoff games. △ Less

Submitted 3 October, 2019; v1 submitted 28 May, 2018; originally announced May 2018.

Comments: arXiv admin note: text overlap with arXiv:1805.01578

Optimal Capital Injections with the Risk of Ruin: A Stochastic Differential Game of Impulse Control and Stopping Approach

Authors: David Mguni

Abstract: We consider an investment problem in which an investor performs capital injections to increase the liquidity of a firm for it to maximise profit from market operations. Each time the investor performs an injection, the investor incurs a fixed transaction cost. In addition to maximising their terminal reward, the investor seeks to minimise the risk of loss of their investment (from a possible firm… ▽ More We consider an investment problem in which an investor performs capital injections to increase the liquidity of a firm for it to maximise profit from market operations. Each time the investor performs an injection, the investor incurs a fixed transaction cost. In addition to maximising their terminal reward, the investor seeks to minimise the risk of loss of their investment (from a possible firm ruin) by exiting the market at some point in time. We show that the problem can be reformulated in terms of a new stochastic differential game of control and stopping in which one of the players modifies a (jump-)diffusion process using impulse controls and an adversary chooses a stopping time to end the game. We show that the value of this game can be computed by solving a double obstacle problem described by a quasi-variational inequality. We then characterise the value of the game via a set of HJBI equations, considering both games with zero-sum and non-zero-sum payoff structures. Our last result demonstrates that the solution to the investment problem is recoverable from the Nash equilibrium strategies of the game. △ Less

Submitted 3 October, 2019; v1 submitted 2 May, 2018; originally announced May 2018.

Optimal Selection of Transaction Costs in a Dynamic Principal-Agent Problem

Authors: David Mguni

Abstract: Environments with fixed adjustment costs such as transaction costs or \lq menu costs\rq$ $ are widespread within economic systems. The presence of fixed minimal adjustment costs produces adjustment stickiness so that agents must choose a sequence of points at which time to perform their actions. This paper performs an analysis of the effect of transaction costs on agent behaviour within a dynamic… ▽ More Environments with fixed adjustment costs such as transaction costs or \lq menu costs\rq$ $ are widespread within economic systems. The presence of fixed minimal adjustment costs produces adjustment stickiness so that agents must choose a sequence of points at which time to perform their actions. This paper performs an analysis of the effect of transaction costs on agent behaviour within a dynamic optimisation problem by way of introducing the theory of incentive design to optimal stochastic impulse control. The setup consists of an agent that maximises their utility by performing a sequence of purchases of some consumable good over some time horizon whilst facing transaction costs and a Principal that chooses the agent's transaction costs. This results in a dynamic Principal-Agent model in which the agent uses impulse controls to perform adjustments to their cash-flow process. We address the question of which fixed value of the transaction cost the Principal must choose to induce a desired behaviour from the agent. We study the effect of changes to the transaction cost and show that with an appropriate choice of transaction cost, the agent's preferences can be sufficiently distorted so that the agent finds it optimal to maximise the Principal's objective even when the agent's cash-flow is unobserved by the Principal. △ Less

Submitted 8 October, 2019; v1 submitted 2 May, 2018; originally announced May 2018.

A Viscosity Approach to Stochastic Differential Games of Control and Stopping Involving Impulsive Control

Authors: David Mguni

Abstract: This paper analyses a stochastic differential game of control and stopping in which one of the players modifies a diffusion process using impulse controls, an adversary then chooses a stopping time to end the game. The paper firstly establishes the regularity and boundedness of the upper and lower value functions from which an appropriate variant of the dynamic programming principle (DPP) is deriv… ▽ More This paper analyses a stochastic differential game of control and stopping in which one of the players modifies a diffusion process using impulse controls, an adversary then chooses a stopping time to end the game. The paper firstly establishes the regularity and boundedness of the upper and lower value functions from which an appropriate variant of the dynamic programming principle (DPP) is derived. It is then proven that the upper and lower value functions coincide so that the game admits a value and that the value of the game is a unique viscosity solution to a HJBI equation described by a double obstacle quasi-integro-variational inequality. △ Less

Submitted 3 October, 2019; v1 submitted 30 March, 2018; originally announced March 2018.