-
Optimal stopping for Markov processes with positive jumps
Authors:
Fabian Crocce,
Ernesto Mordecki
Abstract:
Consider the discounted optimal stopping problem for a real valued Markov process with only positive jumps. We provide a theorem to verify that the optimal stopping region has the form {x >= x^*} for some critical threshold x^*, and a representation formula for the value function of the problem in terms of the Green kernel of the process, based on Dynkin's characterization of the value function as…
▽ More
Consider the discounted optimal stopping problem for a real valued Markov process with only positive jumps. We provide a theorem to verify that the optimal stopping region has the form {x >= x^*} for some critical threshold x^*, and a representation formula for the value function of the problem in terms of the Green kernel of the process, based on Dynkin's characterization of the value function as the least excessive majorant. As an application of our results, using the Fourier transform to compute the Green kernel of the process, we solve a new example: the optimal stopping for a Levy-driven Ornstein-Uhlenbeck process used to model prices in electricity markets.
△ Less
Submitted 13 November, 2024;
originally announced November 2024.
-
An algorithm to solve optimal stopping problems for one-dimensional diffusions
Authors:
Fabián Crocce,
Ernesto Mordecki
Abstract:
Considering a real-valued diffusion, a real-valued reward function and a positive discount rate, we provide an algorithm to solve the optimal stopping problem consisting in finding the optimal expected discounted reward and the optimal stopping time at which it is attained. Our approach is based on Dynkin's characterization of the value function. The combination of Riesz's representation of $α$-ex…
▽ More
Considering a real-valued diffusion, a real-valued reward function and a positive discount rate, we provide an algorithm to solve the optimal stopping problem consisting in finding the optimal expected discounted reward and the optimal stopping time at which it is attained. Our approach is based on Dynkin's characterization of the value function. The combination of Riesz's representation of $α$-excessive functions and the inversion formula gives the density of the representing measure, being only necessary to determine its support. This last task is accomplished through an algorithm. The proposed method always arrives to the solution, thus no verification is needed, giving, in particular, the shape of the stopping region. Generalizations to diffusions with atoms in the speed measure and to non smooth payoffs are analyzed.
△ Less
Submitted 23 September, 2019;
originally announced September 2019.
-
A non-iterative algorithm for generalized Pig games
Authors:
Fabián Crocce,
Ernesto Mordecki
Abstract:
We provide a polynomial algorithm to find the value and an optimal strategy for a generalization of the Pig game. Modeled as a competitive Markov decision process, the corresponding Bellman equations can be decoupled leading to systems of two non-linear equations with two unknowns. In this way we avoid the classical iterative approaches. A simple complexity analysis reveals that the algorithm requ…
▽ More
We provide a polynomial algorithm to find the value and an optimal strategy for a generalization of the Pig game. Modeled as a competitive Markov decision process, the corresponding Bellman equations can be decoupled leading to systems of two non-linear equations with two unknowns. In this way we avoid the classical iterative approaches. A simple complexity analysis reveals that the algorithm requires O(s log(s)) steps, where s is the number of states of the game. The classical Pig and the Piglet (a simple variant of the Pig played with a coin) are examined in detail.
△ Less
Submitted 20 August, 2018;
originally announced August 2018.
-
On optimal stopping of multidimensional diffusions
Authors:
Sören Christensen,
Fabián Crocce,
Ernesto Mordecki,
Paavo Salminen
Abstract:
This paper develops an approach for solving perpetual discounted optimal stopping problems for multidimensional diffusions, with special emphasis on the $d$-dimensional Wiener process. We first obtain some verification theorems for diffusions, based on the Green kernel representation of the value function associated with the problem. Specializing to the multidimensional Wiener process, we apply th…
▽ More
This paper develops an approach for solving perpetual discounted optimal stopping problems for multidimensional diffusions, with special emphasis on the $d$-dimensional Wiener process. We first obtain some verification theorems for diffusions, based on the Green kernel representation of the value function associated with the problem. Specializing to the multidimensional Wiener process, we apply the Martin boundary theory to obtain a set of tractable integral equations involving only harmonic functions that characterize the stopping region of the problem. These equations allow to formulate a discretization scheme to obtain an approximate solution. The approach is illustrated through the optimal stopping problem of a $d$-dimensional Wiener process with a positive definite quadratic form reward function.
△ Less
Submitted 3 November, 2016;
originally announced November 2016.
-
Error analysis in Fourier methods for option pricing
Authors:
Fabián Crocce,
Juho Häppölä,
Jonas Kiessling,
Raúl Tempone
Abstract:
We provide a bound for the error committed when using a Fourier method to price European options when the underlying follows an exponential \levy dynamic. The price of the option is described by a partial integro-differential equation (PIDE). Applying a Fourier transformation to the PIDE yields an ordinary differential equation that can be solved analytically in terms of the characteristic exponen…
▽ More
We provide a bound for the error committed when using a Fourier method to price European options when the underlying follows an exponential \levy dynamic. The price of the option is described by a partial integro-differential equation (PIDE). Applying a Fourier transformation to the PIDE yields an ordinary differential equation that can be solved analytically in terms of the characteristic exponent of the \levy process. Then, a numerical inverse Fourier transform allows us to obtain the option price. We present a novel bound for the error and use this bound to set the parameters for the numerical method. We analyse the properties of the bound for a dissipative and pure-jump example. The bound presented is independent of the asymptotic behaviour of option prices at extreme asset prices. The error bound can be decomposed into a product of terms resulting from the dynamics and the option payoff, respectively. The analysis is supplemented by numerical examples that demonstrate results comparable to and superior to the existing literature.
△ Less
Submitted 29 November, 2015; v1 submitted 27 February, 2015;
originally announced March 2015.
-
Optimal Stopping for Strong Markov Processes: Explicit solutions and verification theorems for diffusions, multidimensional diffusions, and jump-processes
Authors:
Fabián Crocce
Abstract:
We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow, has two main components: the Dynkin's characterization of the value function as the smallest excessive function dominating the reward; and the Riesz representati…
▽ More
We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow, has two main components: the Dynkin's characterization of the value function as the smallest excessive function dominating the reward; and the Riesz representation of excessive functions in terms of the Green kernel, the main reference being Salminen 85. In the context of one-dimensional diffusions we give a complete characterization of the solution under some assumptions on the reward function. If the optimal stopping problem is a ray, we provide a simple equation to find the boundary and discuss the validity of the smooth fit principle. We include some new examples as the optimal stopping of the skew Brownian motion and the sticky Brownian motion. In particular, we consider cases in which the smooth fit principle fails. In the general case, we propose an algorithm that finds the optimal stopping region when it is a disjoint union of intervals. We also give a simple formula for the value function. Using this algorithm we solve some examples including polynomial rewards. For general Markov processes with continuous sample paths (for instance multidimensional diffusions) we provide a verification theorem and use it to solve a particular problem. Finally we consider one-dimensional strong Markov processes with only positive (or only negative) jumps, and provide another verification theorem for right-sided (left-sided) problems. As applications of our results we address the problem of pricing an American put option in a Lévy market, and also solve an optimal stopping problem for a Lévy driven Ornstein-Uhlenbeck process.
△ Less
Submitted 29 May, 2014;
originally announced May 2014.
-
A finite exact algorithm to solve a dice game
Authors:
Fabián Crocce,
Ernesto Mordecki
Abstract:
We provide an algorithm to find the value and an optimal strategy of the solitaire variant of the Ten Thousand dice game in the framework of Markov Control Processes. Once an optimal critical threshold is found, the set of non-stopping states of the game becomes finite, and the solution is found by a backwards algorithm that gives the values for each one of these states of the game. The algorithm…
▽ More
We provide an algorithm to find the value and an optimal strategy of the solitaire variant of the Ten Thousand dice game in the framework of Markov Control Processes. Once an optimal critical threshold is found, the set of non-stopping states of the game becomes finite, and the solution is found by a backwards algorithm that gives the values for each one of these states of the game. The algorithm is finite and exact.The idea to find the critical threshold comes from the continuous pasting condition used in optimal stopping problems for continuous-time processes with jumps.
△ Less
Submitted 29 May, 2014;
originally announced May 2014.
-
Explicit solutions in one-sided optimal stopping problems for one-dimensional diffusions
Authors:
Fabián Crocce,
Ernesto Mordecki
Abstract:
Consider the optimal stopping problem of a one-dimensional diffusion with positive discount. Based on Dynkin's characterization of the value as the minimal excessive majorant of the reward and considering its Riesz representation, we give an explicit equation to find the optimal stopping threshold for problems with one-sided stopping regions, and an explicit formula for the value function of the p…
▽ More
Consider the optimal stopping problem of a one-dimensional diffusion with positive discount. Based on Dynkin's characterization of the value as the minimal excessive majorant of the reward and considering its Riesz representation, we give an explicit equation to find the optimal stopping threshold for problems with one-sided stopping regions, and an explicit formula for the value function of the problem. This representation also gives light on the validity of the smooth fit principle. The results are illustrated by solving some classical problems, and also through the solution of: optimal stopping of the skew Brownian motion, and optimal stopping of the sticky Brownian motion, including cases in which the smooth fit principle fails.
△ Less
Submitted 2 July, 2013; v1 submitted 4 February, 2013;
originally announced February 2013.
-
Optimal minimax strategy in a dice game
Authors:
Fabian Crocce,
Ernesto Mordecki
Abstract:
Each of two players, by turns, rolls a dice several times accumulating the successive scores until he decides to stop, or he rolls an ace. When stopping, the accumulated turn score is added to the player account and the dice is given to his opponent. If he rolls an ace, the dice is given to the opponent without adding any point. In this paper we formulate this game in the framework of competitiv…
▽ More
Each of two players, by turns, rolls a dice several times accumulating the successive scores until he decides to stop, or he rolls an ace. When stopping, the accumulated turn score is added to the player account and the dice is given to his opponent. If he rolls an ace, the dice is given to the opponent without adding any point. In this paper we formulate this game in the framework of competitive Markov decision processes (also known as stochastic games), show that the game has a value, provide an algorithm to compute the optimal minimax strategy, and present results of this algorithm in three different variants of the game.
△ Less
Submitted 30 December, 2009;
originally announced December 2009.
