-
Flexible forward improvement iteration for infinite time horizon Markovian optimal stopping problems
Authors:
Sören Christensen,
Albrecht Irle,
Julian Peter Lemburg
Abstract:
In this paper, we propose an extension of the forward improvement iteration algorithm, originally introduced in Irle (2006) and recently reconsidered in Miclo and Villeneuve (2021). The main new ingredient is a flexible window parameter describing the look-ahead distance in the improvement step. We consider the framework of a Markovian optimal stopping problem in discrete time with random discount…
▽ More
In this paper, we propose an extension of the forward improvement iteration algorithm, originally introduced in Irle (2006) and recently reconsidered in Miclo and Villeneuve (2021). The main new ingredient is a flexible window parameter describing the look-ahead distance in the improvement step. We consider the framework of a Markovian optimal stopping problem in discrete time with random discounting and infinite time horizon. We prove convergence and show that the additional flexibility may significantly reduce the runtime.
△ Less
Submitted 26 November, 2021;
originally announced November 2021.
-
A General Method for Finding the Optimal Threshold in Discrete Time
Authors:
Sören Christensen,
Albrecht Irle
Abstract:
We develop an approach for solving one-sided optimal stopping problems in discrete time for general underlying Markov processes on the real line. The main idea is to transform the problem into an auxiliary problem for the ladder height variables. In case that the original problem has a one-sided solution and the auxiliary problem has a monotone structure, the corresponding myopic stopping time is…
▽ More
We develop an approach for solving one-sided optimal stopping problems in discrete time for general underlying Markov processes on the real line. The main idea is to transform the problem into an auxiliary problem for the ladder height variables. In case that the original problem has a one-sided solution and the auxiliary problem has a monotone structure, the corresponding myopic stopping time is optimal for the original problem as well. This elementary line of argument directly leads to a characterization of the optimal boundary in the original problem: The optimal threshold is given by the threshold of the myopic stopping time in the auxiliary problem. Supplying also a sufficient condition for our approach to work, we obtain solutions for many prominent examples in the literature, among others the problems of Novikov-Shiryaev, Shepp-Shiryaev, and the American put in option pricing under general conditions. As a further application we show that for underlying random walks (and Lévy processes in continuous time), the reward functions $g$ leading to one-sided stopping problems are exactly the monotone and log-concave functions.
△ Less
Submitted 26 October, 2018; v1 submitted 23 October, 2017;
originally announced October 2017.
-
The Monotone Case Approach for the Solution of Certain Multidimensional Optimal Stopping Problems
Authors:
Sören Christensen,
Albrecht Irle
Abstract:
This paper studies explicitly solvable multidimensional optimal stopping problems of sum- and product-type in discrete and continuous time using the monotone case approach. It gives a review on monotone case stopping using the Doob decomposition, resp. Doob-Meyer decomposition in continuous time, also in its multiplicative versions. The approach via these decompositions leads to explicit solutions…
▽ More
This paper studies explicitly solvable multidimensional optimal stopping problems of sum- and product-type in discrete and continuous time using the monotone case approach. It gives a review on monotone case stopping using the Doob decomposition, resp. Doob-Meyer decomposition in continuous time, also in its multiplicative versions. The approach via these decompositions leads to explicit solutions for a variety of examples, including multidimensional versions of the house-selling and burglar's problem, the Poisson disorder problem, and an optimal investment problem.
△ Less
Submitted 3 June, 2019; v1 submitted 4 May, 2017;
originally announced May 2017.
-
Optimal portfolio selection under vanishing fixed transaction costs
Authors:
Sören Christensen,
Albrecht Irle,
Andreas Ludwig
Abstract:
In this paper, asymptotic results in a long-term growth rate portfolio optimization model under both fixed and proportional transaction costs are obtained. More precisely, the convergence of the model when the fixed costs tend to zero is investigated. A suitable limit model with purely proportional costs is introduced and an optimal strategy is shown to consist of keeping the risky fraction proces…
▽ More
In this paper, asymptotic results in a long-term growth rate portfolio optimization model under both fixed and proportional transaction costs are obtained. More precisely, the convergence of the model when the fixed costs tend to zero is investigated. A suitable limit model with purely proportional costs is introduced and an optimal strategy is shown to consist of keeping the risky fraction process in a unique interval $[A,B]\subseteq\,]0,1[$ with minimal effort. Furthermore, the convergence of optimal boundaries, asymptotic growth rates, and optimal risky fraction processes is rigorously proved. The results are based on an in-depth analysis of the convergence of the solutions to the corresponding HJB-equations.
△ Less
Submitted 6 July, 2017; v1 submitted 4 November, 2016;
originally announced November 2016.
-
Classification error in multiclass discrimination from Markov data
Authors:
Sören Christensen,
Albrecht Irle,
Lars Willert
Abstract:
As a model for an on-line classification setting we consider a stochastic process $(X_{-n},Y_{-n})_{n}$, the present time-point being denoted by 0, with observables $ \ldots,X_{-n},X_{-n+1},\ldots, X_{-1}, X_0$ from which the pattern $Y_0$ is to be inferred. So in this classification setting, in addition to the present observation $X_0$ a number $l$ of preceding observations may be used for classi…
▽ More
As a model for an on-line classification setting we consider a stochastic process $(X_{-n},Y_{-n})_{n}$, the present time-point being denoted by 0, with observables $ \ldots,X_{-n},X_{-n+1},\ldots, X_{-1}, X_0$ from which the pattern $Y_0$ is to be inferred. So in this classification setting, in addition to the present observation $X_0$ a number $l$ of preceding observations may be used for classification, thus taking a possible dependence structure into account as it occurs e.g. in an ongoing classification of handwritten characters. We treat the question how the performance of classifiers is improved by using such additional information. For our analysis, a hidden Markov model is used. Letting $R_l$ denote the minimal risk of misclassification using $l$ preceding observations we show that the difference $\sup_k |R_l - R_{l+k}|$ decreases exponentially fast as $l$ increases. This suggests that a small $l$ might already lead to a noticeable improvement. To follow this point we look at the use of past observations for kernel classification rules. Our practical findings in simulated hidden Markov models and in the classification of handwritten characters indicate that using $l=1$, i.e. just the last preceding observation in addition to $X_0$, can lead to a substantial reduction of the risk of misclassification. So, in the presence of stochastic dependencies, we advocate to use $ X_{-1},X_0$ for finding the pattern $Y_0$ instead of only $X_0$ as one would in the independent situation.
△ Less
Submitted 22 September, 2015;
originally announced September 2015.
-
Convergence of switching diffusions
Authors:
Sören Christensen,
Albrecht Irle
Abstract:
This paper studies the asymptotic behavior of processes with switching. More precisely, the stability under fast switching for diffusion processes and discrete state space Markovian processes is considered. The proofs are based on semimartingale techniques, so that no Markovian assumption for the modulating process is needed.
This paper studies the asymptotic behavior of processes with switching. More precisely, the stability under fast switching for diffusion processes and discrete state space Markovian processes is considered. The proofs are based on semimartingale techniques, so that no Markovian assumption for the modulating process is needed.
△ Less
Submitted 26 November, 2014; v1 submitted 4 March, 2014;
originally announced March 2014.
-
Optimal multiple stopping with random waiting times
Authors:
Sören Christensen,
Albrecht Irle,
Stephan Jürgens
Abstract:
In the standard models for optimal multiple stopping problems it is assumed that between two exercises there is always a time period of deterministic length $δ$, the so called refraction period. This prevents the optimal exercise times from bunching up together on top of the optimal stopping time for the one-exercise case. In this article we generalize the standard model by considering random refr…
▽ More
In the standard models for optimal multiple stopping problems it is assumed that between two exercises there is always a time period of deterministic length $δ$, the so called refraction period. This prevents the optimal exercise times from bunching up together on top of the optimal stopping time for the one-exercise case. In this article we generalize the standard model by considering random refraction times. We develop the theory and reduce the problem to a sequence of ordinary stopping problems thus extending the results for deterministic times. This requires an extension of the underlying filtrations in general. Furthermore we consider the Markovian case and treat an example explicitly.
△ Less
Submitted 9 May, 2012;
originally announced May 2012.
