Rare Event Simulation for Steady-State Probabilities via Recurrency Cycles
Authors:
Krzysztof Bisewski,
Daan Crommelin,
Michel Mandjes
Abstract:
We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space $\mathbb R^d$ and discrete time steps (i.e. a discrete-time $\mathbb R^d$-valued Markov chain). The algorithm, which we coin Recurrent Multilevel Splitting (RMS), relies on the Markov chain's underlying recurrent structure, in combina…
▽ More
We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space $\mathbb R^d$ and discrete time steps (i.e. a discrete-time $\mathbb R^d$-valued Markov chain). The algorithm, which we coin Recurrent Multilevel Splitting (RMS), relies on the Markov chain's underlying recurrent structure, in combination with the Multilevel Splitting method. Extensive simulation experiments are performed, including experiments with a nonlinear stochastic model that has some characteristics of complex climate models. The numerical experiments show that RMS can boost the computational efficiency by several orders of magnitude compared to the Monte Carlo method.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
Controlling the time discretization bias for the supremum of Brownian Motion
Authors:
Krzysztof Bisewski,
Daan Crommelin,
Michel Mandjes
Abstract:
We consider the bias arising from time discretization when estimating the threshold crossing probability $w(b) := \mathbb{P}(\sup_{t\in[0,1]} B_t > b)$, with $(B_t)_{t\in[0,1]}$ a standard Brownian Motion. We prove that if the discretization is equidistant, then to reach a given target value of the relative bias, the number of grid points has to grow quadratically in $b$, as $b$ grows. When consid…
▽ More
We consider the bias arising from time discretization when estimating the threshold crossing probability $w(b) := \mathbb{P}(\sup_{t\in[0,1]} B_t > b)$, with $(B_t)_{t\in[0,1]}$ a standard Brownian Motion. We prove that if the discretization is equidistant, then to reach a given target value of the relative bias, the number of grid points has to grow quadratically in $b$, as $b$ grows. When considering non-equidistant discretizations (with threshold-dependent grid points), we can substantially improve on this: we show that for such grids the required number of grid points is independent of $b$, and in addition we point out how they can be used to construct a strongly efficient algorithm for the estimation of $w(b)$. Finally, we show how to apply the resulting algorithm for a broad class of stochastic processes; it is empirically shown that the threshold-dependent grid significantly outperforms its equidistant counterpart.
△ Less
Submitted 13 September, 2017; v1 submitted 18 May, 2017;
originally announced May 2017.