-
Rare Event Simulation for Steady-State Probabilities via Recurrency Cycles
Authors:
Krzysztof Bisewski,
Daan Crommelin,
Michel Mandjes
Abstract:
We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space $\mathbb R^d$ and discrete time steps (i.e. a discrete-time $\mathbb R^d$-valued Markov chain). The algorithm, which we coin Recurrent Multilevel Splitting (RMS), relies on the Markov chain's underlying recurrent structure, in combina…
▽ More
We develop a new algorithm for the estimation of rare event probabilities associated with the steady-state of a Markov stochastic process with continuous state space $\mathbb R^d$ and discrete time steps (i.e. a discrete-time $\mathbb R^d$-valued Markov chain). The algorithm, which we coin Recurrent Multilevel Splitting (RMS), relies on the Markov chain's underlying recurrent structure, in combination with the Multilevel Splitting method. Extensive simulation experiments are performed, including experiments with a nonlinear stochastic model that has some characteristics of complex climate models. The numerical experiments show that RMS can boost the computational efficiency by several orders of magnitude compared to the Monte Carlo method.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
-
Continuous Assortment Optimization with Logit Choice Probabilities under Incomplete Information
Authors:
Yannik Peeters,
Arnoud V. den Boer,
Michel Mandjes
Abstract:
We consider assortment optimization over a continuous spectrum of products represented by the unit interval, where the seller's problem consists of determining the optimal subset of products to offer to potential customers. To describe the relation between assortment and customer choice, we propose a probabilistic choice model that forms the continuous counterpart of the widely studied discrete mu…
▽ More
We consider assortment optimization over a continuous spectrum of products represented by the unit interval, where the seller's problem consists of determining the optimal subset of products to offer to potential customers. To describe the relation between assortment and customer choice, we propose a probabilistic choice model that forms the continuous counterpart of the widely studied discrete multinomial logit model. We consider the seller's problem under incomplete information, propose a stochastic-approximation type of policy, and show that its regret -- its performance loss compared to the optimal policy -- is only logarithmic in the time horizon. We complement this result by showing a matching lower bound on the regret of any policy, implying that our policy is asymptotically optimal. We then show that adding a capacity constraint significantly changes the structure of the problem: we construct a policy and show that its regret after $T$ time periods is bounded above by a constant times $T^{2/3}$ (up to a logarithmic term); in addition, we show that the regret of any policy is bounded from below by a positive constant times $T^{2/3}$, so that also in the capacitated case we obtain asymptotic optimality. Numerical illustrations show that our policies outperform or are on par with alternatives.
△ Less
Submitted 14 April, 2021; v1 submitted 17 July, 2018;
originally announced July 2018.
-
Estimation of Local Degree Distributions via Local Weighted Averaging and Monte Carlo Cross-Validation
Authors:
Paulo Serra,
Michel Mandjes
Abstract:
Owing to their capability of summarising interactions between elements of a system, networks have become a common type of data in many fields. As networks can be inhomogeneous, in that different regions of the network may exhibit different topologies, an important topic concerns their local properties. This paper focuses on the estimation of the local degree distribution of a vertex in an inhomoge…
▽ More
Owing to their capability of summarising interactions between elements of a system, networks have become a common type of data in many fields. As networks can be inhomogeneous, in that different regions of the network may exhibit different topologies, an important topic concerns their local properties. This paper focuses on the estimation of the local degree distribution of a vertex in an inhomogeneous network. The contributions are twofold: we propose an estimator based on local weighted averaging, and we set up a Monte Carlo cross-validation procedure to pick the parameters of this estimator. Under a specific modelling assumption we derive an oracle inequality that shows how the model parameters affect the precision of the estimator. We illustrate our method by several numerical experiments, on both real and synthetic data, showing in particular that the approach considerably improves upon the natural, empirical estimator.
△ Less
Submitted 26 February, 2018;
originally announced February 2018.
-
Dimension Estimation Using Random Connection Models
Authors:
Paulo Serra,
Michel Mandjes
Abstract:
Information about intrinsic dimension is crucial to perform dimensionality reduction, compress information, design efficient algorithms, and do statistical adaptation. In this paper we propose an estimator for the intrinsic dimension of a data set. The estimator is based on binary neighbourhood information about the observations in the form of two adjacency matrices, and does not require any expli…
▽ More
Information about intrinsic dimension is crucial to perform dimensionality reduction, compress information, design efficient algorithms, and do statistical adaptation. In this paper we propose an estimator for the intrinsic dimension of a data set. The estimator is based on binary neighbourhood information about the observations in the form of two adjacency matrices, and does not require any explicit distance information. The underlying graph is modelled according to a subset of a specific random connection model, sometimes referred to as the Poisson blob model. Computationally the estimator scales like n log n, and we specify its asymptotic distribution and rate of convergence. A simulation study on both real and simulated data shows that our approach compares favourably with some competing methods from the literature, including approaches that rely on distance information.
△ Less
Submitted 8 November, 2017;
originally announced November 2017.
-
Controlling the time discretization bias for the supremum of Brownian Motion
Authors:
Krzysztof Bisewski,
Daan Crommelin,
Michel Mandjes
Abstract:
We consider the bias arising from time discretization when estimating the threshold crossing probability $w(b) := \mathbb{P}(\sup_{t\in[0,1]} B_t > b)$, with $(B_t)_{t\in[0,1]}$ a standard Brownian Motion. We prove that if the discretization is equidistant, then to reach a given target value of the relative bias, the number of grid points has to grow quadratically in $b$, as $b$ grows. When consid…
▽ More
We consider the bias arising from time discretization when estimating the threshold crossing probability $w(b) := \mathbb{P}(\sup_{t\in[0,1]} B_t > b)$, with $(B_t)_{t\in[0,1]}$ a standard Brownian Motion. We prove that if the discretization is equidistant, then to reach a given target value of the relative bias, the number of grid points has to grow quadratically in $b$, as $b$ grows. When considering non-equidistant discretizations (with threshold-dependent grid points), we can substantially improve on this: we show that for such grids the required number of grid points is independent of $b$, and in addition we point out how they can be used to construct a strongly efficient algorithm for the estimation of $w(b)$. Finally, we show how to apply the resulting algorithm for a broad class of stochastic processes; it is empirically shown that the threshold-dependent grid significantly outperforms its equidistant counterpart.
△ Less
Submitted 13 September, 2017; v1 submitted 18 May, 2017;
originally announced May 2017.
-
Convergence rates of Laplace-transform based estimators
Authors:
Arnoud V. den Boer,
Michel Mandjes
Abstract:
This paper considers the problem of estimating probabilities of the form $\mathbb{P}(Y \leq w)$, for a given value of $w$, in the situation that a sample of i.i.d.\ observations $X_1, \ldots, X_n$ of $X$ is available, and where we explicitly know a functional relation between the Laplace transforms of the non-negative random variables $X$ and $Y$. A plug-in estimator is constructed by calculating…
▽ More
This paper considers the problem of estimating probabilities of the form $\mathbb{P}(Y \leq w)$, for a given value of $w$, in the situation that a sample of i.i.d.\ observations $X_1, \ldots, X_n$ of $X$ is available, and where we explicitly know a functional relation between the Laplace transforms of the non-negative random variables $X$ and $Y$. A plug-in estimator is constructed by calculating the Laplace transform of the empirical distribution of the sample $X_1, \ldots, X_n$, applying the functional relation to it, and then (if possible) inverting the resulting Laplace transform and evaluating it in $w$. We show, under mild regularity conditions, that the resulting estimator is weakly consistent and has expected absolute estimation error $O(n^{-1/2} \log(n+1))$. We illustrate our results by two examples: in the first we estimate the distribution of the workload in an M/G/1 queue from observations of the input in fixed time intervals, and in the second we identify the distribution of the increments when observing a compound Poisson process at equidistant points in time (usually referred to as `decompounding').
△ Less
Submitted 29 January, 2016; v1 submitted 25 September, 2014;
originally announced September 2014.
