-
New exponential dispersion models for count data -- the ABM and LM classes
Authors:
Shaul K. Bar-Lev,
Ad Ridder
Abstract:
In their fundamental paper on cubic variance functions, Letac and Mora (The Annals of Statistics,1990) presented a systematic, rigorous and comprehensive study of natural exponential families on the real line, their characterization through their variance functions and mean value parameterization. They presented a section that for some reason has been left unnoticed. This section deals with the co…
▽ More
In their fundamental paper on cubic variance functions, Letac and Mora (The Annals of Statistics,1990) presented a systematic, rigorous and comprehensive study of natural exponential families on the real line, their characterization through their variance functions and mean value parameterization. They presented a section that for some reason has been left unnoticed. This section deals with the construction of variance functions associated with natural exponential families of counting distributions on the set of nonnegative integers and allows to find the corresponding generating measures. As exponential dispersion models are based on natural exponential families, we introduce in this paper two new classes of exponential dispersion models based on their results. For these classes, which are associated with simple variance functions, we derive their mean value parameterization and their associated generating measures. We also prove that they have some desirable properties. Both classes are shown to be overdispersed and zero-inflated in ascending order, making them as competitive statistical models for those in use in both, statistical and actuarial modeling. To our best knowledge, the classes of counting distributions we present in this paper, have not been introduced or discussed before in the literature. To show that our classes can serve as competitive statistical models for those in use (e.g., Poisson, Negative binomial), we include a numerical example of real data. In this example, we compare the performance of our classes with relevant competitive models.
△ Less
Submitted 3 February, 2021; v1 submitted 30 March, 2020;
originally announced March 2020.
-
Monte Carlo Methods for Insurance Risk Computation
Authors:
Shaul Bar-Lev,
Ad Ridder
Abstract:
In this paper we consider the problem of computing tail probabilities of the distribution of a random sum of positive random variables. We assume that the individual variables follow a reproducible natural exponential family (NEF) distribution, and that the random number has a NEF counting distribution with a cubic variance function. This specific modelling is supported by data of the aggregated c…
▽ More
In this paper we consider the problem of computing tail probabilities of the distribution of a random sum of positive random variables. We assume that the individual variables follow a reproducible natural exponential family (NEF) distribution, and that the random number has a NEF counting distribution with a cubic variance function. This specific modelling is supported by data of the aggregated claim distribution of an insurance company. Large tail probabilities are important as they reflect the risk of large losses, however, analytic or numerical expressions are not available. We propose several simulation algorithms which are based on an asymptotic analysis of the distribution of the counting variable and on the reproducibility property of the claim distribution. The aggregated sum is simulated efficiently by importancesampling using an exponential cahnge of measure. We conclude by numerical experiments of these algorithms.
△ Less
Submitted 5 July, 2018;
originally announced July 2018.
-
Counting with Combined Splitting and Capture-Recapture Methods
Authors:
Paul Dupuis,
Bahar Kaynar,
Ad Ridder,
Reuven Rubinstein,
Radislav Vaisman
Abstract:
We apply the splitting method to three well-known counting problems, namely 3-SAT, random graphs with prescribed degrees, and binary contingency tables. We present an enhanced version of the splitting method based on the capture-recapture technique, and show by experiments the superiority of this technique for SAT problems in terms of variance of the associated estimators, and speed of the algorit…
▽ More
We apply the splitting method to three well-known counting problems, namely 3-SAT, random graphs with prescribed degrees, and binary contingency tables. We present an enhanced version of the splitting method based on the capture-recapture technique, and show by experiments the superiority of this technique for SAT problems in terms of variance of the associated estimators, and speed of the algorithms.
△ Less
Submitted 31 March, 2011;
originally announced March 2011.
-
Approximate results for a generalized secretary problem
Authors:
Chris Dietz,
Dinard van der Laan,
Ad Ridder
Abstract:
A version of the classical secretary problem is studied, in which one is interested in selecting one of the b best out of a group of n differently ranked persons who are presented one by one in a random order. It is assumed that b is a preassigned (natural) number. It is known, already for a long time, that for the optimal policy one needs to compute b position thresholds, for instance via backwar…
▽ More
A version of the classical secretary problem is studied, in which one is interested in selecting one of the b best out of a group of n differently ranked persons who are presented one by one in a random order. It is assumed that b is a preassigned (natural) number. It is known, already for a long time, that for the optimal policy one needs to compute b position thresholds, for instance via backwards induction. In this paper we study approximate policies, that use just a single or a double position threshold, albeit in conjunction with a level rank. We give exact and asymptotic (as n tends to infinity) results, which show that the double-level policy is an extremely accurate approximation.
△ Less
Submitted 3 September, 2010;
originally announced September 2010.
-
Asymptotic optimality of the cross-entropy method for Markov chain problems
Authors:
Ad Ridder
Abstract:
The correspondence between the cross-entropy method and the zero-variance approximation to simulate a rare event problem in Markov chains is shown. This leads to a sufficient condition that the cross-entropy estimator is asymptotically optimal.
The correspondence between the cross-entropy method and the zero-variance approximation to simulate a rare event problem in Markov chains is shown. This leads to a sufficient condition that the cross-entropy estimator is asymptotically optimal.
△ Less
Submitted 9 March, 2010;
originally announced March 2010.
-
Finite-state Markov Chains obey Benford's Law
Authors:
Bahar Kaynar,
Arno Berger,
Theodore P. Hill,
Ad Ridder
Abstract:
A sequence of real numbers (x_n) is Benford if the significands, i.e. the fraction parts in the floating-point representation of (x_n) are distributed logarithmically. Similarly, a discrete-time irreducible and aperiodic finite-state Markov chain with probability transition matrix P and limiting matrix P* is Benford if every component of both sequences of matrices (P^n - P*) and (P^{n+1}-P^n) is…
▽ More
A sequence of real numbers (x_n) is Benford if the significands, i.e. the fraction parts in the floating-point representation of (x_n) are distributed logarithmically. Similarly, a discrete-time irreducible and aperiodic finite-state Markov chain with probability transition matrix P and limiting matrix P* is Benford if every component of both sequences of matrices (P^n - P*) and (P^{n+1}-P^n) is Benford or eventually zero. Using recent tools that established Benford behavior both for Newton's method and for finite-dimensional linear maps, via the classical theories of uniform distribution modulo 1 and Perron-Frobenius, this paper derives a simple sufficient condition (nonresonant) guaranteeing that P, or the Markov chain associated with it, is Benford. This result in turn is used to show that almost all Markov chains are Benford, in the sense that if the transition probabilities are chosen independently and continuously, then the resulting Markov chain is Benford with probability one. Concrete examples illustrate the various cases that arise, and the theory is complemented with several simulations and potential applications.
△ Less
Submitted 5 March, 2010; v1 submitted 2 March, 2010;
originally announced March 2010.
