Showing 1–48 of 48 results for author: Spreij, P

Nonparametric Bayesian inference for stochastic processes with piecewise constant priors

Authors: Denis Belomestny, Frank van der Meulen, Peter Spreij

Abstract: We present a survey of some of our recent results on Bayesian nonparametric inference for a multitude of stochastic processes. The common feature is that the prior distribution in the cases considered is on suitable sets of piecewise constant or piecewise linear functions, that differ for the specific situations at hand. Posterior consistency and in most cases contraction rates for the estimators… ▽ More We present a survey of some of our recent results on Bayesian nonparametric inference for a multitude of stochastic processes. The common feature is that the prior distribution in the cases considered is on suitable sets of piecewise constant or piecewise linear functions, that differ for the specific situations at hand. Posterior consistency and in most cases contraction rates for the estimators are presented. Numerical studies on simulated and real data accompany the theoretical results. △ Less

Submitted 17 May, 2023; v1 submitted 12 May, 2023; originally announced May 2023.

MSC Class: Primary: 62G20; Secondary: 62M05

Journal ref: 2021-2022 MATRIX Annals. MATRIX Book Series, vol 5. Springer, Cham, 527-568 (2024)

Synchronous deautoconvolution algorithm for discrete-time positive signals via I-divergence approximation

Authors: Lorenzo Finesso, Peter Spreij

Abstract: We pose the problem of the optimal approximation of a given nonnegative signal $y_t$ with the scalar autoconvolution $(x*x)_t$ of a nonnegative signal $x_t$, where $x_t$ and $y_t$ are signals of equal length. The $\mathcal{I}$-divergence has been adopted as optimality criterion, being well suited to incorporate nonnegativity constraints. To find a minimizer we derive an iterative descent algorithm… ▽ More We pose the problem of the optimal approximation of a given nonnegative signal $y_t$ with the scalar autoconvolution $(x*x)_t$ of a nonnegative signal $x_t$, where $x_t$ and $y_t$ are signals of equal length. The $\mathcal{I}$-divergence has been adopted as optimality criterion, being well suited to incorporate nonnegativity constraints. To find a minimizer we derive an iterative descent algorithm of the alternating minimization type. The algorithm is based on the lifting of the original problem to a larger space, a relaxation technique developed by Csiszár and Tusnády in [Statistics \& Decisions (S1) (1984), 205--237] which, in the present context, requires the solution of a hard partial minimization problem. We study the asymptotic behavior of the algorithm exploiting the optimality properties of the partial minimization problems and prove, among other results, that its limit points are Kuhn-Tucker points of the original minimization problem. Numerical experiments illustrate the results. △ Less

Submitted 1 June, 2024; v1 submitted 24 February, 2023; originally announced February 2023.

Comments: 27 pages, 5 figures. arXiv admin note: text overlap with arXiv:2111.14430

MSC Class: 93B30; 94A17

Journal ref: Journal of computational and applied mathematics 451, Article No. 116025, 2024

The inverse problem of positive autoconvolution

Authors: Lorenzo Finesso, Peter Spreij

Abstract: We pose the problem of approximating optimally a given nonnegative signal with the scalar autoconvolution of a nonnegative signal. The I-divergence is chosen as the optimality criterion being well suited to incorporate nonnegativity constraints. After proving the existence of an optimal approximation we derive an iterative descent algorithm of the alternating minimization type to find a minimizer.… ▽ More We pose the problem of approximating optimally a given nonnegative signal with the scalar autoconvolution of a nonnegative signal. The I-divergence is chosen as the optimality criterion being well suited to incorporate nonnegativity constraints. After proving the existence of an optimal approximation we derive an iterative descent algorithm of the alternating minimization type to find a minimizer. The algorithm is based on the lifting technique developed by Csiszár and Tusnádi and exploits the optimality properties of the related minimization problems in the larger space. We study the asymptotic behavior of the iterative algorithm and prove, among other results, that its limit points are Kuhn-Tucker points of the original minimization problem. Numerical experiments confirm the asymptotic results and exhibit the fast convergence of the proposed algorithm. △ Less

Submitted 29 November, 2021; originally announced November 2021.

MSC Class: 93B30; 94A17

Journal ref: IEEE Transactions on Information Theory 40(6), 4081-4092, 2024

Weak solutions to gamma-driven stochastic differential equations

Authors: Denis Belomestny, Shota Gugushvili, Moritz Schauer, Peter Spreij

Abstract: We study a stochastic differential equation driven by a gamma process, for which we give results on the existence of weak solutions under conditions on the volatility function. To that end we provide results on the density process between the laws of solutions with different volatility functions. We study a stochastic differential equation driven by a gamma process, for which we give results on the existence of weak solutions under conditions on the volatility function. To that end we provide results on the density process between the laws of solutions with different volatility functions. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2011.08321

MSC Class: 60H10

Journal ref: Indagationes Mathematicae 34(4), pp. 820-829 (July 2023)

Nonparametric Bayesian volatility estimation for gamma-driven stochastic differential equations

Authors: Denis Belomestny, Shota Gugushvili, Moritz Schauer, Peter Spreij

Abstract: We study a nonparametric Bayesian approach to estimation of the volatility function of a stochastic differential equation driven by a gamma process. The volatility function is modelled a priori as piecewise constant, and we specify a gamma prior on its values. This leads to a straightforward procedure for posterior inference via an MCMC procedure. We give theoretical performance guarantees (contra… ▽ More We study a nonparametric Bayesian approach to estimation of the volatility function of a stochastic differential equation driven by a gamma process. The volatility function is modelled a priori as piecewise constant, and we specify a gamma prior on its values. This leads to a straightforward procedure for posterior inference via an MCMC procedure. We give theoretical performance guarantees (contraction rates for the posterior) for the Bayesian estimate in terms of the regularity of the unknown volatility function. We illustrate the method on synthetic and real data examples. △ Less

Submitted 26 August, 2021; v1 submitted 16 November, 2020; originally announced November 2020.

MSC Class: 62G20 (Primary) 62M30 (Secondary)

Journal ref: Bernoulli 28(4), 2022, pp. 2151-2180

Asymptotics and approximations of ruin probabilities for multivariate risk processes in a Markovian environment

Authors: G. A. Delsing, M. R. H. Mandjes, P. J. C. Spreij, E. M. M. Winands

Abstract: This paper develops asymptotics and approximations for ruin probabilities in a multivariate risk setting. We consider a model in which the individual reserve processes are driven by a common Markovian environmental process. We subsequently consider a regime in which the claim arrival intensity and transition rates of the environmental process are jointly sped up, and one in which there is (with ov… ▽ More This paper develops asymptotics and approximations for ruin probabilities in a multivariate risk setting. We consider a model in which the individual reserve processes are driven by a common Markovian environmental process. We subsequently consider a regime in which the claim arrival intensity and transition rates of the environmental process are jointly sped up, and one in which there is (with overwhelming probability) maximally one transition of the environmental process in the time interval considered. The approximations are extensively tested in a series of numerical experiments. △ Less

Submitted 21 December, 2018; originally announced December 2018.

An optimization approach to adaptive multi-dimensional capital management

Authors: G. A. Delsing, M. R. H. Mandjes, P. J. C. Spreij, E. M. M. Winands

Abstract: Firms should keep capital to offer sufficient protection against the risks they are facing. In the insurance context methods have been developed to determine the minimum capital level required, but less so in the context of firms with multiple business lines including allocation. The individual capital reserve of each line can be represented by means of classical models, such as the conventional C… ▽ More Firms should keep capital to offer sufficient protection against the risks they are facing. In the insurance context methods have been developed to determine the minimum capital level required, but less so in the context of firms with multiple business lines including allocation. The individual capital reserve of each line can be represented by means of classical models, such as the conventional Cramér-Lundberg model, but the challenge lies in soundly modelling the correlations between the business lines. We propose a simple yet versatile approach that allows for dependence by introducing a common environmental factor. We present a novel Bayesian approach to calibrate the latent environmental state distribution based on observations concerning the claim processes. The calibration approach is adjusted for an environmental factor that changes over time. The convergence of the calibration procedure towards the true environmental state is deduced. We then point out how to determine the optimal initial capital of the different business lines under specific constraints on the ruin probability of subsets of business lines. Upon combining the above findings, we have developed an easy-to-implement approach to capital risk management in a multi-dimensional insurance risk model. △ Less

Submitted 20 December, 2018; originally announced December 2018.

Journal ref: Insurance: Mathematics and Economics 84, 87-97 (2019)

Approximation of nonnegative systems by moving averages of fixed order

Authors: Lorenzo Finesso, Peter Spreij

Abstract: We pose the approximation problem for scalar nonnegative input-output systems via impulse response convolutions of finite order, i.e. finite order moving averages, based on repeated observations of input/output signal pairs. The problem is converted into a nonnegative matrix factorization with special structure for which we use Csiszár's I-divergence as the criterion of optimality. Conditions are… ▽ More We pose the approximation problem for scalar nonnegative input-output systems via impulse response convolutions of finite order, i.e. finite order moving averages, based on repeated observations of input/output signal pairs. The problem is converted into a nonnegative matrix factorization with special structure for which we use Csiszár's I-divergence as the criterion of optimality. Conditions are given, on the input/output data, that guarantee the existence and uniqueness of the minimum. We propose an algorithm of the alternating minimization type for I-divergence minimization, and present its asymptotic behavior. For the case of noisy observations we give the large sample properties of the statistical version of the minimization problem for different observation regimes. Numerical experiments confirm the asymptotic results and exhibit fast convergence of the proposed algorithm. △ Less

Submitted 23 October, 2018; originally announced October 2018.

MSC Class: 62B10; 62E20; 94A17; 93B30; 93E12

Journal ref: Automatica 107, pp 1-8, 2019

Nonparametric Bayesian inference for Gamma-type Lévy subordinators

Authors: Denis Belomestny, Shota Gugushvili, Moritz Schauer, Peter Spreij

Abstract: Given discrete time observations over a growing time interval, we consider a nonparametric Bayesian approach to estimation of the Lévy density of a Lévy process belonging to a flexible class of infinite activity subordinators. Posterior inference is performed via MCMC, and we circumvent the problem of the intractable likelihood via the data augmentation device, that in our case relies on bridge pr… ▽ More Given discrete time observations over a growing time interval, we consider a nonparametric Bayesian approach to estimation of the Lévy density of a Lévy process belonging to a flexible class of infinite activity subordinators. Posterior inference is performed via MCMC, and we circumvent the problem of the intractable likelihood via the data augmentation device, that in our case relies on bridge process sampling via Gamma process bridges. Our approach also requires the use of a new infinite-dimensional form of a reversible jump MCMC algorithm. We show that our method leads to good practical results in challenging simulation examples. On the theoretical side, we establish that our nonparametric Bayesian procedure is consistent: in the low frequency data setting, with equispaced in time observations and intervals between successive observations remaining fixed, the posterior asymptotically, as the sample size $n\rightarrow\infty$, concentrates around the Lévy density under which the data have been generated. Finally, we test our method on a classical insurance dataset. △ Less

Submitted 30 January, 2019; v1 submitted 30 April, 2018; originally announced April 2018.

MSC Class: Primary: 62G20; Secondary: 62M30

Journal ref: Communications in Mathematical Sciences, Volume 17, Number 3, 2019

Nonparametric Bayesian volatility estimation

Authors: Shota Gugushvili, Frank van der Meulen, Moritz Schauer, Peter Spreij

Abstract: Given discrete time observations over a fixed time interval, we study a nonparametric Bayesian approach to estimation of the volatility coefficient of a stochastic differential equation. We postulate a histogram-type prior on the volatility with piecewise constant realisations on bins forming a partition of the time interval. The values on the bins are assigned an inverse Gamma Markov chain (IGMC)… ▽ More Given discrete time observations over a fixed time interval, we study a nonparametric Bayesian approach to estimation of the volatility coefficient of a stochastic differential equation. We postulate a histogram-type prior on the volatility with piecewise constant realisations on bins forming a partition of the time interval. The values on the bins are assigned an inverse Gamma Markov chain (IGMC) prior. Posterior inference is straightforward to implement via Gibbs sampling, as the full conditional distributions are available explicitly and turn out to be inverse Gamma. We also discuss in detail the hyperparameter selection for our method. Our nonparametric Bayesian approach leads to good practical results in representative simulation examples. Finally, we apply it on a classical data set in change-point analysis: weekly closings of the Dow-Jones industrial averages. △ Less

Submitted 29 March, 2019; v1 submitted 30 January, 2018; originally announced January 2018.

MSC Class: 62G20 (Primary); 62M05 (Secondary)

Journal ref: 2017 MATRIX Annals, Springer International Publishing, 2019

Diffusion limits for a Markov modulated binomial counting process

Authors: Peter Spreij, Jaap Storm

Abstract: In this paper we study limit behavior for a Markov-modulated (MM) binomial counting process, also called a binomial counting process under regime switching. Such a process naturally appears in the context of credit risk when multiple obligors are present. Markov-modulation takes place when the failure/default rate of each individual obligor depends on an underlying Markov chain. The limit behavior… ▽ More In this paper we study limit behavior for a Markov-modulated (MM) binomial counting process, also called a binomial counting process under regime switching. Such a process naturally appears in the context of credit risk when multiple obligors are present. Markov-modulation takes place when the failure/default rate of each individual obligor depends on an underlying Markov chain. The limit behavior under consideration occurs when the number of obligors increases unboundedly, and/or by accelerating the modulating Markov process, called rapid switching. We establish diffusion approximations, obtained by application of (semi)martingale central limit theorems. Depending on the specific circumstances, different approximations are found. △ Less

Submitted 4 February, 2019; v1 submitted 11 January, 2018; originally announced January 2018.

MSC Class: 60F17; 60F05; 60G99

Journal ref: Prob. Eng. Inf. Sci. 34 (2020) 235-257

Nonparametric Bayesian estimation of a Hölder continuous diffusion coefficient

Authors: Shota Gugushvili, Frank van der Meulen, Moritz Schauer, Peter Spreij

Abstract: We consider a nonparametric Bayesian approach to estimate the diffusion coefficient of a stochastic differential equation given discrete time observations over a fixed time interval. As a prior on the diffusion coefficient, we employ a histogram-type prior with piecewise constant realisations on bins forming a partition of the time interval. Specifically, these constants are realizations of indepe… ▽ More We consider a nonparametric Bayesian approach to estimate the diffusion coefficient of a stochastic differential equation given discrete time observations over a fixed time interval. As a prior on the diffusion coefficient, we employ a histogram-type prior with piecewise constant realisations on bins forming a partition of the time interval. Specifically, these constants are realizations of independent inverse Gamma distributed randoma variables. We justify our approach by deriving the rate at which the corresponding posterior distribution asymptotically concentrates around the data-generating diffusion coefficient. This posterior contraction rate turns out to be optimal for estimation of a Hölder-continuous diffusion coefficient with smoothness parameter $0<λ\leq 1.$ Our approach is straightforward to implement, as the posterior distributions turn out to be inverse Gamma again, and leads to good practical results in a wide range of simulation examples. Finally, we apply our method on exchange rate data sets. △ Less

Submitted 30 January, 2019; v1 submitted 22 June, 2017; originally announced June 2017.

MSC Class: 62G20 (Primary); 62M05 (Secondary)

Journal ref: Braz. J. Probab. Stat., 34(3): 537-579. 2020

Dynamic Erdős-Rényi graphs

Authors: M. Mandjes, N. J. Starreveld, R. Bekker, P. Spreij

Abstract: We propose two classes of dynamic versions of the classical Erdős-Rényi graph: one in which the transition rates are governed by an external regime process, and one in which the transition rates are periodically resampled. For both models we consider the evolution of the number of edges present, with explicit results for the corresponding moments, functional central limit theorems and large deviat… ▽ More We propose two classes of dynamic versions of the classical Erdős-Rényi graph: one in which the transition rates are governed by an external regime process, and one in which the transition rates are periodically resampled. For both models we consider the evolution of the number of edges present, with explicit results for the corresponding moments, functional central limit theorems and large deviations asymptotics. △ Less

Submitted 16 March, 2017; originally announced March 2017.

Explicit computations for some Markov modulated counting processes

Authors: Michel Mandjes, Peter Spreij

Abstract: In this paper we present elementary computations for some Markov modulated counting processes, also called counting processes with regime switching. Regime switching has become an increasingly popular concept in many branches of science. In finance, for instance, one could identify the background process with the `state of the economy', to which asset prices react, or as an identification of the v… ▽ More In this paper we present elementary computations for some Markov modulated counting processes, also called counting processes with regime switching. Regime switching has become an increasingly popular concept in many branches of science. In finance, for instance, one could identify the background process with the `state of the economy', to which asset prices react, or as an identification of the varying default rate of an obligor. The key feature of the counting processes in this paper is that their intensity processes are functions of a finite state Markov chain. This kind of processes can be used to model default events of some companies. Many quantities of interest in this paper, like conditional characteristic functions, can all be derived from conditional probabilities, which can, in principle, be analytically computed. We will also study limit results for models with rapid switching, which occur when inflating the intensity matrix of the Markov chain by a factor tending to infinity. The paper is largely expository in nature, with a didactic flavor. △ Less

Submitted 9 April, 2016; originally announced April 2016.

MSC Class: 60G44; 60G55; 60J27

Journal ref: in Advanced Modelling in Mathematical Finance, In Honour of Ernst Eberlein (2016)

A note on the central limit theorem for a one-sided reflected Ornstein-Uhlenbeck process

Authors: Michel Mandjes, Peter Spreij

Abstract: In this short communication we present a (functional) central limit theorem for the idle process of a one-sided reflected Ornstein-Uhlenbeck proces. In this short communication we present a (functional) central limit theorem for the idle process of a one-sided reflected Ornstein-Uhlenbeck proces. △ Less

Submitted 21 January, 2016; originally announced January 2016.

Journal ref: Statistica Neerlandica 71(3), 225-235 (2017)

A non-parametric Bayesian approach to decompounding from high frequency data

Authors: Shota Gugushvili, Frank van der Meulen, Peter Spreij

Abstract: Given a sample from a discretely observed compound Poisson process, we consider non-parametric estimation of the density $f_0$ of its jump sizes, as well as of its intensity $λ_0.$ We take a Bayesian approach to the problem and specify the prior on $f_0$ as the Dirichlet location mixture of normal densities. An independent prior for $λ_0$ is assumed to be compactly supported and to possess a posit… ▽ More Given a sample from a discretely observed compound Poisson process, we consider non-parametric estimation of the density $f_0$ of its jump sizes, as well as of its intensity $λ_0.$ We take a Bayesian approach to the problem and specify the prior on $f_0$ as the Dirichlet location mixture of normal densities. An independent prior for $λ_0$ is assumed to be compactly supported and to possess a positive density with respect to the Lebesgue measure. We show that under suitable assumptions the posterior contracts around the pair $(λ_0,f_0)$ at essentially (up to a logarithmic factor) the $\sqrt{nΔ}$-rate, where $n$ is the number of observations and $Δ$ is the mesh size at which the process is sampled. The emphasis is on high frequency data, $Δ\to 0$, but the obtained results are also valid for fixed $Δ$. In either case we assume that $nΔ\rightarrow\infty$. Our main result implies existence of Bayesian point estimates converging (in the frequentist sense, in probability) to $(λ_0,f_0)$ at the same rate. We also discuss a practical implementation of our approach. The computational problem is dealt with by inclusion of auxiliary variables and we develop a Markov Chain Monte Carlo algorithm that samples from the joint distribution of the unknown parameters in the mixture density and the introduced auxiliary variables. Numerical examples illustrate the feasibility of this approach. △ Less

Submitted 31 May, 2016; v1 submitted 12 July, 2015; originally announced July 2015.

MSC Class: 62G20; 62M30

Journal ref: Stat. Inference Stoch. Process. 21 , no. 1, 53-79 (2018)

Large deviations for Markov-modulated diffusion processes with rapid switching

Authors: Gang Huang, Michel Mandjes, Peter Spreij

Abstract: In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated diffusion process and the occupation measure of the Markov chain (which evidently also yields the large deviations principle for each of them separately by appl… ▽ More In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated diffusion process and the occupation measure of the Markov chain (which evidently also yields the large deviations principle for each of them separately by applying the contraction principle). The structure of the proof is such that we first prove exponential tightness, and then establish a local large deviations principle (where the latter part is split into proving the corresponding upper bound and lower bound). △ Less

Submitted 13 January, 2015; originally announced January 2015.

MSC Class: 60F05; 60F17

Journal ref: Stochastic Processes and their Applications 126, 1785-1818 (2016)

Markov-modulated Ornstein-Uhlenbeck processes

Authors: Gang Huang, Marijn Jansen, Michel Mandjes, Peter Spreij, Koen De Turck

Abstract: In this paper we consider an Ornstein-Uhlenbeck (OU) process $(M(t))_{t\geqslant 0}$ whose parameters are determined by an external Markov process $(X(t))_{t\geqslant 0}$ on a finite state space $\{1,\ldots,d\}$; this process is usually referred to as Markov-modulated Ornstein-Uhlenbeck (MMOU). We use stochastic integration theory to determine explicit expressions for the mean and variance of… ▽ More In this paper we consider an Ornstein-Uhlenbeck (OU) process $(M(t))_{t\geqslant 0}$ whose parameters are determined by an external Markov process $(X(t))_{t\geqslant 0}$ on a finite state space $\{1,\ldots,d\}$; this process is usually referred to as Markov-modulated Ornstein-Uhlenbeck (MMOU). We use stochastic integration theory to determine explicit expressions for the mean and variance of $M(t)$. Then we establish a system of partial differential equations (PDEs) for the Laplace transform of $M(t)$ and the state $X(t)$ of the background process, jointly for time epochs $t=t_1,\ldots,t_K.$ Then we use this PDE to set up a recursion that yields all moments of $M(t)$ and its stationary counterpart; we also find an expression for the covariance between $M(t)$ and $M(t+u)$. We then establish a functional central limit theorem for $M(t)$ for the situation that certain parameters of the underlying OU processes are scaled, in combination with the modulating Markov process being accelerated; interestingly, specific scalings lead to drastically different limiting processes. We conclude the paper by considering the situation of a single Markov process modulating multiple OU processes. △ Less

Submitted 26 December, 2014; originally announced December 2014.

MSC Class: 60F05; 60F17

Journal ref: Advances in Applied Probability 48(1), 235-254 (2016)

Nonparametric Bayesian inference for multidimensional compound Poisson processes

Authors: Shota Gugushvili, Frank van der Meulen, Peter Spreij

Abstract: Given a sample from a discretely observed multidimensional compound Poisson process, we study the problem of nonparametric estimation of its jump size density $r_0$ and intensity $λ_0$. We take a nonparametric Bayesian approach to the problem and determine posterior contraction rates in this context, which, under some assumptions, we argue to be optimal posterior contraction rates. In particular,… ▽ More Given a sample from a discretely observed multidimensional compound Poisson process, we study the problem of nonparametric estimation of its jump size density $r_0$ and intensity $λ_0$. We take a nonparametric Bayesian approach to the problem and determine posterior contraction rates in this context, which, under some assumptions, we argue to be optimal posterior contraction rates. In particular, our results imply the existence of Bayesian point estimates that converge to the true parameter pair $(r_0,λ_0)$ at these rates. To the best of our knowledge, construction of nonparametric density estimators for inference in the class of discretely observed multidimensional Lévy processes, and the study of their rates of convergence is a new contribution to the literature. △ Less

Submitted 5 June, 2015; v1 submitted 24 December, 2014; originally announced December 2014.

Comments: Published at http://dx.doi.org/10.15559/15-VMSTA20 in the Modern Stochastics: Theory and Applications (https://www.i-journals.org/vtxpp/VMSTA) by VTeX (http://www.vtex.lt/)

Report number: VTeX-VMSTA-VMSTA20

Journal ref: Modern Stochastics: Theory and Applications 2015, Vol. 2, No. 1, 1-15

Posterior contraction rate for non-parametric Bayesian estimation of the dispersion coefficient of a stochastic differential equation

Authors: Shota Gugushvili, Peter Spreij

Abstract: We derive the posteror contraction rate for non-parametric Bayesian estimation of a deterministic dispersion coefficient of a linear stochastic differential equation. We derive the posteror contraction rate for non-parametric Bayesian estimation of a deterministic dispersion coefficient of a linear stochastic differential equation. △ Less

Submitted 9 September, 2014; originally announced September 2014.

Comments: 11 pages

MSC Class: Primary: 62G20; Secondary: 62M05

Journal ref: ESAIM: Probability and Statistics 20 (2016), 143-153

Approximation of Nonnegative Systems by Finite Impulse Response Convolutions

Authors: Lorenzo Finesso, Peter Spreij

Abstract: We pose the deterministic, nonparametric, approximation problem for scalar nonnegative input/output systems via finite impulse response convolutions, based on repeated observations of input/output signal pairs. The problem is converted into a nonnegative matrix factorization with special structure for which we use Csiszár's I-divergence as the criterion of optimality. Conditions are given, on the… ▽ More We pose the deterministic, nonparametric, approximation problem for scalar nonnegative input/output systems via finite impulse response convolutions, based on repeated observations of input/output signal pairs. The problem is converted into a nonnegative matrix factorization with special structure for which we use Csiszár's I-divergence as the criterion of optimality. Conditions are given, on the input/output data, that guarantee the existence and uniqueness of the minimum. We propose a standard algorithm of the alternating minimization type for I-divergence minimization, and study its asymptotic behavior. We also provide a statistical version of the minimization problem and give its large sample properties. △ Less

Submitted 10 July, 2013; v1 submitted 4 June, 2013; originally announced June 2013.

Comments: This paper was previously posted under the name "Nonnegative Deconvolution with Repeated Measurements". The current version is slightly different

MSC Class: 93B30; 93B15; 92C55

Journal ref: IEEE Transactions on Information Theory 61(8), 4399-4409 (2015)

A note on non-parametric Bayesian estimation for Poisson point processes

Authors: Shota Gugushvili, Peter Spreij

Abstract: We derive the posterior contraction rate for non-parametric Bayesian estimation of the intensity function of a Poisson point process. We derive the posterior contraction rate for non-parametric Bayesian estimation of the intensity function of a Poisson point process. △ Less

Submitted 14 April, 2018; v1 submitted 27 April, 2013; originally announced April 2013.

Comments: References updated

MSC Class: 62G20 (Primary); 62M30 (Secondary)

Consistent non-parametric Bayesian estimation for a time-inhomogeneous Brownian motion

Authors: Shota Gugushvili, Peter Spreij

Abstract: We establish posterior consistency for non-parametric Bayesian estimation of the dispersion coefficient of a time-inhomogeneous Brownian motion. We establish posterior consistency for non-parametric Bayesian estimation of the dispersion coefficient of a time-inhomogeneous Brownian motion. △ Less

Submitted 24 April, 2013; originally announced April 2013.

Comments: 12 pages

MSC Class: 62G20 (Primary); 62M05 (Secondary)

Journal ref: ESAIM: Probability and Statistics 18 (2014), 332-341

Limit theorems for reflected Ornstein-Uhlenbeck processes

Authors: Gang Huang, Michel Mandjes, Peter Spreij

Abstract: This paper studies one-dimensional Ornstein-Uhlenbeck processes, with the distinguishing feature that they are reflected on a single boundary (put at level 0) or two boundaries (put at levels 0 and d>0). In the literature they are referred to as reflected OU (ROU) and doubly-reflected OU (DROU) respectively. For both cases, we explicitly determine the decay rates of the (transient) probability to… ▽ More This paper studies one-dimensional Ornstein-Uhlenbeck processes, with the distinguishing feature that they are reflected on a single boundary (put at level 0) or two boundaries (put at levels 0 and d>0). In the literature they are referred to as reflected OU (ROU) and doubly-reflected OU (DROU) respectively. For both cases, we explicitly determine the decay rates of the (transient) probability to reach a given extreme level. The methodology relies on sample-path large deviations, so that we also identify the associated most likely paths. For DROU, we also consider the `idleness process' $L_t$ and the `loss process' $U_t$, which are the minimal nondecreasing processes which make the OU process remain $\geqslant 0$ and $\leqslant d$, respectively. We derive central limit theorems for $U_t$ and $L_t$, using techniques from stochastic integration and the martingale central limit theorem. △ Less

Submitted 1 April, 2013; originally announced April 2013.

MSC Class: 60F05; 60F10; 90B22

Journal ref: Statistica Neerlandica 68(1), 25-42, (2014)

A block Hankel generalized confluent Vandermonde matrix

Authors: Andre Klein, Peter Spreij

Abstract: Vandermonde matrices are well known. They have a number of interesting properties and play a role in (Lagrange) interpolation problems, partial fraction expansions, and finding solutions to linear ordinary differential equations, to mention just a few applications. Usually, one takes these matrices square, $q\times q$ say, in which case the $i$-th column is given by $u(z_i)$, where we write… ▽ More Vandermonde matrices are well known. They have a number of interesting properties and play a role in (Lagrange) interpolation problems, partial fraction expansions, and finding solutions to linear ordinary differential equations, to mention just a few applications. Usually, one takes these matrices square, $q\times q$ say, in which case the $i$-th column is given by $u(z_i)$, where we write $u(z)=(1,z,...,z^{q-1})^\top$. If all the $z_i$ ($i=1,...,q$) are different, the Vandermonde matrix is non-singular, otherwise not. The latter case obviously takes place when all $z_i$ are the same, $z$ say, in which case one could speak of a confluent Vandermonde matrix. Non-singularity is obtained if one considers the matrix $V(z)$ whose $i$-th column ($i=1,...,q$) is given by the $(i-1)$-th derivative $u^{(i-1)}(z)^\top$. We will consider generalizations of the confluent Vandermonde matrix $V(z)$ by considering matrices obtained by using as building blocks the matrices $M(z)=u(z)w(z)$, with $u(z)$ as above and $w(z)=(1,z,...,z^{r-1})$, together with its derivatives $M^{(k)}(z)$. Specifically, we will look at matrices whose $ij$-th block is given by $M^{(i+j)}(z)$, where the indices $i,j$ by convention have initial value zero. These in general non-square matrices exhibit a block-Hankel structure. We will answer a number of elementary questions for this matrix. What is the rank? What is the null-space? Can the latter be parametrized in a simple way? Does it depend on $z$? What are left or right inverses? It turns out that answers can be obtained by factorizing the matrix into a product of other matrix polynomials having a simple structure. The answers depend on the size of the matrix $M(z)$ and the number of derivatives $M^{(k)}(z)$ that is involved. The results are obtained by mostly elementary methods, no specific knowledge of the theory of matrix polynomials is needed. △ Less

Submitted 23 March, 2013; originally announced March 2013.

MSC Class: 15A09; 15A23; 15A24; 15B99

Journal ref: Linear Algebra and its Applications 455, 32-72 (2014)

Non-parametric Bayesian drift estimation for stochastic differential equations

Authors: Shota Gugushvili, Peter Spreij

Abstract: We consider non-parametric Bayesian estimation of the drift coefficient of a one-dimensional stochastic differential equation from discrete-time observations on the solution of this equation. Under suitable regularity conditions that are weaker than those previosly suggested in the literature, we establish posterior consistency in this context. Furthermore, we show that posterior consistency exten… ▽ More We consider non-parametric Bayesian estimation of the drift coefficient of a one-dimensional stochastic differential equation from discrete-time observations on the solution of this equation. Under suitable regularity conditions that are weaker than those previosly suggested in the literature, we establish posterior consistency in this context. Furthermore, we show that posterior consistency extends to the multidimensional setting as well, which, to the best of our knowledge, is a new result in this setting. △ Less

Submitted 25 February, 2013; v1 submitted 21 June, 2012; originally announced June 2012.

Comments: 27 pages

MSC Class: 62G20 (Primary) 62M05 (Secondary)

Journal ref: Lithuanian Mathematical Journal 54(2) 127-141 (2014)

Parametric inference for stochastic differential equations: a smooth and match approach

Authors: Shota Gugushvili, Peter Spreij

Abstract: We study the problem of parameter estimation for a univariate discretely observed ergodic diffusion process given as a solution to a stochastic differential equation. The estimation procedure we propose consists of two steps. In the first step, which is referred to as a smoothing step, we smooth the data and construct a nonparametric estimator of the invariant density of the process. In the second… ▽ More We study the problem of parameter estimation for a univariate discretely observed ergodic diffusion process given as a solution to a stochastic differential equation. The estimation procedure we propose consists of two steps. In the first step, which is referred to as a smoothing step, we smooth the data and construct a nonparametric estimator of the invariant density of the process. In the second step, which is referred to as a matching step, we exploit a characterisation of the invariant density as a solution of a certain ordinary differential equation, replace the invariant density in this equation by its nonparametric estimator from the smoothing step in order to arrive at an intuitively appealing criterion function, and next define our estimator of the parameter of interest as a minimiser of this criterion function. Our main results show that under suitable conditions our estimator is $\sqrt{n}$-consistent, and even asymptotically normal. We also discuss a way of improving its asymptotic performance through a one-step Newton-Raphson type procedure and present results of a small scale simulation study. △ Less

Submitted 22 October, 2012; v1 submitted 4 November, 2011; originally announced November 2011.

Comments: 26 pages

MSC Class: 62F12 (Primary) 62M05; 62G07; 62G20 (Secondary)

Journal ref: ALEA Lat. Am. J. Probab. Math. Stat. 9 (2012), no. 2, 609-635

Two-step Nonnegative Matrix Factorization Algorithm for the Approximate Realization of Hidden Markov Models

Authors: L. Finesso, A. Grassi, P. Spreij

Abstract: We propose a two-step algorithm for the construction of a Hidden Markov Model (HMM) of assigned size, i.e. cardinality of the state space of the underlying Markov chain, whose $n$-dimensional distribution is closest in divergence to a given distribution. The algorithm is based on the factorization of a pseudo Hankel matrix, defined in terms of the given distribution, into the product of a tall and… ▽ More We propose a two-step algorithm for the construction of a Hidden Markov Model (HMM) of assigned size, i.e. cardinality of the state space of the underlying Markov chain, whose $n$-dimensional distribution is closest in divergence to a given distribution. The algorithm is based on the factorization of a pseudo Hankel matrix, defined in terms of the given distribution, into the product of a tall and a wide nonnegative matrix. The implementation is based on the nonnegative matrix factorization (NMF) algorithm. To evaluate the performance of our algorithm we produced some numerical simulations in the context of HMM order reduction. △ Less

Submitted 20 July, 2010; originally announced July 2010.

Comments: presented at MTNS2010 - Budapest, July 2010

MSC Class: 93E03; 60J10

Journal ref: Proceedings of the 19th International Symposium on Mathematical Theory of Networks and Systems - MTNS 2010, 369-374, (2010)

Deconvolution for an atomic distribution: rates of convergence

Authors: Shota Gugushvili, Bert van Es, Peter Spreij

Abstract: Let $X_1,..., X_n$ be i.i.d.\ copies of a random variable $X=Y+Z,$ where $ X_i=Y_i+Z_i,$ and $Y_i$ and $Z_i$ are independent and have the same distribution as $Y$ and $Z,$ respectively. Assume that the random variables $Y_i$'s are unobservable and that $Y=AV,$ where $A$ and $V$ are independent, $A$ has a Bernoulli distribution with probability of success equal to $1-p$ and $V$ has a distribution f… ▽ More Let $X_1,..., X_n$ be i.i.d.\ copies of a random variable $X=Y+Z,$ where $ X_i=Y_i+Z_i,$ and $Y_i$ and $Z_i$ are independent and have the same distribution as $Y$ and $Z,$ respectively. Assume that the random variables $Y_i$'s are unobservable and that $Y=AV,$ where $A$ and $V$ are independent, $A$ has a Bernoulli distribution with probability of success equal to $1-p$ and $V$ has a distribution function $F$ with density $f.$ Let the random variable $Z$ have a known distribution with density $k.$ Based on a sample $X_1,...,X_n,$ we consider the problem of nonparametric estimation of the density $f$ and the probability $p.$ Our estimators of $f$ and $p$ are constructed via Fourier inversion and kernel smoothing. We derive their convergence rates over suitable functional classes. By establishing in a number of cases the lower bounds for estimation of $f$ and $p$ we show that our estimators are rate-optimal in these cases. △ Less

Submitted 24 February, 2011; v1 submitted 12 July, 2010; originally announced July 2010.

Comments: 27 pages

MSC Class: 62G07; 62G20

Journal ref: J. Nonparametr. Stat. 23 (2011), no. 4, 1003-1029

The affine transform formula for affine jump-diffusions with a general closed convex state space

Authors: Peter Spreij, Enno Veerman

Abstract: We establish existence of exponential moments and the validity of the affine transform formula for affine jump-diffusions with a general closed convex state space. This extends known results for affine jump-diffusions with a canonical state space. The key step is to prove the martingale property of an exponential local martingale, using the well-posedness of the associated martingale problem. By a… ▽ More We establish existence of exponential moments and the validity of the affine transform formula for affine jump-diffusions with a general closed convex state space. This extends known results for affine jump-diffusions with a canonical state space. The key step is to prove the martingale property of an exponential local martingale, using the well-posedness of the associated martingale problem. By analytic extension we obtain the affine transform formula for complex exponentials, in particular for the characteristic function. Our results apply to a wide class of affine processes, including those with a matrix-valued state space, which have recently gained interest in the literature. △ Less

Submitted 12 October, 2010; v1 submitted 6 May, 2010; originally announced May 2010.

Comments: jumps included

MSC Class: 60J60; 91G30

Affine diffusions with non-canonical state space

Authors: Peter Spreij, Enno Veerman

Abstract: Multidimensional affine diffusions have been studied in detail for the case of a canonical state space. We present results for general state spaces and provide a complete characterization of all possible affine diffusions with polyhedral and quadratic state space. We give necessary and sufficient conditions on the behavior of drift and diffusion on the boundary of the state space in order to obta… ▽ More Multidimensional affine diffusions have been studied in detail for the case of a canonical state space. We present results for general state spaces and provide a complete characterization of all possible affine diffusions with polyhedral and quadratic state space. We give necessary and sufficient conditions on the behavior of drift and diffusion on the boundary of the state space in order to obtain invariance and to prove strong existence and uniqueness. △ Less

Submitted 6 May, 2010; v1 submitted 3 April, 2010; originally announced April 2010.

Comments: 36 pages; paper is split into two papers; results on invariance and strong solutions added

MSC Class: 60J60; 91G30

Nonparametric methods for volatility density estimation

Authors: Bert van Es, Peter Spreij, Harry van Zanten

Abstract: Stochastic volatility modelling of financial processes has become increasingly popular. The proposed models usually contain a stationary volatility process. We will motivate and review several nonparametric methods for estimation of the density of the volatility process. Both models based on discretely sampled continuous time processes and discrete time models will be discussed. The key insigh… ▽ More Stochastic volatility modelling of financial processes has become increasingly popular. The proposed models usually contain a stationary volatility process. We will motivate and review several nonparametric methods for estimation of the density of the volatility process. Both models based on discretely sampled continuous time processes and discrete time models will be discussed. The key insight for the analysis is a transformation of the volatility density estimation problem to a deconvolution model for which standard methods exist. Three type of nonparametric density estimators are reviewed: the Fourier-type deconvolution kernel density estimator, a wavelet deconvolution density estimator and a penalized projection estimator. The performance of these estimators will be compared. Key words: stochastic volatility models, deconvolution, density estimation, kernel estimator, wavelets, minimum contrast estimation, mixing △ Less

Submitted 27 October, 2009; originally announced October 2009.

MSC Class: 62G07; 62G08; 62M07; 62P20; 91G70

Journal ref: Advanced Mathematical Methods for Finance, Chapter 11, 293-312, Giulia di Nunno, Bernt Øksendal Eds., Springer (2011)

Multivariate Nonparametric Volatility Density Estimation

Authors: Bert van Es, Peter Spreij

Abstract: We consider a continuous-time stochastic volatility model. The model contains a stationary volatility process, the multivariate density of the finite dimensional distributions of which we aim to estimate. We assume that we observe the process at discrete instants in time. The sampling times will be equidistant with vanishing distance. A multivariate Fourier-type deconvolution kernel density es… ▽ More We consider a continuous-time stochastic volatility model. The model contains a stationary volatility process, the multivariate density of the finite dimensional distributions of which we aim to estimate. We assume that we observe the process at discrete instants in time. The sampling times will be equidistant with vanishing distance. A multivariate Fourier-type deconvolution kernel density estimator based on the logarithm of the squared processes is proposed to estimate the multivariate volatility density. An expansion of the bias and a bound on the variance are derived. Key words: stochastic volatility models, multivariate density estimation, kernel estimator, deconvolution, mixing △ Less

Submitted 22 October, 2009; originally announced October 2009.

MSC Class: 62G07; 62M07; 62P20

Journal ref: Journal of Multivariate Analysis 102, 683-697 (2011)

Sample-path Large Deviations in Credit Risk

Authors: Vincent Leijdekker, Michel Mandjes, Peter Spreij

Abstract: The event of large losses plays an important role in credit risk. As these large losses are typically rare, and portfolios usually consist of a large number of positions, large deviation theory is the natural tool to analyze the tail asymptotics of the probabilities involved. We first derive a sample-path large deviation principle (LDP) for the portfolio's loss process, which enables the computa… ▽ More The event of large losses plays an important role in credit risk. As these large losses are typically rare, and portfolios usually consist of a large number of positions, large deviation theory is the natural tool to analyze the tail asymptotics of the probabilities involved. We first derive a sample-path large deviation principle (LDP) for the portfolio's loss process, which enables the computation of the logarithmic decay rate of the probabilities of interest. In addition, we derive exact asymptotic results for a number of specific rare-event probabilities, such as the probability of the loss process exceeding some given function. △ Less

Submitted 30 September, 2009; originally announced September 2009.

MSC Class: 60F10; 91G40

Journal ref: Journal of Applied Mathematics (2011), Article ID 354171

Approximate factor analysis model building via alternating I-divergence minimization

Authors: Lorenzo Finesso, Peter Spreij

Abstract: Given a positive definite covariance matrix $\widehat Σ$, we strive to construct an optimal \emph{approximate} factor analysis model $HH^\top +D$, with $H$ having a prescribed number of columns and $D>0$ diagonal. The optimality criterion we minimize is the I-divergence between the corresponding normal laws. Lifting the problem into a properly chosen larger space enables us to derive an alternatin… ▽ More Given a positive definite covariance matrix $\widehat Σ$, we strive to construct an optimal \emph{approximate} factor analysis model $HH^\top +D$, with $H$ having a prescribed number of columns and $D>0$ diagonal. The optimality criterion we minimize is the I-divergence between the corresponding normal laws. Lifting the problem into a properly chosen larger space enables us to derive an alternating minimization algorithm à la Csiszár-Tusnády for the construction of the best approximation. The convergence properties of the algorithm are studied, with special attention given to the case where $D$ is singular. △ Less

Submitted 20 July, 2010; v1 submitted 9 December, 2008; originally announced December 2008.

MSC Class: 62H25; 62B10

Journal ref: Psychometrika 81, 702-726 (2016)

Negative volatility for a 2-dimensional square root SDE

Authors: Peter Spreij, Enno Veerman

Abstract: In affine term structure models the short rate is modelled as an affine transformation of a multi-dimensional square root process. Sufficient conditions to avoid negative volatility factors are the multivariate Feller conditions. We will prove their necessity for a 2-dimensional square root SDE with one volatility factor by presenting a methodology based on measure transformations and solving li… ▽ More In affine term structure models the short rate is modelled as an affine transformation of a multi-dimensional square root process. Sufficient conditions to avoid negative volatility factors are the multivariate Feller conditions. We will prove their necessity for a 2-dimensional square root SDE with one volatility factor by presenting a methodology based on measure transformations and solving linear systems of ordinary differential equations. △ Less

Submitted 25 November, 2008; v1 submitted 8 July, 2008; originally announced July 2008.

Comments: 15 pages, 0 figures

Multivariate Feller conditions in term structure models: Why do(n't) we care?

Authors: Peter Spreij, Enno Veerman, Peter Vlaar

Abstract: In this paper, the relevance of the Feller conditions in discrete time macro-finance term structure models is investigated. The Feller conditions are usually imposed on a continuous time multivariate square root process to ensure that the roots have nonnegative arguments. For a discrete time approximate model, the Feller conditions do not give this guarantee. Moreover, in a macro-finance context… ▽ More In this paper, the relevance of the Feller conditions in discrete time macro-finance term structure models is investigated. The Feller conditions are usually imposed on a continuous time multivariate square root process to ensure that the roots have nonnegative arguments. For a discrete time approximate model, the Feller conditions do not give this guarantee. Moreover, in a macro-finance context the restrictions imposed might be economically unappealing. At the same time, it has also been observed that even without the Feller conditions imposed, for a practically relevant term structure model, negative arguments rarely occur. Using models estimated on German data, we compare the yields implied by (approximate) analytic exponentially affine expressions to those obtained through Monte Carlo simulations of very high numbers of sample paths. It turns out that the differences are rarely statistically significant, whether the Feller conditions are imposed or not. Moreover, economically the differences are negligible, as they are always below one basis point. △ Less

Submitted 7 April, 2008; originally announced April 2008.

Comments: 19 pages, 3 figures

MSC Class: 62P05; 62P20; 91B28

Explicit Computations for a Filtering Problem with Point Process Observations with Applications to Credit Risk

Authors: Vincent Leijdekker, Peter Spreij

Abstract: We consider the intensity-based approach for the modeling of default times of one or more companies. In this approach the default times are defined as the jump times of a Cox process, which is a Poisson process conditional on the realization of its intensity. We assume that the intensity follows the Cox-Ingersoll-Ross model. This model allows one to calculate survival probabilities and prices of… ▽ More We consider the intensity-based approach for the modeling of default times of one or more companies. In this approach the default times are defined as the jump times of a Cox process, which is a Poisson process conditional on the realization of its intensity. We assume that the intensity follows the Cox-Ingersoll-Ross model. This model allows one to calculate survival probabilities and prices of defaultable bonds explicitly. In this paper we assume that the Brownian motion, that drives the intensity, is not observed. Using filtering theory for point process observations, we are able to derive dynamics for the intensity and its moment generating function, given the observations of the Cox process. A transformation of the dynamics of the conditional moment generating function allows us to solve the filtering problem, between the jumps of the Cox process, as well as at the jumps. Assuming that the initial distribution of the intensity is of the Gamma type, we obtain an explicit solution to the filtering problem for all t>0. We conclude the paper with the observation that the resulting conditional moment generating function at time t corresponds to a mixture of Gamma distributions. △ Less

Submitted 11 February, 2008; originally announced February 2008.

MSC Class: 93E11; 60G35; 60G55

Deconvolution for an atomic distribution

Authors: Bert van Es, Shota Gugushvili, Peter Spreij

Abstract: Let $X_1,...,X_n$ be i.i.d. observations, where $X_i=Y_i+σZ_i$ and $Y_i$ and $Z_i$ are independent. Assume that unobservable $Y$'s are distributed as a random variable $UV,$ where $U$ and $V$ are independent, $U$ has a Bernoulli distribution with probability of zero equal to $p$ and $V$ has a distribution function $F$ with density $f.$ Furthermore, let the random variables $Z_i$ have the standar… ▽ More Let $X_1,...,X_n$ be i.i.d. observations, where $X_i=Y_i+σZ_i$ and $Y_i$ and $Z_i$ are independent. Assume that unobservable $Y$'s are distributed as a random variable $UV,$ where $U$ and $V$ are independent, $U$ has a Bernoulli distribution with probability of zero equal to $p$ and $V$ has a distribution function $F$ with density $f.$ Furthermore, let the random variables $Z_i$ have the standard normal distribution and let $σ>0.$ Based on a sample $X_1,..., X_n,$ we consider the problem of estimation of the density $f$ and the probability $p.$ We propose a kernel type deconvolution estimator for $f$ and derive its asymptotic normality at a fixed point. A consistent estimator for $p$ is given as well. Our results demonstrate that our estimator behaves very much like the kernel type deconvolution estimator in the classical deconvolution problem. △ Less

Submitted 30 April, 2008; v1 submitted 21 September, 2007; originally announced September 2007.

Comments: Published in at http://dx.doi.org/10.1214/07-EJS121 the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-EJS-EJS_2007_121 MSC Class: 62G07 (Primary) 62G20 (Secondary)

Journal ref: Electronic Journal of Statistics 2008, Vol. 2, 265-297

Factor Analysis and Alternating Minimization

Authors: Lorenzo Finesso, Peter Spreij

Abstract: In this paper we make a first attempt at understanding how to build an optimal approximate normal factor analysis model. The criterion we have chosen to evaluate the distance between different models is the I-divergence between the corresponding normal laws. The algorithm that we propose for the construction of the best approximation is of an the alternating minimization kind. In this paper we make a first attempt at understanding how to build an optimal approximate normal factor analysis model. The criterion we have chosen to evaluate the distance between different models is the I-divergence between the corresponding normal laws. The algorithm that we propose for the construction of the best approximation is of an the alternating minimization kind. △ Less

Submitted 17 April, 2007; originally announced April 2007.

MSC Class: 62E17; 93E12

Journal ref: in Modeling, Estimation and Control, Festschrift in Honor of Giorgio Picci on the Occasion of his Sixty-Fifth Birthday (2007)

Approximation of stationary processes by Hidden Markov Models

Authors: Lorenzo Finesso, Angela Grassi, Peter Spreij

Abstract: We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under mild conditions, the existence of the divergence rate between a stationary process and an HMM. Since in general there is no analytic expression available for… ▽ More We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under mild conditions, the existence of the divergence rate between a stationary process and an HMM. Since in general there is no analytic expression available for this divergence rate, we approximate it with a properly defined, and easily computable, divergence between Hankel matrices, which we use as our approximation criterion. We propose a three-step algorithm, based on the Nonnegative Matrix Factorization technique, which realizes an HMM optimal with respect to the defined approximation criterion. A full theoretical analysis of the algorithm is given in the special case of Markov approximation. △ Less

Submitted 6 February, 2008; v1 submitted 23 June, 2006; originally announced June 2006.

Comments: The 2nd version mainly has additional references and a new condition of Theorem 4.2

MSC Class: 93E03; 60J10

Journal ref: Mathematics of Control, Signals and Systems 22(1), 1-22 (2010)

A kernel type nonparametric density estimator for decompounding

Authors: Bert van Es, Shota Gugushvili, Peter Spreij

Abstract: Given a sample from a discretely observed compound Poisson process, we consider estimation of the density of the jump sizes. We propose a kernel type nonparametric density estimator and study its asymptotic properties. An order bound for the bias and an asymptotic expansion of the variance of the estimator are given. Pointwise weak consistency and asymptotic normality are established. The result… ▽ More Given a sample from a discretely observed compound Poisson process, we consider estimation of the density of the jump sizes. We propose a kernel type nonparametric density estimator and study its asymptotic properties. An order bound for the bias and an asymptotic expansion of the variance of the estimator are given. Pointwise weak consistency and asymptotic normality are established. The results show that, asymptotically, the estimator behaves very much like an ordinary kernel estimator. △ Less

Submitted 5 September, 2007; v1 submitted 17 May, 2005; originally announced May 2005.

Comments: Published at http://dx.doi.org/10.3150/07-BEJ6091 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ6091

Journal ref: Bernoulli 2007, Vol. 13, No. 3, 672-694

The Bezoutian and Fisher's information matrix of an ARMA process

Authors: Andre Klein, Peter Spreij

Abstract: In this paper we derive some properties of the Bezout matrix and relate the Fisher information matrix for a stationary ARMA process to the Bezoutian. Some properties are explained via realizations in state space form of the derivatives of the white noise process with respect to the parameters. A factorization of the Fisher information matrix as a product in factors which involve the Bezout matri… ▽ More In this paper we derive some properties of the Bezout matrix and relate the Fisher information matrix for a stationary ARMA process to the Bezoutian. Some properties are explained via realizations in state space form of the derivatives of the white noise process with respect to the parameters. A factorization of the Fisher information matrix as a product in factors which involve the Bezout matrix of the associated AR and MA polynomials is derived. From this factorization we can characterize singularity of the Fisher information matrix. △ Less

Submitted 11 May, 2005; originally announced May 2005.

MSC Class: 5A23; 15A24; 15A57; 62M10

Journal ref: Linear Algebra and its Applications 416, 160-174 (2006)

Nonnegative Matrix Factorization and I-Divergence Alternating Minimization

Authors: Lorenzo Finesso, Peter Spreij

Abstract: In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$ such that $V=WH$. Exact, non trivial, nonnegative factorizations do not always exist, hence it is interesting to pose the approximate NMF problem. The criteri… ▽ More In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$ such that $V=WH$. Exact, non trivial, nonnegative factorizations do not always exist, hence it is interesting to pose the approximate NMF problem. The criterion which is commonly employed is I-divergence between nonnegative matrices. The problem becomes that of finding, for assigned $k$, the factorization $WH$ closest to $V$ in I-divergence. An iterative algorithm, EM like, for the construction of the best pair $(W, H)$ has been proposed in the literature. In this paper we interpret the algorithm as an alternating minimization procedure à la Csiszár-Tusnády and investigate some of its stability properties. NMF is widespreading as a data analysis method in applications for which the positivity constraint is relevant. There are other data analysis methods which impose some form of nonnegativity: we discuss here the connections between NMF and Archetypal Analysis. △ Less

Submitted 13 July, 2005; v1 submitted 3 December, 2004; originally announced December 2004.

MSC Class: 93E03

Journal ref: Linear Algebra and its Applications 416, 270-287 (2006)

Approximate Nonnegative Matrix Factorization via Alternating Minimization

Authors: Lorenzo Finesso, Peter Spreij

Abstract: In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$ such that $V=WH$. Exact, non trivial, nonnegative factorizations do not always exist, hence it is interesting to pose the approximate NMF problem. The criteri… ▽ More In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix $V \in \R_+^{m\times n}$ find, for assigned $k$, nonnegative matrices $W\in\R_+^{m\times k}$ and $H\in\R_+^{k\times n}$ such that $V=WH$. Exact, non trivial, nonnegative factorizations do not always exist, hence it is interesting to pose the approximate NMF problem. The criterion which is commonly employed is I-divergence between nonnegative matrices. The problem becomes that of finding, for assigned $k$, the factorization $WH$ closest to $V$ in I-divergence. An iterative algorithm, EM like, for the construction of the best pair $(W, H)$ has been proposed in the literature. In this paper we interpret the algorithm as an alternating minimization procedure à la Csiszár-Tusnády and investigate some of its stability properties. NMF is widespreading as a data analysis method in applications for which the positivity constraint is relevant. There are other data analysis methods which impose some form of nonnegativity: we discuss here the connections between NMF and Archetypal Analysis. An interesting system theoretic application of NMF is to the problem of approximate realization of Hidden Markov Models. △ Less

Submitted 13 February, 2004; originally announced February 2004.

MSC Class: 93E03

Journal ref: Proceedings of the 16th International Symposium on Mathematical Theory of Networks and Systems, Leuven, July 5-9, 2004

Nonparametric volatility density estimation for discrete time models

Authors: Bert van Es, Peter Spreij, Harry van Zanten

Abstract: We consider discrete time models for asset prices with a stationary volatility process. We aim at estimating the multivariate density of this process at a set of consecutive time instants. A Fourier type deconvolution kernel density estimator based on the logarithm of the squared process is proposed to estimate the volatility density. Expansions of the bias and bounds on the variance are derived… ▽ More We consider discrete time models for asset prices with a stationary volatility process. We aim at estimating the multivariate density of this process at a set of consecutive time instants. A Fourier type deconvolution kernel density estimator based on the logarithm of the squared process is proposed to estimate the volatility density. Expansions of the bias and bounds on the variance are derived. △ Less

Submitted 14 June, 2002; originally announced June 2002.

MSC Class: 62G07; 62M07; 62P20

Journal ref: Journal of Nonparametric Statistics 17 (2), 237-249 (2005)

On hidden Markov chains and finite stochastic systems

Authors: Peter Spreij

Abstract: In this paper we study various properties of finite stochastic systems or hidden Markov chains as they are alternatively called. We discuss their construction following different approaches and we also derive recursive filtering formulas for the different systems that we consider. The key tool is a simple lemma on conditional expectations. In this paper we study various properties of finite stochastic systems or hidden Markov chains as they are alternatively called. We discuss their construction following different approaches and we also derive recursive filtering formulas for the different systems that we consider. The key tool is a simple lemma on conditional expectations. △ Less

Submitted 20 July, 2001; originally announced July 2001.

MSC Class: 60G42; 60J10; 93E11

Journal ref: Statistics and Probability Letters 62, 189-201 (2003)

Nonparametric Volatility Density Estimation

Authors: Bert van Es, Peter Spreij, Harry van Zanten

Abstract: We consider two kinds of stochastic volatility models. Both kinds of models contain a stationary volatility process, the density of which, at a fixed instant in time, we aim to estimate. We discuss discrete time models where for instance a log price process is modeled as the product of a volatility process and i.i.d. noise. We also consider samples of certain continuous time diffusion processe… ▽ More We consider two kinds of stochastic volatility models. Both kinds of models contain a stationary volatility process, the density of which, at a fixed instant in time, we aim to estimate. We discuss discrete time models where for instance a log price process is modeled as the product of a volatility process and i.i.d. noise. We also consider samples of certain continuous time diffusion processes. The sampled time instants will be be equidistant with vanishing distance. A Fourier type deconvolution kernel density estimator based on the logarithm of the squared processes is proposed to estimate the volatility density. Expansions of the bias and bounds on the variances are derived. △ Less

Submitted 16 June, 2002; v1 submitted 19 July, 2001; originally announced July 2001.

MSC Class: 62G07; 62M07; 62P20

Journal ref: Bernoulli 9 (3), 451-645 (2003)