Showing 1–10 of 10 results for author: Söhl, J

Testing for no effect in regression problems: a permutation approach

Authors: Michał Ciszewski, Jakob Söhl, Ton Leenen, Bart van Trigt, Geurt Jongbloed

Abstract: Often the question arises whether $Y$ can be predicted based on $X$ using a certain model. Especially for highly flexible models such as neural networks one may ask whether a seemingly good prediction is actually better than fitting pure noise or whether it has to be attributed to the flexibility of the model. This paper proposes a rigorous permutation test to assess whether the prediction is bett… ▽ More Often the question arises whether $Y$ can be predicted based on $X$ using a certain model. Especially for highly flexible models such as neural networks one may ask whether a seemingly good prediction is actually better than fitting pure noise or whether it has to be attributed to the flexibility of the model. This paper proposes a rigorous permutation test to assess whether the prediction is better than the prediction of pure noise. The test avoids any sample splitting and is based instead on generating new pairings of $(X_i,Y_j)$. It introduces a new formulation of the null hypothesis and rigorous justification for the test, which distinguishes it from previous literature. The theoretical findings are applied both to simulated data and to sensor data of tennis serves in an experimental context. The simulation study underscores how the available information affects the test. It shows that the less informative the predictors, the lower the probability of rejecting the null hypothesis of fitting pure noise and emphasizes that detecting weaker dependence between variables requires a sufficient sample size. △ Less

Submitted 26 April, 2024; v1 submitted 4 May, 2023; originally announced May 2023.

Comments: Submitted to a special issue of Statistica Neerlandica

Bernstein -- von Mises theorems for statistical inverse problems II: Compound Poisson processes

Authors: Richard Nickl, Jakob Söhl

Abstract: We study nonparametric Bayesian statistical inference for the parameters governing a pure jump process of the form $$Y_t = \sum_{k=1}^{N(t)} Z_k,~~~ t \ge 0,$$ where $N(t)$ is a standard Poisson process of intensity $λ$, and $Z_k$ are drawn i.i.d.~from jump measure $μ$. A high-dimensional wavelet series prior for the Lévy measure $ν= λμ$ is devised and the posterior distribution arises from observ… ▽ More We study nonparametric Bayesian statistical inference for the parameters governing a pure jump process of the form $$Y_t = \sum_{k=1}^{N(t)} Z_k,~~~ t \ge 0,$$ where $N(t)$ is a standard Poisson process of intensity $λ$, and $Z_k$ are drawn i.i.d.~from jump measure $μ$. A high-dimensional wavelet series prior for the Lévy measure $ν= λμ$ is devised and the posterior distribution arises from observing discrete samples $Y_Δ, Y_{2Δ}, \dots, Y_{nΔ}$ at fixed observation distance $Δ$, giving rise to a nonlinear inverse inference problem. We derive contraction rates in uniform norm for the posterior distribution around the true Lévy density that are optimal up to logarithmic factors over Hölder classes, as sample size $n$ increases. We prove a functional Bernstein-von Mises theorem for the distribution functions of both $μ$ and $ν$, as well as for the intensity $λ$, establishing the fact that the posterior distribution is approximated by an infinite-dimensional Gaussian measure whose covariance structure is shown to attain the information lower bound for this inverse problem. As a consequence posterior based inferences, such as nonparametric credible sets, are asymptotically valid and optimal from a frequentist point of view. △ Less

Submitted 5 September, 2019; v1 submitted 22 September, 2017; originally announced September 2017.

Comments: 51 pages, to appear in Electronic Journal of Statistics

MSC Class: 62G20; 65N21; 60G51; 60J75

Journal ref: Electron. J. Statist. 13(2) (2019) 3513-3571

Nonparametric Bayesian posterior contraction rates for discretely observed scalar diffusions

Authors: Richard Nickl, Jakob Söhl

Abstract: We consider nonparametric Bayesian inference in a reflected diffusion model $dX_t = b (X_t)dt + σ(X_t) dW_t,$ with discretely sampled observations $X_0, X_Δ, \dots, X_{nΔ}$. We analyse the nonlinear inverse problem corresponding to the `low frequency sampling' regime where $Δ>0$ is fixed and $n \to \infty$. A general theorem is proved that gives conditions for prior distributions $Π$ on the diffus… ▽ More We consider nonparametric Bayesian inference in a reflected diffusion model $dX_t = b (X_t)dt + σ(X_t) dW_t,$ with discretely sampled observations $X_0, X_Δ, \dots, X_{nΔ}$. We analyse the nonlinear inverse problem corresponding to the `low frequency sampling' regime where $Δ>0$ is fixed and $n \to \infty$. A general theorem is proved that gives conditions for prior distributions $Π$ on the diffusion coefficient $σ$ and the drift function $b$ that ensure minimax optimal contraction rates of the posterior distribution over Hölder-Sobolev smoothness classes. These conditions are verified for natural examples of nonparametric random wavelet series priors. For the proofs we derive new concentration inequalities for empirical processes arising from discretely observed diffusions that are of independent interest. △ Less

Submitted 29 March, 2016; v1 submitted 19 October, 2015; originally announced October 2015.

Comments: 44 pages

MSC Class: Primary 62G05; secondary 60J60; 62F15; 62G20

Journal ref: Ann. Statist. 45(4) (2017) 1664-1693

Adaptive confidence bands for Markov chains and diffusions: Estimating the invariant measure and the drift

Authors: Jakob Söhl, Mathias Trabs

Abstract: As a starting point we prove a functional central limit theorem for estimators of the invariant measure of a geometrically ergodic Harris-recurrent Markov chain in a multi-scale space. This allows to construct confidence bands for the invariant density with optimal (up to undersmoothing) $L^{\infty}$-diameter by using wavelet projection estimators. In addition our setting applies to the drift esti… ▽ More As a starting point we prove a functional central limit theorem for estimators of the invariant measure of a geometrically ergodic Harris-recurrent Markov chain in a multi-scale space. This allows to construct confidence bands for the invariant density with optimal (up to undersmoothing) $L^{\infty}$-diameter by using wavelet projection estimators. In addition our setting applies to the drift estimation of diffusions observed discretely with fixed observation distance. We prove a functional central limit theorem for estimators of the drift function and finally construct adaptive confidence bands for the drift by using a completely data-driven estimator. △ Less

Submitted 7 July, 2016; v1 submitted 22 December, 2014; originally announced December 2014.

Comments: to appear in ESAIM: Probability and Statistics

MSC Class: 62G15 (Primary); 60F05; 60J05; 60J60; 62M05 (Secondary)

Journal ref: ESAIM: PS 20 (2016) 432-462

Uniform central limit theorems for the Grenander estimator

Authors: Jakob Söhl

Abstract: We consider the Grenander estimator that is the maximum likelihood estimator for non-increasing densities. We prove uniform central limit theorems for certain subclasses of bounded variation functions and for Hölder balls of smoothness s>1/2. We do not assume that the density is differentiable or continuous. The proof can be seen as an adaptation of the method for the parametric maximum likelihood… ▽ More We consider the Grenander estimator that is the maximum likelihood estimator for non-increasing densities. We prove uniform central limit theorems for certain subclasses of bounded variation functions and for Hölder balls of smoothness s>1/2. We do not assume that the density is differentiable or continuous. The proof can be seen as an adaptation of the method for the parametric maximum likelihood estimator to the nonparametric setting. Since nonparametric maximum likelihood estimators lie on the boundary, the derivative of the likelihood cannot be expected to equal zero as in the parametric case. Nevertheless, our proofs rely on the fact that the derivative of the likelihood can be shown to be small at the maximum likelihood estimator. △ Less

Submitted 26 June, 2015; v1 submitted 24 November, 2014; originally announced November 2014.

Comments: 17 pages

MSC Class: Primary 60F05; secondary 62G07; 62E20

Journal ref: Electron. J. Stat. 9 (2015) 1404-1423

High-frequency Donsker theorems for Lévy measures

Authors: Richard Nickl, Markus Reiß, Jakob Söhl, Mathias Trabs

Abstract: Donsker-type functional limit theorems are proved for empirical processes arising from discretely sampled increments of a univariate Lévy process. In the asymptotic regime the sampling frequencies increase to infinity and the limiting object is a Gaussian process that can be obtained from the composition of a Brownian motion with a covariance operator determined by the Lévy measure. The results ar… ▽ More Donsker-type functional limit theorems are proved for empirical processes arising from discretely sampled increments of a univariate Lévy process. In the asymptotic regime the sampling frequencies increase to infinity and the limiting object is a Gaussian process that can be obtained from the composition of a Brownian motion with a covariance operator determined by the Lévy measure. The results are applied to derive the asymptotic distribution of natural estimators for the distribution function of the Lévy jump measure. As an application we deduce Kolmogorov-Smirnov type tests and confidence bands. △ Less

Submitted 4 December, 2014; v1 submitted 9 October, 2013; originally announced October 2013.

Comments: 41 pages, 1 figure, to appear in Prob. Th. Relat. Fields

MSC Class: Primary: 60F05; Secondary: 60G51; 62G05

Journal ref: Probab. Theory Relat. Fields 164 (2016) 61-108

Polar sets of anisotropic Gaussian random fields

Authors: Jakob Söhl

Abstract: This paper studies polar sets of anisotropic Gaussian random fields, i.e. sets which a Gaussian random field does not hit almost surely. The main assumptions are that the eigenvalues of the covariance matrix are bounded from below and that the canonical metric associated with the Gaussian random field is dominated by an anisotropic metric. We deduce an upper bound for the hitting probabilities and… ▽ More This paper studies polar sets of anisotropic Gaussian random fields, i.e. sets which a Gaussian random field does not hit almost surely. The main assumptions are that the eigenvalues of the covariance matrix are bounded from below and that the canonical metric associated with the Gaussian random field is dominated by an anisotropic metric. We deduce an upper bound for the hitting probabilities and conclude that sets with small Hausdorff dimension are polar. Moreover, the results allow for a translation of the Gaussian random field by a random field, that is independent of the Gaussian random field and whose sample functions are of bounded Hölder norm. △ Less

Submitted 3 August, 2012; originally announced August 2012.

Comments: 12 pages

MSC Class: 60G60; 60G15; 60G17; 28A80

Journal ref: Stat. Probabil. Lett. 80(9-10) (2010) 840-847

A uniform central limit theorem and efficiency for deconvolution estimators

Authors: Jakob Söhl, Mathias Trabs

Abstract: We estimate linear functionals in the classical deconvolution problem by kernel estimators. We obtain a uniform central limit theorem with $\sqrt{n}$-rate on the assumption that the smoothness of the functionals is larger than the ill-posedness of the problem, which is given by the polynomial decay rate of the characteristic function of the error. The limit distribution is a generalized Brownian b… ▽ More We estimate linear functionals in the classical deconvolution problem by kernel estimators. We obtain a uniform central limit theorem with $\sqrt{n}$-rate on the assumption that the smoothness of the functionals is larger than the ill-posedness of the problem, which is given by the polynomial decay rate of the characteristic function of the error. The limit distribution is a generalized Brownian bridge with a covariance structure that depends on the characteristic function of the error and on the functionals. The proposed estimators are optimal in the sense of semiparametric efficiency. The class of linear functionals is wide enough to incorporate the estimation of distribution functions. The proofs are based on smoothed empirical processes and mapping properties of the deconvolution operator. △ Less

Submitted 3 August, 2012; originally announced August 2012.

Comments: 30 pages

MSC Class: 62G05; 60F05

Journal ref: Electron. J. Statist. 6 (2012) 2486-2518

Confidence sets in nonparametric calibration of exponential Lévy models

Authors: Jakob Söhl

Abstract: Confidence intervals and joint confidence sets are constructed for the nonparametric calibration of exponential Lévy models based on prices of European options. To this end, we show joint asymptotic normality in the spectral calibration method for the estimators of the volatility, the drift, the jump intensity and the Lévy density at finitely many points. Confidence intervals and joint confidence sets are constructed for the nonparametric calibration of exponential Lévy models based on prices of European options. To this end, we show joint asymptotic normality in the spectral calibration method for the estimators of the volatility, the drift, the jump intensity and the Lévy density at finitely many points. △ Less

Submitted 19 September, 2013; v1 submitted 29 February, 2012; originally announced February 2012.

Comments: to appear in Finance and Stochastics

MSC Class: 60G51; 62G15; 91G70

Journal ref: Finance Stoch. 18 (2014) 617-649

Option calibration of exponential Lévy models: Confidence intervals and empirical results

Authors: Jakob Söhl, Mathias Trabs

Abstract: Observing prices of European put and call options, we calibrate exponential Lévy models nonparametrically. We discuss the efficient implementation of the spectral estimation procedures for Lévy models of finite jump activity as well as for self-decomposable Lévy models. Based on finite sample variances, confidence intervals are constructed for the volatility, for the drift and, pointwise, for the… ▽ More Observing prices of European put and call options, we calibrate exponential Lévy models nonparametrically. We discuss the efficient implementation of the spectral estimation procedures for Lévy models of finite jump activity as well as for self-decomposable Lévy models. Based on finite sample variances, confidence intervals are constructed for the volatility, for the drift and, pointwise, for the jump density. As demonstrated by simulations, these intervals perform well in terms of size and coverage probabilities. We compare the performance of the procedures for finite and infinite jump activity based on options on the German DAX index and find that both methods achieve good calibration results. The stability of the finite activity model is studied when the option prices are observed in a sequence of trading days. △ Less

Submitted 17 October, 2012; v1 submitted 27 February, 2012; originally announced February 2012.

Comments: to appear in Journal of Computational Finance

MSC Class: 60G51; 62G15; 91B25

Journal ref: J. Comput. Finance 18(2) (2014) 91-119