-
Multi- and Infinite-variate Integration and $L^2$-Approximation on Hilbert Spaces with Gaussian Kernels
Authors:
Michael Gnewuch,
Klaus Ritter,
Robin Rüßmann
Abstract:
We study integration and $L^2$-approximation in the worst-case setting for deterministic linear algorithms based on function evaluations. The underlying function space is a reproducing kernel Hilbert space with a Gaussian kernel of tensor product form. In the infinite-variate case, for both computational problems, we establish matching upper and lower bounds for the polynomial convergence rate of…
▽ More
We study integration and $L^2$-approximation in the worst-case setting for deterministic linear algorithms based on function evaluations. The underlying function space is a reproducing kernel Hilbert space with a Gaussian kernel of tensor product form. In the infinite-variate case, for both computational problems, we establish matching upper and lower bounds for the polynomial convergence rate of the $n$-th minimal error. In the multivariate case, we improve several tractability results for the integration problem. For the proofs, we establish the following transference result together with an explicit construction: Each of the computational problems on a space with a Gaussian kernel is equivalent on the level of algorithms to the same problem on a Hermite space with suitable parameters.
△ Less
Submitted 6 December, 2024;
originally announced December 2024.
-
Poissonian pair correlations for dependent random variables
Authors:
Jasmin Fielder,
Michael Gnewuch,
Christian Weiß
Abstract:
We consider Poissonian pair correlations (PPC) for uniformly distributed sequences of random numbers with a dependency structure. More specifically, we treat two classes of dependent random variables which have widely been studied in the literature, namely sequences of jittered samples and random walks on the torus. We show that for the former class, the PPC property depends on how the finite samp…
▽ More
We consider Poissonian pair correlations (PPC) for uniformly distributed sequences of random numbers with a dependency structure. More specifically, we treat two classes of dependent random variables which have widely been studied in the literature, namely sequences of jittered samples and random walks on the torus. We show that for the former class, the PPC property depends on how the finite sample is extended to an infinite sequence. Moreover, we prove that, under some mild assumptions, the random walk on the torus generically has PPC.
△ Less
Submitted 31 January, 2025; v1 submitted 29 November, 2024;
originally announced November 2024.
-
Data Compression using Rank-1 Lattices for Parameter Estimation in Machine Learning
Authors:
Michael Gnewuch,
Kumar Harsha,
Marcin Wnuk
Abstract:
The mean squared error and regularized versions of it are standard loss functions in supervised machine learning. However, calculating these losses for large data sets can be computationally demanding. Modifying an approach of J. Dick and M. Feischl [Journal of Complexity 67 (2021)], we present algorithms to reduce extensive data sets to a smaller size using rank-1 lattices. Rank-1 lattices are qu…
▽ More
The mean squared error and regularized versions of it are standard loss functions in supervised machine learning. However, calculating these losses for large data sets can be computationally demanding. Modifying an approach of J. Dick and M. Feischl [Journal of Complexity 67 (2021)], we present algorithms to reduce extensive data sets to a smaller size using rank-1 lattices. Rank-1 lattices are quasi-Monte Carlo (QMC) point sets that are, if carefully chosen, well-distributed in a multidimensional unit cube. The compression strategy in the preprocessing step assigns every lattice point a pair of weights depending on the original data and responses, representing its relative importance. As a result, the compressed data makes iterative loss calculations in optimization steps much faster. We analyze the errors of our QMC data compression algorithms and the cost of the preprocessing step for functions whose Fourier coefficients decay sufficiently fast so that they lie in certain Wiener algebras or Korobov spaces. In particular, we prove that our approach can lead to arbitrary high convergence rates as long as the functions are sufficiently smooth.
△ Less
Submitted 20 September, 2024;
originally announced September 2024.
-
QMC integration based on arbitrary (t,m,s)-nets yields optimal convergence rates on several scales of function spaces
Authors:
Michael Gnewuch,
Josef Dick,
Lev Markhasin,
Winfried Sickel
Abstract:
We study the integration problem over the $s$-dimensional unit cube on four types of Banach spaces of integrands. First we consider Haar wavelet spaces, consisting of functions whose Haar wavelet coefficients exhibit a certain decay behavior measured by a parameter $α>0$. We study the worst case error of integration over the norm unit ball and provide upper error bounds for quasi-Monte Carlo (QMC)…
▽ More
We study the integration problem over the $s$-dimensional unit cube on four types of Banach spaces of integrands. First we consider Haar wavelet spaces, consisting of functions whose Haar wavelet coefficients exhibit a certain decay behavior measured by a parameter $α>0$. We study the worst case error of integration over the norm unit ball and provide upper error bounds for quasi-Monte Carlo (QMC) cubature rules based on arbitrary $(t,m,s)$-nets as well as matching lower error bounds for arbitrary cubature rules. These results show that using arbitrary $(t,m,s)$-nets as sample points yields the best possible rate of convergence. Afterwards we study spaces of integrands of fractional smoothness $α\in (0,1)$ and state a sharp Koksma-Hlawka-type inequality. More precisely, we show that on those spaces the worst case error of integration is equal to the corresponding fractional discrepancy. Those spaces can be continuously embedded into tensor product Bessel potential spaces, also known as Sobolev spaces of dominated mixed smoothness, with the same set of parameters. The latter spaces can be embedded into suitable Besov spaces of dominating mixed smoothness $α$, which in turn can be embedded into the Haar wavelet spaces with the same set of parameters. Therefore our upper error bounds on Haar wavelet spaces for QMC cubatures based on $(t,m,s)$-nets transfer (with possibly different constants) to the corresponding spaces of integrands of fractional smoothness and to Sobolev and Besov spaces of dominating mixed smoothness. Moreover, known lower error bounds for periodic Sobolev and Besov spaces of dominating mixed smoothness show that QMC integration based on arbitrary $(t,m,s)$-nets yields the best possible convergence rate on periodic as well as on non-periodic Sobolev and Besov spaces of dominating smoothness.
△ Less
Submitted 19 September, 2024;
originally announced September 2024.
-
Improved bounds for the bracketing number of orthants or revisiting an algorithm of Thiémard to compute bounds for the star discrepancy
Authors:
Michael Gnewuch
Abstract:
We improve the best known upper bound for the bracketing number of $d$-dimensional axis-parallel boxes anchored in $0$ (or, put differently, of lower left orthants intersected with the $d$-dimensional unit cube $[0,1]^d$). More precisely, we provide a better upper bound for the cardinality of an algorithmic bracketing cover construction due to Eric Thiémard, which forms the core of his algorithm t…
▽ More
We improve the best known upper bound for the bracketing number of $d$-dimensional axis-parallel boxes anchored in $0$ (or, put differently, of lower left orthants intersected with the $d$-dimensional unit cube $[0,1]^d$). More precisely, we provide a better upper bound for the cardinality of an algorithmic bracketing cover construction due to Eric Thiémard, which forms the core of his algorithm to approximate the star discrepancy of arbitrary point sets from [E. Thiémard, An algorithm to compute bounds for the star discrepancy, J.~Complexity 17 (2001), 850 -- 880].
Moreover, the new upper bound for the bracketing number of anchored axis-parallel boxes yields an improved upper bound for the bracketing number of arbitrary axis-parallel boxes in $[0,1]^d$.
In our upper bounds all constants are fully explicit.
△ Less
Submitted 12 April, 2024; v1 submitted 1 January, 2024;
originally announced January 2024.
-
Computable error bounds for quasi-Monte Carlo using points with non-negative local discrepancy
Authors:
Michael Gnewuch,
Peter Kritzer,
Art B. Owen,
Zexin Pan
Abstract:
Let $f:[0,1]^d\to\mathbb{R}$ be a completely monotone integrand as defined by Aistleitner and Dick (2015) and let points $\boldsymbol{x}_0,\dots,\boldsymbol{x}_{n-1}\in[0,1]^d$ have a non-negative local discrepancy (NNLD) everywhere in $[0,1]^d$. We show how to use these properties to get a non-asymptotic and computable upper bound for the integral of $f$ over $[0,1]^d$. An analogous non-positive…
▽ More
Let $f:[0,1]^d\to\mathbb{R}$ be a completely monotone integrand as defined by Aistleitner and Dick (2015) and let points $\boldsymbol{x}_0,\dots,\boldsymbol{x}_{n-1}\in[0,1]^d$ have a non-negative local discrepancy (NNLD) everywhere in $[0,1]^d$. We show how to use these properties to get a non-asymptotic and computable upper bound for the integral of $f$ over $[0,1]^d$. An analogous non-positive local discrepancy (NPLD) property provides a computable lower bound. It has been known since Gabai (1967) that the two dimensional Hammersley points in any base $b\ge2$ have non-negative local discrepancy. Using the probabilistic notion of associated random variables, we generalize Gabai's finding to digital nets in any base $b\ge2$ and any dimension $d\ge1$ when the generator matrices are permutation matrices. We show that permutation matrices cannot attain the best values of the digital net quality parameter when $d\ge3$. As a consequence the computable absolutely sure bounds we provide come with less accurate estimates than the usual digital net estimates do in high dimensions. We are also able to construct high dimensional rank one lattice rules that are NNLD. We show that those lattices do not have good discrepancy properties: any lattice rule with the NNLD property in dimension $d\ge2$ either fails to be projection regular or has all its points on the main diagonal. Complete monotonicity is a very strict requirement that for some integrands can be mitigated via a control variate.
△ Less
Submitted 8 September, 2024; v1 submitted 8 September, 2023;
originally announced September 2023.
-
New Bounds for the Extreme and the Star Discrepancy of Double-Infinite Matrices
Authors:
Jasmin Fiedler,
Michael Gnewuch,
Christian Weiß
Abstract:
According to Aistleitner and Weimar, there exist two-dimensional (double) infinite matrices whose star-discrepancy $D_N^{*s}$ of the first $N$ rows and $s$ columns, interpreted as $N$ points in $[0,1]^s$, satisfies an inequality of the form $$D_N^{*s} \leq \sqrtα \sqrt{A+B\frac{\ln(\log_2(N))}{s}}\sqrt{\frac{s}{N}}$$ with $α= ζ^{-1}(2) \approx 1.73, A=1165$ and $B=178$. These matrices are obtained…
▽ More
According to Aistleitner and Weimar, there exist two-dimensional (double) infinite matrices whose star-discrepancy $D_N^{*s}$ of the first $N$ rows and $s$ columns, interpreted as $N$ points in $[0,1]^s$, satisfies an inequality of the form $$D_N^{*s} \leq \sqrtα \sqrt{A+B\frac{\ln(\log_2(N))}{s}}\sqrt{\frac{s}{N}}$$ with $α= ζ^{-1}(2) \approx 1.73, A=1165$ and $B=178$. These matrices are obtained by using i.i.d sequences, and the parameters $s$ and $N$ refer to the dimension and the sample size respectively. In this paper, we improve their result in two directions: First, we change the character of the equation so that the constant $A$ gets replaced by a value $A_s$ dependent on the dimension $s$ such that for $s>1$ we have $A_s<A$. Second, we generalize the result to the case of the (extreme) discrepancy. The paper is complemented by a section where we show numerical results for the dependence of the parameter $A_s$ on $s$.
△ Less
Submitted 8 May, 2023;
originally announced May 2023.
-
Infinite-dimensional integration and $L^2$-approximation on Hermite spaces
Authors:
Michael Gnewuch,
Aicke Hinrichs,
Klaus Ritter,
Robin Rüßmann
Abstract:
We study integration and $L^2$-approximation of functions of infinitely many variables in the following setting: The underlying function space is the countably infinite tensor product of univariate Hermite spaces and the probability measure is the corresponding product of the standard normal distribution. The maximal domain of the functions from this tensor product space is necessarily a proper su…
▽ More
We study integration and $L^2$-approximation of functions of infinitely many variables in the following setting: The underlying function space is the countably infinite tensor product of univariate Hermite spaces and the probability measure is the corresponding product of the standard normal distribution. The maximal domain of the functions from this tensor product space is necessarily a proper subset of the sequence space $\mathbb{R}^\mathbb{N}$. We establish upper and lower bounds for the minimal worst case errors under general assumptions; these bounds do match for tensor products of well-studied Hermite spaces of functions with finite or with infinite smoothness. In the proofs we employ embedding results, and the upper bounds are attained constructively with the help of multivariate decomposition methods.
△ Less
Submitted 4 November, 2023; v1 submitted 4 April, 2023;
originally announced April 2023.
-
Infinite-Variate $L^2$-Approximation with Nested Subspace Sampling
Authors:
Kumar Harsha,
Michael Gnewuch,
Marcin Wnuk
Abstract:
We consider $L^2$-approximation on weighted reproducing kernel Hilbert spaces of functions depending on infinitely many variables. We focus on unrestricted linear information, admitting evaluations of arbitrary continuous linear functionals. We distinguish between ANOVA and non-ANOVA spaces, where, by ANOVA spaces, we refer to function spaces whose norms are induced by an underlying ANOVA function…
▽ More
We consider $L^2$-approximation on weighted reproducing kernel Hilbert spaces of functions depending on infinitely many variables. We focus on unrestricted linear information, admitting evaluations of arbitrary continuous linear functionals. We distinguish between ANOVA and non-ANOVA spaces, where, by ANOVA spaces, we refer to function spaces whose norms are induced by an underlying ANOVA function decomposition. In ANOVA spaces, we provide an optimal algorithm to solve the approximation problem using linear information. We determine the upper and lower error bounds on the polynomial convergence rate of $n$-th minimal worst-case errors, which match if the weights decay regularly. For non-ANOVA spaces, we also establish upper and lower error bounds. Our analysis reveals that for weights with a regular and moderate decay behavior, the convergence rate of $n$-th minimal errors is strictly higher in ANOVA than in non-ANOVA spaces.
△ Less
Submitted 29 July, 2023; v1 submitted 30 January, 2023;
originally announced January 2023.
-
Countable Tensor Products of Hermite Spaces and Spaces of Gaussian Kernels
Authors:
M. Gnewuch,
M. Hefter,
A. Hinrichs,
K. Ritter
Abstract:
In recent years finite tensor products of reproducing kernel Hilbert spaces (RKHSs) of Gaussian kernels on the one hand and of Hermite spaces on the other hand have been considered in tractability analysis of multivariate problems. In the present paper we study countably infinite tensor products for both types of spaces. We show that the incomplete tensor product in the sense of von Neumann may be…
▽ More
In recent years finite tensor products of reproducing kernel Hilbert spaces (RKHSs) of Gaussian kernels on the one hand and of Hermite spaces on the other hand have been considered in tractability analysis of multivariate problems. In the present paper we study countably infinite tensor products for both types of spaces. We show that the incomplete tensor product in the sense of von Neumann may be identified with an RKHS whose domain is a proper subset of the sequence space $\mathbb{R}^\mathbb{N}$. Moreover, we show that each tensor product of spaces of Gaussian kernels having square-summable shape parameters is isometrically isomorphic to a tensor product of Hermite spaces; the corresponding isomorphism is given explicitly, respects point evaluations, and is also an $L^2$-isometry. This result directly transfers to the case of finite tensor products. Furthermore, we provide regularity results for Hermite spaces of functions of a single variable.
△ Less
Submitted 22 February, 2022; v1 submitted 12 October, 2021;
originally announced October 2021.
-
On Negative Dependence Properties of Latin Hypercube Samples and Scrambled Nets
Authors:
Benjamin Doerr,
Michael Gnewuch
Abstract:
We study the notion of $γ$-negative dependence of random variables. This notion is a relaxation of the notion of negative orthant dependence (which corresponds to $1$-negative dependence), but nevertheless it still ensures concentration of measure and allows to use large deviation bounds of Chernoff-Hoeffding- or Bernstein-type. We study random variables based on random points $P$. These random va…
▽ More
We study the notion of $γ$-negative dependence of random variables. This notion is a relaxation of the notion of negative orthant dependence (which corresponds to $1$-negative dependence), but nevertheless it still ensures concentration of measure and allows to use large deviation bounds of Chernoff-Hoeffding- or Bernstein-type. We study random variables based on random points $P$. These random variables appear naturally in the analysis of the discrepancy of $P$ or, equivalently, of a suitable worst-case integration error of the quasi-Monte Carlo cubature that uses the points in $P$ as integration nodes. We introduce the correlation number, which is the smallest possible value of $γ$ that ensures $γ$-negative dependence. We prove that the random variables of interest based on Latin hypercube sampling or on $(t,m,d)$-nets do, in general, not have a correlation number of $1$, i.e., they are not negative orthant dependent. But it is known that the random variables based on Latin hypercube sampling in dimension $d$ are actually $γ$-negatively dependent with $γ\le e^d$, and the resulting probabilistic discrepancy bounds do only mildly depend on the $γ$-value.
△ Less
Submitted 28 June, 2021; v1 submitted 21 April, 2021;
originally announced April 2021.
-
Discrepancy Bounds for a Class of Negatively Dependent Random Points Including Latin Hypercube Samples
Authors:
Michael Gnewuch,
Nils Hebbinghaus
Abstract:
We introduce a class of $γ$-negatively dependent random samples. We prove that this class includes, apart from Monte Carlo samples, in particular Latin hypercube samples and Latin hypercube samples padded by Monte Carlo.
For a $γ$-negatively dependent $N$-point sample in dimension $d$ we provide probabilistic upper bounds for its star discrepancy with explicitly stated dependence on $N$, $d$, an…
▽ More
We introduce a class of $γ$-negatively dependent random samples. We prove that this class includes, apart from Monte Carlo samples, in particular Latin hypercube samples and Latin hypercube samples padded by Monte Carlo.
For a $γ$-negatively dependent $N$-point sample in dimension $d$ we provide probabilistic upper bounds for its star discrepancy with explicitly stated dependence on $N$, $d$, and $γ$. These bounds generalize the probabilistic bounds for Monte Carlo samples from [Heinrich et al., Acta Arith. 96 (2001), 279--302] and [C.~Aistleitner, J.~Complexity 27 (2011), 531--540], and they are optimal for Monte Carlo and Latin hypercube samples. In the special case of Monte Carlo samples the constants that appear in our bounds improve substantially on the constants presented in the latter paper and in [C.~Aistleitner, M.~T.~Hofer, Math. Comp.~83 (2014), 1373--1381].
△ Less
Submitted 6 February, 2021;
originally announced February 2021.
-
A Generalized Faulhaber Inequality, Improved Bracketing Covers, and Applications to Discrepancy
Authors:
Michael Gnewuch,
Hendrik Pasing,
Christian Weiß
Abstract:
We prove a generalized Faulhaber inequality to bound the sums of the $j$-th powers of the first $n$ (possibly shifted) natural numbers. With the help of this inequality we are able to improve the known bounds for bracketing numbers of $d$-dimensional axis-parallel boxes anchored in $0$ (or, put differently, of lower left orthants intersected with the $d$-dimensional unit cube $[0,1]^d$). We use th…
▽ More
We prove a generalized Faulhaber inequality to bound the sums of the $j$-th powers of the first $n$ (possibly shifted) natural numbers. With the help of this inequality we are able to improve the known bounds for bracketing numbers of $d$-dimensional axis-parallel boxes anchored in $0$ (or, put differently, of lower left orthants intersected with the $d$-dimensional unit cube $[0,1]^d$). We use these improved bracketing numbers to establish new bounds for the star-discrepancy of negatively dependent random point sets and its expectation. We apply our findings also to the weighted star-discrepancy.
△ Less
Submitted 20 April, 2021; v1 submitted 22 October, 2020;
originally announced October 2020.
-
Randomized sparse grid algorithms for multivariate integration on Haar-Wavelet spaces
Authors:
Marcin Wnuk,
Michael Gnewuch
Abstract:
The \emph{deterministic} sparse grid method, also known as Smolyak's method, is a well-established and widely used tool to tackle multivariate approximation problems, and there is a vast literature on it. Much less is known about \emph{randomized} versions of the sparse grid method. In this paper we analyze randomized sparse grid algorithms, namely randomized sparse grid quadratures for multivaria…
▽ More
The \emph{deterministic} sparse grid method, also known as Smolyak's method, is a well-established and widely used tool to tackle multivariate approximation problems, and there is a vast literature on it. Much less is known about \emph{randomized} versions of the sparse grid method. In this paper we analyze randomized sparse grid algorithms, namely randomized sparse grid quadratures for multivariate integration on the $D$-dimensional unit cube $[0,1)^D$. Let $d,s \in \mathbb{N}$ be such that $D=d\cdot s$. The $s$-dimensional building blocks of the sparse grid quadratures are based on stratified sampling for $s=1$ and on scrambled $(0,m,s)$-nets for $s\ge 2$. The spaces of integrands and the error criterion we consider are Haar wavelet spaces with parameter $α$ and the randomized error (i.e., the worst case root mean square error), respectively. We prove sharp (i.e., matching) upper and lower bounds for the convergence rates of the $N$-th mininimal errors for all possible combinations of the parameters $d$ and $s$.
Our upper error bounds still hold if we consider as spaces of integrands Sobolev spaces of mixed dominated smoothness with smoothness parameters $1/2< α< 1$ instead of Haar wavelet spaces.
△ Less
Submitted 23 January, 2020;
originally announced January 2020.
-
On Negatively Dependent Sampling Schemes, Variance Reduction, and Probabilistic Upper Discrepancy Bounds
Authors:
Michael Gnewuch,
Marcin Wnuk,
Nils Hebbinghaus
Abstract:
We study some notions of negative dependence of a sampling scheme that can be used to derive variance bounds for the corresponding estimator or discrepancy bounds for the underlying random point set that are at least as good as the corresponding bounds for plain Monte Carlo sampling.
We provide new pre-asymptotic bounds with explicit constants for the star discrepancy and the weighted star discr…
▽ More
We study some notions of negative dependence of a sampling scheme that can be used to derive variance bounds for the corresponding estimator or discrepancy bounds for the underlying random point set that are at least as good as the corresponding bounds for plain Monte Carlo sampling.
We provide new pre-asymptotic bounds with explicit constants for the star discrepancy and the weighted star discrepancy of sampling schemes that satisfy suitable negative dependence properties. Furthermore, we compare the different notions of negative dependence and give several examples of negatively dependent sampling schemes.
△ Less
Submitted 20 November, 2019; v1 submitted 24 April, 2019;
originally announced April 2019.
-
Explicit error bounds for randomized Smolyak algorithms and an application to infinite-dimensional integration
Authors:
Michael Gnewuch,
Marcin Wnuk
Abstract:
Smolyak's method, also known as hyperbolic cross approximation or sparse grid method, is a powerful tool to tackle multivariate tensor product problems solely with the help of efficient algorithms for the corresponding univariate problem. In this paper we study the randomized setting, i.e., we randomize Smolyak's method. We provide upper and lower error bounds for randomized Smolyak algorithms wit…
▽ More
Smolyak's method, also known as hyperbolic cross approximation or sparse grid method, is a powerful tool to tackle multivariate tensor product problems solely with the help of efficient algorithms for the corresponding univariate problem. In this paper we study the randomized setting, i.e., we randomize Smolyak's method. We provide upper and lower error bounds for randomized Smolyak algorithms with explicitly given dependence on the number of variables and the number of information evaluations used. The error criteria we consider are the worst-case root mean square error (the typical error criterion for randomized algorithms, often referred to as "randomized error") and the root mean square worst-case error (often referred to as "worst-case error"). Randomized Smolyak algorithms can be used as building blocks for efficient methods such as multilevel algorithms, multivariate decomposition methods or dimension-wise quadrature methods to tackle successfully high-dimensional or even infnite-dimensional problems. As an example, we provide a very general and sharp result on the convergence rate of N-th minimal errors of infnite-dimensional integration on weighted reproducing kernel Hilbert spaces. Moreover, we are able to characterize the spaces for which randomized algorithms for infnte-dimensional integration are superior to deterministic ones. We illustrate our fndings for the special instance of weighted Korobov spaces. We indicate how these results can be extended, e.g., to spaces of functions whose smooth dependence on successive variables increases ("spaces of increasing smoothness") and to the problem of L2-approximation (function recovery).
△ Less
Submitted 6 March, 2019;
originally announced March 2019.
-
Note on Pairwise Negative Dependence of Randomized Rank-1 Lattices
Authors:
Marcin Wnuk,
Michael Gnewuch
Abstract:
In her recent paper [Negative dependence, scrambled nets, and variance bounds. Math. Oper. Res. 43 (2018), 228-251] Christiane Lemieux studied a framework to analyze the dependence structure of sampling schemes. The main goal of the framework is to determine conditions under which the negative dependence structure of a sampling scheme yields estimators with reduced variance compared to Monte Carlo…
▽ More
In her recent paper [Negative dependence, scrambled nets, and variance bounds. Math. Oper. Res. 43 (2018), 228-251] Christiane Lemieux studied a framework to analyze the dependence structure of sampling schemes. The main goal of the framework is to determine conditions under which the negative dependence structure of a sampling scheme yields estimators with reduced variance compared to Monte Carlo estimators. For instance, she was able to show that in dimension d = 2 scrambled (0,m, d)-nets lead to randomized quasi-Monte Carlo estimators with variance no larger than the variance of Monte Carlo estimators for functions monotone in each variable. Her result relies on a pairwise negative dependence property that is, in particular, satisfied by (0,m, 2)-nets. In this note we establish that the same result holds true in arbitrary dimension d for a type of randomized lattice point sets that we call randomly shifted and jittered rank-1 lattices. We show that the details of the randomization are crucial and that already small modifications may destroy the pairwise negative dependence property.
△ Less
Submitted 19 March, 2019; v1 submitted 6 March, 2019;
originally announced March 2019.
-
Embeddings for Infinite-Dimensional Integration and $L_2$-Approximation with Increasing Smoothness
Authors:
M. Gnewuch,
M. Hefter,
A. Hinrichs,
K. Ritter,
G. W. Wasilkowski
Abstract:
We study integration and $L_2$-approximation on countable tensor products of function spaces of increasing smoothness. We obtain upper and lower bounds for the minimal errors, which are sharp in many cases including, e.g., Korobov, Walsh, Haar, and Sobolev spaces. For the proofs we derive embedding theorems between spaces of increasing smoothness and appropriate weighted function spaces of fixed s…
▽ More
We study integration and $L_2$-approximation on countable tensor products of function spaces of increasing smoothness. We obtain upper and lower bounds for the minimal errors, which are sharp in many cases including, e.g., Korobov, Walsh, Haar, and Sobolev spaces. For the proofs we derive embedding theorems between spaces of increasing smoothness and appropriate weighted function spaces of fixed smoothness.
△ Less
Submitted 19 September, 2018;
originally announced September 2018.
-
Probabilistic Lower Bounds for the Discrepancy of Latin Hypercube Samples
Authors:
Benjamin Doerr,
Carola Doerr,
Michael Gnewuch
Abstract:
We provide probabilistic lower bounds for the star discrepancy of Latin hypercube samples. These bounds are sharp in the sense that they match the recent probabilistic upper bounds for the star discrepancy of Latin hypercube samples proved in [M.~Gnewuch, N.~Hebbinghaus. "Discrepancy bounds for a class of negatively dependent random points including Latin hypercube samples". Preprint 2016.]. Toget…
▽ More
We provide probabilistic lower bounds for the star discrepancy of Latin hypercube samples. These bounds are sharp in the sense that they match the recent probabilistic upper bounds for the star discrepancy of Latin hypercube samples proved in [M.~Gnewuch, N.~Hebbinghaus. "Discrepancy bounds for a class of negatively dependent random points including Latin hypercube samples". Preprint 2016.]. Together, this result and our work implies that the discrepancy of Latin hypercube samples differs at most by constant factors from the discrepancy of uniformly sampled point sets.
△ Less
Submitted 26 July, 2017;
originally announced July 2017.
-
Equivalence of Weighted Anchored and ANOVA Spaces of Functions with Mixed Smoothness of Order one in $L_p$
Authors:
Michael Gnewuch,
Mario Hefter,
Aicke Hinrichs,
Klaus Ritter,
Grzegorz W. Wasilkowski
Abstract:
We consider $γ$-weighted anchored and ANOVA spaces of functions with mixed first order partial derivatives bounded in a weighted $L_p$ norm with $1 \leq p \leq \infty$. The domain of the functions is $D^d$, where $D \subseteq \mathbb{R}$ is a bounded or unbounded interval. We provide conditions on the weights $γ$ that guarantee that anchored and ANOVA spaces are equal (as sets of functions) and ha…
▽ More
We consider $γ$-weighted anchored and ANOVA spaces of functions with mixed first order partial derivatives bounded in a weighted $L_p$ norm with $1 \leq p \leq \infty$. The domain of the functions is $D^d$, where $D \subseteq \mathbb{R}$ is a bounded or unbounded interval. We provide conditions on the weights $γ$ that guarantee that anchored and ANOVA spaces are equal (as sets of functions) and have equivalent norms with equivalence constants uniformly or polynomially bounded in $d$. Moreover, we discuss applications of these results to integration and approximation of functions on $D^d$.
△ Less
Submitted 22 October, 2016;
originally announced October 2016.
-
Embeddings of Weighted Hilbert Spaces and Applications to Multivariate and Infinite-Dimensional Integration
Authors:
Michael Gnewuch,
Mario Hefter,
Aicke Hinrichs,
Klaus Ritter
Abstract:
We study embeddings and norm estimates for tensor products of weighted reproducing kernel Hilbert spaces. These results lead to a transfer principle that is directly applicable to tractability studies of multivariate problems as integration and approximation, and to their infinite-dimensional counterparts. In an application we consider weighted tensor product Sobolev spaces of mixed smoothness of…
▽ More
We study embeddings and norm estimates for tensor products of weighted reproducing kernel Hilbert spaces. These results lead to a transfer principle that is directly applicable to tractability studies of multivariate problems as integration and approximation, and to their infinite-dimensional counterparts. In an application we consider weighted tensor product Sobolev spaces of mixed smoothness of any integer order, equipped with the classical, the anchored, or the ANOVA norm. Here we derive new results for multivariate and infinite-dimensional integration.
△ Less
Submitted 2 August, 2016;
originally announced August 2016.
-
Calculation of Discrepancy Measures and Applications
Authors:
Carola Doerr,
Michael Gnewuch,
Magnus Wahlström
Abstract:
In this book chapter we survey known approaches and algorithms to compute discrepancy measures of point sets. After providing an introduction which puts the calculation of discrepancy measures in a more general context, we focus on the geometric discrepancy measures for which computation algorithms have been designed. In particular, we explain methods to determine $L_2$-discrepancies and approache…
▽ More
In this book chapter we survey known approaches and algorithms to compute discrepancy measures of point sets. After providing an introduction which puts the calculation of discrepancy measures in a more general context, we focus on the geometric discrepancy measures for which computation algorithms have been designed. In particular, we explain methods to determine $L_2$-discrepancies and approaches to tackle the inherently difficult problem to calculate the star discrepancy of given sample sets. We also discuss in more detail three applications of algorithms to approximate discrepancies.
△ Less
Submitted 7 May, 2014;
originally announced May 2014.
-
Optimal randomized changing dimension algorithms for infinite-dimensional integration on function spaces with ANOVA-type decomposition
Authors:
Josef Dick,
Michael Gnewuch
Abstract:
We study the numerical integration problem for functions with infinitely many variables. The function spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms related to the ANOVA decomposition of the integrands. The weights model the relative importance of different groups of variables. We investigate randomized quadrature algorithms and measure their quality by…
▽ More
We study the numerical integration problem for functions with infinitely many variables. The function spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms related to the ANOVA decomposition of the integrands. The weights model the relative importance of different groups of variables. We investigate randomized quadrature algorithms and measure their quality by estimating the randomized worst-case integration error.
In particular, we provide lower error bounds for a very general class of randomized algorithms that includes non-linear and adaptive algorithms. Furthermore, we propose new randomized changing dimension algorithms and present favorable upper error bounds. For product weights and finite-intersection weights our lower and upper error bounds match and show that our changing dimension algorithms are optimal in the sense that they achieve convergence rates arbitrarily close to the best possible convergence rate. As more specific examples, we discuss unanchored Sobolev spaces of different degrees of smoothness and randomized changing dimension algorithms that use as building blocks scrambled polynomial lattice rules.
Our analysis extends the analysis given in [J. Baldeaux, M. Gnewuch. Optimal randomized multilevel algorithms for infinite-dimensional integration on function spaces with ANOVA-type decomposition. arXiv:1209.0882v1 [math.NA], Preprint 2012]. In contrast to the previous article we now investigate a different cost model for algorithms. With respect to that cost model, randomized multilevel algorithms cannot, in general, achieve optimal convergence rates, but, as we prove for important classes of weights, changing dimension algorithms actually can.
△ Less
Submitted 12 June, 2013;
originally announced June 2013.
-
Infinite-Dimensional Integration in Weighted Hilbert Spaces: Anchored Decompositions, Optimal Deterministic Algorithms, and Higher Order Convergence
Authors:
Josef Dick,
Michael Gnewuch
Abstract:
We study numerical integration of functions depending on an infinite number of variables. We provide lower error bounds for general deterministic linear algorithms and provide matching upper error bounds with the help of suitable multilevel algorithms and changing dimension algorithms.
More precisely, the spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms…
▽ More
We study numerical integration of functions depending on an infinite number of variables. We provide lower error bounds for general deterministic linear algorithms and provide matching upper error bounds with the help of suitable multilevel algorithms and changing dimension algorithms.
More precisely, the spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms induced by an underlying anchored function space decomposition. Here the weights model the relative importance of different groups of variables. The error criterion used is the deterministic worst case error. We study two cost models for function evaluation which depend on the number of active variables of the chosen sample points, and two classes of weights, namely product and order-dependent (POD) weights and the newly introduced weights with finite active dimension. We show for these classes of weights that multilevel algorithms achieve the optimal rate of convergence in the first cost model while changing dimension algorithms achieve the optimal convergence rate in the second model.
As an illustrative example, we discuss the anchored Sobolev space with smoothness parameter $α$ and provide new optimal quasi-Monte Carlo multilevel algorithms and quasi-Monte Carlo changing dimension algorithms based on higher-order polynomial lattice rules.
△ Less
Submitted 15 October, 2012;
originally announced October 2012.
-
Lower Error Bounds for Randomized Multilevel and Changing Dimension Algorithms
Authors:
Michael Gnewuch
Abstract:
We provide lower error bounds for randomized algorithms that approximate integrals of functions depending on an unrestricted or even infinite number of variables. More precisely, we consider the infinite-dimensional integration problem on weighted Hilbert spaces with an underlying anchored decomposition and arbitrary weights. We focus on randomized algorithms and the randomized worst case error. W…
▽ More
We provide lower error bounds for randomized algorithms that approximate integrals of functions depending on an unrestricted or even infinite number of variables. More precisely, we consider the infinite-dimensional integration problem on weighted Hilbert spaces with an underlying anchored decomposition and arbitrary weights. We focus on randomized algorithms and the randomized worst case error. We study two cost models for function evaluation which depend on the number of active variables of the chosen sample points. Multilevel algorithms behave very well with respect to the first cost model, while changing dimension algorithms and also dimension-wise quadrature methods, which are based on a similar idea, can take advantage of the more generous second cost model. We prove the first non-trivial lower error bounds for randomized algorithms in these cost models and demonstrate their quality in the case of product weights. In particular, we show that the randomized changing dimension algorithms provided in [L. Plaskota, G. W. Wasilkowski, J. Complexity 27 (2011), 505--518] achieve convergence rates arbitrarily close to the optimal convergence rate.
△ Less
Submitted 9 September, 2012;
originally announced September 2012.
-
Optimal randomized multilevel algorithms for infinite-dimensional integration on function spaces with ANOVA-type decomposition
Authors:
Jan Baldeaux,
Michael Gnewuch
Abstract:
In this paper, we consider the infinite-dimensional integration problem on weighted reproducing kernel Hilbert spaces with norms induced by an underlying function space decomposition of ANOVA-type. The weights model the relative importance of different groups of variables. We present new randomized multilevel algorithms to tackle this integration problem and prove upper bounds for their randomized…
▽ More
In this paper, we consider the infinite-dimensional integration problem on weighted reproducing kernel Hilbert spaces with norms induced by an underlying function space decomposition of ANOVA-type. The weights model the relative importance of different groups of variables. We present new randomized multilevel algorithms to tackle this integration problem and prove upper bounds for their randomized error. Furthermore, we provide in this setting the first non-trivial lower error bounds for general randomized algorithms, which, in particular, may be adaptive or non-linear. These lower bounds show that our multilevel algorithms are optimal. Our analysis refines and extends the analysis provided in [F. J. Hickernell, T. Müller-Gronbach, B. Niu, K. Ritter, J. Complexity 26 (2010), 229-254], and our error bounds improve substantially on the error bounds presented there. As an illustrative example, we discuss the unanchored Sobolev space and employ randomized quasi-Monte Carlo multilevel algorithms based on scrambled polynomial lattice rules.
△ Less
Submitted 5 September, 2012;
originally announced September 2012.
-
Construction of Minimal Bracketing Covers for Rectangles
Authors:
Michael Gnewuch
Abstract:
We construct explicit $δ$-bracketing covers with minimal cardinality for the set system of (anchored) rectangles in the two dimensional unit cube. More precisely, the cardinality of these $δ$-bracketing covers are bounded from above by $δ^{-2} + o(δ^{-2})$. A lower bound for the cardinality of arbitrary $δ$-bracketing covers for $d$-dimensional anchored boxes from [M. Gnewuch, Bracketing numbers…
▽ More
We construct explicit $δ$-bracketing covers with minimal cardinality for the set system of (anchored) rectangles in the two dimensional unit cube. More precisely, the cardinality of these $δ$-bracketing covers are bounded from above by $δ^{-2} + o(δ^{-2})$. A lower bound for the cardinality of arbitrary $δ$-bracketing covers for $d$-dimensional anchored boxes from [M. Gnewuch, Bracketing numbers for axis-parallel boxes and applications to geometric discrepancy, J. Complexity 24 (2008) 154-172] implies the lower bound $δ^{-2}+O(δ^{-1})$ in dimension $d=2$, showing that our constructed covers are (essentially) optimal.
We study also other $δ$-bracketing covers for the set system of rectangles, deduce the coefficient of the most significant term $δ^{-2}$ in the asymptotic expansion of their cardinality, and compute their cardinality for explicit values of $δ$.
△ Less
Submitted 28 July, 2008;
originally announced July 2008.
-
Discrepancy of Symmetric Products of Hypergraphs
Authors:
Benjamin Doerr,
Michael Gnewuch,
Nils Hebbinghaus
Abstract:
For a hypergraph ${\mathcal H} = (V,{\mathcal E})$, its $d$--fold symmetric product is $Δ^d {\mathcal H} = (V^d,\{E^d |E \in {\mathcal E}\})$. We give several upper and lower bounds for the $c$-color discrepancy of such products. In particular, we show that the bound ${disc}(Δ^d {\mathcal H},2) \le {disc}({\mathcal H},2)$ proven for all $d$ in [B. Doerr, A. Srivastav, and P. Wehr, Discrepancy of…
▽ More
For a hypergraph ${\mathcal H} = (V,{\mathcal E})$, its $d$--fold symmetric product is $Δ^d {\mathcal H} = (V^d,\{E^d |E \in {\mathcal E}\})$. We give several upper and lower bounds for the $c$-color discrepancy of such products. In particular, we show that the bound ${disc}(Δ^d {\mathcal H},2) \le {disc}({\mathcal H},2)$ proven for all $d$ in [B. Doerr, A. Srivastav, and P. Wehr, Discrepancy of {C}artesian products of arithmetic progressions, Electron. J. Combin. 11(2004), Research Paper 5, 16 pp.] cannot be extended to more than $c = 2$ colors. In fact, for any $c$ and $d$ such that $c$ does not divide $d!$, there are hypergraphs having arbitrary large discrepancy and ${disc}(Δ^d {\mathcal H},c) = Ω_d({disc}({\mathcal H},c)^d)$. Apart from constant factors (depending on $c$ and $d$), in these cases the symmetric product behaves no better than the general direct product ${\mathcal H}^d$, which satisfies ${disc}({\mathcal H}^d,c) = O_{c,d}({disc}({\mathcal H},c)^d)$.
△ Less
Submitted 20 April, 2006;
originally announced April 2006.
