-
Central limit theorem for the stratified resampling mechanism
Authors:
Roberta Flenghi,
Benjamin Jourdain
Abstract:
The stratified resampling mechanism is one of the resampling schemes commonly used in the resampling steps of particle filters. In the present paper, we prove a central limit theorem for this mechanism under the assumption that the initial positions are independent and identically distributed and the weights proportional to a positive function of the positions such that the image of their common d…
▽ More
The stratified resampling mechanism is one of the resampling schemes commonly used in the resampling steps of particle filters. In the present paper, we prove a central limit theorem for this mechanism under the assumption that the initial positions are independent and identically distributed and the weights proportional to a positive function of the positions such that the image of their common distribution by this function has a non zero component absolutely continuous with respect to the Lebesgue measure. This result relies on the convergence in distribution of the fractional part of partial sums of the normalized weights to some random variable uniformly distributed on $[0,1]$, which is established in the companion paper \cite{CLTfract} by overcoming the difficulty raised by the coupling through the normalization. Under the conjecture that a similar convergence in distribution remains valid at the next steps of a particle filter which alternates selections according to the stratified resampling mechanism and mutations according to Markov kernels, we provide an inductive formula for the asymptotic variance of the resampled population after $n$ steps. We perform numerical experiments which support the validity of this formula.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Convergence to the uniform distribution of vectors of partial sums modulo one with a common factor
Authors:
Roberta Flenghi,
Benjamin Jourdain
Abstract:
In this work, we prove the joint convergence in distribution of $q$ variables modulo one obtained as partial sums of a sequence of i.i.d. square integrable random variables multiplied by a common factor given by some function of an empirical mean of the same sequence. The limit is uniformy distributed over $[0,1]^q$. To deal with the coupling introduced by the common factor, we assume that the joi…
▽ More
In this work, we prove the joint convergence in distribution of $q$ variables modulo one obtained as partial sums of a sequence of i.i.d. square integrable random variables multiplied by a common factor given by some function of an empirical mean of the same sequence. The limit is uniformy distributed over $[0,1]^q$. To deal with the coupling introduced by the common factor, we assume that the joint distribution of the random variables has a non zero component absolutely continuous with respect to the Lebesgue measure, so that the convergence in the central limit theorem for this sequence holds in total variation distance. While our result provides a generalization of Benford's law to a data adapted mantissa, our main motivation is the derivation of a central limit theorem for the stratified resampling mechanism, which is performed in the companion paper \cite{echant}.
△ Less
Submitted 7 August, 2023; v1 submitted 3 August, 2023;
originally announced August 2023.
-
Deep Learning-based Schemes for Singularly Perturbed Convection-Diffusion Problems
Authors:
A. Beguinet,
V. Ehrlacher,
R. Flenghi,
M. Fuente,
O. Mula,
A. Somacal
Abstract:
Deep learning-based numerical schemes such as Physically Informed Neural Networks (PINNs) have recently emerged as an alternative to classical numerical schemes for solving Partial Differential Equations (PDEs). They are very appealing at first sight because implementing vanilla versions of PINNs based on strong residual forms is easy, and neural networks offer very high approximation capabilities…
▽ More
Deep learning-based numerical schemes such as Physically Informed Neural Networks (PINNs) have recently emerged as an alternative to classical numerical schemes for solving Partial Differential Equations (PDEs). They are very appealing at first sight because implementing vanilla versions of PINNs based on strong residual forms is easy, and neural networks offer very high approximation capabilities. However, when the PDE solutions are low regular, an expert insight is required to build deep learning formulations that do not incur in variational crimes. Optimization solvers are also significantly challenged, and can potentially spoil the final quality of the approximated solution due to the convergence to bad local minima, and bad generalization capabilities. In this paper, we present an exhaustive numerical study of the merits and limitations of these schemes when solutions exhibit low-regularity, and compare performance with respect to more benign cases when solutions are very smooth. As a support for our study, we consider singularly perturbed convection-diffusion problems where the regularity of solutions typically degrades as certain multiscale parameters go to zero.
△ Less
Submitted 10 May, 2022;
originally announced May 2022.
-
Central limit theorem over non-linear functionals of empirical measures: beyond the iid setting
Authors:
Roberta Flenghi,
Benjamin Jourdain
Abstract:
The central limit theorem is, with the strong law of large numbers, one of the two fundamental limit theorems in probability theory. Benjamin Jourdain and Alvin Tse have extended to non-linear functionals of the empirical measure of independent and identically distributed random vectors the central limit theorem which is well known for linear functionals. The main tool permitting this extension is…
▽ More
The central limit theorem is, with the strong law of large numbers, one of the two fundamental limit theorems in probability theory. Benjamin Jourdain and Alvin Tse have extended to non-linear functionals of the empirical measure of independent and identically distributed random vectors the central limit theorem which is well known for linear functionals. The main tool permitting this extension is the linear functional derivative, one of the notions of derivation on the Wasserstein space of probability measures that have recently been developed. The purpose of this work is to generalize what has been done by Jourdain and Tse: provide a Central Limit Theorem for non-linear functionals of independent and non equidistributed random vectors such as the successive values of an ergodic Markov chain.
△ Less
Submitted 13 April, 2022;
originally announced April 2022.
