Stochastic Langevin Monte Carlo for (weakly) log-concave posterior distributions
Authors:
Marelys Crespo Navas,
Sébastien Gadat,
Xavier Gendre
Abstract:
In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is popular in machine learning for sampling posterior distribution. We will pay specific attention in our work to the computational cost in terms of $n$ (the numbe…
▽ More
In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is popular in machine learning for sampling posterior distribution. We will pay specific attention in our work to the computational cost in terms of $n$ (the number of observations that produces the posterior distribution), and $d$ (the dimension of the ambient space where the parameter of interest is living). We derive our analysis in the weakly convex framework, which is parameterized with the help of the Kurdyka-Łojasiewicz (KL) inequality, that permits to handle a vanishing curvature settings, which is far less restrictive when compared to the simple strongly convex case. We establish that the final horizon of simulation to obtain an $\varepsilon$ approximation (in terms of entropy) is of the order $( d \log(n)^2 )^{(1+r)^2} [\log^2(\varepsilon^{-1}) + n^2 d^{2(1+r)} \log^{4(1+r)}(n) ]$ with a Poissonian subsampling of parameter $\left(n ( d \log^2(n))^{1+r}\right)^{-1}$, where the parameter $r$ is involved in the KL inequality and varies between $0$ (strongly convex case) and $1$ (limiting Laplace situation).
△ Less
Submitted 8 January, 2023;
originally announced January 2023.
A statistical approach for robust tolerance design
Authors:
Ambre Diet,
Nicolas Couellan,
Xavier Gendre,
Julien Martin
Abstract:
Within an industrial manufacturing process, tolerancing is a key player. The dimensions uncertainties management starts during the design phase, with an assessment on variability of parts not yet produced. For one assembly step, we can gain knowledge from the tolerance range required for the parts involved. In order to assess output uncertainty of this assembly in a reliable way, this paper presen…
▽ More
Within an industrial manufacturing process, tolerancing is a key player. The dimensions uncertainties management starts during the design phase, with an assessment on variability of parts not yet produced. For one assembly step, we can gain knowledge from the tolerance range required for the parts involved. In order to assess output uncertainty of this assembly in a reliable way, this paper presents an approach based on the deviation of the sum of uniform distributions. As traditional approaches based on Hoeffding inequalities do not give accurate results when the deviation considered is small, we propose an improved upper bound. We then discuss how the stack chain geometry impacts the bound definition. Finally, we show an application of the proposed approach in tolerance design of an aircraft sub-assembly. The main interest of the technique compared to existing methodologies is the management of the confidence level and the emphasis of the explicit role of the balance within the stack chain.
△ Less
Submitted 19 December, 2019;
originally announced December 2019.