Title:Convergence Analysis of Langevin Monte Carlo in Chi-Square Divergence

Abstract:We study sampling from a target distribution $\nu_* \propto e^{-f}$ using the unadjusted Langevin Monte Carlo (LMC) algorithm when the target $\nu_*$ satisfies the Poincaré inequality and the potential $f$ is weakly smooth, i.e., $\nabla f$ is $\beta$-Hölder continuous. We prove that $\widetilde{\mathcal{O}}(\epsilon^{-1/\beta})$ steps are sufficient for LMC to reach $\epsilon$ neighborhood of the target in Chi-square divergence. We derive the dimension dependency of the convergence rate under various scenarios, where the effects of initialization and the Poincaré constant are particularly taken into consideration. For convex and first-order smooth potentials, if we assume the Kannan-Lovász-Simonovits (KLS) conjecture, then LMC with warm-start achieves the best-known rate $\widetilde{\mathcal{O}}(d\epsilon^{-1})$ which was previously established for strongly convex potentials. In the pessimistic case when the KLS conjecture is not true, using the results of Lee and Vempala, and initializing LMC with a Gaussian, we obtain the rate $\widetilde{\mathcal{O}}(d^{3}\epsilon^{-1})$ for all smooth potentials that are convex up to finite perturbations. Translating this rate to KL divergence improves upon the best-known rate for smooth potentials that have linear tail growth. For weakly smooth potentials whose tails behave like $\|x\|^\alpha$, the regime of improvement becomes the interval $\alpha \in (1,10/7]$.
Finally, as we rely on the Poincaré inequality, our framework covers a wide range of non-convex potentials that are weakly smooth, and have at least linear tail growth.