-
Fast relaxation of the random field Ising dynamics
Authors:
Ahmed El Alaoui,
Ronen Eldan,
Reza Gheissari,
Arianna Piana
Abstract:
We study the convergence properties of Glauber dynamics for the random field Ising model (RFIM) with ferromagnetic interactions on finite domains of $\mathbb{Z}^d$, $d \ge 2$. Of particular interest is the Griffiths phase where correlations decay exponentially fast in expectation over the quenched disorder, but there exist arbitrarily large islands of weak fields where low-temperature behavior is…
▽ More
We study the convergence properties of Glauber dynamics for the random field Ising model (RFIM) with ferromagnetic interactions on finite domains of $\mathbb{Z}^d$, $d \ge 2$. Of particular interest is the Griffiths phase where correlations decay exponentially fast in expectation over the quenched disorder, but there exist arbitrarily large islands of weak fields where low-temperature behavior is observed. Our results are twofold:
1. Under weak spatial mixing (boundary-to-bulk exponential decay of correlations) in expectation, we show that the dynamics satisfy a weak Poincaré inequality implying algebraic relaxation to equilibrium over timescales polynomial in the volume $N$ of the domain, and polynomial time mixing from a warm start. From this we construct a polynomial-time approximate sampling algorithm based on running Glauber dynamics over an increasing sequence of approximations of the domain.
2. Under strong spatial mixing (exponential decay of correlations even near boundary pinnings) in expectation, we prove a full Poincaré inequality, implying exponential relaxation to equilibrium and $N^{o(1)}$-mixing time. Note by way of example, both weak and strong spatial mixing hold at any temperature, provided the external fields are strong enough.
Our proofs combine a stochastic localization technique which has the effect of increasing the variance of the field, with a field-dependent coarse graining which controls the resulting sub-critical percolation process of sites with weak fields.
△ Less
Submitted 12 November, 2024; v1 submitted 10 November, 2023;
originally announced November 2023.
-
Hit-and-run mixing via localization schemes
Authors:
Yuansi Chen,
Ronen Eldan
Abstract:
We analyze the hit-and-run algorithm for sampling uniformly from an isotropic convex body $K$ in $n$ dimensions. We show that the algorithm mixes in time $\tilde{O}(n^2/ ψ_n^2)$, where $ψ_n$ is the smallest isoperimetric constant for any isotropic logconcave distribution, also known as the Kannan-Lovasz-Simonovits (KLS) constant. Our bound improves upon previous bounds of the form…
▽ More
We analyze the hit-and-run algorithm for sampling uniformly from an isotropic convex body $K$ in $n$ dimensions. We show that the algorithm mixes in time $\tilde{O}(n^2/ ψ_n^2)$, where $ψ_n$ is the smallest isoperimetric constant for any isotropic logconcave distribution, also known as the Kannan-Lovasz-Simonovits (KLS) constant. Our bound improves upon previous bounds of the form $\tilde{O}(n^2 R^2/r^2)$, which depend on the ratio $R/r$ of the radii of the circumscribed and inscribed balls of $K$, gaining a factor of $n$ in the case of isotropic convex bodies. Consequently, our result gives a mixing time estimate for the hit-and-run which matches the state-of-the-art bounds for the ball walk. Our main proof technique is based on an annealing of localization schemes introduced in Chen and Eldan (2022), which allows us to reduce the problem to the analysis of the mixing time on truncated Gaussian distributions.
△ Less
Submitted 1 December, 2022;
originally announced December 2022.
-
Noise stability on the Boolean hypercube via a renormalized Brownian motion
Authors:
Ronen Eldan,
Dan Mikulincer,
Prasad Raghavendra
Abstract:
We consider a variant of the classical notion of noise on the Boolean hypercube which gives rise to a new approach to inequalities regarding noise stability. We use this approach to give a new proof of the Majority is Stablest theorem by Mossel, O'Donnell, and Oleszkiewicz, improving the dependence of the bound on the maximal influence of the function from logarithmic to polynomial. We also show t…
▽ More
We consider a variant of the classical notion of noise on the Boolean hypercube which gives rise to a new approach to inequalities regarding noise stability. We use this approach to give a new proof of the Majority is Stablest theorem by Mossel, O'Donnell, and Oleszkiewicz, improving the dependence of the bound on the maximal influence of the function from logarithmic to polynomial. We also show that a variant of the conjecture by Courtade and Kumar regarding the most informative Boolean function, where the classical noise is replaced by our notion, holds true. Our approach is based on a stochastic construction that we call the renormalized Brownian motion, which facilitates the use of inequalities in Gaussian space in the analysis of Boolean functions.
△ Less
Submitted 12 August, 2022;
originally announced August 2022.
-
An Optimal "It Ain't Over Till It's Over" Theorem
Authors:
Ronen Eldan,
Avi Wigderson,
Pei Wu
Abstract:
We study the probability of Boolean functions with small max influence to become constant under random restrictions. Let $f$ be a Boolean function such that the variance of $f$ is $Ω(1)$ and all its individual influences are bounded by $τ$. We show that when restricting all but a $ρ=\tildeΩ((\log(1/τ))^{-1})$ fraction of the coordinates, the restricted function remains nonconstant with overwhelmin…
▽ More
We study the probability of Boolean functions with small max influence to become constant under random restrictions. Let $f$ be a Boolean function such that the variance of $f$ is $Ω(1)$ and all its individual influences are bounded by $τ$. We show that when restricting all but a $ρ=\tildeΩ((\log(1/τ))^{-1})$ fraction of the coordinates, the restricted function remains nonconstant with overwhelming probability. This bound is essentially optimal, as witnessed by the tribes function $\mathrm{TRIBES}=\mathrm{AND}_{n/C\log n}\circ\mathrm{OR}_{C\log n}$.
We extend it to an anti-concentration result, showing that the restricted function has nontrivial variance with probability $1-o(1)$. This gives a sharp version of the "it ain't over till it's over" theorem due to Mossel, O'Donnell, and Oleszkiewicz. Our proof is discrete, and avoids the use of the invariance principle.
We also show two consequences of our above result: (i) As a corollary, we prove that for a uniformly random input $x$, the block sensitivity of $f$ at $x$ is $\tildeΩ(\log(1/τ))$ with probability $1-o(1)$. This should be compared with the implication of Kahn, Kalai, and Linial's result, which implies that the average block sensitivity of $f$ is $Ω(\log(1/τ))$. (ii) Combining our proof with a well-known result due to O'Donnell, Saks, Schramm, and Servedio, one can also conclude that: Restricting all but a $ρ=\tildeΩ(1/\sqrt{\log (1/τ) })$ fraction of the coordinates of a monotone function $f$, then the restricted function has decision tree complexity $Ω(τ^{-Θ(ρ)})$ with probability $Ω(1)$.
△ Less
Submitted 6 August, 2022;
originally announced August 2022.
-
Isoperimetric Inequalities Made Simpler
Authors:
Ronen Eldan,
Guy Kindler,
Noam Lifshitz,
Dor Minzer
Abstract:
We give an alternative, simple method to prove isoperimetric inequalities over the hypercube. In particular, we show:
1. An elementary proof of classical isoperimetric inequalities of Talagrand, as well as a stronger isoperimetric result conjectured by Talagrand and recently proved by Eldan and Gross.
2. A strengthening of the Friedgut junta theorem, asserting that if the $p$-moment of the sen…
▽ More
We give an alternative, simple method to prove isoperimetric inequalities over the hypercube. In particular, we show:
1. An elementary proof of classical isoperimetric inequalities of Talagrand, as well as a stronger isoperimetric result conjectured by Talagrand and recently proved by Eldan and Gross.
2. A strengthening of the Friedgut junta theorem, asserting that if the $p$-moment of the sensitivity of a function is constant for some $1/2 + \varepsilon\leq p\leq 1$, then the function is close to a junta. In this language, Friedgut's theorem is the special case that $p=1$.
△ Less
Submitted 21 July, 2025; v1 submitted 13 April, 2022;
originally announced April 2022.
-
Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chains
Authors:
Yuansi Chen,
Ronen Eldan
Abstract:
Two recent and seemingly-unrelated techniques for proving mixing bounds for Markov chains are: (i) the framework of Spectral Independence, introduced by Anari, Liu and Oveis Gharan, and its numerous extensions, which have given rise to several breakthroughs in the analysis of mixing times of discrete Markov chains and (ii) the Stochastic Localization technique which has proven useful in establishi…
▽ More
Two recent and seemingly-unrelated techniques for proving mixing bounds for Markov chains are: (i) the framework of Spectral Independence, introduced by Anari, Liu and Oveis Gharan, and its numerous extensions, which have given rise to several breakthroughs in the analysis of mixing times of discrete Markov chains and (ii) the Stochastic Localization technique which has proven useful in establishing mixing and expansion bounds for both log-concave measures and for measures on the discrete hypercube. In this paper, we introduce a framework which connects ideas from both techniques. Our framework unifies, simplifies and extends those two techniques. In its center is the concept of a localization scheme which, to every probability measure, assigns a martingale of probability measures which localize in space as time evolves. As it turns out, to every such scheme corresponds a Markov chain, and many chains of interest appear naturally in this framework. This viewpoint provides tools for deriving mixing bounds for the dynamics through the analysis of the corresponding localization process. Generalizations of concepts of Spectral Independence and Entropic Independence naturally arise from our definitions, and in particular we recover the main theorems in the spectral and entropic independence frameworks via simple martingale arguments (completely bypassing the need to use the theory of high-dimensional expanders). We demonstrate the strength of our proposed machinery by giving short and (arguably) simpler proofs to many mixing bounds in the recent literature, including giving the first $O(n \log n)$ bound for the mixing time of Glauber dynamics on the hardcore-model (of arbitrary degree) in the tree-uniqueness regime.
△ Less
Submitted 6 June, 2022; v1 submitted 8 March, 2022;
originally announced March 2022.
-
Non-asymptotic approximations of neural networks by Gaussian processes
Authors:
Ronen Eldan,
Dan Mikulincer,
Tselil Schramm
Abstract:
We study the extent to which wide neural networks may be approximated by Gaussian processes when initialized with random weights. It is a well-established fact that as the width of a network goes to infinity, its law converges to that of a Gaussian process. We make this quantitative by establishing explicit convergence rates for the central limit theorem in an infinite-dimensional functional space…
▽ More
We study the extent to which wide neural networks may be approximated by Gaussian processes when initialized with random weights. It is a well-established fact that as the width of a network goes to infinity, its law converges to that of a Gaussian process. We make this quantitative by establishing explicit convergence rates for the central limit theorem in an infinite-dimensional functional space, metrized with a natural transportation distance. We identify two regimes of interest; when the activation function is polynomial, its degree determines the rate of convergence, while for non-polynomial activations, the rate is governed by the smoothness of the function.
△ Less
Submitted 17 February, 2021;
originally announced February 2021.
-
Log concavity and concentration of Lipschitz functions on the Boolean hypercube
Authors:
Ronen Eldan,
Omer Shamir
Abstract:
It is well-known that measures whose density is the form $e^{-V}$ where $V$ is a uniformly convex potential on $\RR^n$ attain strong concentration properties. In search of a notion of log-concavity on the discrete hypercube, we consider measures on $\{-1,1\}^n$ whose multi-linear extension $f$ satisfies $\log \nabla^2 f(x) \preceq β\Id$, for $β\geq 0$, which we refer to as $β$-semi-log-concave. We…
▽ More
It is well-known that measures whose density is the form $e^{-V}$ where $V$ is a uniformly convex potential on $\RR^n$ attain strong concentration properties. In search of a notion of log-concavity on the discrete hypercube, we consider measures on $\{-1,1\}^n$ whose multi-linear extension $f$ satisfies $\log \nabla^2 f(x) \preceq β\Id$, for $β\geq 0$, which we refer to as $β$-semi-log-concave. We prove that these measures satisfy a nontrivial concentration bound, namely, any Hamming Lipchitz test function $\varphi$ satisfies $\Var_ν[\varphi] \leq n^{2-C_β}$ for $C_β>0$. As a corollary, we prove a concentration bound for measures which exhibit the so-called Rayleigh property. Namely, we show that for measures such that under any external field (or exponential tilt), the correlation between any two coordinates is non-positive, Hamming-Lipschitz functions admit nontrivial concentration.
△ Less
Submitted 26 July, 2020;
originally announced July 2020.
-
A Spectral Condition for Spectral Gap: Fast Mixing in High-Temperature Ising Models
Authors:
Ronen Eldan,
Frederic Koehler,
Ofer Zeitouni
Abstract:
We prove that Ising models on the hypercube with general quadratic interactions satisfy a Poincaré inequality with respect to the natural Dirichlet form corresponding to Glauber dynamics, as soon as the operator norm of the interaction matrix is smaller than $1$. The inequality implies a control on the mixing time of the Glauber dynamics. Our techniques rely on a localization procedure which estab…
▽ More
We prove that Ising models on the hypercube with general quadratic interactions satisfy a Poincaré inequality with respect to the natural Dirichlet form corresponding to Glauber dynamics, as soon as the operator norm of the interaction matrix is smaller than $1$. The inequality implies a control on the mixing time of the Glauber dynamics. Our techniques rely on a localization procedure which establishes a structural result, stating that Ising measures may be decomposed into a mixture of measures with quadratic potentials of rank one, and provides a framework for proving concentration bounds for high temperature Ising models.
△ Less
Submitted 6 August, 2021; v1 submitted 16 July, 2020;
originally announced July 2020.
-
Community detection and percolation of information in a geometric setting
Authors:
Ronen Eldan,
Dan Mikulincer,
Hester Pieters
Abstract:
We make the first steps towards generalizing the theory of stochastic block models, in the sparse regime, towards a model where the discrete community structure is replaced by an underlying geometry. We consider a geometric random graph over a homogeneous metric space where the probability of two vertices to be connected is an arbitrary function of the distance. We give sufficient conditions under…
▽ More
We make the first steps towards generalizing the theory of stochastic block models, in the sparse regime, towards a model where the discrete community structure is replaced by an underlying geometry. We consider a geometric random graph over a homogeneous metric space where the probability of two vertices to be connected is an arbitrary function of the distance. We give sufficient conditions under which the locations can be recovered (up to an isomorphism of the space) in the sparse regime. Moreover, we define a geometric counterpart of the model of flow of information on trees, due to Mossel and Peres, in which one considers a branching random walk on a sphere and the goal is to recover the location of the root based on the locations of leaves. We give some sufficient conditions for percolation and for non-percolation of information in this model.
△ Less
Submitted 1 July, 2022; v1 submitted 28 June, 2020;
originally announced June 2020.
-
A simple approach to chaos for $p$-spin models
Authors:
Ronen Eldan
Abstract:
We prove that, in mixed $p$-spin models of spin glasses, the location of the ground state is chaotic under small Gaussian perturbations. For the case of even $p$-spin models, this was shown by Chen, Handschy and Lerman [2018]. We rely on a different approach which only uses the Parisi formula as a black box.
We prove that, in mixed $p$-spin models of spin glasses, the location of the ground state is chaotic under small Gaussian perturbations. For the case of even $p$-spin models, this was shown by Chen, Handschy and Lerman [2018]. We rely on a different approach which only uses the Parisi formula as a black box.
△ Less
Submitted 10 May, 2020; v1 submitted 30 April, 2020;
originally announced April 2020.
-
Second-order bounds on correlations between increasing families
Authors:
Ronen Eldan
Abstract:
Harris's correlation inequality states that any two monotone functions on the Boolean hypercube are positively correlated. Talagrand \cite{Talcorr} started a line of works in search of quantitative versions of this fact by providing a lower bound on the correlation in terms of the influences of the functions. A famous conjecture of Chvátal \cite{Chvatal} was found by Friedgut, Kahn, Kalai and Kell…
▽ More
Harris's correlation inequality states that any two monotone functions on the Boolean hypercube are positively correlated. Talagrand \cite{Talcorr} started a line of works in search of quantitative versions of this fact by providing a lower bound on the correlation in terms of the influences of the functions. A famous conjecture of Chvátal \cite{Chvatal} was found by Friedgut, Kahn, Kalai and Keller \cite{FKKK} to be equivalent to a certain strengthening of Talagrand's bound, conjectured to hold true when one of the functions is antipodal (hence $g(x) = 1-g(-x)$). Motivated by this conjecture, we strengthen some of those bounds by giving estimates that also involve the second order Fourier coefficients of the functions. In particular we show that in the bounds due to Talagrand and due to Keller, Mossel and Sen \cite{KMS14}, a logarithmic factor can be replaced by its square root when one of the functions is antipodal. Our proofs follow a different route than the ones in the literature, and the analysis is carried out in the Gaussian setting.
△ Less
Submitted 25 December, 2019;
originally announced December 2019.
-
Concentration on the Boolean hypercube via pathwise stochastic analysis
Authors:
Ronen Eldan,
Renan Gross
Abstract:
We develop a new technique for proving concentration inequalities which relate between the variance and influences of Boolean functions. Using this technique, we
1. Settle a conjecture of Talagrand [Tal97] proving that…
▽ More
We develop a new technique for proving concentration inequalities which relate between the variance and influences of Boolean functions. Using this technique, we
1. Settle a conjecture of Talagrand [Tal97] proving that $$\int_{\left\{ -1,1\right\} ^{n}}\sqrt{h_{f}\left(x\right)}dμ\geq C\cdot\mathrm{var}\left(f\right)\cdot\left(\log\left(\frac{1}{\sum\mathrm{Inf}_{i}^{2}\left(f\right)}\right)\right)^{1/2},$$ where $h_{f}\left(x\right)$ is the number of edges at $x$ along which $f$ changes its value, and $\mathrm{Inf}_{i}\left(f\right)$ is the influence of the $i$-th coordinate.
2. Strengthen several classical inequalities concerning the influences of a Boolean function, showing that near-maximizers must have large vertex boundaries. An inequality due to Talagrand states that for a Boolean function $f$, $\mathrm{var}\left(f\right)\leq C\sum_{i=1}^{n}\frac{\mathrm{Inf}_{i}\left(f\right)}{1+\log\left(1/\mathrm{Inf}_{i}\left(f\right)\right)}$. We give a lower bound for the size of the vertex boundary of functions saturating this inequality. As a corollary, we show that for sets that satisfy the edge-isoperimetric inequality or the Kahn-Kalai-Linial inequality up to a constant, a constant proportion of the mass is in the inner vertex boundary.
3. Improve a quantitative relation between influences and noise stability given by Keller and Kindler.
Our proofs rely on techniques based on stochastic calculus, and bypass the use of hypercontractivity common to previous proofs.
△ Less
Submitted 12 March, 2020; v1 submitted 26 September, 2019;
originally announced September 2019.
-
Stability of the Shannon-Stam inequality via the Föllmer process
Authors:
Ronen Eldan,
Dan Mikulincer
Abstract:
We prove stability estimates for the Shannon-Stam inequality (also known as the entropy-power inequality) for log-concave random vectors in terms of entropy and transportation distance. In particular, we give the first stability estimate for general log-concave random vectors in the following form: for log-concave random vectors $X,Y \in \mathbb{R}^d$, the deficit in the Shannon-Stam inequality is…
▽ More
We prove stability estimates for the Shannon-Stam inequality (also known as the entropy-power inequality) for log-concave random vectors in terms of entropy and transportation distance. In particular, we give the first stability estimate for general log-concave random vectors in the following form: for log-concave random vectors $X,Y \in \mathbb{R}^d$, the deficit in the Shannon-Stam inequality is bounded from below by the expression
$$
C \left(\mathrm{D}\left(X||G\right) + \mathrm{D}\left(Y||G\right)\right),
$$
where $\mathrm{D}\left( \cdot ~ ||G\right)$ denotes the relative entropy with respect to the standard Gaussian and the constant $C$ depends only on the covariance structures and the spectral gaps of $X$ and $Y$. In the case of uniformly log-concave vectors our analysis gives dimension-free bounds. Our proofs are based on a new approach which uses an entropy-minimizing process from stochastic control theory.
△ Less
Submitted 17 March, 2019;
originally announced March 2019.
-
A dimension-free reverse logarithmic Sobolev inequality for low-complexity functions in Gaussian space
Authors:
Ronen Eldan,
Michel Ledoux
Abstract:
We discuss new proofs, and new forms, of a reverse logarithmic Sobolev inequality, with respect to the standard Gaussian measure, for low complexity functions, measured in terms of Gaussian-width. In particular, we provide a dimension-free improvement for a related result given in [Eldan '18].
We discuss new proofs, and new forms, of a reverse logarithmic Sobolev inequality, with respect to the standard Gaussian measure, for low complexity functions, measured in terms of Gaussian-width. In particular, we provide a dimension-free improvement for a related result given in [Eldan '18].
△ Less
Submitted 17 March, 2019;
originally announced March 2019.
-
Stability of the logarithmic Sobolev inequality via the Föllmer Process
Authors:
Ronen Eldan,
Joseph Lehec,
Yair Shenfeld
Abstract:
We study the stability and instability of the Gaussian logarithmic Sobolev inequality, in terms of covariance, Wasserstein distance and Fisher information, addressing several open questions in the literature. We first establish an improved logarithmic Sobolev inequality which is at the same time scale invariant and dimension free. As a corollary, we show that if the covariance of the measure is bo…
▽ More
We study the stability and instability of the Gaussian logarithmic Sobolev inequality, in terms of covariance, Wasserstein distance and Fisher information, addressing several open questions in the literature. We first establish an improved logarithmic Sobolev inequality which is at the same time scale invariant and dimension free. As a corollary, we show that if the covariance of the measure is bounded by the identity, one may obtain a sharp and dimension-free stability bound in terms of the Fisher information matrix. We then investigate under what conditions stability estimates control the covariance, and when such control is impossible. For the class of measures whose covariance matrix is dominated by the identity, we obtain optimal dimension-free stability bounds which show that the deficit in the logarithmic Sobolev inequality is minimized by Gaussian measures, under a fixed covariance constraint. On the other hand, we construct examples showing that without the boundedness of the covariance, the inequality is not stable. Finally, we study stability in terms of the Wasserstein distance, and show that even for the class of measures with a bounded covariance matrix, it is hopeless to obtain a dimension-free stability result. The counterexamples provided motivate us to put forth a new notion of stability, in terms of proximity to mixtures of the Gaussian distribution. We prove new estimates (some dimension-free) based on this notion. These estimates are strictly stronger than some of the existing stability results in terms of the Wasserstein metric. Our proof techniques rely heavily on stochastic methods.
△ Less
Submitted 29 May, 2020; v1 submitted 11 March, 2019;
originally announced March 2019.
-
Taming correlations through entropy-efficient measure decompositions with applications to mean-field approximation
Authors:
Ronen Eldan
Abstract:
The analysis of various models in statistical physics relies on the existence of decompositions of measures into mixtures of product-like components, where the goal is to attain a decomposition into measures whose entropy is close to that of the original measure, yet with small correlations between coordinates. We prove a related general result: For every isotropic measure $μ$ on $\mathbb{R}^n$ an…
▽ More
The analysis of various models in statistical physics relies on the existence of decompositions of measures into mixtures of product-like components, where the goal is to attain a decomposition into measures whose entropy is close to that of the original measure, yet with small correlations between coordinates. We prove a related general result: For every isotropic measure $μ$ on $\mathbb{R}^n$ and every $ε> 0$, there exists a decomposition $μ= \int μ_θd m(θ)$ such that $H(μ) - \mathbb{E}_{θ\sim m} H(μ_θ) \leq n ε$ and $\mathbb{E}_{θ\sim m} \mathrm{Cov}(μ_θ) \preceq \mathrm{Id}/ε$. As an application, we prove a general bound for the mean-field approximation of Ising and Potts models, which is in a sense dimension free, in both continuous and discrete settings. In particular, for an Ising model on $\{\pm 1 \}^n$ or on $[-1,1]^n$, we show that the deficit between the mean-field approximation and the free energy is at most $C \frac{1+p}{p} \left ( n\|J\|_{S_p} \right)^{\frac{p}{1+p}} $ for all $p>0$, where $\|J\|_{S_p}$ denotes the Schatten-$p$ norm of the interaction matrix. For the case $p=2$, this recovers the result of [Jain et al., 2018], but for an optimal choice of $p$ it often allows to get almost dimension-free bounds.
△ Less
Submitted 31 May, 2019; v1 submitted 28 November, 2018;
originally announced November 2018.
-
The CLT in high dimensions: quantitative bounds via martingale embedding
Authors:
Ronen Eldan,
Dan Mikulincer,
Alex Zhai
Abstract:
We introduce a new method for obtaining quantitative convergence rates for the central limit theorem (CLT) in a high dimensional setting. Using our method, we obtain several new bounds for convergence in transportation distance and entropy, and in particular: (a) We improve the best known bound, obtained by the third named author, for convergence in quadratic Wasserstein transportation distance fo…
▽ More
We introduce a new method for obtaining quantitative convergence rates for the central limit theorem (CLT) in a high dimensional setting. Using our method, we obtain several new bounds for convergence in transportation distance and entropy, and in particular: (a) We improve the best known bound, obtained by the third named author, for convergence in quadratic Wasserstein transportation distance for bounded random vectors; (b) We derive the first non-asymptotic convergence rate for the entropic CLT in arbitrary dimension, for general log-concave random vectors; (c) We give an improved bound for convergence in transportation distance under a log-concavity assumption and improvements for both metrics under the assumption of strong log-concavity. Our method is based on martingale embeddings and specifically on the Skorokhod embedding constructed by the first named author.
△ Less
Submitted 7 September, 2020; v1 submitted 24 June, 2018;
originally announced June 2018.
-
Cone points of Brownian motion in arbitrary dimension
Authors:
Yotam Alexander,
Ronen Eldan
Abstract:
We show that the convex hull of the path of Brownian motion in $n$-dimensions, up to time $1$, is a smooth set. As a consequence, we conclude that a Brownian motion in any dimension almost surely has no cone points for any cone whose dual cone is nontrivial.
We show that the convex hull of the path of Brownian motion in $n$-dimensions, up to time $1$, is a smooth set. As a consequence, we conclude that a Brownian motion in any dimension almost surely has no cone points for any cone whose dual cone is nontrivial.
△ Less
Submitted 4 May, 2018;
originally announced May 2018.
-
Decomposition of mean-field Gibbs distributions into product measures
Authors:
Ronen Eldan,
Renan Gross
Abstract:
We show that under a low complexity condition on the gradient of a Hamiltonian, Gibbs distributions on the Boolean hypercube are approximate mixtures of product measures whose probability vectors are critical points of an associated mean-field functional. This extends a previous work by the first author. As an application, we demonstrate how this framework helps characterize both Ising models sati…
▽ More
We show that under a low complexity condition on the gradient of a Hamiltonian, Gibbs distributions on the Boolean hypercube are approximate mixtures of product measures whose probability vectors are critical points of an associated mean-field functional. This extends a previous work by the first author. As an application, we demonstrate how this framework helps characterize both Ising models satisfying a mean-field condition and the conditional distributions which arise in the emerging theory of nonlinear large deviations, both in the dense case and in the polynomially-sparse case.
△ Less
Submitted 19 April, 2018; v1 submitted 19 August, 2017;
originally announced August 2017.
-
Exponential random graphs behave like mixtures of stochastic block models
Authors:
Ronen Eldan,
Renan Gross
Abstract:
We study the behavior of exponential random graphs in both the sparse and the dense regime. We show that exponential random graphs are approximate mixtures of graphs with independent edges whose probability matrices are critical points of an associated functional, thereby satisfying a certain matrix equation. In the dense regime, every solution to this equation is close to a block matrix, concludi…
▽ More
We study the behavior of exponential random graphs in both the sparse and the dense regime. We show that exponential random graphs are approximate mixtures of graphs with independent edges whose probability matrices are critical points of an associated functional, thereby satisfying a certain matrix equation. In the dense regime, every solution to this equation is close to a block matrix, concluding that the exponential random graph behaves roughly like a mixture of stochastic block models. We also show existence and uniqueness of solutions to this equation for several families of exponential random graphs, including the case where the subgraphs are counted with positive weights and the case where all weights are small in absolute value. In particular, this generalizes some of the results in a paper by Chatterjee and Diaconis from the dense regime to the sparse regime and strengthens their bounds from the cut-metric to the one-metric.
△ Less
Submitted 19 April, 2018; v1 submitted 5 July, 2017;
originally announced July 2017.
-
Gaussian-width gradient complexity, reverse log-Sobolev inequalities and nonlinear large deviations
Authors:
Ronen Eldan
Abstract:
We prove structure theorems for measures on the discrete cube and on Gaussian space, which provide sufficient conditions for mean-field behavior. These conditions rely on a new notion of complexity for such measures, namely the Gaussian-width of the gradient of the log-density. On the cube $\{-1,1\}^n$, we show that a measure $ν$ which exhibits low complexity can be written as a mixture of measure…
▽ More
We prove structure theorems for measures on the discrete cube and on Gaussian space, which provide sufficient conditions for mean-field behavior. These conditions rely on a new notion of complexity for such measures, namely the Gaussian-width of the gradient of the log-density. On the cube $\{-1,1\}^n$, we show that a measure $ν$ which exhibits low complexity can be written as a mixture of measures $\{ν_θ\}_{θ\in \mathcal{I}}$ such that: i. for each $θ$, the measure $ν_θ$ is a small perturbation of $ν$ such that $\log \tfrac{d ν_θ}{d ν}$ is a linear function whose gradient is small and, ii. $ν_θ$ is close to some product measure, in Wasserstein distance, for most $θ$. Thus, our framework can be used to study the behavior of low-complexity measures beyond approximation of the partition function, showing that those measures are roughly mixtures of product measures whose entropy is close to that of the original measure. In particular, as a corollary of our theorems, we derive a bound for the naïve mean-field approximation of the log-partition function which improves the nonlinear large deviation framework of Chatterjee and Dembo in several ways: 1. It does not require any bounds on second derivatives. 2. The covering number is replaced by the weaker notion of Gaussian-width 3. We obtain stronger asymptotics with respect to the dimension. Two other corollaries are decomposition theorems for exponential random graphs and large-degree Ising models. In the Gaussian case, we show that measures of low-complexity exhibit an almost-tight reverse Log-Sobolev inequality.
△ Less
Submitted 29 June, 2018; v1 submitted 13 December, 2016;
originally announced December 2016.
-
Information and dimensionality of anisotropic random geometric graphs
Authors:
Ronen Eldan,
Dan Mikulincer
Abstract:
This paper deals with the problem of detecting non-isotropic high-dimensional geometric structure in random graphs. Namely, we study a model of a random geometric graph in which vertices correspond to points generated randomly and independently from a non-isotropic $d$-dimensional Gaussian distribution, and two vertices are connected if the distance between them is smaller than some pre-specified…
▽ More
This paper deals with the problem of detecting non-isotropic high-dimensional geometric structure in random graphs. Namely, we study a model of a random geometric graph in which vertices correspond to points generated randomly and independently from a non-isotropic $d$-dimensional Gaussian distribution, and two vertices are connected if the distance between them is smaller than some pre-specified threshold. We derive new notions of dimensionality which depend upon the eigenvalues of the covariance of the Gaussian distribution. If $α$ denotes the vector of eigenvalues, and $n$ is the number of vertices, then the quantities $\left(\frac{||α||_2}{||α||_3}\right)^6/n^3$ and $\left(\frac{||α||_2}{||α||_4}\right)^4/n^3$ determine upper and lower bounds for the possibility of detection. This generalizes a recent result by Bubeck, Ding, Rácz and the first named author from [BDER14] which shows that the quantity $d/n^3$ determines the boundary of detection for isotropic geometry. Our methods involve Fourier analysis and the theory of characteristic functions to investigate the underlying probabilities of the model. The proof of the lower bound uses information theoretic tools, based on the method presented in [BG15].
△ Less
Submitted 23 February, 2020; v1 submitted 8 September, 2016;
originally announced September 2016.
-
Kernel-based methods for bandit convex optimization
Authors:
Sébastien Bubeck,
Ronen Eldan,
Yin Tat Lee
Abstract:
We consider the adversarial convex bandit problem and we build the first $\mathrm{poly}(T)$-time algorithm with $\mathrm{poly}(n) \sqrt{T}$-regret for this problem. To do so we introduce three new ideas in the derivative-free optimization literature: (i) kernel methods, (ii) a generalization of Bernoulli convolutions, and (iii) a new annealing schedule for exponential weights (with increasing lear…
▽ More
We consider the adversarial convex bandit problem and we build the first $\mathrm{poly}(T)$-time algorithm with $\mathrm{poly}(n) \sqrt{T}$-regret for this problem. To do so we introduce three new ideas in the derivative-free optimization literature: (i) kernel methods, (ii) a generalization of Bernoulli convolutions, and (iii) a new annealing schedule for exponential weights (with increasing learning rate). The basic version of our algorithm achieves $\tilde{O}(n^{9.5} \sqrt{T})$-regret, and we show that a simple variant of this algorithm can be run in $\mathrm{poly}(n \log(T))$-time per step at the cost of an additional $\mathrm{poly}(n) T^{o(1)}$ factor in the regret. These results improve upon the $\tilde{O}(n^{11} \sqrt{T})$-regret and $\exp(\mathrm{poly}(T))$-time result of the first two authors, and the $\log(T)^{\mathrm{poly}(n)} \sqrt{T}$-regret and $\log(T)^{\mathrm{poly}(n)}$-time result of Hazan and Li. Furthermore we conjecture that another variant of the algorithm could achieve $\tilde{O}(n^{1.5} \sqrt{T})$-regret, and moreover that this regret is unimprovable (the current best lower bound being $Ω(n \sqrt{T})$ and it is achieved with linear functions). For the simpler situation of zeroth order stochastic convex optimization this corresponds to the conjecture that the optimal query complexity is of order $n^3 / ε^2$.
△ Less
Submitted 11 July, 2016;
originally announced July 2016.
-
How many matrices can be spectrally balanced simultaneously?
Authors:
Ronen Eldan,
Fedor Nazarov,
Yuval Peres
Abstract:
We prove that any $\ell$ positive definite $d \times d$ matrices, $M_1,\ldots,M_\ell$, of full rank, can be simultaneously spectrally balanced in the following sense: for any $k < d$ such that $\ell \leq \lfloor \frac{d-1}{k-1} \rfloor$, there exists a matrix $A$ satisfying $\frac{λ_1(A^T M_i A) }{ \mathrm{Tr}( A^T M_i A ) } < \frac{1}{k}$ for all $i$, where $λ_1(M)$ denotes the largest eigenvalue…
▽ More
We prove that any $\ell$ positive definite $d \times d$ matrices, $M_1,\ldots,M_\ell$, of full rank, can be simultaneously spectrally balanced in the following sense: for any $k < d$ such that $\ell \leq \lfloor \frac{d-1}{k-1} \rfloor$, there exists a matrix $A$ satisfying $\frac{λ_1(A^T M_i A) }{ \mathrm{Tr}( A^T M_i A ) } < \frac{1}{k}$ for all $i$, where $λ_1(M)$ denotes the largest eigenvalue of a matrix $M$. This answers a question posed by Peres, Popov and Sousi and completes the picture described in that paper regarding sufficient conditions for transience of self-interacting random walks. Furthermore, in some cases we give quantitative bounds on the transience of such walks.
△ Less
Submitted 6 June, 2016;
originally announced June 2016.
-
Transport-entropy inequalities and curvature in discrete-space Markov chains
Authors:
Ronen Eldan,
James R. Lee,
Joseph Lehec
Abstract:
We show that if the random walk on a graph has positive coarse Ricci curvature in the sense of Ollivier, then the stationary measure satisfies a W^1 transport-entropy inequality. Peres and Tetali have conjectured a stronger consequence, that a modified log-Sobolev inequality (MLSI) should hold, in analogy with the setting of Markov diffusions. We discuss how our entropy interpolation approach sugg…
▽ More
We show that if the random walk on a graph has positive coarse Ricci curvature in the sense of Ollivier, then the stationary measure satisfies a W^1 transport-entropy inequality. Peres and Tetali have conjectured a stronger consequence, that a modified log-Sobolev inequality (MLSI) should hold, in analogy with the setting of Markov diffusions. We discuss how our entropy interpolation approach suggests a natural attack on the MLSI conjecture.
△ Less
Submitted 27 December, 2016; v1 submitted 23 April, 2016;
originally announced April 2016.
-
Multi-scale exploration of convex functions and bandit convex optimization
Authors:
Sébastien Bubeck,
Ronen Eldan
Abstract:
We construct a new map from a convex function to a distribution on its domain, with the property that this distribution is a multi-scale exploration of the function. We use this map to solve a decade-old open problem in adversarial bandit convex optimization by showing that the minimax regret for this problem is $\tilde{O}(\mathrm{poly}(n) \sqrt{T})$, where $n$ is the dimension and $T$ the number…
▽ More
We construct a new map from a convex function to a distribution on its domain, with the property that this distribution is a multi-scale exploration of the function. We use this map to solve a decade-old open problem in adversarial bandit convex optimization by showing that the minimax regret for this problem is $\tilde{O}(\mathrm{poly}(n) \sqrt{T})$, where $n$ is the dimension and $T$ the number of rounds. This bound is obtained by studying the dual Bayesian maximin regret via the information ratio analysis of Russo and Van Roy, and then using the multi-scale exploration to solve the Bayesian problem.
△ Less
Submitted 23 July, 2015;
originally announced July 2015.
-
Sampling from a log-concave distribution with Projected Langevin Monte Carlo
Authors:
Sébastien Bubeck,
Ronen Eldan,
Joseph Lehec
Abstract:
We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when th…
▽ More
We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when the target distribution is uniform, LMC mixes in $\tilde{O}(n^7)$ steps (where $n$ is the dimension). We also provide preliminary experimental evidence that LMC performs at least as well as hit-and-run, for which a better mixing time of $\tilde{O}(n^4)$ was proved by Lov{á}sz and Vempala.
△ Less
Submitted 9 July, 2015;
originally announced July 2015.
-
Braess's paradox for the spectral gap in random graphs and delocalization of eigenvectors
Authors:
Ronen Eldan,
Miklós Rácz,
Tselil Schramm
Abstract:
We study how the spectral gap of the normalized Laplacian of a random graph changes when an edge is added to or removed from the graph. There are known examples of graphs where, perhaps counterintuitively, adding an edge can decrease the spectral gap, a phenomenon that is analogous to Braess's paradox in traffic networks. We show that this is often the case in random graphs in a strong sense. More…
▽ More
We study how the spectral gap of the normalized Laplacian of a random graph changes when an edge is added to or removed from the graph. There are known examples of graphs where, perhaps counterintuitively, adding an edge can decrease the spectral gap, a phenomenon that is analogous to Braess's paradox in traffic networks. We show that this is often the case in random graphs in a strong sense. More precisely, we show that for typical instances of Erdős-Rényi random graphs $G(n,p)$ with constant edge density $p \in (0,1)$, the addition of a random edge will decrease the spectral gap with positive probability, strictly bounded away from zero. To do this, we prove a new delocalization result for eigenvectors of the Laplacian of $G(n,p)$, which might be of independent interest.
△ Less
Submitted 20 June, 2015; v1 submitted 28 April, 2015;
originally announced April 2015.
-
The entropic barrier: a simple and optimal universal self-concordant barrier
Authors:
Sébastien Bubeck,
Ronen Eldan
Abstract:
We prove that the Cramér transform of the uniform measure on a convex body in $\mathbb{R}^n$ is a $(1+o(1)) n$-self-concordant barrier, improving a seminal result of Nesterov and Nemirovski. This gives the first explicit construction of a universal barrier for convex bodies with optimal self-concordance parameter. The proof is based on basic geometry of log-concave distributions, and elementary du…
▽ More
We prove that the Cramér transform of the uniform measure on a convex body in $\mathbb{R}^n$ is a $(1+o(1)) n$-self-concordant barrier, improving a seminal result of Nesterov and Nemirovski. This gives the first explicit construction of a universal barrier for convex bodies with optimal self-concordance parameter. The proof is based on basic geometry of log-concave distributions, and elementary duality in exponential families.
△ Less
Submitted 11 April, 2015; v1 submitted 4 December, 2014;
originally announced December 2014.
-
Testing for high-dimensional geometry in random graphs
Authors:
Sébastien Bubeck,
Jian Ding,
Ronen Eldan,
Miklós Rácz
Abstract:
We study the problem of detecting the presence of an underlying high-dimensional geometric structure in a random graph. Under the null hypothesis, the observed graph is a realization of an Erdős-Rényi random graph $G(n,p)$. Under the alternative, the graph is generated from the $G(n,p,d)$ model, where each vertex corresponds to a latent independent random vector uniformly distributed on the sphere…
▽ More
We study the problem of detecting the presence of an underlying high-dimensional geometric structure in a random graph. Under the null hypothesis, the observed graph is a realization of an Erdős-Rényi random graph $G(n,p)$. Under the alternative, the graph is generated from the $G(n,p,d)$ model, where each vertex corresponds to a latent independent random vector uniformly distributed on the sphere $\mathbb{S}^{d-1}$, and two vertices are connected if the corresponding latent vectors are close enough. In the dense regime (i.e., $p$ is a constant), we propose a near-optimal and computationally efficient testing procedure based on a new quantity which we call signed triangles. The proof of the detection lower bound is based on a new bound on the total variation distance between a Wishart matrix and an appropriately normalized GOE matrix. In the sparse regime, we make a conjecture for the optimal detection boundary. We conclude the paper with some preliminary steps on the problem of estimating the dimension in $G(n,p,d)$.
△ Less
Submitted 21 November, 2015; v1 submitted 20 November, 2014;
originally announced November 2014.
-
Regularization under diffusion and anti-concentration of the information content
Authors:
Ronen Eldan,
James R. Lee
Abstract:
Under the Ornstein-Uhlenbeck semigroup $\{U_t\}$, any non-negative measurable $f : \mathbb R^n \to \mathbb R_+$ exhibits a uniform tail bound better than that implied by Markov's inequality and conservation of mass: For every $α\geq e^3$, and $t > 0$, \[ γ_n\left(\left\{x \in \mathbb R^n : U_t f(x) > α\int f\,dγ_n\right\}\right) \leq C(t) \frac{1}α \sqrt{\frac{\log \log α}{\log α}}\] where $γ_n$ i…
▽ More
Under the Ornstein-Uhlenbeck semigroup $\{U_t\}$, any non-negative measurable $f : \mathbb R^n \to \mathbb R_+$ exhibits a uniform tail bound better than that implied by Markov's inequality and conservation of mass: For every $α\geq e^3$, and $t > 0$, \[ γ_n\left(\left\{x \in \mathbb R^n : U_t f(x) > α\int f\,dγ_n\right\}\right) \leq C(t) \frac{1}α \sqrt{\frac{\log \log α}{\log α}}\] where $γ_n$ is the $n$-dimensional Gaussian measure and $C(t)$ is a constant depending only on $t$. This confirms positively the Gaussian limiting case of Talagrand's convolution conjecture (1989).
This is shown to follow from a more general phenomenon. Suppose that $f : \mathbb{R}^n \to \mathbb{R}_+$ is {\em semi-log-convex} in the sense that for some $β> 0$, for all $x \in \mathbb{R}^n$, the eigenvalues of $\nabla^2 \log f(x)$ are at least $-β$. Then $f$ satisfies a tail bound asymptotically better than that implied by Markov's inequality.
△ Less
Submitted 10 October, 2017; v1 submitted 14 October, 2014;
originally announced October 2014.
-
From trees to seeds: on the inference of the seed from large trees in the uniform attachment model
Authors:
Sébastien Bubeck,
Ronen Eldan,
Elchanan Mossel,
Miklós Z. Rácz
Abstract:
We study the influence of the seed in random trees grown according to the uniform attachment model, also known as uniform random recursive trees. We show that different seeds lead to different distributions of limiting trees from a total variation point of view. To do this, we construct statistics that measure, in a certain well-defined sense, global "balancedness" properties of such trees. Our pa…
▽ More
We study the influence of the seed in random trees grown according to the uniform attachment model, also known as uniform random recursive trees. We show that different seeds lead to different distributions of limiting trees from a total variation point of view. To do this, we construct statistics that measure, in a certain well-defined sense, global "balancedness" properties of such trees. Our paper follows recent results on the same question for the preferential attachment model.
△ Less
Submitted 20 October, 2014; v1 submitted 26 September, 2014;
originally announced September 2014.
-
Efficient Algorithms for Discrepancy Minimization in Convex Sets
Authors:
Ronen Eldan,
Mohit Singh
Abstract:
A result of Spencer states that every collection of $n$ sets over a universe of size $n$ has a coloring of the ground set with $\{-1,+1\}$ of discrepancy $O(\sqrt{n})$. A geometric generalization of this result was given by Gluskin (see also Giannopoulos) who showed that every symmetric convex body $K\subseteq R^n$ with Gaussian measure at least $e^{-εn}$, for a small $ε>0$, contains a point…
▽ More
A result of Spencer states that every collection of $n$ sets over a universe of size $n$ has a coloring of the ground set with $\{-1,+1\}$ of discrepancy $O(\sqrt{n})$. A geometric generalization of this result was given by Gluskin (see also Giannopoulos) who showed that every symmetric convex body $K\subseteq R^n$ with Gaussian measure at least $e^{-εn}$, for a small $ε>0$, contains a point $y\in K$ where a constant fraction of coordinates of $y$ are in $\{-1,1\}$. This is often called a partial coloring result. While both these results were inherently non-algorithmic, recently Bansal (see also Lovett-Meka) gave a polynomial time algorithm for Spencer's setting and Rothvoßgave a randomized polynomial time algorithm obtaining the same guarantee as the result of Gluskin and Giannopoulos.
This paper has several related results. First we prove another constructive version of the result of Gluskin and Giannopoulos via an optimization of a linear function. This implies a linear programming based algorithm for combinatorial discrepancy obtaining the same result as Spencer. Our second result gives a new approach to obtains partial colorings and shows that every convex body $K\subseteq R^n$, possibly non-symmetric, with Gaussian measure at least $e^{-εn}$, for a small $ε>0$, contains a point $y\in K$ where a constant fraction of coordinates of $y$ are in $\{-1,1\}$. Finally, we give a simple proof that shows that for any $δ>0$ there exists a constant $c>0$ such that given a body $K$ with $γ_n(K)\geq δ$, a uniformly random $x$ from $\{-1,1\}^n$ is in $cK$ with constant probability. This gives an algorithmic version of a special case of the result of Banaszczyk.
△ Less
Submitted 9 September, 2014;
originally announced September 2014.
-
On multiple peaks and moderate deviations for supremum of Gaussian field
Authors:
Jian Ding,
Ronen Eldan,
Alex Zhai
Abstract:
We prove two theorems concerning extreme values of general Gaussian fields. Our first theorem concerns with the concept of multiple peaks. A theorem of Chatterjee states that when a centered Gaussian field admits the so-called superconcentration property, it typically attains values near its maximum on multiple near-orthogonal sites, known as multiple peaks. We improve his theorem in two aspects:…
▽ More
We prove two theorems concerning extreme values of general Gaussian fields. Our first theorem concerns with the concept of multiple peaks. A theorem of Chatterjee states that when a centered Gaussian field admits the so-called superconcentration property, it typically attains values near its maximum on multiple near-orthogonal sites, known as multiple peaks. We improve his theorem in two aspects: (i) the number of peaks attained by our bound is of the order $\exp(c / σ^2)$ (as opposed to Chatterjee's polynomial bound in $1/σ$), where $σ$ is the standard deviation of the supremum of the Gaussian field, which is assumed to have variance at most $1$ and (ii) our bound need not assume that the correlations are non-negative. We also prove a similar result based on the superconcentration of the free energy. As primary applications, we infer that for the S-K spin glass model on the $n$-hypercube and directed polymers on $\mathbb{Z}_n^2$, there are polynomially (in $n$) many near-orthogonal sites that achieve values near their respective maxima.
Our second theorem gives an upper bound on moderate deviation for the supremum of a general Gaussian field. While the Gaussian isoperimetric inequality implies a sub-Gaussian concentration bound for the supremum, we show that the exponent in that bound can be improved under the assumption that the expectation of the supremum is of the same order as that of the independent case.
△ Less
Submitted 24 November, 2013; v1 submitted 21 November, 2013;
originally announced November 2013.
-
A two-sided estimate for the Gaussian noise stability deficit
Authors:
Ronen Eldan
Abstract:
The Gaussian noise-stability of a set A in R^n is defined by S_rho(A) = P (X in A and Y in A) where X and Y are standard Gaussian vectors whose correlation is rho. Borell's inequality states that for all 0 < rho < 1, among all sets A with a given Gaussian measure, the quantity S_rho(A) is maximized when A is a half-space.
We give a novel short proof of this fact, based on stochastic calculus. Mo…
▽ More
The Gaussian noise-stability of a set A in R^n is defined by S_rho(A) = P (X in A and Y in A) where X and Y are standard Gaussian vectors whose correlation is rho. Borell's inequality states that for all 0 < rho < 1, among all sets A with a given Gaussian measure, the quantity S_rho(A) is maximized when A is a half-space.
We give a novel short proof of this fact, based on stochastic calculus. Moreover, we prove an almost tight, two-sided, dimension-free robustness estimate for this inequality: by introducing a new metric to measure the distance between the set A and its corresponding half-space H (namely the distance between the two centroids), we show that the deficit S_rho(H) - S_rho(A) can be controlled from both below and above by essentially the same function of the distance, up to logarithmic factors.
As a consequence, we also establish the conjectured exponent in the robustness estimate proven by Mossel-Neeman, which uses the total-variation distance as a metric. In the limit rho->1, we get an improved dimension free robustness bound for the Gaussian isoperimetric inequality. Our estimates are also valid for a the more general version of stability where more than two correlated vectors are considered.
△ Less
Submitted 2 September, 2014; v1 submitted 10 July, 2013;
originally announced July 2013.
-
Bounding the norm of a log-concave vector via thin-shell estimates
Authors:
Ronen Eldan,
Joseph Lehec
Abstract:
Chaining techniques show that if X is an isotropic log-concave random vector in R^n and Gamma is a standard Gaussian vector then E |X| < C n^{1/4} E |Gamma| for any norm |*|, where C is a universal constant. Using a completely different argument we establish a similar inequality relying on the thin-shell constant sigma_n = sup ((var|X|^){1/2} ; X isotropic and log-concave on R^n).
In particular,…
▽ More
Chaining techniques show that if X is an isotropic log-concave random vector in R^n and Gamma is a standard Gaussian vector then E |X| < C n^{1/4} E |Gamma| for any norm |*|, where C is a universal constant. Using a completely different argument we establish a similar inequality relying on the thin-shell constant sigma_n = sup ((var|X|^){1/2} ; X isotropic and log-concave on R^n).
In particular, we show that if the thin-shell conjecture sigma_n = O(1) holds, then n^{1/4} can be replaced by log (n) in the inequality.
As a consequence, we obtain certain bounds for the mean-width, the dual mean-width and the isotropic constant of an isotropic convex body.
In particular, we give an alternative proof of the fact that a positive answer to the thin-shell conjecture implies a positive answer to the slicing problem, up to a logarithmic factor.
△ Less
Submitted 18 June, 2013; v1 submitted 16 June, 2013;
originally announced June 2013.
-
Diffusion-limited aggregation on the hyperbolic plane
Authors:
Ronen Eldan
Abstract:
We consider an analogous version of the diffusion-limited aggregation model defined on the hyperbolic plane. We prove that almost surely the aggregate viewed at time infinity will have a positive density.
We consider an analogous version of the diffusion-limited aggregation model defined on the hyperbolic plane. We prove that almost surely the aggregate viewed at time infinity will have a positive density.
△ Less
Submitted 9 September, 2015; v1 submitted 13 June, 2013;
originally announced June 2013.
-
Skorokhod Embeddings via Stochastic Flows on the Space of Measures
Authors:
Ronen Eldan
Abstract:
We present a new construction of a Skorohod embedding, namely, given a probability measure mu with zero expectation and finite variance, we construct an integrable stopping time T adapted to a filtration F_t, such that W_t has the law mu, where W_t is a standard Wiener process adapted to the same filtration. We find several sufficient conditions for the stopping time T to be bounded or to have a s…
▽ More
We present a new construction of a Skorohod embedding, namely, given a probability measure mu with zero expectation and finite variance, we construct an integrable stopping time T adapted to a filtration F_t, such that W_t has the law mu, where W_t is a standard Wiener process adapted to the same filtration. We find several sufficient conditions for the stopping time T to be bounded or to have a sub-exponential tail. In particular, our embedding seems rather natural for the case that mu is a log-concave measure and the tail behaviour of $T$ admits some tight bounds in that case. Our embedding admits the property that the stochastic measure-valued process {mu_t} (0<t<T), where mu_t is as the law of W_T conditioned on F_t, is a Markov process.
△ Less
Submitted 5 May, 2015; v1 submitted 13 March, 2013;
originally announced March 2013.
-
Volumetric Properties of the Convex Hull of an n-dimensional Brownian Motion
Authors:
Ronen Eldan
Abstract:
Let K be the convex hull of the path of a standard brownian motion B(t) in R^n, taken at time 0 < t < 1. We derive formulas for the expected volume and surface area of K. Moreover, we show that in order to approximate K by a discrete version of K, namely by the convex hull of a random walk attained by taking B(t_n) at discrete (random) times, the number of steps that one should take in order for t…
▽ More
Let K be the convex hull of the path of a standard brownian motion B(t) in R^n, taken at time 0 < t < 1. We derive formulas for the expected volume and surface area of K. Moreover, we show that in order to approximate K by a discrete version of K, namely by the convex hull of a random walk attained by taking B(t_n) at discrete (random) times, the number of steps that one should take in order for the volume of the difference to be relatively small is of order n^3. Next, we show that the distribution of facets of K is in some sense scale invariant: for any given family of simplices (satisfying some compactness condition), one expects to find in this family a constant number of facets of tK as t approaches infinity. Finally, we discuss some possible extensions of our methods and suggest some further research.
△ Less
Submitted 21 December, 2017; v1 submitted 11 November, 2012;
originally announced November 2012.
-
Thin shell implies spectral gap up to polylog via a stochastic localization scheme
Authors:
Ronen Eldan
Abstract:
We consider the isoperimetric inequality on the class of high-dimensional isotropic convex bodies. We establish quantitative connections between two well-known open problems related to this inequality, namely, the thin shell conjecture, and the conjecture by Kannan, Lovasz, and Simonovits, showing that the corresponding optimal bounds are equivalent up to logarithmic factors. In particular we prov…
▽ More
We consider the isoperimetric inequality on the class of high-dimensional isotropic convex bodies. We establish quantitative connections between two well-known open problems related to this inequality, namely, the thin shell conjecture, and the conjecture by Kannan, Lovasz, and Simonovits, showing that the corresponding optimal bounds are equivalent up to logarithmic factors. In particular we prove that, up to logarithmic factors, the minimal possible ratio between surface area and volume is attained on ellipsoids. We also show that a positive answer to the thin shell conjecture would imply an optimal dependence on the dimension in a certain formulation of the Brunn-Minkowski inequality. Our results rely on the construction of a stochastic localization scheme for log-concave measures.
△ Less
Submitted 16 December, 2012; v1 submitted 5 March, 2012;
originally announced March 2012.
-
An efficiency upper bound for inverse covariance estimation
Authors:
Ronen Eldan
Abstract:
We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional Gaussian random vector, one needs at least a number of samples proportional to $d$. Furthermore, we show that with $n \ll d$ samples, the hypothesis that two given…
▽ More
We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional Gaussian random vector, one needs at least a number of samples proportional to $d$. Furthermore, we show that with $n \ll d$ samples, the hypothesis that two given coordinates are fully correlated, when all other coordinates are conditioned to be zero, cannot be told apart from the hypothesis that the two are uncorrelated.
△ Less
Submitted 11 February, 2013; v1 submitted 3 December, 2011;
originally announced December 2011.
-
Dimensionality and the stability of the Brunn-Minkowski inequality
Authors:
Ronen Eldan,
Bo`az Klartag
Abstract:
We prove stability estimates for the Brunn-Minkowski inequality for convex sets. Unlike existing stability results, our estimates improve as the dimension grows. Our results are equivalent to a thin shell bound, which is one of the central ingredients in the proof of the central limit theorem for convex sets.
We prove stability estimates for the Brunn-Minkowski inequality for convex sets. Unlike existing stability results, our estimates improve as the dimension grows. Our results are equivalent to a thin shell bound, which is one of the central ingredients in the proof of the central limit theorem for convex sets.
△ Less
Submitted 6 August, 2012; v1 submitted 30 October, 2011;
originally announced October 2011.
-
Extremal points of high dimensional random walks and mixing times of a Brownian motion on the sphere
Authors:
Ronen Eldan
Abstract:
We derive asymptotics for the probability of the origin to be an extremal point of a random walk in R^n. We show that in order for the probability to be roughly 1/2, the number of steps of the random walk should be between e^{c n / log n}$ and e^{C n log n}. As a result, we attain a bound for the ?pi/2-covering time of a spherical brownian motion.
We derive asymptotics for the probability of the origin to be an extremal point of a random walk in R^n. We show that in order for the probability to be roughly 1/2, the number of steps of the random walk should be between e^{c n / log n}$ and e^{C n log n}. As a result, we attain a bound for the ?pi/2-covering time of a spherical brownian motion.
△ Less
Submitted 15 March, 2013; v1 submitted 2 June, 2011;
originally announced June 2011.
-
Convex Hulls in the Hyperbolic Space
Authors:
Itai Benjamini,
Ronen Eldan
Abstract:
We show that there exists a universal constant C>0 such that the convex hull of any N points in the hyperbolic space H^n is of volume smaller than C N, and that for any dimension n there exists a constant C_n > 0 such that for any subset A of H^n,
Vol(Conv(A_1)) < C_n Vol(A_1) where A_1 is the set of points of hyperbolic distance to A smaller than 1.
We show that there exists a universal constant C>0 such that the convex hull of any N points in the hyperbolic space H^n is of volume smaller than C N, and that for any dimension n there exists a constant C_n > 0 such that for any subset A of H^n,
Vol(Conv(A_1)) < C_n Vol(A_1) where A_1 is the set of points of hyperbolic distance to A smaller than 1.
△ Less
Submitted 2 June, 2011; v1 submitted 30 May, 2011;
originally announced May 2011.
-
Approximately gaussian marginals and the hyperplane conjecture
Authors:
Ronen Eldan,
Bo'az Klartag
Abstract:
We discuss connections between certain well-known open problems related to the uniform measure on a high-dimensional convex body. In particular, we show that the "thin shell conjecture" implies the "hyperplane conjecture". This extends a result by K. Ball, according to which the stronger "spectral gap conjecture" implies the "hyperplane conjecture".
We discuss connections between certain well-known open problems related to the uniform measure on a high-dimensional convex body. In particular, we show that the "thin shell conjecture" implies the "hyperplane conjecture". This extends a result by K. Ball, according to which the stronger "spectral gap conjecture" implies the "hyperplane conjecture".
△ Less
Submitted 6 January, 2010;
originally announced January 2010.
-
A Polynomial Number of Random Points does not Determine the Volume of a Convex Body
Authors:
Ronen Eldan
Abstract:
We show that there is no algorithm which, provided a polynomial number of random points uniformly distributed over a convex body in R^n, can approximate the volume of the body up to a constant factor with high probability.
We show that there is no algorithm which, provided a polynomial number of random points uniformly distributed over a convex body in R^n, can approximate the volume of the body up to a constant factor with high probability.
△ Less
Submitted 2 June, 2011; v1 submitted 15 March, 2009;
originally announced March 2009.
-
Pointwise Estimates for Marginals of Convex Bodies
Authors:
Ronen Eldan,
Bo'az Klartag
Abstract:
We prove a pointwise version of the multi-dimensional central limit theorem for convex bodies. Namely, let X be an isotropic random vector in R^n with a log-concave density. For a typical subspace E in R^n of dimension n^c, consider the probability density of the projection of X onto E. We show that the ratio between this probability density and the standard gaussian density in E is very close t…
▽ More
We prove a pointwise version of the multi-dimensional central limit theorem for convex bodies. Namely, let X be an isotropic random vector in R^n with a log-concave density. For a typical subspace E in R^n of dimension n^c, consider the probability density of the projection of X onto E. We show that the ratio between this probability density and the standard gaussian density in E is very close to 1 in large parts of E. Here c > 0 is a universal constant. This complements a recent result by the second named author, where the total-variation metric between the densities was considered.
△ Less
Submitted 18 August, 2007;
originally announced August 2007.