Showing 51–100 of 107 results for author: Sly, A

Evolving Voter Model on Dense Random Graphs

Authors: Riddhipratim Basu, Allan Sly

Abstract: In this paper we examine a variant of the voter model on a dynamically changing network where agents have the option of changing their friends rather than changing their opinions. We analyse, in the context of dense random graphs, two models considered in Durrett et. al.(Proc. Natl. Acad. Sci. 109: 3682-3687, 2012). When an edge with two agents holding different opinion is updated, with probabilit… ▽ More In this paper we examine a variant of the voter model on a dynamically changing network where agents have the option of changing their friends rather than changing their opinions. We analyse, in the context of dense random graphs, two models considered in Durrett et. al.(Proc. Natl. Acad. Sci. 109: 3682-3687, 2012). When an edge with two agents holding different opinion is updated, with probability $\fracβ{n}$, one agent performs a voter model step and changes its opinion to copy the other, and with probability $1-\fracβ{n}$, the edge between them is broken and reconnected to a new agent chosen randomly from (i) the whole network (rewire-to-random model) or, (ii) the agents having the same opinion (rewire-to-same model). We rigorously establish in both the models, the time for this dynamics to terminate exhibits a phase transition in the model parameter $β$. For $β$ sufficiently small, with high probability the network rapidly splits into two disconnected communities with opposing opinions, whereas for $β$ large enough the dynamics runs for longer and the density of opinion changes significantly before the process stops. In the rewire-to-random model, we show that a positive fraction of both opinions survive with high probability. △ Less

Submitted 13 January, 2015; originally announced January 2015.

An exposition to information percolation for the Ising model

Authors: Eyal Lubetzky, Allan Sly

Abstract: Information percolation is a new method for analyzing stochastic spin systems through classifying and controlling the clusters of information-flow in the space-time slab. It yielded sharp mixing estimates (cutoff with an $O(1)$-window) for the Ising model on $Z^d$ up to the critical temperature, as well as results on the effect of initial conditions on mixing. In this expository note we demonstrat… ▽ More Information percolation is a new method for analyzing stochastic spin systems through classifying and controlling the clusters of information-flow in the space-time slab. It yielded sharp mixing estimates (cutoff with an $O(1)$-window) for the Ising model on $Z^d$ up to the critical temperature, as well as results on the effect of initial conditions on mixing. In this expository note we demonstrate the method on lattices (more generally, on any locally-finite transitive graph) at very high temperatures. △ Less

Submitted 31 December, 2014; originally announced January 2015.

Comments: 11 pages

Glauber Dynamics of colorings on trees

Authors: Allan Sly, Yumeng Zhang

Abstract: The mixing time of the Glauber dynamics for spin systems on trees is closely related to reconstruction problem. Martinelli, Sinclair and Weitz established this correspondence for a class of spin systems with soft constraints bounding the log-Sobolev constant by a comparison with the block dynamics. However, when there are hard constraints, the block dynamics may be reducible. We introduce a vari… ▽ More The mixing time of the Glauber dynamics for spin systems on trees is closely related to reconstruction problem. Martinelli, Sinclair and Weitz established this correspondence for a class of spin systems with soft constraints bounding the log-Sobolev constant by a comparison with the block dynamics. However, when there are hard constraints, the block dynamics may be reducible. We introduce a variant of the block dynamics extending these results to a wide class of spin systems with hard constraints. This applies for essentially any spin system that has non-reconstruction provided that on average the root is not locally frozen in a large neighborhood. In particular we prove that the mixing time of the Glauber dynamics for colorings on the regular tree is $O(n\log n)$ in the entire known non-reconstruction regime. △ Less

Submitted 9 December, 2014; originally announced December 2014.

Comments: 25 pages

Bi-Lipschitz Expansion of Measurable Sets

Authors: Riddhipratim Basu, Vladas Sidoravicius, Allan Sly

Abstract: We show that for $0<γ, γ' <1$ and for measurable subsets of the unit square with Lebesgue measure $γ$ there exist bi-Lipschitz maps with bounded Lipschitz constant (uniformly over all such sets) which are identity on the boundary and increases the Lebesgue measure of the set to at least $1-γ'$. We show that for $0<γ, γ' <1$ and for measurable subsets of the unit square with Lebesgue measure $γ$ there exist bi-Lipschitz maps with bounded Lipschitz constant (uniformly over all such sets) which are identity on the boundary and increases the Lebesgue measure of the set to at least $1-γ'$. △ Less

Submitted 20 November, 2014; originally announced November 2014.

Scheduling of non-colliding random walks

Authors: Riddhipratim Basu, Vladas Sidoravicius, Allan Sly

Abstract: On the complete graph ${\cal{K}}_M$ with $M \ge3$ vertices consider two independent discrete time random walks $\mathbb{X}$ and $\mathbb{Y}$, choosing their steps uniformly at random. A pair of trajectories $\mathbb{X} = \{ X_1, X_2, \dots \}$ and $\mathbb{Y} = \{Y_1, Y_2, \dots \}$ is called {\it{non-colliding}}, if by delaying their jump times one can keep both walks at distinct vertices forever… ▽ More On the complete graph ${\cal{K}}_M$ with $M \ge3$ vertices consider two independent discrete time random walks $\mathbb{X}$ and $\mathbb{Y}$, choosing their steps uniformly at random. A pair of trajectories $\mathbb{X} = \{ X_1, X_2, \dots \}$ and $\mathbb{Y} = \{Y_1, Y_2, \dots \}$ is called {\it{non-colliding}}, if by delaying their jump times one can keep both walks at distinct vertices forever. It was conjectured by P. Winkler that for large enough $M$ the set of pairs of non-colliding trajectories $\{\mathbb{X},\mathbb{Y} \} $ has positive measure. N. Alon translated this problem to the language of coordinate percolation, a class of dependent percolation models, which in most situations is not tractable by methods of Bernoulli percolation. In this representation Winkler's conjecture is equivalent to the existence of an infinite open cluster for large enough $M$. In this paper we establish the conjecture. △ Less

Submitted 14 November, 2014; originally announced November 2014.

Proof of the satisfiability conjecture for large k

Authors: Jian Ding, Allan Sly, Nike Sun

Abstract: We establish the satisfiability threshold for random $k$-SAT for all $k\ge k_0$, with $k_0$ an absolute constant. That is, there exists a limiting density $α_*(k)$ such that a random $k$-SAT formula of clause density $α$ is with high probability satisfiable for $α<α_*$, and unsatisfiable for $α>α_*$. We show that the threshold $α_*(k)$ is given explicitly by the one-step replica symmetry breaking… ▽ More We establish the satisfiability threshold for random $k$-SAT for all $k\ge k_0$, with $k_0$ an absolute constant. That is, there exists a limiting density $α_*(k)$ such that a random $k$-SAT formula of clause density $α$ is with high probability satisfiable for $α<α_*$, and unsatisfiable for $α>α_*$. We show that the threshold $α_*(k)$ is given explicitly by the one-step replica symmetry breaking prediction from statistical physics. The proof develops a new analytic method for moment calculations on random graphs, mapping a high-dimensional optimization problem to a more tractable problem of analyzing tree recursions. We believe that our method may apply to a range of random CSPs in the 1-RSB universality class. △ Less

Submitted 15 April, 2021; v1 submitted 3 November, 2014; originally announced November 2014.

Rigidity and tolerance for perturbed lattices

Authors: Yuval Peres, Allan Sly

Abstract: A perturbed lattice is a point process $Π=\{x+Y_x:x\in \mathbb{Z}^d\}$ where the lattice points in $\mathbb{Z}^d$ are perturbed by i.i.d.\ random variables $\{Y_x\}_{x\in \mathbb{Z}^d}$. A random point process $Π$ is said to be rigid if $|Π\cap B_0(1)|$, the number of points in a ball, can be exactly determined given $Π\setminus B_0(1)$, the points outside the ball. The process $Π$ is called delet… ▽ More A perturbed lattice is a point process $Π=\{x+Y_x:x\in \mathbb{Z}^d\}$ where the lattice points in $\mathbb{Z}^d$ are perturbed by i.i.d.\ random variables $\{Y_x\}_{x\in \mathbb{Z}^d}$. A random point process $Π$ is said to be rigid if $|Π\cap B_0(1)|$, the number of points in a ball, can be exactly determined given $Π\setminus B_0(1)$, the points outside the ball. The process $Π$ is called deletion tolerant if removing one point of $Π$ yields a process with distribution indistinguishable from that of $Π$. Suppose that $Y_x\sim N_d(0,σ^2 I)$ are Gaussian vectors with with $d$ independent components of variance $σ^2$. Holroyd and Soo showed that in dimensions $d=1,2$ the resulting Gaussian perturbed lattice $Π$ is rigid and deletion intolerant. We show that in dimension $d\geq 3$ there exists a critical parameter $σ_r(d)$ such that $Π$ is rigid if $σ<σ_r$ and deletion tolerant (hence non-rigid) if $σ>σ_r$. △ Less

Submitted 15 September, 2014; originally announced September 2014.

MSC Class: 60K35

Last Passage Percolation with a Defect Line and the Solution of the Slow Bond Problem

Authors: Riddhipratim Basu, Vladas Sidoravicius, Allan Sly

Abstract: We address the question of how a localized microscopic defect, especially if it is small with respect to certain dynamic parameters, affects the macroscopic behavior of a system. In particular we consider two classical exactly solvable models: Ulam's problem of the maximal increasing sequence and the totally asymmetric simple exclusion process. For the first model, using its representation as a Po… ▽ More We address the question of how a localized microscopic defect, especially if it is small with respect to certain dynamic parameters, affects the macroscopic behavior of a system. In particular we consider two classical exactly solvable models: Ulam's problem of the maximal increasing sequence and the totally asymmetric simple exclusion process. For the first model, using its representation as a Poissonian version of directed last passage percolation on $\mathbb R^2$, we introduce the defect by placing a positive density of extra points along the diagonal line. For the latter, the defect is produced by decreasing the jump rate of each particle when it crosses the origin. The powerful algebraic tools for studying these processes break down in the perturbed versions of the models. Taking a more geometric approach we show that in both cases the presence of an arbitrarily small defect affects the macroscopic behavior of the system: in Ulam's problem the time constant increases, and for the exclusion process the flux of particles decreases. This, in particular, settles the longstanding Slow Bond Problem. △ Less

Submitted 7 April, 2016; v1 submitted 15 August, 2014; originally announced August 2014.

Comments: 62 pages, 21 figures. Exposition improved and many figures added in this version

Universality of cutoff for the Ising model

Authors: Eyal Lubetzky, Allan Sly

Abstract: On any locally-finite geometry, the stochastic Ising model is known to be contractive when the inverse-temperature $β$ is small enough, via classical results of Dobrushin and of Holley in the 1970's. By a general principle proposed by Peres, the dynamics is then expected to exhibit cutoff. However, so far cutoff for the Ising model has been confirmed mainly for lattices, heavily relying on amenabi… ▽ More On any locally-finite geometry, the stochastic Ising model is known to be contractive when the inverse-temperature $β$ is small enough, via classical results of Dobrushin and of Holley in the 1970's. By a general principle proposed by Peres, the dynamics is then expected to exhibit cutoff. However, so far cutoff for the Ising model has been confirmed mainly for lattices, heavily relying on amenability and log Sobolev inequalities. Without these, cutoff was unknown at any fixed $β>0$, no matter how small, even in basic examples such as the Ising model on a binary tree or a random regular graph. We use the new framework of information percolation to show that, in any geometry, there is cutoff for the Ising model at high enough temperatures. Precisely, on any sequence of graphs with maximum degree $d$, the Ising model has cutoff provided that $β<κ/d$ for some absolute constant $κ$ (a result which, up to the value of $κ$, is best possible). Moreover, the cutoff location is established as the time at which the sum of squared magnetizations drops to 1, and the cutoff window is $O(1)$, just as when $β=0$. Finally, the mixing time from almost every initial state is not more than a factor of $1+ε_β$ faster then the worst one (with $ε_β\to0$ as $β\to 0$), whereas the uniform starting state is at least $2-ε_β$ times faster. △ Less

Submitted 28 July, 2014; v1 submitted 7 July, 2014; originally announced July 2014.

Comments: 26 pages, 2 figures. Companion paper to arXiv:1401.6065

MSC Class: 60J27; 82C20; 60K35; 60B10

Consistency Thresholds for the Planted Bisection Model

Authors: Elchanan Mossel, Joe Neeman, Allan Sly

Abstract: The planted bisection model is a random graph model in which the nodes are divided into two equal-sized communities and then edges are added randomly in a way that depends on the community membership. We establish necessary and sufficient conditions for the asymptotic recoverability of the planted bisection in this model. When the bisection is asymptotically recoverable, we give an efficient algor… ▽ More The planted bisection model is a random graph model in which the nodes are divided into two equal-sized communities and then edges are added randomly in a way that depends on the community membership. We establish necessary and sufficient conditions for the asymptotic recoverability of the planted bisection in this model. When the bisection is asymptotically recoverable, we give an efficient algorithm that successfully recovers it. We also show that the planted bisection is recoverable asymptotically if and only if with high probability every node belongs to the same community as the majority of its neighbors. Our algorithm for finding the planted bisection runs in time almost linear in the number of edges. It has three stages: spectral clustering to compute an initial guess, a "replica" stage to get almost every vertex correct, and then some simple local moves to finish the job. An independent work by Abbe, Bandeira, and Hall establishes similar (slightly weaker) results but only in the case of logarithmic average degree. △ Less

Submitted 13 July, 2020; v1 submitted 7 July, 2014; originally announced July 2014.

Comments: latest version contains an erratum, addressing an error pointed out by Jan van Waaij

Journal ref: Electronic Journal of Probability 21 (2016), no. 21, 1--24

Decay of Correlations for the Hardcore Model on the $d$-regular Random Graph

Authors: Nayantara Bhatnagar, Allan Sly, Prasad Tetali

Abstract: A key insight from statistical physics about spin systems on random graphs is the central role played by Gibbs measures on trees. We determine the local weak limit of the hardcore model on random regular graphs asymptotically until just below its condensation threshold, showing that it converges in probability locally in a strong sense to the free boundary condition Gibbs measure on the tree. As a… ▽ More A key insight from statistical physics about spin systems on random graphs is the central role played by Gibbs measures on trees. We determine the local weak limit of the hardcore model on random regular graphs asymptotically until just below its condensation threshold, showing that it converges in probability locally in a strong sense to the free boundary condition Gibbs measure on the tree. As a consequence we show that the reconstruction threshold on the random graph, indicative of the onset of point to set spatial correlations, is equal to the reconstruction threshold on the $d$-regular tree for which we determine precise asymptotics. We expect that our methods will generalize to a wide range of spin systems for which the second moment method holds. △ Less

Submitted 23 May, 2014; originally announced May 2014.

Comments: 39 pages, 5 figures. arXiv admin note: text overlap with arXiv:1004.3531

Harmonic pinnacles in the Discrete Gaussian model

Authors: Eyal Lubetzky, Fabio Martinelli, Allan Sly

Abstract: The 2D Discrete Gaussian model gives each height function $η: \mathbb{Z}^2\to\mathbb{Z}$ a probability proportional to $\exp(-β\mathcal{H}(η))$, where $β$ is the inverse-temperature and $\mathcal{H}(η) = \sum_{x\sim y}(η_x-η_y)^2$ sums over nearest-neighbor bonds. We consider the model at large fixed $β$, where it is flat unlike its continuous analog (the Gaussian Free Field). We first establish… ▽ More The 2D Discrete Gaussian model gives each height function $η: \mathbb{Z}^2\to\mathbb{Z}$ a probability proportional to $\exp(-β\mathcal{H}(η))$, where $β$ is the inverse-temperature and $\mathcal{H}(η) = \sum_{x\sim y}(η_x-η_y)^2$ sums over nearest-neighbor bonds. We consider the model at large fixed $β$, where it is flat unlike its continuous analog (the Gaussian Free Field). We first establish that the maximum height in an $L\times L$ box with 0 boundary conditions concentrates on two integers $M,M+1$ with $M\sim \sqrt{(1/2πβ)\log L\log\log L}$. The key is a large deviation estimate for the height at the origin in $\mathbb{Z}^2$, dominated by "harmonic pinnacles", integer approximations of a harmonic variational problem. Second, in this model conditioned on $η\geq 0$ (a floor), the average height rises, and in fact the height of almost all sites concentrates on levels $H,H+1$ where $H\sim M/\sqrt{2}$. This in particular pins down the asymptotics, and corrects the order, in results of Bricmont, El-Mellouki and Fröhlich (1986), where it was argued that the maximum and the height of the surface above a floor are both of order $\sqrt{\log L}$. Finally, our methods extend to other classical surface models (e.g., restricted SOS), featuring connections to $p$-harmonic analysis and alternating sign matrices. △ Less

Submitted 20 May, 2014; originally announced May 2014.

Comments: 40 pages, 5 figures

MSC Class: 82B41; 60K35; 31C20; 31C05

Information percolation and cutoff for the stochastic Ising model

Authors: Eyal Lubetzky, Allan Sly

Abstract: We introduce a new framework for analyzing Glauber dynamics for the Ising model. The traditional approach for obtaining sharp mixing results has been to appeal to estimates on spatial properties of the stationary measure from within a multi-scale analysis of the dynamics. Here we propose to study these simultaneously by examining "information percolation" clusters in the space-time slab. Using t… ▽ More We introduce a new framework for analyzing Glauber dynamics for the Ising model. The traditional approach for obtaining sharp mixing results has been to appeal to estimates on spatial properties of the stationary measure from within a multi-scale analysis of the dynamics. Here we propose to study these simultaneously by examining "information percolation" clusters in the space-time slab. Using this framework, we obtain new results for the Ising model on $(\mathbb{Z}/n\mathbb{Z})^d$ throughout the high temperature regime: total-variation mixing exhibits cutoff with an $O(1)$-window around the time at which the magnetization is the square-root of the volume. (Previously, cutoff in the full high temperature regime was only known for $d\leq 2$, and only with an $O(\log\log n)$-window.) Furthermore, the new framework opens the door to understanding the effect of the initial state on the mixing time. We demonstrate this on the 1D Ising model, showing that starting from the uniform ("disordered") initial distribution asymptotically halves the mixing time, whereas almost every deterministic starting state is asymptotically as bad as starting from the ("ordered") all-plus state. △ Less

Submitted 28 May, 2015; v1 submitted 23 January, 2014; originally announced January 2014.

Comments: 42 pages, 8 figures

MSC Class: 60J27; 82C20; 60K35; 60B10

A Proof Of The Block Model Threshold Conjecture

Authors: Elchanan Mossel, Joe Neeman, Allan Sly

Abstract: We study a random graph model named the "block model" in statistics and the "planted partition model" in theoretical computer science. In its simplest form, this is a random graph with two equal-sized clusters, with a between-class edge probability of $q$ and a within-class edge probability of $p$. A striking conjecture of Decelle, Krzkala, Moore and Zdeborová based on deep, non-rigorous ideas f… ▽ More We study a random graph model named the "block model" in statistics and the "planted partition model" in theoretical computer science. In its simplest form, this is a random graph with two equal-sized clusters, with a between-class edge probability of $q$ and a within-class edge probability of $p$. A striking conjecture of Decelle, Krzkala, Moore and Zdeborová based on deep, non-rigorous ideas from statistical physics, gave a precise prediction for the algorithmic threshold of clustering in the sparse planted partition model. In particular, if $p = a/n$ and $q = b/n$, $s=(a-b)/2$ and $p=(a+b)/2$ then Decelle et al.\ conjectured that it is possible to efficiently cluster in a way correlated with the true partition if $s^2 > p$ and impossible if $s^2 < p$. By comparison, the best-known rigorous result is that of Coja-Oghlan, who showed that clustering is possible if $s^2 > C p \ln p$ for some sufficiently large $C$. In a previous work, we proved that indeed it is information theoretically impossible to to cluster if $s^2 < p$ and furthermore it is information theoretically impossible to even estimate the model parameters from the graph when $s^2 < p$. Here we complete the proof of the conjecture by providing an efficient algorithm for clustering in a way that is correlated with the true partition when $s^2 > p$. A different independent proof of the same result was recently obtained by Laurent Massoulie. △ Less

Submitted 25 August, 2015; v1 submitted 17 November, 2013; originally announced November 2013.

Comments: 32 pages, v3 extends the results to slowly growing degrees

Maximum independent sets on random regular graphs

Authors: Jian Ding, Allan Sly, Nike Sun

Abstract: We determine the asymptotics of the independence number of the random $d$-regular graph for all $d \ge d_0$. It is highly concentrated, with constant-order fluctuations around $nα_* - c_*\log n$ for explicit constants $α_*(d)$ and $c_*(d)$. Our proof rigorously confirms the one-step replica symmetry breaking heuristics for this problem, and we believe the techniques will be more broadly applicable… ▽ More We determine the asymptotics of the independence number of the random $d$-regular graph for all $d \ge d_0$. It is highly concentrated, with constant-order fluctuations around $nα_* - c_*\log n$ for explicit constants $α_*(d)$ and $c_*(d)$. Our proof rigorously confirms the one-step replica symmetry breaking heuristics for this problem, and we believe the techniques will be more broadly applicable to the study of other combinatorial properties of random graphs. △ Less

Submitted 17 October, 2013; originally announced October 2013.

Satisfiability threshold for random regular NAE-SAT

Authors: Jian Ding, Allan Sly, Nike Sun

Abstract: We consider the random regular $k$-NAE-SAT problem with $n$ variables each appearing in exactly $d$ clauses. For all $k$ exceeding an absolute constant $k_0$, we establish explicitly the satisfiability threshold $d_*=d_*(k)$. We prove that for $d<d_*$ the problem is satisfiable with high probability while for $d>d_*$ the problem is unsatisfiable with high probability. If the threshold $d_*$ lands… ▽ More We consider the random regular $k$-NAE-SAT problem with $n$ variables each appearing in exactly $d$ clauses. For all $k$ exceeding an absolute constant $k_0$, we establish explicitly the satisfiability threshold $d_*=d_*(k)$. We prove that for $d<d_*$ the problem is satisfiable with high probability while for $d>d_*$ the problem is unsatisfiable with high probability. If the threshold $d_*$ lands exactly on an integer, we show that the problem is satisfiable with probability bounded away from both zero and one. This is the first result to locate the exact satisfiability threshold in a random constraint satisfaction problem exhibiting the condensation phenomenon identified by Krzakala et al. (2007). Our proof verifies the one-step replica symmetry breaking formalism for this model. We expect our methods to be applicable to a broad range of random constraint satisfaction problems and combinatorial problems on random graphs. △ Less

Submitted 17 October, 2013; originally announced October 2013.

Belief propagation, robust reconstruction and optimal recovery of block models

Authors: Elchanan Mossel, Joe Neeman, Allan Sly

Abstract: We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities $a/n$ and $b/n$ for inter- and intra-block edge probabilities, respectively. It was recently shown that one can do better than a random guess if and only if $(a-b)^2>2(a+b)$. Using a variant of belief propagation, we give a reconstruction algorithm that is optimal in the sense that… ▽ More We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities $a/n$ and $b/n$ for inter- and intra-block edge probabilities, respectively. It was recently shown that one can do better than a random guess if and only if $(a-b)^2>2(a+b)$. Using a variant of belief propagation, we give a reconstruction algorithm that is optimal in the sense that if $(a-b)^2>C(a+b)$ for some constant $C$ then our algorithm maximizes the fraction of the nodes labeled correctly. Ours is the only algorithm proven to achieve the optimal fraction of nodes labeled correctly. Along the way, we prove some results of independent interest regarding robust reconstruction for the Ising model on regular and Poisson trees. △ Less

Submitted 27 September, 2016; v1 submitted 5 September, 2013; originally announced September 2013.

Comments: Published at http://dx.doi.org/10.1214/15-AAP1145 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP1145

Journal ref: Annals of Applied Probability 2016, Vol. 26, No. 4, 2211-2256

Spectral redemption: clustering sparse networks

Authors: Florent Krzakala, Cristopher Moore, Elchanan Mossel, Joe Neeman, Allan Sly, Lenka Zdeborová, Pan Zhang

Abstract: Spectral algorithms are classic approaches to clustering and community detection in networks. However, for sparse networks the standard versions of these algorithms are suboptimal, in some cases completely failing to detect communities even when other algorithms such as belief propagation can do so. Here we introduce a new class of spectral algorithms based on a non-backtracking walk on the direct… ▽ More Spectral algorithms are classic approaches to clustering and community detection in networks. However, for sparse networks the standard versions of these algorithms are suboptimal, in some cases completely failing to detect communities even when other algorithms such as belief propagation can do so. Here we introduce a new class of spectral algorithms based on a non-backtracking walk on the directed edges of the graph. The spectrum of this operator is much better-behaved than that of the adjacency matrix or other commonly used matrices, maintaining a strong separation between the bulk eigenvalues and the eigenvalues relevant to community structure even in the sparse case. We show that our algorithm is optimal for graphs generated by the stochastic block model, detecting communities all the way down to the theoretical limit. We also show the spectrum of the non-backtracking operator for some real-world networks, illustrating its advantages over traditional spectral clustering. △ Less

Submitted 23 August, 2013; v1 submitted 24 June, 2013; originally announced June 2013.

Comments: 11 pages, 6 figures. Clarified to what extent our claims are rigorous, and to what extent they are conjectures; also added an interpretation of the eigenvectors of the 2n-dimensional version of the non-backtracking matrix

Journal ref: Proceedings of the National Academy of Sciences 110, no. 52 (2013): 20935-20940

Distances in critical long range percolation

Authors: Jian Ding, Allan Sly

Abstract: We study the long range percolation model on $\mathbb{Z}$ where sites $i$ and $j$ are connected with probability $β|i-j|^{-s}$. Graph distances are now well understood for all exponents $s$ except in the case $s=2$ where the model exhibits non-trivial self-similar scaling. Establishing a conjecture of Benjamini and Berger \cite{BenBer:01}, we prove that the typical distance from site 0 to $n$ grow… ▽ More We study the long range percolation model on $\mathbb{Z}$ where sites $i$ and $j$ are connected with probability $β|i-j|^{-s}$. Graph distances are now well understood for all exponents $s$ except in the case $s=2$ where the model exhibits non-trivial self-similar scaling. Establishing a conjecture of Benjamini and Berger \cite{BenBer:01}, we prove that the typical distance from site 0 to $n$ grows as a power law $n^{θ(β)}$ up to a multiplicative constant for some exponent $0<θ(β)<1$ as does the diameter of the graph on a box of length $n$. △ Less

Submitted 7 November, 2015; v1 submitted 16 March, 2013; originally announced March 2013.

Comments: A number of revisions have been implemented in Version 2

MSC Class: 60K35; 82B43; 82B28

Scaling limit and cube-root fluctuations in SOS surfaces above a wall

Authors: Pietro Caputo, Eyal Lubetzky, Fabio Martinelli, Allan Sly, Fabio Lucio Toninelli

Abstract: Consider the classical $(2+1)$-dimensional Solid-On-Solid model above a hard wall on an $L\times L$ box of $\bbZ^2$. The model describes a crystal surface by assigning a non-negative integer height $η_x$ to each site $x$ in the box and 0 heights to its boundary. The probability of a surface configuration $η$ is proportional to $\exp(-β\mathcal{H}(η))$, where $β$ is the inverse-temperature and… ▽ More Consider the classical $(2+1)$-dimensional Solid-On-Solid model above a hard wall on an $L\times L$ box of $\bbZ^2$. The model describes a crystal surface by assigning a non-negative integer height $η_x$ to each site $x$ in the box and 0 heights to its boundary. The probability of a surface configuration $η$ is proportional to $\exp(-β\mathcal{H}(η))$, where $β$ is the inverse-temperature and $\mathcal{H}(η)$ sums the absolute values of height differences between neighboring sites. We give a full description of the shape of the SOS surface for low enough temperatures. First we show that with high probability the height of almost all sites is concentrated on two levels, $H(L)=\lfloor (1/4β)\log L\rfloor$ and $H(L)-1$. Moreover, for most values of $L$ the height is concentrated on the single value $H(L)$. Next, we study the ensemble of level lines corresponding to the heights $(H(L),H(L)-1,...)$. We prove that w.h.p. there is a unique macroscopic level line for each height. Furthermore, when taking a diverging sequence of system sizes $L_k$, the rescaled macroscopic level line at height $H(L_k)-n$ has a limiting shape if the fractional parts of $(1/4β)\log L_k$ converge to a noncritical value. The scaling limit is an explicit convex subset of the unit square $Q$ and its boundary has a flat component on the boundary of $Q$. Finally, the highest macroscopic level line has $L_k^{1/3+o(1)}$ fluctuations along the flat part of the boundary of its limiting shape. △ Less

Submitted 27 February, 2013; originally announced February 2013.

Comments: 54 pages, 8 figures

MSC Class: 60K35; 82B41; 82C24

Strategic Learning and the Topology of Social Networks

Authors: Elchanan Mossel, Allan Sly, Omer Tamuz

Abstract: We consider a group of strategic agents who must each repeatedly take one of two possible actions. They learn which of the two actions is preferable from initial private signals, and by observing the actions of their neighbors in a social network. We show that the question of whether or not the agents learn efficiently depends on the topology of the social network. In particular, we identify a g… ▽ More We consider a group of strategic agents who must each repeatedly take one of two possible actions. They learn which of the two actions is preferable from initial private signals, and by observing the actions of their neighbors in a social network. We show that the question of whether or not the agents learn efficiently depends on the topology of the social network. In particular, we identify a geometric "egalitarianism" condition on the social network that guarantees learning in infinite networks, or learning with high probability in large finite networks, in any equilibrium. We also give examples of non-egalitarian networks with equilibria in which learning fails. △ Less

Submitted 30 May, 2015; v1 submitted 25 September, 2012; originally announced September 2012.

Comments: 30 pages, one figure

Journal ref: Econometrica, Volume 83, Issue 5, pages 1755-1794, September 2015

Social learning equilibria

Authors: Elchanan Mossel, Manuel Mueller-Frank, Allan Sly, Omer Tamuz

Abstract: We consider a large class of social learning models in which a group of agents face uncertainty regarding a state of the world, share the same utility function, observe private signals, and interact in a general dynamic setting. We introduce Social Learning Equilibria, a static equilibrium concept that abstracts away from the details of the given extensive form, but nevertheless captures the corre… ▽ More We consider a large class of social learning models in which a group of agents face uncertainty regarding a state of the world, share the same utility function, observe private signals, and interact in a general dynamic setting. We introduce Social Learning Equilibria, a static equilibrium concept that abstracts away from the details of the given extensive form, but nevertheless captures the corresponding asymptotic equilibrium behavior. We establish general conditions for agreement, herding, and information aggregation in equilibrium, highlighting a connection between agreement and information aggregation. △ Less

Submitted 27 September, 2019; v1 submitted 25 July, 2012; originally announced July 2012.

Asymptotic Learning on Bayesian Social Networks

Authors: Elchanan Mossel, Allan Sly, Omer Tamuz

Abstract: Understanding information exchange and aggregation on networks is a central problem in theoretical economics, probability and statistics. We study a standard model of economic agents on the nodes of a social network graph who learn a binary "state of the world" S, from initial signals, by repeatedly observing each other's best guesses. Asymptotic learning is said to occur on a family of graphs G… ▽ More Understanding information exchange and aggregation on networks is a central problem in theoretical economics, probability and statistics. We study a standard model of economic agents on the nodes of a social network graph who learn a binary "state of the world" S, from initial signals, by repeatedly observing each other's best guesses. Asymptotic learning is said to occur on a family of graphs G_n = (V_n, E_n), with |V_n| tending to infinity, if with probability tending to 1 as n tends to infinity all agents in G_n eventually estimate S correctly. We identify sufficient conditions for asymptotic learning and contruct examples where learning does not occur when the conditions do not hold. △ Less

Submitted 25 July, 2012; originally announced July 2012.

Comments: 28 pages, 2 figures. arXiv admin note: substantial text overlap with arXiv:1105.4765

Journal ref: Probability Theory and Related Fields, 158(1-2):127-157, 2014

The replica symmetric solution for Potts models on d-regular graphs

Authors: Amir Dembo, Andrea Montanari, Allan Sly, Nike Sun

Abstract: We provide an explicit formula for the limiting free energy density (log-partition function divided by the number of vertices) for ferromagnetic Potts models on uniformly sparse graph sequences converging locally to the d-regular tree for d even, covering all temperature regimes. This formula coincides with the Bethe free energy functional evaluated at a suitable fixed point of the belief propagat… ▽ More We provide an explicit formula for the limiting free energy density (log-partition function divided by the number of vertices) for ferromagnetic Potts models on uniformly sparse graph sequences converging locally to the d-regular tree for d even, covering all temperature regimes. This formula coincides with the Bethe free energy functional evaluated at a suitable fixed point of the belief propagation recursion on the d-regular tree, the so-called replica symmetric solution. For uniformly random d-regular graphs we further show that the replica symmetric Bethe formula is an upper bound for the asymptotic free energy for any model with permissive interactions. △ Less

Submitted 23 July, 2012; originally announced July 2012.

Comments: 23 pages

MSC Class: 82B20; 82B23; 05C80; 60K35

The shape of the $(2+1)$D SOS surface above a wall

Authors: Pietro Caputo, Eyal Lubetzky, Fabio Martinelli, Allan Sly, Fabio Lucio Toninelli

Abstract: We give a full description for the shape of the classical (2+1)\Dim Solid-On-Solid model above a wall, introduced by Temperley (1952). On an $L\times L$ box at a large inverse-temperature $β$ the height of most sites concentrates on a single level $h = \lfloor (1/4β)\log L\rfloor$ for most values of $L$. For a sequence of diverging boxes the ensemble of level lines of heights $(h,h-1,...)$ has a s… ▽ More We give a full description for the shape of the classical (2+1)\Dim Solid-On-Solid model above a wall, introduced by Temperley (1952). On an $L\times L$ box at a large inverse-temperature $β$ the height of most sites concentrates on a single level $h = \lfloor (1/4β)\log L\rfloor$ for most values of $L$. For a sequence of diverging boxes the ensemble of level lines of heights $(h,h-1,...)$ has a scaling limit in Hausdorff distance iff the fractional parts of $(1/4β)\log L$ converge to a noncritical value. The scaling limit is explicitly given by nested distinct loops formed via translates of Wulff shapes. Finally, the $h$-level lines feature $L^{1/3+o(1)}$ fluctuations from the side boundaries. △ Less

Submitted 16 July, 2012; originally announced July 2012.

Comments: 5 pages

MSC Class: 60K35; 82C22

Journal ref: Comptes Rendus Mathematique 350(13-14):703-706, 2012

Dynamics of $(2+1)$-dimensional SOS surfaces above a wall: Slow mixing induced by entropic repulsion

Authors: Pietro Caputo, Eyal Lubetzky, Fabio Martinelli, Allan Sly, Fabio Lucio Toninelli

Abstract: We study the Glauber dynamics for the $(2+1)\mathrm{D}$ Solid-On-Solid model above a hard wall and below a far away ceiling, on an $L\times L$ box of $\mathbb{Z}^2$ with zero boundary conditions, at large inverse-temperature $β$. It was shown by Bricmont, El Mellouki and Fröhlich [J. Stat. Phys. 42 (1986) 743-798] that the floor constraint induces an entropic repulsion effect which lifts the surfa… ▽ More We study the Glauber dynamics for the $(2+1)\mathrm{D}$ Solid-On-Solid model above a hard wall and below a far away ceiling, on an $L\times L$ box of $\mathbb{Z}^2$ with zero boundary conditions, at large inverse-temperature $β$. It was shown by Bricmont, El Mellouki and Fröhlich [J. Stat. Phys. 42 (1986) 743-798] that the floor constraint induces an entropic repulsion effect which lifts the surface to an average height $H\asymp(1/β)\log L$. As an essential step in understanding the effect of entropic repulsion on the Glauber dynamics we determine the equilibrium height $H$ to within an additive constant: $H=(1/4β)\log L+O(1)$. We then show that starting from zero initial conditions the surface rises to its final height $H$ through a sequence of metastable transitions between consecutive levels. The time for a transition from height $h=aH$, $a\in(0,1)$, to height $h+1$ is roughly $\exp(cL^a)$ for some constant $c>0$. In particular, the mixing time of the dynamics is exponentially large in $L$, that is, $T_{\mathrm{MIX}}\geq e^{cL}$. We also provide the matching upper bound $T_{\mathrm{MIX}}\leq e^{c'L}$, requiring a challenging analysis of the statistics of height contours at low temperature and new coupling ideas and techniques. Finally, to emphasize the role of entropic repulsion we show that without a floor constraint at height zero the mixing time is no longer exponentially large in $L$. △ Less

Submitted 24 July, 2014; v1 submitted 31 May, 2012; originally announced May 2012.

Comments: Published in at http://dx.doi.org/10.1214/13-AOP836 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP836

Journal ref: Annals of Probability 2014, Vol. 42, No. 4, 1516-1589

Glauber Dynamics for the mean-field Potts Model

Authors: Paul Cuff, Jian Ding, Oren Louidor, Eyal Lubetzky, Yuval Peres, Allan Sly

Abstract: We study Glauber dynamics for the mean-field (Curie-Weiss) Potts model with $q\geq 3$ states and show that it undergoes a critical slowdown at an inverse-temperature $β_s(q)$ strictly lower than the critical $β_c(q)$ for uniqueness of the thermodynamic limit. The dynamical critical $β_s(q)$ is the spinodal point marking the onset of metastability. We prove that when $β<β_s(q)$ the mixing time is… ▽ More We study Glauber dynamics for the mean-field (Curie-Weiss) Potts model with $q\geq 3$ states and show that it undergoes a critical slowdown at an inverse-temperature $β_s(q)$ strictly lower than the critical $β_c(q)$ for uniqueness of the thermodynamic limit. The dynamical critical $β_s(q)$ is the spinodal point marking the onset of metastability. We prove that when $β<β_s(q)$ the mixing time is asymptotically $C(β, q) n \log n$ and the dynamics exhibits the cutoff phenomena, a sharp transition in mixing, with a window of order $n$. At $β=β_s(q)$ the dynamics no longer exhibits cutoff and its mixing obeys a power-law of order $n^{4/3}$. For $β>β_s(q)$ the mixing time is exponentially large in $n$. Furthermore, as $β\uparrow β_s$ with $n$, the mixing time interpolates smoothly from subcritical to critical behavior, with the latter reached at a scaling window of $O(n^{-2/3})$ around $β_s$. These results form the first complete analysis of mixing around the critical dynamical temperature --- including the critical power law --- for a model with a first order phase transition. △ Less

Submitted 11 June, 2012; v1 submitted 19 April, 2012; originally announced April 2012.

Comments: 45 pages, 5 figures

MSC Class: 60J10; 60K35; 82C20

Journal ref: Journal of Statistical Physics, 149(3):432-477, November, 2012

Lipschitz embeddings of random sequences

Authors: Riddhipratim Basu, Allan Sly

Abstract: We develop a new multi-scale framework flexible enough to solve a number of problems involving embedding random sequences into random sequences. Grimmett, Liggett and Richthammer asked whether there exists an increasing M-Lipschitz embedding from one i.i.d. Bernoulli sequences into an independent copy with positive probability. We give a positive answer for large enough M. A closely related proble… ▽ More We develop a new multi-scale framework flexible enough to solve a number of problems involving embedding random sequences into random sequences. Grimmett, Liggett and Richthammer asked whether there exists an increasing M-Lipschitz embedding from one i.i.d. Bernoulli sequences into an independent copy with positive probability. We give a positive answer for large enough M. A closely related problem is to show that two independent Poisson processes on R are roughly isometric (or quasi-isometric). Our approach also applies in this case answering a conjecture of Szegedy and of Peled. Our theorem also gives a new proof to Winkler's compatible sequences problem. △ Less

Submitted 19 April, 2012; v1 submitted 13 April, 2012; originally announced April 2012.

Comments: 46 pages, 3 figures added

The computational hardness of counting in two-spin models on d-regular graphs

Authors: Allan Sly, Nike Sun

Abstract: The class of two-spin systems contains several important models, including random independent sets and the Ising model of statistical physics. We show that for both the hard-core (independent set) model and the anti-ferromagnetic Ising model with arbitrary external field, it is NP-hard to approximate the partition function or approximately sample from the model on d-regular graphs when the model h… ▽ More The class of two-spin systems contains several important models, including random independent sets and the Ising model of statistical physics. We show that for both the hard-core (independent set) model and the anti-ferromagnetic Ising model with arbitrary external field, it is NP-hard to approximate the partition function or approximately sample from the model on d-regular graphs when the model has non-uniqueness on the d-regular tree. Together with results of Jerrum--Sinclair, Weitz, and Sinclair--Srivastava--Thurley giving FPRAS's for all other two-spin systems except at the uniqueness threshold, this gives an almost complete classification of the computational complexity of two-spin systems on bounded-degree graphs. Our proof establishes that the normalized log-partition function of any two-spin system on bipartite locally tree-like graphs converges to a limiting "free energy density" which coincides with the (non-rigorous) Bethe prediction of statistical physics. We use this result to characterize the local structure of two-spin systems on locally tree-like bipartite expander graphs, which then become the basic gadgets in a randomized reduction to approximate MAX-CUT. Our approach is novel in that it makes no use of the second moment method employed in previous works on these questions. △ Less

Submitted 12 March, 2012; originally announced March 2012.

Comments: 23 pages

Cutoff for general spin systems with arbitrary boundary conditions

Authors: Eyal Lubetzky, Allan Sly

Abstract: The cutoff phenomenon describes a sharp transition in the convergence of a Markov chain to equilibrium. In recent work, the authors established cutoff and its location for the stochastic Ising model on the $d$-dimensional torus $(Z/nZ)^d$ for any $d\geq 1$. The proof used the symmetric structure of the torus and monotonicity in an essential way. Here we enhance the framework and extend it to gen… ▽ More The cutoff phenomenon describes a sharp transition in the convergence of a Markov chain to equilibrium. In recent work, the authors established cutoff and its location for the stochastic Ising model on the $d$-dimensional torus $(Z/nZ)^d$ for any $d\geq 1$. The proof used the symmetric structure of the torus and monotonicity in an essential way. Here we enhance the framework and extend it to general geometries, boundary conditions and external fields to derive a cutoff criterion that involves the growth rate of balls and the log-Sobolev constant of the Glauber dynamics. In particular, we show there is cutoff for stochastic Ising on any sequence of bounded-degree graphs with sub-exponential growth under arbitrary external fields provided the inverse log-Sobolev constant is bounded. For lattices with homogenous boundary, such as all-plus, we identify the cutoff location explicitly in terms of spectral gaps of infinite-volume dynamics on half-plane intersections. Analogous results establishing cutoff are obtained for non-monotone spin-systems at high temperatures, including the gas hard-core model, the Potts model, the anti-ferromagnetic Potts model and the coloring model. △ Less

Submitted 5 November, 2012; v1 submitted 20 February, 2012; originally announced February 2012.

Comments: 47 pages, 3 figures. Companion paper to arXiv:0909.4320. To appear in Comm. Pure Appl. Math

MSC Class: 60J27; 82C20; 60K35; 60B10

Stochastic Block Models and Reconstruction

Authors: Elchanan Mossel, Joe Neeman, Allan Sly

Abstract: The planted partition model (also known as the stochastic blockmodel) is a classical cluster-exhibiting random graph model that has been extensively studied in statistics, physics, and computer science. In its simplest form, the planted partition model is a model for random graphs on $n$ nodes with two equal-sized clusters, with an between-class edge probability of $q$ and a within-class edge prob… ▽ More The planted partition model (also known as the stochastic blockmodel) is a classical cluster-exhibiting random graph model that has been extensively studied in statistics, physics, and computer science. In its simplest form, the planted partition model is a model for random graphs on $n$ nodes with two equal-sized clusters, with an between-class edge probability of $q$ and a within-class edge probability of $p$. Although most of the literature on this model has focused on the case of increasing degrees (ie.\ $pn, qn \to \infty$ as $n \to \infty$), the sparse case $p, q = O(1/n)$ is interesting both from a mathematical and an applied point of view. A striking conjecture of Decelle, Krzkala, Moore and Zdeborová based on deep, non-rigorous ideas from statistical physics gave a precise prediction for the algorithmic threshold of clustering in the sparse planted partition model. In particular, if $p = a/n$ and $q = b/n$, then Decelle et al.\ conjectured that it is possible to cluster in a way correlated with the true partition if $(a - b)^2 > 2(a + b)$, and impossible if $(a - b)^2 < 2(a + b)$. By comparison, the best-known rigorous result is that of Coja-Oghlan, who showed that clustering is possible if $(a - b)^2 > C (a + b)$ for some sufficiently large $C$. We prove half of their prediction, showing that it is indeed impossible to cluster if $(a - b)^2 < 2(a + b)$. Furthermore we show that it is impossible even to estimate the model parameters from the graph when $(a - b)^2 < 2(a + b)$; on the other hand, we provide a simple and efficient algorithm for estimating $a$ and $b$ when $(a - b)^2 > 2(a + b)$. Following Decelle et al, our work establishes a rigorous connection between the clustering problem, spin-glass models on the Bethe lattice and the so called reconstruction problem. This connection points to fascinating applications and open problems. △ Less

Submitted 21 August, 2012; v1 submitted 7 February, 2012; originally announced February 2012.

MSC Class: 05C80

Robust estimation of latent tree graphical models: Inferring hidden states with inexact parameters

Authors: Elchanan Mossel, Sebastien Roch, Allan Sly

Abstract: Latent tree graphical models are widely used in computational biology, signal and image processing, and network tomography. Here we design a new efficient, estimation procedure for latent tree models, including Gaussian and discrete, reversible models, that significantly improves on previous sample requirement bounds. Our techniques are based on a new hidden state estimator which is robust to inac… ▽ More Latent tree graphical models are widely used in computational biology, signal and image processing, and network tomography. Here we design a new efficient, estimation procedure for latent tree models, including Gaussian and discrete, reversible models, that significantly improves on previous sample requirement bounds. Our techniques are based on a new hidden state estimator which is robust to inaccuracies in estimated parameters. More precisely, we prove that latent tree models can be estimated with high probability in the so-called Kesten-Stigum regime with $O(log^2 n)$ samples where $n$ is the number of nodes. △ Less

Submitted 21 September, 2011; originally announced September 2011.

From Agreement to Asymptotic Learning

Authors: Elchanan Mossel, Allan Sly, Omer Tamuz

Abstract: We consider a group of Bayesian agents who are each given an independent signal about an unknown state of the world, and proceed to communicate with each other. We study the question of asymptotic learning: do agents learn the state of the world with probability that approaches one as the number of agents tends to infinity? We show that under general conditions asymptotic learning follows from a… ▽ More We consider a group of Bayesian agents who are each given an independent signal about an unknown state of the world, and proceed to communicate with each other. We study the question of asymptotic learning: do agents learn the state of the world with probability that approaches one as the number of agents tends to infinity? We show that under general conditions asymptotic learning follows from agreement on posterior actions or posterior beliefs, regardless of the communication dynamics. In particular, we prove that asymptotic learning holds for the Gale-Kariv model on undirected networks and non-atomic private beliefs. △ Less

Submitted 13 November, 2012; v1 submitted 24 May, 2011; originally announced May 2011.

Comments: This paper has been split into two: https://arxiv.boxedpaper.com/abs/1207.5893 and https://arxiv.boxedpaper.com/abs/1207.5895

Mixing of the upper triangular matrix walk

Authors: Yuval Peres, Allan Sly

Abstract: We study a natural random walk over the upper triangular matrices, with entries in the field $\Z_2$, generated by steps which add row $i+1$ to row $i$. We show that the mixing time of the lazy random walk is $O(n^2)$ which is optimal up to constants. Our proof makes key use of the linear structure of the group and extends to walks on the upper triangular matrices over the fields $\Z_q$ for $q$ pri… ▽ More We study a natural random walk over the upper triangular matrices, with entries in the field $\Z_2$, generated by steps which add row $i+1$ to row $i$. We show that the mixing time of the lazy random walk is $O(n^2)$ which is optimal up to constants. Our proof makes key use of the linear structure of the group and extends to walks on the upper triangular matrices over the fields $\Z_q$ for $q$ prime. △ Less

Submitted 30 May, 2011; v1 submitted 23 May, 2011; originally announced May 2011.

Comments: 11 pages

MSC Class: 60J10; 60B15

Quasi-polynomial mixing of the 2D stochastic Ising model with "plus" boundary up to criticality

Authors: Eyal Lubetzky, Fabio Martinelli, Allan Sly, Fabio Lucio Toninelli

Abstract: We considerably improve upon the recent result of Martinelli and Toninelli on the mixing time of Glauber dynamics for the 2D Ising model in a box of side $L$ at low temperature and with random boundary conditions whose distribution $P$ stochastically dominates the extremal plus phase. An important special case is when $P$ is concentrated on the homogeneous all-plus configuration, where the mixing… ▽ More We considerably improve upon the recent result of Martinelli and Toninelli on the mixing time of Glauber dynamics for the 2D Ising model in a box of side $L$ at low temperature and with random boundary conditions whose distribution $P$ stochastically dominates the extremal plus phase. An important special case is when $P$ is concentrated on the homogeneous all-plus configuration, where the mixing time $T_{mix}$ is conjectured to be polynomial in $L$. In [MT] it was shown that for a large enough inverse-temperature $β$ and any $ε>0$ there exists $c=c(β,ε)$ such that $\lim_{L\to\infty}P(T_{mix}\geq \exp({c L^ε}))=0$. In particular, for the all-plus boundary conditions and $β$ large enough $T_{mix} \leq \exp({c L^ε})$. Here we show that the same conclusions hold for all $β$ larger than the critical value $β_c$ and with $\exp({c L^ε})$ replaced by $L^{c \log L}$ (i.e. quasi-polynomial mixing). The key point is a modification of the inductive scheme of [MT] together with refined equilibrium estimates that hold up to criticality, obtained via duality and random-line representation tools for the Ising model. In particular, we establish new precise bounds on the law of Peierls contours which quantitatively sharpen the Brownian bridge picture established e.g. in [Greenberg-Ioffe (2005)],[Higuchi (1979)],[Hryniv (1998)]. △ Less

Submitted 6 December, 2010; originally announced December 2010.

Comments: 45 pages, 14 figures

MSC Class: 60K35; 82C20

Properties of Uniform Doubly Stochastic Matrices

Authors: Sourav Chatterjee, Persi Diaconis, Allan Sly

Abstract: We investigate the properties of uniform doubly stochastic random matrices, that is non-negative matrices conditioned to have their rows and columns sum to 1. The rescaled marginal distributions are shown to converge to exponential distributions and indeed even large sub-matrices of side-length $o(n^{1/2-ε})$ behave like independent exponentials. We determine the limiting empirical distribution of… ▽ More We investigate the properties of uniform doubly stochastic random matrices, that is non-negative matrices conditioned to have their rows and columns sum to 1. The rescaled marginal distributions are shown to converge to exponential distributions and indeed even large sub-matrices of side-length $o(n^{1/2-ε})$ behave like independent exponentials. We determine the limiting empirical distribution of the singular values the the matrix. Finally the mixing time of the associated Markov chains is shown to be exactly 2 with high probability. △ Less

Submitted 29 October, 2010; originally announced October 2010.

MSC Class: 60B20

Computational Transition at the Uniqueness Threshold

Authors: Allan Sly

Abstract: The hardcore model is a model of lattice gas systems which has received much attention in statistical physics, probability theory and theoretical computer science. It is the probability distribution over independent sets $I$ of a graph weighted proportionally to $λ^{|I|}$ with fugacity parameter $λ$. We prove that at the uniqueness threshold of the hardcore model on the $d$-regular tree, approxima… ▽ More The hardcore model is a model of lattice gas systems which has received much attention in statistical physics, probability theory and theoretical computer science. It is the probability distribution over independent sets $I$ of a graph weighted proportionally to $λ^{|I|}$ with fugacity parameter $λ$. We prove that at the uniqueness threshold of the hardcore model on the $d$-regular tree, approximating the partition function becomes computationally hard on graphs of maximum degree $d$. Specifically, we show that unless NP$=$RP there is no polynomial time approximation scheme for the partition function (the sum of such weighted independent sets) on graphs of maximum degree $d$ for fugacity $λ_c(d) < λ< λ_c(d) + ε(d)$ where $λ_c = \frac{(d-1)^{d-1}}{(d-2)^d}$ is the uniqueness threshold on the $d$-regular tree and $ε(d)>0$. Weitz produced an FPTAS for approximating the partition function when $0<λ< λ_c(d)$ so this result demonstrates that the computational threshold exactly coincides with the statistical physics phase transition thus confirming the main conjecture of [28]. We further analyze the special case of $λ=1, d=6$ and show there is no polynomial time algorithm for approximately counting independent sets on graphs of maximum degree $d= 6$ which is optimal. Our proof is based on specially constructed random bi-partite graphs which act as gadgets in a reduction to MAX-CUT. Building on the second moment method analysis of [28] and combined with an analysis of the reconstruction problem on the tree our proof establishes a strong version of 'replica' method heuristics developed by theoretical physicists. The result establishes the first rigorous correspondence between the hardness of approximate counting and sampling with statistical physics phase transitions. △ Less

Submitted 31 May, 2010; originally announced May 2010.

Comments: 33 pages

Random graphs with a given degree sequence

Authors: Sourav Chatterjee, Persi Diaconis, Allan Sly

Abstract: Large graphs are sometimes studied through their degree sequences (power law or regular graphs). We study graphs that are uniformly chosen with a given degree sequence. Under mild conditions, it is shown that sequences of such graphs have graph limits in the sense of Lovász and Szegedy with identifiable limits. This allows simple determination of other features such as the number of triangles. The… ▽ More Large graphs are sometimes studied through their degree sequences (power law or regular graphs). We study graphs that are uniformly chosen with a given degree sequence. Under mild conditions, it is shown that sequences of such graphs have graph limits in the sense of Lovász and Szegedy with identifiable limits. This allows simple determination of other features such as the number of triangles. The argument proceeds by studying a natural exponential model having the degree sequence as a sufficient statistic. The maximum likelihood estimate (MLE) of the parameters is shown to be unique and consistent with high probability. Thus $n$ parameters can be consistently estimated based on a sample of size one. A fast, provably convergent, algorithm for the MLE is derived. These ingredients combine to prove the graph limit theorem. Along the way, a continuous version of the Erdős--Gallai characterization of degree sequences is derived. △ Less

Submitted 30 August, 2011; v1 submitted 7 May, 2010; originally announced May 2010.

Comments: Published in at http://dx.doi.org/10.1214/10-AAP728 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP728

Journal ref: Annals of Applied Probability 2011, Vol. 21, No. 4, 1400-1435

Reconstruction Threshold for the Hardcore Model

Authors: Nayantara Bhatnagar, Allan Sly, Prasad Tetali

Abstract: In this paper we consider the reconstruction problem on the tree for the hardcore model. We determine new bounds for the non-reconstruction regime on the k-regular tree showing non-reconstruction when lambda < (ln 2-o(1))ln^2(k)/(2 lnln(k)) improving the previous best bound of lambda < e-1. This is almost tight as reconstruction is known to hold when lambda> (e+o(1))ln^2(k). We discuss the relat… ▽ More In this paper we consider the reconstruction problem on the tree for the hardcore model. We determine new bounds for the non-reconstruction regime on the k-regular tree showing non-reconstruction when lambda < (ln 2-o(1))ln^2(k)/(2 lnln(k)) improving the previous best bound of lambda < e-1. This is almost tight as reconstruction is known to hold when lambda> (e+o(1))ln^2(k). We discuss the relationship for finding large independent sets in sparse random graphs and to the mixing time of Markov chains for sampling independent sets on trees. △ Less

Submitted 20 April, 2010; originally announced April 2010.

Comments: 14 pages, 2 figures

Journal ref: In Proceedings of the 14th International Conference on Randomization and Computation (RANDOM), volume 6302 of Lecture Notes in Computer Science, pages 434-447. Springer, 2010

Explicit expanders with cutoff phenomena

Authors: Eyal Lubetzky, Allan Sly

Abstract: The cutoff phenomenon describes a sharp transition in the convergence of an ergodic finite Markov chain to equilibrium. Of particular interest is understanding this convergence for the simple random walk on a bounded-degree expander graph. The first example of a family of bounded-degree graphs where the random walk exhibits cutoff in total-variation was provided only very recently, when the author… ▽ More The cutoff phenomenon describes a sharp transition in the convergence of an ergodic finite Markov chain to equilibrium. Of particular interest is understanding this convergence for the simple random walk on a bounded-degree expander graph. The first example of a family of bounded-degree graphs where the random walk exhibits cutoff in total-variation was provided only very recently, when the authors showed this for a typical random regular graph. However, no example was known for an explicit (deterministic) family of expanders with this phenomenon. Here we construct a family of cubic expanders where the random walk from a worst case initial position exhibits total-variation cutoff. Variants of this construction give cubic expanders without cutoff, as well as cubic graphs with cutoff at any prescribed time-point. △ Less

Submitted 18 March, 2010; originally announced March 2010.

Comments: 17 pages, 2 figures

MSC Class: 60B10; 60J10; 60G50; 05C81

On the inference of large phylogenies with long branches: How long is too long?

Authors: Elchanan Mossel, Sebastien Roch, Allan Sly

Abstract: Recent work has highlighted deep connections between sequence-length requirements for high-probability phylogeny reconstruction and the related problem of the estimation of ancestral sequences. In [Daskalakis et al.'09], building on the work of [Mossel'04], a tight sequence-length requirement was obtained for the CFN model. In particular the required sequence length for high-probability reconstr… ▽ More Recent work has highlighted deep connections between sequence-length requirements for high-probability phylogeny reconstruction and the related problem of the estimation of ancestral sequences. In [Daskalakis et al.'09], building on the work of [Mossel'04], a tight sequence-length requirement was obtained for the CFN model. In particular the required sequence length for high-probability reconstruction was shown to undergo a sharp transition (from $O(\log n)$ to $\hbox{poly}(n)$, where $n$ is the number of leaves) at the "critical" branch length $\critmlq$ (if it exists) of the ancestral reconstruction problem. Here we consider the GTR model. For this model, recent results of [Roch'09] show that the tree can be accurately reconstructed with sequences of length $O(\log(n))$ when the branch lengths are below $\critksq$, known as the Kesten-Stigum (KS) bound. Although for the CFN model $\critmlq = \critksq$, it is known that for the more general GTR models one has $\critmlq \geq \critksq$ with a strict inequality in many cases. Here, we show that this phenomenon also holds for phylogenetic reconstruction by exhibiting a family of symmetric models $Q$ and a phylogenetic reconstruction algorithm which recovers the tree from $O(\log n)$-length sequences for some branch lengths in the range $(\critksq,\critmlq)$. Second we prove that phylogenetic reconstruction under GTR models requires a polynomial sequence-length for branch lengths above $\critmlq$. △ Less

Submitted 20 January, 2010; originally announced January 2010.

Critical Ising on the square lattice mixes in polynomial time

Authors: Eyal Lubetzky, Allan Sly

Abstract: The Ising model is widely regarded as the most studied model of spin-systems in statistical physics. The focus of this paper is its dynamic (stochastic) version, the Glauber dynamics, introduced in 1963 and by now the most popular means of sampling the Ising measure. Intensive study throughout the last three decades has yielded a rigorous understanding of the spectral-gap of the dynamics on… ▽ More The Ising model is widely regarded as the most studied model of spin-systems in statistical physics. The focus of this paper is its dynamic (stochastic) version, the Glauber dynamics, introduced in 1963 and by now the most popular means of sampling the Ising measure. Intensive study throughout the last three decades has yielded a rigorous understanding of the spectral-gap of the dynamics on $\Z^2$ everywhere except at criticality. While the critical behavior of the Ising model has long been the focus for physicists, mathematicians have only recently developed an understanding of its critical geometry with the advent of SLE, CLE and new tools to study conformally invariant systems. A rich interplay exists between the static and dynamic models. At the static phase-transition for Ising, the dynamics is conjectured to undergo a critical slowdown: At high temperature the inverse-gap is O(1), at the critical $β_c$ it is polynomial in the side-length and at low temperature it is exponential in it. A seminal series of papers verified this on $\Z^2$ except at $β=β_c$ where the behavior remained a challenging open problem. Here we establish the first rigorous polynomial upper bound for the critical mixing, thus confirming the critical slowdown for the Ising model in $\Z^2$. Namely, we show that on a finite box with arbitrary (e.g. fixed, free, periodic) boundary conditions, the inverse-gap at $β=β_c$ is polynomial in the side-length. The proof harnesses recent understanding of the scaling limit of critical Fortuin-Kasteleyn representation of the Ising model together with classical tools from the analysis of Markov chains. △ Less

Submitted 6 August, 2010; v1 submitted 11 January, 2010; originally announced January 2010.

Comments: 26 pages; 5 figures

MSC Class: 60K35; 82B20; 82B27; 82C20

The weak limit of Ising models on locally tree-like graphs

Authors: Andrea Montanari, Elchanan Mossel, Allan Sly

Abstract: We consider the Ising model with inverse temperature beta and without external field on sequences of graphs G_n which converge locally to the k-regular tree. We show that for such graphs the Ising measure locally weak converges to the symmetric mixture of the Ising model with + boundary conditions and the - boundary conditions on the k-regular tree with inverse temperature β. In the case where t… ▽ More We consider the Ising model with inverse temperature beta and without external field on sequences of graphs G_n which converge locally to the k-regular tree. We show that for such graphs the Ising measure locally weak converges to the symmetric mixture of the Ising model with + boundary conditions and the - boundary conditions on the k-regular tree with inverse temperature β. In the case where the graphs G_n are expanders we derive a more detailed understanding by showing convergence of the Ising measure condition on positive magnetization (sum of spins) to the + measure on the tree. △ Less

Submitted 3 December, 2009; originally announced December 2009.

Comments: 16 pages

Simple Random Walk on Long Range Percolation Clusters II: Scaling Limits

Authors: Nicholas Crawford, Allan Sly

Abstract: We study limit laws for simple random walks on supercritical long range percolation clusters on $\Z^d, d \geq 1$. For the long range percolation model, the probability that two vertices $x, y$ are connected behaves asymptotically as $\|x-y\|_2^{-s}$. When $s\in(d, d+1)$, we prove that the scaling limit of simple random walk on the infinite component converges to an $α$-stable Lévy process with… ▽ More We study limit laws for simple random walks on supercritical long range percolation clusters on $\Z^d, d \geq 1$. For the long range percolation model, the probability that two vertices $x, y$ are connected behaves asymptotically as $\|x-y\|_2^{-s}$. When $s\in(d, d+1)$, we prove that the scaling limit of simple random walk on the infinite component converges to an $α$-stable Lévy process with $α= s-d$ establishing a conjecture of Berger and Biskup. The convergence holds in both the quenched and annealed senses. In the case where $d=1$ and $s>2$ we show that the simple random walk converges to a Brownian motion. The proof combines heat kernel bounds from our companion paper, ergodic theory estimates and an involved coupling constructed through the exploration of a large number of walks on the cluster. △ Less

Submitted 28 January, 2010; v1 submitted 30 November, 2009; originally announced November 2009.

Comments: 47 pages. Minor Revision

MSC Class: 60F17;82B41;82B43

Cutoff for the Ising model on the lattice

Authors: Eyal Lubetzky, Allan Sly

Abstract: Introduced in 1963, Glauber dynamics is one of the most practiced and extensively studied methods for sampling the Ising model on lattices. It is well known that at high temperatures, the time it takes this chain to mix in $L^1$ on a system of size $n$ is $O(\log n)$. Whether in this regime there is cutoff, i.e. a sharp transition in the $L^1$-convergence to equilibrium, is a fundamental open pr… ▽ More Introduced in 1963, Glauber dynamics is one of the most practiced and extensively studied methods for sampling the Ising model on lattices. It is well known that at high temperatures, the time it takes this chain to mix in $L^1$ on a system of size $n$ is $O(\log n)$. Whether in this regime there is cutoff, i.e. a sharp transition in the $L^1$-convergence to equilibrium, is a fundamental open problem: If so, as conjectured by Peres, it would imply that mixing occurs abruptly at $(c+o(1))\log n$ for some fixed $c>0$, thus providing a rigorous stopping rule for this MCMC sampler. However, obtaining the precise asymptotics of the mixing and proving cutoff can be extremely challenging even for fairly simple Markov chains. Already for the one-dimensional Ising model, showing cutoff is a longstanding open problem. We settle the above by establishing cutoff and its location at the high temperature regime of the Ising model on the lattice with periodic boundary conditions. Our results hold for any dimension and at any temperature where there is strong spatial mixing: For $\Z^2$ this carries all the way to the critical temperature. Specifically, for fixed $d\geq 1$, the continuous-time Glauber dynamics for the Ising model on $(\Z/n\Z)^d$ with periodic boundary conditions has cutoff at $(d/2λ_\infty)\log n$, where $λ_\infty$ is the spectral gap of the dynamics on the infinite-volume lattice. To our knowledge, this is the first time where cutoff is shown for a Markov chain where even understanding its stationary distribution is limited. The proof hinges on a new technique for translating $L^1$ to $L^2$ mixing which enables the application of log-Sobolev inequalities. The technique is general and carries to other monotone and anti-monotone spin-systems. △ Less

Submitted 23 September, 2009; originally announced September 2009.

Comments: 34 pages, 3 figures

MSC Class: 60J27; 82C20; 60K35; 60B10

Journal ref: Inventiones Mathematicae 191 (2013), no. 3, 719-755

Heat Kernel Upper Bounds on Long Range Percolation Clusters

Authors: Nicholas Crawford, Allan Sly

Abstract: In this paper, we derive upper bounds for the heat kernel of the simple random walk on the infinite cluster of a supercritical long range percolation process. For any $d \geq 1$ and for any exponent $s \in (d, (d+2) \wedge 2d)$ giving the rate of decay of the percolation process, we show that the return probability decays like $t^{-\ffrac{d}{s-d}}$ up to logarithmic corrections, where $t$ denote… ▽ More In this paper, we derive upper bounds for the heat kernel of the simple random walk on the infinite cluster of a supercritical long range percolation process. For any $d \geq 1$ and for any exponent $s \in (d, (d+2) \wedge 2d)$ giving the rate of decay of the percolation process, we show that the return probability decays like $t^{-\ffrac{d}{s-d}}$ up to logarithmic corrections, where $t$ denotes the time the walk is run. Moreover, our methods also yield generalized bounds on the spectral gap of the dynamics and on the diameter of the largest component in a box. Besides its intrinsic interest, the main result is needed for a companion paper studying the scaling limit of simple random walk on the infinite cluster. △ Less

Submitted 30 November, 2009; v1 submitted 14 July, 2009; originally announced July 2009.

Comments: 29 pages, Added References, Expanded Theorem 2

Exact thresholds for Ising-Gibbs samplers on general graphs

Authors: Elchanan Mossel, Allan Sly

Abstract: We establish tight results for rapid mixing of Gibbs samplers for the Ferromagnetic Ising model on general graphs. We show that if \[(d-1)\tanhβ<1,\] then there exists a constant C such that the discrete time mixing time of Gibbs samplers for the ferromagnetic Ising model on any graph of n vertices and maximal degree d, where all interactions are bounded by $β$, and arbitrary external fields are b… ▽ More We establish tight results for rapid mixing of Gibbs samplers for the Ferromagnetic Ising model on general graphs. We show that if \[(d-1)\tanhβ<1,\] then there exists a constant C such that the discrete time mixing time of Gibbs samplers for the ferromagnetic Ising model on any graph of n vertices and maximal degree d, where all interactions are bounded by $β$, and arbitrary external fields are bounded by $Cn\log n$. Moreover, the spectral gap is uniformly bounded away from 0 for all such graphs, as well as for infinite graphs of maximal degree d. We further show that when $d\tanhβ<1$, with high probability over the Erdos-Renyi random graph $G(n,d/n)$, it holds that the mixing time of Gibbs samplers is \[n^{1+Θ({1}/{\log\log n})}.\] Both results are tight, as it is known that the mixing time for random regular and Erdos-Renyi random graphs is, with high probability, exponential in n when $(d-1)\tanhβ>1$, and $d\tanhβ>1$, respectively. To our knowledge our results give the first tight sufficient conditions for rapid mixing of spin systems on general graphs. Moreover, our results are the first rigorous results establishing exact thresholds for dynamics on random graphs in terms of spatial thresholds on trees. △ Less

Submitted 5 February, 2013; v1 submitted 17 March, 2009; originally announced March 2009.

Comments: Published in at http://dx.doi.org/10.1214/11-AOP737 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP737

Journal ref: Annals of Probability 2013, Vol. 41, No. 1, 294-328

Mixing time of exponential random graphs

Authors: Shankar Bhamidi, Guy Bresler, Allan Sly

Abstract: Exponential random graphs are used extensively in the sociology literature. This model seeks to incorporate in random graphs the notion of reciprocity, that is, the larger than expected number of triangles and other small subgraphs. Sampling from these distributions is crucial for parameter estimation hypothesis testing, and more generally for understanding basic features of the network model it… ▽ More Exponential random graphs are used extensively in the sociology literature. This model seeks to incorporate in random graphs the notion of reciprocity, that is, the larger than expected number of triangles and other small subgraphs. Sampling from these distributions is crucial for parameter estimation hypothesis testing, and more generally for understanding basic features of the network model itself. In practice sampling is typically carried out using Markov chain Monte Carlo, in particular either the Glauber dynamics or the Metropolis-Hasting procedure. In this paper we characterize the high and low temperature regimes of the exponential random graph model. We establish that in the high temperature regime the mixing time of the Glauber dynamics is $Θ(n^2 \log n)$, where $n$ is the number of vertices in the graph; in contrast, we show that in the low temperature regime the mixing is exponentially slow for any local Markov chain. Our results, moreover, give a rigorous basis for criticisms made of such models. In the high temperature regime, where sampling with MCMC is possible, we show that any finite collection of edges are asymptotically independent; thus, the model does not possess the desired reciprocity property, and is not appreciably different from the Erdős-Rényi random graph. △ Less

Submitted 11 December, 2008; originally announced December 2008.

Comments: 20 pages

MSC Class: 60C05; 05C80; 90B15

Cutoff phenomena for random walks on random regular graphs

Authors: Eyal Lubetzky, Allan Sly

Abstract: The cutoff phenomenon describes a sharp transition in the convergence of a family of ergodic finite Markov chains to equilibrium. Many natural families of chains are believed to exhibit cutoff, and yet establishing this fact is often extremely challenging. An important such family of chains is the random walk on $\G(n,d)$, a random $d$-regular graph on $n$ vertices. It is well known that almost… ▽ More The cutoff phenomenon describes a sharp transition in the convergence of a family of ergodic finite Markov chains to equilibrium. Many natural families of chains are believed to exhibit cutoff, and yet establishing this fact is often extremely challenging. An important such family of chains is the random walk on $\G(n,d)$, a random $d$-regular graph on $n$ vertices. It is well known that almost every such graph for $d\geq 3$ is an expander, and even essentially Ramanujan, implying a mixing-time of $O(\log n)$. According to a conjecture of Peres, the simple random walk on $\G(n,d)$ for such $d$ should then exhibit cutoff with high probability. As a special case of this, Durrett conjectured that the mixing time of the lazy random walk on a random 3-regular graph is w.h.p. $(6+o(1))\log_2 n$. In this work we confirm the above conjectures, and establish cutoff in total-variation, its location and its optimal window, both for simple and for non-backtracking random walks on $\G(n,d)$. Namely, for any fixed $d\geq3$, the simple random walk on $\G(n,d)$ w.h.p. has cutoff at $\frac{d}{d-2}\log_{d-1} n$ with window order $\sqrt{\log n}$. Surprisingly, the non-backtracking random walk on $\G(n,d)$ w.h.p. has cutoff already at $\log_{d-1} n$ with constant window order. We further extend these results to $\G(n,d)$ for any $d=n^{o(1)}$ that grows with $n$ (beyond which the mixing time is O(1)), where we establish concentration of the mixing time on one of two consecutive integers. △ Less

Submitted 5 November, 2009; v1 submitted 29 November, 2008; originally announced December 2008.

Comments: 33 pages, 4 figures

MSC Class: 60B10; 60J10; 60G50; 05C80

Journal ref: Duke Math. J. 153, no. 3 (2010), 475-510

Reconstruction of symmetric Potts Models

Authors: Allan Sly

Abstract: The reconstruction problem on the tree has been studied in numerous contexts including statistical physics, information theory and computational biology. However, rigorous reconstruction thresholds have only been established in a small number of models. We prove the first exact reconstruction threshold in a non-binary model establishing the Kesten-Stigum bound for the 3-state Potts model on regu… ▽ More The reconstruction problem on the tree has been studied in numerous contexts including statistical physics, information theory and computational biology. However, rigorous reconstruction thresholds have only been established in a small number of models. We prove the first exact reconstruction threshold in a non-binary model establishing the Kesten-Stigum bound for the 3-state Potts model on regular trees of large degree. We further establish that the Kesten-Stigum bound is not tight for the $q$-state Potts model when $q \geq 5$. Moreover, we determine asymptotics for the reconstruction thresholds. △ Less

Submitted 7 November, 2008; originally announced November 2008.