-
On the Discontinuous Breaking of Replica Symmetry and Shattering in Mean-Field Spin Glasses
Authors:
Antonio Auffinger,
Ahmed El Alaoui,
Mark Sellke
Abstract:
We show that in mean-field spin glasses, a discontinuous breaking of replica symmetry at the critical inverse temperature $β_c$ implies the existence of an intermediate shattered phase. This confirms a prediction from physics regarding the nature of random first order phase transitions. On the other hand, we give an example of a spherical spin glass which exhibits shattering, yet the transition is…
▽ More
We show that in mean-field spin glasses, a discontinuous breaking of replica symmetry at the critical inverse temperature $β_c$ implies the existence of an intermediate shattered phase. This confirms a prediction from physics regarding the nature of random first order phase transitions. On the other hand, we give an example of a spherical spin glass which exhibits shattering, yet the transition is continuous at $β_c$.
△ Less
Submitted 2 June, 2025;
originally announced June 2025.
-
Near-optimal shattering in the Ising pure p-spin and rarity of solutions returned by stable algorithms
Authors:
Ahmed El Alaoui
Abstract:
We show that in the Ising pure $p$-spin model of spin glasses, shattering takes place at all inverse temperatures $β\in (\sqrt{(2 \log p)/p}, \sqrt{2\log 2})$ when $p$ is sufficiently large as a function of $β$. Of special interest is the lower boundary of this interval which matches the large $p$ asymptotics of the inverse temperature marking the hypothetical dynamical transition predicted in sta…
▽ More
We show that in the Ising pure $p$-spin model of spin glasses, shattering takes place at all inverse temperatures $β\in (\sqrt{(2 \log p)/p}, \sqrt{2\log 2})$ when $p$ is sufficiently large as a function of $β$. Of special interest is the lower boundary of this interval which matches the large $p$ asymptotics of the inverse temperature marking the hypothetical dynamical transition predicted in statistical physics. We show this as a consequence of a `soft' version of the overlap gap property which asserts the existence of a distance gap of points of typical energy from a typical sample from the Gibbs measure. We further show that this latter property implies that stable algorithms seeking to return a point of at least typical energy are confined to an exponentially rare subset of that super-level set, provided that their success probability is not vanishingly small.
△ Less
Submitted 13 January, 2025; v1 submitted 4 December, 2024;
originally announced December 2024.
-
Fast relaxation of the random field Ising dynamics
Authors:
Ahmed El Alaoui,
Ronen Eldan,
Reza Gheissari,
Arianna Piana
Abstract:
We study the convergence properties of Glauber dynamics for the random field Ising model (RFIM) with ferromagnetic interactions on finite domains of $\mathbb{Z}^d$, $d \ge 2$. Of particular interest is the Griffiths phase where correlations decay exponentially fast in expectation over the quenched disorder, but there exist arbitrarily large islands of weak fields where low-temperature behavior is…
▽ More
We study the convergence properties of Glauber dynamics for the random field Ising model (RFIM) with ferromagnetic interactions on finite domains of $\mathbb{Z}^d$, $d \ge 2$. Of particular interest is the Griffiths phase where correlations decay exponentially fast in expectation over the quenched disorder, but there exist arbitrarily large islands of weak fields where low-temperature behavior is observed. Our results are twofold:
1. Under weak spatial mixing (boundary-to-bulk exponential decay of correlations) in expectation, we show that the dynamics satisfy a weak Poincaré inequality implying algebraic relaxation to equilibrium over timescales polynomial in the volume $N$ of the domain, and polynomial time mixing from a warm start. From this we construct a polynomial-time approximate sampling algorithm based on running Glauber dynamics over an increasing sequence of approximations of the domain.
2. Under strong spatial mixing (exponential decay of correlations even near boundary pinnings) in expectation, we prove a full Poincaré inequality, implying exponential relaxation to equilibrium and $N^{o(1)}$-mixing time. Note by way of example, both weak and strong spatial mixing hold at any temperature, provided the external fields are strong enough.
Our proofs combine a stochastic localization technique which has the effect of increasing the variance of the field, with a field-dependent coarse graining which controls the resulting sub-critical percolation process of sites with weak fields.
△ Less
Submitted 12 November, 2024; v1 submitted 10 November, 2023;
originally announced November 2023.
-
Shattering in Pure Spherical Spin Glasses
Authors:
Ahmed El Alaoui,
Andrea Montanari,
Mark Sellke
Abstract:
We prove the existence of a shattered phase within the replica-symmetric phase of the pure spherical $p$-spin models for $p$ sufficiently large.
In this phase, we construct a decomposition of the sphere into well-separated small clusters, each of which has exponentially small Gibbs mass, yet which together carry all but an exponentially small fraction of the Gibbs mass.
We achieve this via qua…
▽ More
We prove the existence of a shattered phase within the replica-symmetric phase of the pure spherical $p$-spin models for $p$ sufficiently large.
In this phase, we construct a decomposition of the sphere into well-separated small clusters, each of which has exponentially small Gibbs mass, yet which together carry all but an exponentially small fraction of the Gibbs mass.
We achieve this via quantitative estimates on the derivative of the Franz--Parisi potential, which measures the Gibbs mass profile around a typical sample. Corollaries on dynamics are derived, in particular we show the two-times correlation function of stationary Langevin dynamics must have an exponentially long plateau. We further show that shattering implies disorder chaos for the Gibbs measure in the optimal transport sense; this is known to imply failure of sampling algorithms which are stable under perturbation in the same metric.
△ Less
Submitted 18 January, 2025; v1 submitted 10 July, 2023;
originally announced July 2023.
-
Bounds on the covariance matrix of the Sherrington-Kirkpatrick model
Authors:
Ahmed El Alaoui,
Jason Gaitonde
Abstract:
We consider the Sherrington-Kirkpatrick model with no external field and inverse temperature $β<1$ and prove that the expected operator norm of the covariance matrix of the Gibbs measure is bounded by a constant depending only on $β$. This answers an open question raised by Talagrand, who proved a bound of $C(β) (\log n)^8$. Our result follows by establishing an approximate formula for the covaria…
▽ More
We consider the Sherrington-Kirkpatrick model with no external field and inverse temperature $β<1$ and prove that the expected operator norm of the covariance matrix of the Gibbs measure is bounded by a constant depending only on $β$. This answers an open question raised by Talagrand, who proved a bound of $C(β) (\log n)^8$. Our result follows by establishing an approximate formula for the covariance matrix which we obtain by differentiating the TAP equations and then optimally controlling the associated error terms. We complement this result by showing diverging lower bounds on the operator norm, both at the critical and low temperatures.
△ Less
Submitted 12 November, 2024; v1 submitted 5 December, 2022;
originally announced December 2022.
-
Local algorithms for Maximum Cut and Minimum Bisection on locally treelike regular graphs of large degree
Authors:
Ahmed El Alaoui,
Andrea Montanari,
Mark Sellke
Abstract:
Given a graph $G$ of degree $k$ over $n$ vertices, we consider the problem of computing a near maximum cut or a near minimum bisection in polynomial time. For graphs of girth $2L$, we develop a local message passing algorithm whose complexity is $O(nkL)$, and that achieves near optimal cut values among all $L$-local algorithms. Focusing on max-cut, the algorithm constructs a cut of value…
▽ More
Given a graph $G$ of degree $k$ over $n$ vertices, we consider the problem of computing a near maximum cut or a near minimum bisection in polynomial time. For graphs of girth $2L$, we develop a local message passing algorithm whose complexity is $O(nkL)$, and that achieves near optimal cut values among all $L$-local algorithms. Focusing on max-cut, the algorithm constructs a cut of value $nk/4+ n\mathsf{P}_\star\sqrt{k/4}+\mathsf{err}(n,k,L)$, where $\mathsf{P}_\star\approx 0.763166$ is the value of the Parisi formula from spin glass theory, and $\mathsf{err}(n,k,L)=o_n(n)+no_k(\sqrt{k})+n \sqrt{k} o_L(1)$ (subscripts indicate the asymptotic variables). Our result generalizes to locally treelike graphs, i.e., graphs whose girth becomes $2L$ after removing a small fraction of vertices.
Earlier work established that, for random $k$-regular graphs, the typical max-cut value is $nk/4+ n\mathsf{P}_\star\sqrt{k/4}+o_n(n)+no_k(\sqrt{k})$. Therefore our algorithm is nearly optimal on such graphs. An immediate corollary of this result is that random regular graphs have nearly minimum max-cut, and nearly maximum min-bisection among all regular locally treelike graphs. This can be viewed as a combinatorial version of the near-Ramanujan property of random regular graphs.
△ Less
Submitted 3 February, 2023; v1 submitted 12 November, 2021;
originally announced November 2021.
-
Algorithmic pure states for the negative spherical perceptron
Authors:
Ahmed El Alaoui,
Mark Sellke
Abstract:
We consider the spherical perceptron with Gaussian disorder. This is the set $S$ of points $σ\in \mathbb{R}^N$ on the sphere of radius $\sqrt{N}$ satisfying $\langle g_a , σ\rangle \ge κ\sqrt{N}\,$ for all $1 \le a \le M$, where $(g_a)_{a=1}^M$ are independent standard gaussian vectors and $κ\in \mathbb{R}$ is fixed. Various characteristics of $S$ such as its surface measure and the largest $M$ fo…
▽ More
We consider the spherical perceptron with Gaussian disorder. This is the set $S$ of points $σ\in \mathbb{R}^N$ on the sphere of radius $\sqrt{N}$ satisfying $\langle g_a , σ\rangle \ge κ\sqrt{N}\,$ for all $1 \le a \le M$, where $(g_a)_{a=1}^M$ are independent standard gaussian vectors and $κ\in \mathbb{R}$ is fixed. Various characteristics of $S$ such as its surface measure and the largest $M$ for which it is non-empty, were computed heuristically in statistical physics in the asymptotic regime $N \to \infty$, $M/N \to α$. The case $κ<0$ is of special interest as $S$ is conjectured to exhibit a hierarchical tree-like geometry known as "full replica-symmetry breaking" (FRSB) close to the satisfiability threshold $α_{\text{SAT}}(κ)$, and whose characteristics are captured by a Parisi variational principle akin to the one appearing in the Sherrington-Kirkpatrick model. In this paper we design an efficient algorithm which, given oracle access to the solution of the Parisi variational principle, exploits this conjectured FRSB structure for $κ<0$ and outputs a vector $\hatσ$ satisfying $\langle g_a , \hatσ\rangle \ge κ\sqrt{N}$ for all $1\le a \le M$ and lying on a sphere of non-trivial radius $\sqrt{\bar{q} N}$, where $\bar{q} \in (0,1)$ is the right-end of the support of the associated Parisi measure. We expect $\hatσ$ to be approximately the barycenter of a pure state of the spherical perceptron. Moreover we expect that $\bar{q} \to 1$ as $α\to α_{\text{SAT}}(κ)$, so that $\big\langle g_a,\hatσ/|\hatσ|\big\rangle \geq (κ-o(1))\sqrt{N}$ near criticality.
△ Less
Submitted 29 October, 2020;
originally announced October 2020.
