-
Shattering in the Ising Pure $p$-Spin Model
Authors:
David Gamarnik,
Aukosh Jagannath,
Eren C. Kızıldağ
Abstract:
We study the Ising pure $p$-spin model for large $p$. We investigate the landscape of the Hamiltonian of this model. We show that for any $γ>0$ and any large enough $p$, the model exhibits an intricate geometrical property known as the multi Overlap Gap Property above the energy value $γ\sqrt{2\ln 2}$. We then show that for any inverse temperature $\sqrt{\ln 2}<β<\sqrt{2\ln 2}$ and any large $p$,…
▽ More
We study the Ising pure $p$-spin model for large $p$. We investigate the landscape of the Hamiltonian of this model. We show that for any $γ>0$ and any large enough $p$, the model exhibits an intricate geometrical property known as the multi Overlap Gap Property above the energy value $γ\sqrt{2\ln 2}$. We then show that for any inverse temperature $\sqrt{\ln 2}<β<\sqrt{2\ln 2}$ and any large $p$, the model exhibits shattering: w.h.p. as $n\to\infty$, there exists exponentially many well-separated clusters such that (a) each cluster has exponentially small Gibbs mass, and (b) the clusters collectively contain all but a vanishing fraction of Gibbs mass. Moreover, these clusters consist of configurations with energy near $β$. Range of temperatures for which shattering occurs is within the replica symmetric region. To the best of our knowledge, this is the first shattering result regarding the Ising $p$-spin models. Our proof is elementary, and in particular based on simple applications of the first and the second moment methods.
△ Less
Submitted 14 July, 2023;
originally announced July 2023.
-
Existence of the free energy for heavy-tailed spin glasses
Authors:
Aukosh Jagannath,
Patrick Lopatto
Abstract:
We study the free energy of a mean-field spin glass whose coupling distribution has power law tails. Under the assumption that the couplings have infinite variance and finite mean, we show that the thermodynamic limit of the quenched free energy exists, and that the free energy is self-averaging.
We study the free energy of a mean-field spin glass whose coupling distribution has power law tails. Under the assumption that the couplings have infinite variance and finite mean, we show that the thermodynamic limit of the quenched free energy exists, and that the free energy is self-averaging.
△ Less
Submitted 4 December, 2022; v1 submitted 17 November, 2022;
originally announced November 2022.
-
A simple construction of the dynamical $Φ^4_3$ model
Authors:
Aukosh Jagannath,
Nicolas Perkowski
Abstract:
The $Φ^4_3$ equation is a singular stochastic PDE with important applications in mathematical physics. Its solution usually requires advanced mathematical theories like regularity structures or paracontrolled distributions, and even local well-posedness is highly nontrivial. Here we propose a multiplicative transformation to reduce the periodic $Φ^4_3$ equation to a well-posed random PDE. This lea…
▽ More
The $Φ^4_3$ equation is a singular stochastic PDE with important applications in mathematical physics. Its solution usually requires advanced mathematical theories like regularity structures or paracontrolled distributions, and even local well-posedness is highly nontrivial. Here we propose a multiplicative transformation to reduce the periodic $Φ^4_3$ equation to a well-posed random PDE. This leads to a simple and elementary proof of global well-posedness, which only relies on Schauder estimates, the maximum principle, and basic estimates for paraproducts, and in particular does not need regularity structures or paracontrolled distributions.
△ Less
Submitted 30 August, 2021;
originally announced August 2021.
-
Shattering Versus Metastability in Spin Glasses
Authors:
Gérard Ben Arous,
Aukosh Jagannath
Abstract:
Our goal in this work is to better understand the relationship between replica symmetry breaking, shattering, and metastability. To this end, we study the static and dynamic behaviour of spherical pure $p$-spin glasses above the replica symmetry breaking temperature $T_{s}$. In this regime, we find that there are at least two distinct temperatures related to non-trivial behaviour. First we prove t…
▽ More
Our goal in this work is to better understand the relationship between replica symmetry breaking, shattering, and metastability. To this end, we study the static and dynamic behaviour of spherical pure $p$-spin glasses above the replica symmetry breaking temperature $T_{s}$. In this regime, we find that there are at least two distinct temperatures related to non-trivial behaviour. First we prove that there is a regime of temperatures in which the spherical $p$-spin model exhibits a shattering phase. Our results holds in a regime above but near $T_s$. We then find that metastable states exist up to an even higher temperature $T_{BBM}$ as predicted by Barrat--Burioni--Mézard which is expected to be higher than the phase boundary for the shattering phase $T_d <T_{BBM}$. We develop this work by first developing a Thouless--Anderson--Palmer decomposition which builds on the work of Subag. We then present a series of questions and conjectures regarding the sharp phase boundaries for shattering and slow mixing.
△ Less
Submitted 16 April, 2021;
originally announced April 2021.
-
Hardness of Random Optimization Problems for Boolean Circuits, Low-Degree Polynomials, and Langevin Dynamics
Authors:
David Gamarnik,
Aukosh Jagannath,
Alexander S. Wein
Abstract:
We consider the problem of finding nearly optimal solutions of optimization problems with random objective functions. Two concrete problems we consider are (a) optimizing the Hamiltonian of a spherical or Ising $p$-spin glass model, and (b) finding a large independent set in a sparse Erdős-Rényi graph. The following families of algorithms are considered: (a) low-degree polynomials of the input; (b…
▽ More
We consider the problem of finding nearly optimal solutions of optimization problems with random objective functions. Two concrete problems we consider are (a) optimizing the Hamiltonian of a spherical or Ising $p$-spin glass model, and (b) finding a large independent set in a sparse Erdős-Rényi graph. The following families of algorithms are considered: (a) low-degree polynomials of the input; (b) low-depth Boolean circuits; (c) the Langevin dynamics algorithm. We show that these families of algorithms fail to produce nearly optimal solutions with high probability. For the case of Boolean circuits, our results improve the state-of-the-art bounds known in circuit complexity theory (although we consider the search problem as opposed to the decision problem).
Our proof uses the fact that these models are known to exhibit a variant of the overlap gap property (OGP) of near-optimal solutions. Specifically, for both models, every two solutions whose objectives are above a certain threshold are either close or far from each other. The crux of our proof is that the classes of algorithms we consider exhibit a form of stability. We show by an interpolation argument that stable algorithms cannot overcome the OGP barrier.
The stability of Langevin dynamics is an immediate consequence of the well-posedness of stochastic differential equations. The stability of low-degree polynomials and Boolean circuits is established using tools from Gaussian and Boolean analysis -- namely hypercontractivity and total influence, as well as a novel lower bound for random walks avoiding certain subsets. In the case of Boolean circuits, the result also makes use of Linal-Mansour-Nisan's classical theorem. Our techniques apply more broadly to low influence functions and may apply more generally.
△ Less
Submitted 26 January, 2022; v1 submitted 25 April, 2020;
originally announced April 2020.
-
The Overlap Gap Property and Approximate Message Passing Algorithms for $p$-spin models
Authors:
David Gamarnik,
Aukosh Jagannath
Abstract:
We consider the algorithmic problem of finding a near ground state (near optimal solution) of a $p$-spin model. We show that for a class of algorithms broadly defined as Approximate Message Passing (AMP), the presence of the Overlap Gap Property (OGP), appropriately defined, is a barrier. We conjecture that when $p\ge 4$ the model does indeed exhibits OGP (and prove it for the space of binary solu…
▽ More
We consider the algorithmic problem of finding a near ground state (near optimal solution) of a $p$-spin model. We show that for a class of algorithms broadly defined as Approximate Message Passing (AMP), the presence of the Overlap Gap Property (OGP), appropriately defined, is a barrier. We conjecture that when $p\ge 4$ the model does indeed exhibits OGP (and prove it for the space of binary solutions). Assuming the validity of this conjecture, as an implication, the AMP fails to find near ground states in these models, per our result. We extend our result to the problem of finding pure states by means of Thouless, Anderson and Palmer (TAP) based iterations, which is yet another example of AMP type algorithms. We show that such iterations fail to find pure states approximately, subject to the conjecture that the space of pure states exhibits the OGP, appropriately stated, when $p\ge 4$.
△ Less
Submitted 25 November, 2019; v1 submitted 15 November, 2019;
originally announced November 2019.
-
Bounding flows for spherical spin glass dynamics
Authors:
Gerard Ben Arous,
Reza Gheissari,
Aukosh Jagannath
Abstract:
We introduce a new approach to studying spherical spin glass dynamics based on differential inequalities for one-time observables. Using this approach, we obtain an approximate phase diagram for the evolution of the energy $H$ and its gradient under Langevin dynamics for spherical $p$-spin models. We then derive several consequences of this phase diagram. For example, at any temperature, uniformly…
▽ More
We introduce a new approach to studying spherical spin glass dynamics based on differential inequalities for one-time observables. Using this approach, we obtain an approximate phase diagram for the evolution of the energy $H$ and its gradient under Langevin dynamics for spherical $p$-spin models. We then derive several consequences of this phase diagram. For example, at any temperature, uniformly over all starting points, the process must reach and remain in an absorbing region of large negative values of $H$ and large (in norm) gradients in order 1 time. Furthermore, if the process starts in a neighborhood of a critical point of $H$ with negative energy, then both the gradient and energy must increase macroscopically under this evolution, even if this critical point is a saddle with index of order $N$. As a key technical tool, we estimate Sobolev norms of spin glass Hamiltonians, which are of independent interest.
△ Less
Submitted 24 October, 2019; v1 submitted 2 August, 2018;
originally announced August 2018.
-
On spin distributions for generic p-spin models
Authors:
Antonio Auffinger,
Aukosh Jagannath
Abstract:
We provide an alternative formula for spin distributions of generic p-spin glass models. As a main application of this expression, we write spin statistics as solutions of partial differential equations and we show that the generic p-spin models satisfy multiscale Thouless-Anderson-Palmer equations as originally predicted in the work of Mezard-Virasoro.
We provide an alternative formula for spin distributions of generic p-spin glass models. As a main application of this expression, we write spin statistics as solutions of partial differential equations and we show that the generic p-spin models satisfy multiscale Thouless-Anderson-Palmer equations as originally predicted in the work of Mezard-Virasoro.
△ Less
Submitted 22 February, 2018; v1 submitted 20 February, 2018;
originally announced February 2018.
-
Spectral gap estimates in mean field spin glasses
Authors:
Gérard Ben Arous,
Aukosh Jagannath
Abstract:
We show that mixing for local, reversible dynamics of mean field spin glasses is exponentially slow in the low temperature regime. We introduce a notion of free energy barriers for the overlap, and prove that their existence imply that the spectral gap is exponentially small, and thus that mixing is exponentially slow. We then exhibit sufficient conditions on the equilibrium Gibbs measure which gu…
▽ More
We show that mixing for local, reversible dynamics of mean field spin glasses is exponentially slow in the low temperature regime. We introduce a notion of free energy barriers for the overlap, and prove that their existence imply that the spectral gap is exponentially small, and thus that mixing is exponentially slow. We then exhibit sufficient conditions on the equilibrium Gibbs measure which guarantee the existence of these barriers, using the notion of replicon eigenvalue and 2D Guerra Talagrand bounds. We show how these sufficient conditions cover large classes of Ising spin models for reversible nearest-neighbor dynamics and spherical models for Langevin dynamics. Finally, in the case of Ising spins, Panchenko's recent rigorous calculation [79] of the free energy for a system of "two real replica" enables us to prove a quenched LDP for the overlap distribution, which gives us a wider criterion for slow mixing directly related to the Franz-Parisi-Virasoro approach [43,60]. This condition holds in a wider range of temperatures.
△ Less
Submitted 2 March, 2018; v1 submitted 11 May, 2017;
originally announced May 2017.
-
Random matrices and the New York City subway system
Authors:
Aukosh Jagannath,
Thomas Trogdon
Abstract:
We analyze subway arrival times in the New York City subway system. We find regimes where the gaps between trains exhibit both (unitarily invariant) random matrix statistics and Poisson statistics. The departure from random matrix statistics is captured by the value of the Coulomb potential along the subway route. This departure becomes more pronounced as trains make more stops.
We analyze subway arrival times in the New York City subway system. We find regimes where the gaps between trains exhibit both (unitarily invariant) random matrix statistics and Poisson statistics. The departure from random matrix statistics is captured by the value of the Coulomb potential along the subway route. This departure becomes more pronounced as trains make more stops.
△ Less
Submitted 7 March, 2017;
originally announced March 2017.
-
Thouless-Anderson-Palmer equations for the generic p-spin glass model
Authors:
Antonio Auffinger,
Aukosh Jagannath
Abstract:
We study the Thouless-Anderson-Palmer (TAP) equations for spin glasses on the hypercube. First, using a random, approximately ultrametric decomposition of the hypercube, we decompose the Gibbs measure, $\langle\cdot\rangle_N$, into a mixture of conditional laws, $\langle\cdot\rangle_{α,N}$. We show that the TAP equations hold for the spin at any site with respect to $\langle\cdot\rangle_{α,N}$ sim…
▽ More
We study the Thouless-Anderson-Palmer (TAP) equations for spin glasses on the hypercube. First, using a random, approximately ultrametric decomposition of the hypercube, we decompose the Gibbs measure, $\langle\cdot\rangle_N$, into a mixture of conditional laws, $\langle\cdot\rangle_{α,N}$. We show that the TAP equations hold for the spin at any site with respect to $\langle\cdot\rangle_{α,N}$ simultaneously for all $α$. This result holds for generic models provided that the Parisi measure of the model has a jump at the top of its support.
△ Less
Submitted 21 February, 2018; v1 submitted 19 December, 2016;
originally announced December 2016.
-
On the Spectral Gap of Spherical Spin Glass Dynamics
Authors:
Reza Gheissari,
Aukosh Jagannath
Abstract:
We consider the time to equilibrium for the Langevin dynamics of the spherical $p$-spin glass model of system size $N$. We show that the log-Sobolev constant and spectral gap are order $1$ in $N$ at sufficiently high temperature whereas the spectral gap decays exponentially in $N$ at sufficiently low temperatures. These verify the existence of a dynamical high temperature phase and a dynamical gla…
▽ More
We consider the time to equilibrium for the Langevin dynamics of the spherical $p$-spin glass model of system size $N$. We show that the log-Sobolev constant and spectral gap are order $1$ in $N$ at sufficiently high temperature whereas the spectral gap decays exponentially in $N$ at sufficiently low temperatures. These verify the existence of a dynamical high temperature phase and a dynamical glass phase at the level of the spectral gap. Key to these results are the understanding of the extremal process and restricted free energy of Subag--Zeitouni and Subag.
△ Less
Submitted 4 June, 2018; v1 submitted 23 August, 2016;
originally announced August 2016.
-
Bounding the Complexity of Replica Symmetry Breaking for Spherical Spin Glasses
Authors:
Aukosh Jagannath,
Ian Tobasco
Abstract:
In this paper, we study the Crisanti-Sommers variational problem, which is a variational formula for the free energy of spherical mixed $p$-spin glasses. We begin by computing the dual of this problem using a min-max argument. We find that the dual is a 1-D problem of obstacle type, where the obstacle is related to the covariance structure of the underlying process. This approach yields an alterna…
▽ More
In this paper, we study the Crisanti-Sommers variational problem, which is a variational formula for the free energy of spherical mixed $p$-spin glasses. We begin by computing the dual of this problem using a min-max argument. We find that the dual is a 1-D problem of obstacle type, where the obstacle is related to the covariance structure of the underlying process. This approach yields an alternative way to understand Replica Symmetry Breaking at the level of the variational problem through topological properties of the coincidence set of the optimal dual variable. Using this duality, we give an algorithm to reduce this a priori infinite dimensional variational problem to a finite dimensional one, thereby confining all possible forms of Replica Symmetry Breaking in these models to a finite parameter family. These results complement the authors' related results for the low temperature $Γ$-limit of this variational problem. We briefly discuss the analysis of the Replica Symmetric phase using this approach.
△ Less
Submitted 7 July, 2016;
originally announced July 2016.
-
Low Temperature Asymptotics in Spherical Mean Field Spin Glasses
Authors:
Aukosh Jagannath,
Ian Tobasco
Abstract:
In this paper, we study the low temperature limit of the spherical Crisanti-Sommers variational problem. We identify the $Γ$-limit of the Crisanti-Sommers functionals, thereby establishing a rigorous variational problem for the ground state energy of spherical mixed $p$-spin glasses. As an application, we compute moderate deviations of the corresponding minimizers in the low temperature limit. In…
▽ More
In this paper, we study the low temperature limit of the spherical Crisanti-Sommers variational problem. We identify the $Γ$-limit of the Crisanti-Sommers functionals, thereby establishing a rigorous variational problem for the ground state energy of spherical mixed $p$-spin glasses. As an application, we compute moderate deviations of the corresponding minimizers in the low temperature limit. In particular, for a large class of models this yields moderate deviations for the overlap distribution. We then analyze the ground state energy problem. We show that this variational problem is dual to an obstacle-type problem. This duality is at the heart of our analysis. We present the regularity theory of the optimizers of the primal and dual problems. This culminates in a simple method for constructing a finite dimensional space in which these optimizers live for any model. As a consequence of these results, we unify independent predictions of Crisanti-Leuzzi and Auffinger-Ben Arous regarding the 1RSB phase in this limit. We find that the "positive replicon eigenvalue" and "pure-like" conditions are together necessary for optimality, but that neither are themselves sufficient, answering a question of Auffinger and Ben Arous in the negative. We end by proving that these conditions completely characterize the 1RSB phase in $2+p$-spin models.
△ Less
Submitted 1 February, 2016;
originally announced February 2016.
-
Some Properties of the Phase Diagram for Mixed $p$-Spin Glasses
Authors:
Aukosh Jagannath,
Ian Tobasco
Abstract:
In this paper we study the Parisi variational problem for mixed $p$-spin glasses with Ising spins. Our starting point is a characterization of Parisi measures whose origin lies in the first order optimality conditions for the Parisi functional, which is known to be strictly convex. Using this characterization, we study the phase diagram in the temperature-external field plane. We begin by deriving…
▽ More
In this paper we study the Parisi variational problem for mixed $p$-spin glasses with Ising spins. Our starting point is a characterization of Parisi measures whose origin lies in the first order optimality conditions for the Parisi functional, which is known to be strictly convex. Using this characterization, we study the phase diagram in the temperature-external field plane. We begin by deriving self-consistency conditions for Parisi measures that generalize those of de Almeida and Thouless to all levels of Replica Symmetry Breaking (RSB) and all models. As a consequence, we conjecture that for all models the Replica Symmetric (RS) phase is the region determined by the natural analogue of the de Almeida-Thouless condition. We show that for all models, the complement of this region is in the RSB phase. Furthermore, we show that the conjectured phase boundary is exactly the phase boundary in the plane less a bounded set. In the case of the Sherrington-Kirkpatrick model, we extend this last result to show that this bounded set does not contain the critical point at zero external field.
△ Less
Submitted 22 December, 2015; v1 submitted 10 April, 2015;
originally announced April 2015.
-
A Dynamic Programming Approach to the Parisi Functional
Authors:
Aukosh Jagannath,
Ian Tobasco
Abstract:
G.Parisi predicted an important variational formula for the thermodynamic limit of the intensive free energy for a class of mean field spin glasses. In this paper, we present an elementary approach to the study of the Parisi functional using stochastic dynamic programing and semi-linear PDE. We give a derivation of important properties of the Parisi PDE avoiding the use of Ruelle Probability Casca…
▽ More
G.Parisi predicted an important variational formula for the thermodynamic limit of the intensive free energy for a class of mean field spin glasses. In this paper, we present an elementary approach to the study of the Parisi functional using stochastic dynamic programing and semi-linear PDE. We give a derivation of important properties of the Parisi PDE avoiding the use of Ruelle Probability Cascades and Cole-Hopf transformations. As an application, we give a simple proof of the strict convexity of the Parisi functional, which was recently proved by Auffinger and Chen in [2].
△ Less
Submitted 30 November, 2015; v1 submitted 15 February, 2015;
originally announced February 2015.
