-
Interacting Copies of Random Constraint Satisfaction Problems
Authors:
Maria Chiara Angelini,
Louise Budzynski,
Federico Ricci-Tersenghi
Abstract:
We study a system of $y=2$ coupled copies of a well-known constraint satisfaction problem (random hypergraph bicoloring) to examine how the ferromagnetic coupling between the copies affects the properties of the solution space. We solve the replicated model by applying the cavity method to the supervariables taking $2^y$ values. Our results show that a coupling of strength $γ$ between the copies d…
▽ More
We study a system of $y=2$ coupled copies of a well-known constraint satisfaction problem (random hypergraph bicoloring) to examine how the ferromagnetic coupling between the copies affects the properties of the solution space. We solve the replicated model by applying the cavity method to the supervariables taking $2^y$ values. Our results show that a coupling of strength $γ$ between the copies decreases the clustering threshold $α_d(γ)$, at which typical solutions shatters into disconnected components, therefore preventing numerical methods such as Monte Carlo Markov Chains from reaching equilibrium in polynomial time. This result needs to be reconciled with the observation that, in models with coupled copies, denser regions of the solution space should be more accessible. Additionally, we observe a change in the nature of the clustering phase transition, from discontinuous to continuous, in a wide $γ$ range. We investigate how the coupling affects the behavior of the Belief Propagation (BP) algorithm on finite-size instances and find that BP convergence is significantly impacted by the continuous transition. These results highlight the importance of better understanding algorithmic performance at the clustering transition, and call for a further exploration into the optimal use of re-weighting strategies designed to enhance algorithmic performances.
△ Less
Submitted 21 April, 2025;
originally announced April 2025.
-
Algorithmic thresholds in combinatorial optimization depend on the time scaling
Authors:
M. C. Angelini,
M. Avila-González,
F. D'Amico,
D. Machado,
R. Mulet,
F. Ricci-Tersenghi
Abstract:
In the last decades, many efforts have focused on analyzing typical-case hardness in optimization and inference problems. Some recent work has pointed out that polynomial algorithms exist, running with a time that grows more than linearly with the system size, which can do better than linear algorithms, finding solutions to random problems in a wider range of parameters. However, a theory for poly…
▽ More
In the last decades, many efforts have focused on analyzing typical-case hardness in optimization and inference problems. Some recent work has pointed out that polynomial algorithms exist, running with a time that grows more than linearly with the system size, which can do better than linear algorithms, finding solutions to random problems in a wider range of parameters. However, a theory for polynomial and superlinear algorithms is in general lacking. In this paper, we examine the performance of the Simulated Annealing algorithm, a standard, versatile, and robust choice for solving optimization and inference problems, in the prototypical random $K$-Sat problem. For the first time, we show that the algorithmic thresholds depend on the time scaling of the algorithm with the size of the system. Indeed, one can identify not just one, but different thresholds for linear, quadratic, cubic regimes (and so on). This observation opens new directions in studying the typical case hardness in optimization problems.
△ Less
Submitted 8 May, 2025; v1 submitted 15 April, 2025;
originally announced April 2025.
-
Generalized Lotka-Volterra model with sparse interactions: non-Gaussian effects and topological multiple-equilibria phase
Authors:
Tommaso Tonolo,
Maria Chiara Angelini,
Sandro Azaele,
Amos Maritan,
Giacomo Gradenigo
Abstract:
We study the equilibrium phases of a generalized Lotka-Volterra model characterized by a species interaction matrix which is random, sparse and symmetric. Dynamical fluctuations are modeled by a demographic noise with amplitude proportional to the effective temperature T. The equilibrium distribution of species abundances is obtained by means of the cavity method and the Belief Propagation equatio…
▽ More
We study the equilibrium phases of a generalized Lotka-Volterra model characterized by a species interaction matrix which is random, sparse and symmetric. Dynamical fluctuations are modeled by a demographic noise with amplitude proportional to the effective temperature T. The equilibrium distribution of species abundances is obtained by means of the cavity method and the Belief Propagation equations, which allow for an exact solution on sparse networks. Our results reveal a rich and non-trivial phenomenology that deviates significantly from the predictions of fully connected models. Consistently with data from real ecosystems, which are characterized by sparse rather than dense interaction networks, we find strong deviations from Gaussianity in the distribution of abundances. In addition to the study of these deviations from Gaussianity, which are not related to multiple-equilibria, we also identified a novel topological glass phase, present at both finite temperature, as shown here, and at T=0, as previously suggested in the literature. The peculiarity of this phase, which differs from the multiple-equilibria phase of fully-connected networks, is its strong dependence on the presence of extinctions. These findings provide new insights into how network topology and disorder influence ecological networks, particularly emphasizing that sparsity is a crucial feature for accurately modeling real-world ecological phenomena.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
-
Critical exponents of the spin glass transition in a field at zero temperature
Authors:
Maria Chiara Angelini,
Saverio Palazzi,
Giorgio Parisi,
Tommaso Rizzo
Abstract:
We analyze the spin glass transition in a field in finite dimension $D$ below the upper critical dimension directly at zero temperature using a recently introduced perturbative loop expansion around the Bethe lattice solution. The expansion is generated by the so-called $M$-layer construction, and it has $1/M$ as the associated small parameter. Computing analytically and numerically these non-stan…
▽ More
We analyze the spin glass transition in a field in finite dimension $D$ below the upper critical dimension directly at zero temperature using a recently introduced perturbative loop expansion around the Bethe lattice solution. The expansion is generated by the so-called $M$-layer construction, and it has $1/M$ as the associated small parameter. Computing analytically and numerically these non-standard diagrams at first order in the $1/M$ expansion, we construct an $ε$-expansion around the upper critical dimension $D_\text{uc}=8$, with $ε=D_\text{uc}-D$. Following standard field theoretical methods, we can write a $β$ function, finding a new zero-temperature fixed-point associated with the spin glass transition in a field in dimensions $D<8$. We are also able to compute, at first order in the $ε$-expansion, the three independent critical exponents characterizing the transition, plus the correction-to-scaling exponent.
△ Less
Submitted 28 February, 2025;
originally announced February 2025.
-
Bethe $M$-layer construction for the percolation problem
Authors:
Maria Chiara Angelini,
Saverio Palazzi,
Tommaso Rizzo,
Marco Tarzia
Abstract:
The major difference between percolation and other phase transition models is the absence of an Hamiltonian and of a partition function. For this reason it is not straightforward to identify the corresponding field theory to be used as starting point of Renormalization Group computations. Indeed, it could be identified with the field theory of $n+1$ states Potts model in the limit of $n \to 0$ onl…
▽ More
The major difference between percolation and other phase transition models is the absence of an Hamiltonian and of a partition function. For this reason it is not straightforward to identify the corresponding field theory to be used as starting point of Renormalization Group computations. Indeed, it could be identified with the field theory of $n+1$ states Potts model in the limit of $n \to 0$ only by means of the mapping discovered by Kasteleyn and Fortuin for bond percolation. In this paper we show that it is possible to recover the epsilon expansion for critical exponents in finite dimension directly using the $M$-layer expansion, without the need to perform any analytical continuation. Moreover, we also show explicitly that the critical exponents for site and bond percolation are the same. This computation provides a reference for applications of the $M$-layer method to systems where the underlying field theory is unknown or disputed.
△ Less
Submitted 3 February, 2025; v1 submitted 29 June, 2024;
originally announced July 2024.
-
Bethe $M$-layer construction on the Ising model
Authors:
Maria Chiara Angelini,
Saverio Palazzi,
Giorgio Parisi,
Tommaso Rizzo
Abstract:
In statistical physics, one of the standard methods to study second order phase transitions is the renormalization group that usually leads to an expansion around the corresponding fully connected solution. Unfortunately, often in disordered models, some important finite dimensional second-order phase transitions are qualitatively different or absent in the corresponding fully connected model: in…
▽ More
In statistical physics, one of the standard methods to study second order phase transitions is the renormalization group that usually leads to an expansion around the corresponding fully connected solution. Unfortunately, often in disordered models, some important finite dimensional second-order phase transitions are qualitatively different or absent in the corresponding fully connected model: in such cases the standard expansion fails. Recently, a new method, the $M$-layer one, has been introduced that performs an expansion around a different soluble mean field model: the Bethe lattice one. This new method has been already used to compute the upper critical dimension $D_U$ of different disordered systems such as the Random Field Ising model or the Spin glass model with field. If then one wants to go beyond and construct an expansion around $D_U$ to understand how critical quantities get renormalized, the actual computation of all the numerical factors is needed. This next step has still not been performed, being technically more involved. In this paper we perform this computation for the ferromagnetic Ising model without quenched disorder, in finite dimensions: we show that, at one-loop order inside the $M$-layer approach, we recover the continuum quartic field theory and we are able to identify the coupling constant $g$ and the other parameters of the theory, as a function of macroscopic and microscopic details of the model such as the lattice spacing, the physical lattice dimension and the temperature. This is a fundamental step that will help in applying in the future the same techniques to more complicated systems, for which the standard field theoretical approach is impracticable.
△ Less
Submitted 29 November, 2024; v1 submitted 2 March, 2024;
originally announced March 2024.
-
Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems
Authors:
Maria Chiara Angelini,
Angelo Giorgio Cavaliere,
Raffaele Marino,
Federico Ricci-Tersenghi
Abstract:
Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Me…
▽ More
Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Metropolis Monte Carlo with a properly chosen temperature, which depends on the mini-batch size. This quantitative matching holds both at equilibrium and in the out-of-equilibrium regime, despite the two algorithms having fundamental differences (e.g.\ SGD does not satisfy detailed balance). Such equivalence allows us to use results about performances and limits of Monte Carlo algorithms to optimize the mini-batch size in the SGD-like algorithm and make it efficient at recovering the signal in hard inference problems.
△ Less
Submitted 30 May, 2024; v1 submitted 11 September, 2023;
originally announced September 2023.
-
Real-Space Renormalization group for spin glasses
Authors:
Maria Chiara Angelini
Abstract:
While in the fully-connected limit the solution of the spin-glass model is known, with the existence of a complex transition on a critical line in the temperature-external field phase diagram, in finite dimensions we don't know if a transition is present or not and, if present, if its nature is the same as the one in infinite dimensions. This work contains a review of the real-space Renormalizatio…
▽ More
While in the fully-connected limit the solution of the spin-glass model is known, with the existence of a complex transition on a critical line in the temperature-external field phase diagram, in finite dimensions we don't know if a transition is present or not and, if present, if its nature is the same as the one in infinite dimensions. This work contains a review of the real-space Renormalization Group methods that have been applied to Spin Glasses, highlighting both their point of strength and weakness in characterizing the finite dimensional behaviour of the model.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
The Ising spin glass on random graphs at zero temperature: not all spins are glassy in the glassy phase
Authors:
Gianmarco Perrupato,
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homoge…
▽ More
We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homogeneously on the whole system. Indeed, there exist spins having the same effective local field in all local ground states, exactly as in the replica symmetric (RS) phase, while the spontaneous RSB manifests only on the remaining spins, whose fraction vanishes at criticality. The characterization in terms of spins having fixed or fluctuating local fields can be extended also to the random field Ising model (RFIM), in which case the fluctuating spins are the only responsible for the spontaneous magnetization in the ferromagnetic phase. Close to criticality we are able to connect the statistics of the local fields acting on the spins in the RSB phase with the correlation functions measured in the paramagnetic phase. Identifying the two types of spins on given instances of SG and RFIM, we show that they participate very differently to avalanches produced by flipping a single spin. From the scaling of the number of spins inducing RSB effects close to the critical point and using the $M$-layer expansion we estimate the upper critical dimension $D_U \geq 8$ for SG.
△ Less
Submitted 10 November, 2022; v1 submitted 13 July, 2022;
originally announced July 2022.
-
Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent set
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum inde…
▽ More
The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum independent set (MIS). They conclude that "the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables."
In this comment, we show that a simple greedy algorithm, running in almost linear time, can find solutions for the MIS problem of much better quality than the GNN. The greedy algorithm is faster by a factor of $10^4$ with respect to the GNN for problems with a million variables. We do not see any good reason for solving the MIS with these GNN, as well as for using a sledgehammer to crack nuts.
In general, many claims of superiority of neural networks in solving combinatorial problems are at risk of being not solid enough, since we lack standard benchmarks based on really hard problems. We propose one of such hard benchmarks, and we hope to see future neural network optimizers tested on these problems before any claim of superiority is made.
△ Less
Submitted 2 January, 2023; v1 submitted 27 June, 2022;
originally announced June 2022.
-
Limits and performances of algorithms based on simulated annealing in solving sparse hard inference problems
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal…
▽ More
The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal in the recovery of the planted solution because it gets attracted by glassy states that, instead, do not influence the BP algorithm. At variance with previous conjectures, we propose an analytic estimation for the SA algorithmic threshold by comparing the spinodal point of the paramagnetic phase and the dynamical critical temperature. This is a fundamental connection between thermodynamical phase transitions and out of equilibrium behavior of Glauber dynamics. We also study an improved version of SA, called replicated SA (RSA), where several weakly coupled replicas are cooled down together. We show numerical evidence that the algorithmic threshold for the RSA coincides with the Bayes optimal one. Finally, we develop an approximated analytical theory explaining the optimal performances of RSA and predicting the location of the transition towards the planted solution in the limit of a very large number of replicas. Our results for RSA support the idea that mismatching the parameters in the prior with respect to those of the generative model may produce an algorithm that is optimal and very robust.
△ Less
Submitted 28 June, 2023; v1 submitted 9 June, 2022;
originally announced June 2022.
-
Mismatching as a tool to enhance algorithmic performances of Monte Carlo methods for the planted clique model
Authors:
Maria Chiara Angelini,
Paolo Fachin,
Simone de Feo
Abstract:
Over-parametrization was a crucial ingredient for recent developments in inference and machine-learning fields. However a good theory explaining this success is still lacking. In this paper we study a very simple case of mismatched over-parametrized algorithm applied to one of the most studied inference problem: the planted clique problem. We analyze a Monte Carlo (MC) algorithm in the same class…
▽ More
Over-parametrization was a crucial ingredient for recent developments in inference and machine-learning fields. However a good theory explaining this success is still lacking. In this paper we study a very simple case of mismatched over-parametrized algorithm applied to one of the most studied inference problem: the planted clique problem. We analyze a Monte Carlo (MC) algorithm in the same class of the famous Jerrum algorithm. We show how this MC algorithm is in general suboptimal for the recovery of the planted clique. We show however how to enhance its performances by adding a (mismatched) parameter: the temperature; we numerically find that this over-parametrized version of the algorithm can reach the supposed algorithmic threshold for the planted clique problem.
△ Less
Submitted 19 November, 2021; v1 submitted 10 June, 2021;
originally announced June 2021.
-
Unexpected upper critical dimension for spin glass models in a field predicted by the loop expansion around the Bethe solution at zero temperature
Authors:
Maria Chiara Angelini,
Carlo Lucibello,
Giorgio Parisi,
Gianmarco Perrupato,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theo…
▽ More
The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theory fails is $D_U \le 8$, at variance with the classical result $D_U = 6$ yielded by finite-temperature replica field theory. Our expansion around the Bethe lattice has two crucial differences with respect to the classical one. The finite connectivity $z$ of the lattice is directly included from the beginning in the Bethe lattice, while in the classical computation the finite connectivity is obtained through an expansion in $1/z$. Moreover, if one is interested in the zero temperature ($T = 0$) transition, one can directly expand around the $T = 0$ Bethe transition. The expansion directly at $T = 0$ is not possible in the classical framework because the fully connected spin glass does not have a transition at $T = 0$, being in the broken phase for any value of the external field.
△ Less
Submitted 16 March, 2022; v1 submitted 31 March, 2021;
originally announced March 2021.
-
Solving the fully-connected spherical $p$-spin model with the cavity method: equivalence with the replica results
Authors:
Giacomo Gradenigo,
Maria Chiara Angelini,
Luca Leuzzi,
Federico Ricci-Tersenghi
Abstract:
The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to s…
▽ More
The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to spherical models. Here we show how to write the cavity equations for spherical $p$-spin models on complete graphs, both in the Replica Symmetric (RS) ansatz (corresponding to Belief Propagation) and in the 1-step Replica Symmetry Breaking (1RSB) ansatz (corresponding to Survey Propagation). The cavity equations can be solved by a Gaussian (RS) and multivariate Gaussian (1RSB) ansatz for the distribution of the cavity fields. We compute the free energy in both ansatzes and check that the results are identical to the replica computation, predicting a phase transition to a 1RSB phase at low temperatures. The advantages of solving the model with the cavity method are many. The physical meaning of any ansatz for the cavity marginals is very clear. The cavity method works directly with the distribution of local quantities, which allows to generalize the method to dilute graphs. What we are presenting here is the first step towards the solution of the diluted version of the spherical $p$-spin model, which is a fundamental model in the theory of random lasers and interesting $per~se$ as an easier-to-simulate version of the classical fully-connected $p$-spin model.
△ Less
Submitted 5 February, 2021; v1 submitted 3 July, 2020;
originally announced July 2020.
-
Comment on "Real-space renormalization-group methods for hierarchical spin glasses"
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
In the paper [Angelini M C, Parisi G, and Ricci-Tersenghi F, Ensemble renormalization group for disordered systems, Phys. Rev. B 87 134201 (2013)] we introduced a real-space renormalization group called Ensemble Renormalization Group (ERG) and we applied it to the Edwards-Anderson model, obtaining estimates for the critical exponents in good agreement with those from Monte Carlo simulations. Recen…
▽ More
In the paper [Angelini M C, Parisi G, and Ricci-Tersenghi F, Ensemble renormalization group for disordered systems, Phys. Rev. B 87 134201 (2013)] we introduced a real-space renormalization group called Ensemble Renormalization Group (ERG) and we applied it to the Edwards-Anderson model, obtaining estimates for the critical exponents in good agreement with those from Monte Carlo simulations. Recently the paper [Castellana M, Real-space renormalization-group methods for hierarchical spin glasses, J. Phys. A: Math. Theor. 52 445002 (2019)] re-examined the ERG method from a different perspective, concluding that the previous results were wrong, and claiming that the ERG method predicts trivially wrong critical exponents. In this comment we explain why the conclusions reached by Castellana are wrong, as they are based on a misinterpretation of finite-size effects. We conclude that the ERG method remains a good RG method to obtain critical exponents in strongly disordered models (if properly used).
△ Less
Submitted 6 November, 2019;
originally announced November 2019.
-
New loop expansion for the Random Magnetic Field Ising Ferromagnets at zero temperature
Authors:
Maria Chiara Angelini,
Carlo Lucibello,
Giorgio Parisi,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
We apply to the Random Field Ising Model at zero temperature (T= 0) the perturbative loop expansion around the Bethe solution. A comparison with the standard epsilon-expansion is made, highlighting the key differences that make the new expansion much more appropriate to correctly describe strongly disordered systems, especially those controlled by a T = 0 RG fixed point. This new loop expansion pr…
▽ More
We apply to the Random Field Ising Model at zero temperature (T= 0) the perturbative loop expansion around the Bethe solution. A comparison with the standard epsilon-expansion is made, highlighting the key differences that make the new expansion much more appropriate to correctly describe strongly disordered systems, especially those controlled by a T = 0 RG fixed point. This new loop expansion produces an effective theory with cubic vertices. We compute the one-loop corrections due to cubic vertices, finding new terms that are absent in the epsilon-expansion. However, these new terms are subdominant with respect to the standard, supersymmetric ones, therefore dimensional reduction is still valid at this order of the loop expansion.
△ Less
Submitted 11 June, 2019;
originally announced June 2019.
-
Monte Carlo algorithms are very effective in finding the largest independent set in sparse random graphs
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
The effectiveness of stochastic algorithms based on Monte Carlo dynamics in solving hard optimization problems is mostly unknown. Beyond the basic statement that at a dynamical phase transition the ergodicity breaks and a Monte Carlo dynamics cannot sample correctly the probability distribution in times linear in the system size, there are almost no predictions nor intuitions on the behavior of th…
▽ More
The effectiveness of stochastic algorithms based on Monte Carlo dynamics in solving hard optimization problems is mostly unknown. Beyond the basic statement that at a dynamical phase transition the ergodicity breaks and a Monte Carlo dynamics cannot sample correctly the probability distribution in times linear in the system size, there are almost no predictions nor intuitions on the behavior of this class of stochastic dynamics. The situation is particularly intricate because, when using a Monte Carlo based algorithm as an optimization algorithm, one is usually interested in the out of equilibrium behavior which is very hard to analyse. Here we focus on the use of Parallel Tempering in the search for the largest independent set in a sparse random graph, showing that it can find solutions well beyond the dynamical threshold. Comparison with state-of-the-art message passing algorithms reveals that parallel tempering is definitely the algorithm performing best, although a theory explaining its behavior is still lacking.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
Parallel Tempering for the planted clique problem
Authors:
Maria Chiara Angelini
Abstract:
The theoretical information threshold for the planted clique problem is $2\log_2(N)$, however no polynomial algorithm is known to recover a planted clique of size $O(N^{1/2-ε})$, $ε>0$. In this paper we will apply a standard method for the analysis of disordered models, the Parallel-Tempering (PT) algorithm, to the clique problem, showing numerically that its time-scaling in the hard region is ind…
▽ More
The theoretical information threshold for the planted clique problem is $2\log_2(N)$, however no polynomial algorithm is known to recover a planted clique of size $O(N^{1/2-ε})$, $ε>0$. In this paper we will apply a standard method for the analysis of disordered models, the Parallel-Tempering (PT) algorithm, to the clique problem, showing numerically that its time-scaling in the hard region is indeed polynomial for the analyzed sizes. We also apply PT to a different but connected model, the Sparse Planted Independent Set problem. In this situation thresholds should be sharper and finite size corrections should be less important. Also in this case PT shows a polynomial scaling in the hard region for the recovery.
△ Less
Submitted 8 January, 2019; v1 submitted 16 February, 2018;
originally announced February 2018.
-
One-loop topological expansion for spin glasses in the large connectivity limit
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
We apply for the first time a new one-loop topological expansion around the Bethe solution to the spin-glass model with field in the high connectivity limit, following the methodological scheme proposed in a recent work. The results are completely equivalent to the well known ones, found by standard field theoretical expansion around the fully connected model (Bray and Roberts 1980, and following…
▽ More
We apply for the first time a new one-loop topological expansion around the Bethe solution to the spin-glass model with field in the high connectivity limit, following the methodological scheme proposed in a recent work. The results are completely equivalent to the well known ones, found by standard field theoretical expansion around the fully connected model (Bray and Roberts 1980, and following works). However this method has the advantage that the starting point is the original Hamiltonian of the model, with no need to define an associated field theory, nor to know the initial values of the couplings, and the computations have a clear and simple physical meaning. Moreover this new method can also be applied in the case of zero temperature, when the Bethe model has a transition in field, contrary to the fully connected model that is always in the spin glass phase. Sharing with finite dimensional model the finite connectivity properties, the Bethe lattice is clearly a better starting point for an expansion with respect to the fully connected model. The present work is a first step towards the generalization of this new expansion to more difficult and interesting cases as the zero-temperature limit, where the expansion could lead to different results with respect to the standard one.
△ Less
Submitted 31 January, 2018; v1 submitted 31 August, 2017;
originally announced August 2017.
-
Loop expansion around the Bethe approximation through the $M$-layer construction
Authors:
Ada Altieri,
Maria Chiara Angelini,
Carlo Lucibello,
Giorgio Parisi,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original model for $M=1$. The $1/M$ perturbative series is then expressed by a diagrammatic loop expansion in terms of so-called fat-diagrams. Our motivation is to study so…
▽ More
For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original model for $M=1$. The $1/M$ perturbative series is then expressed by a diagrammatic loop expansion in terms of so-called fat-diagrams. Our motivation is to study some important second-order phase transitions that do exist on the Bethe lattice but are either qualitatively different or absent in the corresponding fully connected case. In this case the standard approach based on a perturbative expansion around the naive mean field theory (essentially a fully connected model) fails. On physical grounds, we expect that when the construction is applied to a lattice in finite dimension there is a small region of the external parameters close to the Bethe critical point where strong deviations from mean-field behavior will be observed. In this region, the $1/M$ expansion for the corrections diverges and it can be the starting point for determining the correct non-mean-field critical exponents using renormalization group arguments. In the end, we will show that the critical series for the generic observable can be expressed as a sum of Feynman diagrams with the same numerical prefactors of field theories. However, the contribution of a given diagram is not evaluated associating Gaussian propagators to its lines as in field theories: one has to consider the graph as a portion of the original lattice, replacing the internal lines with appropriate one-dimensional chains, and attaching to the internal points the appropriate number of infinite-size Bethe trees to restore the correct local connectivity of the original model.
△ Less
Submitted 19 October, 2023; v1 submitted 26 July, 2017;
originally announced July 2017.
-
Real Space Migdal-Kadanoff Renormalisation of Glassy Systems: Recent Results and a Critical Assessment
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
In this manuscript, in honour of L. Kadanoff, we present recent progress obtained in the description of finite dimensional glassy systems thanks to the Migdal-Kadanoff renormalisation group (MK-RG). We provide a critical assessment of the method, in particular discuss its limitation in describing situations in which an infinite number of pure states might be present, and analyse the MK-RG flow in…
▽ More
In this manuscript, in honour of L. Kadanoff, we present recent progress obtained in the description of finite dimensional glassy systems thanks to the Migdal-Kadanoff renormalisation group (MK-RG). We provide a critical assessment of the method, in particular discuss its limitation in describing situations in which an infinite number of pure states might be present, and analyse the MK-RG flow in the limit of infinite dimensions. MK-RG predicts that the spin-glass transition in a field and the glass transition are governed by zero-temperature fixed points of the renormalization group flow. This implies a typical energy scale that grows, approaching the transition, as a power of the correlation length, thus leading to enormously large time-scales as expected from experiments and simulations. These fixed points exist only in dimensions larger than $d_L>3$ but they nevertheless influence the RG flow below it, in particular in three dimensions. MK-RG thus predicts a similar behavior for spin-glasses in a field and models of glasses and relates it to the presence of avoided critical points.
△ Less
Submitted 10 February, 2017;
originally announced February 2017.
-
Real Space Renormalization Group Theory of Disordered Models of Glasses
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
We develop a real space renormalisation group analysis of disordered models of glasses, in particular of the spin models at the origin of the Random First Order Transition theory. We find three fixed points respectively associated to the liquid state, to the critical behavior and to the glass state. The latter two are zero-temperature ones; this provides a natural explanation of the growth of effe…
▽ More
We develop a real space renormalisation group analysis of disordered models of glasses, in particular of the spin models at the origin of the Random First Order Transition theory. We find three fixed points respectively associated to the liquid state, to the critical behavior and to the glass state. The latter two are zero-temperature ones; this provides a natural explanation of the growth of effective activation energy scale and the concomitant huge increase of relaxation time approaching the glass transition. The lower critical dimension depends on the nature of the interacting degrees of freedom and is higher than three for all models. This does not prevent three dimensional systems from being glassy. Indeed, we find that their renormalisation group flow is affected by the fixed points existing in higher dimension and in consequence is non-trivial. Within our theoretical framework the glass transition results to be an avoided phase transition.
△ Less
Submitted 13 April, 2016;
originally announced April 2016.
-
Spectral Detection on Sparse Hypergraphs
Authors:
Maria Chiara Angelini,
Francesco Caltagirone,
Florent Krzakala,
Lenka Zdeborová
Abstract:
We consider the problem of the assignment of nodes into communities from a set of hyperedges, where every hyperedge is a noisy observation of the community assignment of the adjacent nodes. We focus in particular on the sparse regime where the number of edges is of the same order as the number of vertices. We propose a spectral method based on a generalization of the non-backtracking Hashimoto mat…
▽ More
We consider the problem of the assignment of nodes into communities from a set of hyperedges, where every hyperedge is a noisy observation of the community assignment of the adjacent nodes. We focus in particular on the sparse regime where the number of edges is of the same order as the number of vertices. We propose a spectral method based on a generalization of the non-backtracking Hashimoto matrix into hypergraphs. We analyze its performance on a planted generative model and compare it with other spectral methods and with Bayesian belief propagation (which was conjectured to be asymptotically optimal for this model). We conclude that the proposed spectral method detects communities whenever belief propagation does, while having the important advantages to be simpler, entirely nonparametric, and to be able to learn the rule according to which the hyperedges were generated without prior information.
△ Less
Submitted 15 July, 2015;
originally announced July 2015.
-
Spin Glass in a Field: a New Zero-Temperature Fixed Point in Finite Dimensions
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
By using real space renormalisation group (RG) methods we show that spin-glasses in a field display a new kind of transition in high dimensions. The corresponding critical properties and the spin-glass phase are governed by two non-perturbative zero temperature fixed points of the RG flow. We compute the critical exponents, discuss the RG flow and its relevance for three dimensional systems. The n…
▽ More
By using real space renormalisation group (RG) methods we show that spin-glasses in a field display a new kind of transition in high dimensions. The corresponding critical properties and the spin-glass phase are governed by two non-perturbative zero temperature fixed points of the RG flow. We compute the critical exponents, discuss the RG flow and its relevance for three dimensional systems. The new spin-glass phase we discovered has unusual properties, which are intermediate between the ones conjectured by droplet and full replica symmetry breaking theories. These results provide a new perspective on the long-standing debate about the behaviour of spin-glasses in a field.
△ Less
Submitted 16 July, 2015; v1 submitted 3 September, 2014;
originally announced September 2014.
-
The Super-Potts glass: a new disordered model for glass-forming liquids
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
We introduce a new disordered system, the Super-Potts model, which is a more frustrated version of the Potts glass. Its elementary degrees of freedom are variables that can take M values and are coupled via pair-wise interactions. Its exact solution on a completely connected lattice demonstrates that for large enough M it belongs to the class of mean-field systems solved by a one step replica symm…
▽ More
We introduce a new disordered system, the Super-Potts model, which is a more frustrated version of the Potts glass. Its elementary degrees of freedom are variables that can take M values and are coupled via pair-wise interactions. Its exact solution on a completely connected lattice demonstrates that for large enough M it belongs to the class of mean-field systems solved by a one step replica symmetry breaking Ansatz. Numerical simulations by the parallel tempering technique show that in three dimensions it displays a phenomenological behaviour similar to the one of glass-forming liquids. The Super-Potts glass is therefore the first long-sought disordered model allowing one to perform extensive and detailed studies of the Random First Order Transition in finite dimensions. We also discuss its behaviour for small values of M, which is similar to the one of spin-glasses in a field.
△ Less
Submitted 14 January, 2015; v1 submitted 28 July, 2014;
originally announced July 2014.
-
Relations between Short Range and Long Range Ising models
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
We perform a numerical study of the long range (LR) ferromagnetic Ising model with power law decaying interactions ($J \propto r^{-d-σ}$) both on a one-dimensional chain ($d=1$) and on a square lattice ($d=2$). We use advanced cluster algorithms to avoid the critical slowing down. We first check the validity of the relation connecting the critical behavior of the LR model with parameters $(d,σ)$ t…
▽ More
We perform a numerical study of the long range (LR) ferromagnetic Ising model with power law decaying interactions ($J \propto r^{-d-σ}$) both on a one-dimensional chain ($d=1$) and on a square lattice ($d=2$). We use advanced cluster algorithms to avoid the critical slowing down. We first check the validity of the relation connecting the critical behavior of the LR model with parameters $(d,σ)$ to that of a short range (SR) model in an equivalent dimension $D$. We then study the critical behavior of the $d=2$ LR model close to the lower critical $σ$, uncovering that the spatial correlation function decays with two different power laws: the effect of the subdominant power law is much stronger than finite size effects and actually makes the estimate of critical exponents very subtle. By including this subdominant power law, the numerical data are consistent with the standard renormalization group (RG) prediction by Sak, thus making not necessary (and unlikely, according to Occam's razor) the recent proposal by Picco of having a new set of RG fixed points, in addition to the mean-field one and the SR one.
△ Less
Submitted 30 January, 2014; v1 submitted 27 January, 2014;
originally announced January 2014.
-
Compressed sensing with sparse, structured matrices
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi,
Yoshiyuki Kabashima
Abstract:
In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a ρ0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the original signal, compressed at a rate α, by using a message passing algorithm (Expectation Maximization Belief Propagation) that runs in a time linear in N. In the lar…
▽ More
In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a ρ0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the original signal, compressed at a rate α, by using a message passing algorithm (Expectation Maximization Belief Propagation) that runs in a time linear in N. In the large N limit, the scheme proposed here closely approaches the theoretical bound ρ0 = α, and so it is both optimal and efficient (linear time complexity). More generally, we show that several ensembles of dense random matrices can be converted into ensembles of sparse random matrices, having the same thresholds, but much lower computational complexity.
△ Less
Submitted 12 April, 2013; v1 submitted 12 July, 2012;
originally announced July 2012.
-
Ensemble renormalization group for disordered systems
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
We propose and study a renormalization group transformation that can be used also for models with strong quenched disorder, like spin glasses. The method is based on a mapping between disorder distributions, chosen such as to keep some physical properties (e.g., the ratio of correlations averaged over the ensemble) invariant under the transformation. We validate this ensemble renormalization group…
▽ More
We propose and study a renormalization group transformation that can be used also for models with strong quenched disorder, like spin glasses. The method is based on a mapping between disorder distributions, chosen such as to keep some physical properties (e.g., the ratio of correlations averaged over the ensemble) invariant under the transformation. We validate this ensemble renormalization group by applying it to the hierarchical model (both the diluted ferromagnetic version and the spin glass version), finding results in agreement with Monte Carlo simulations.
△ Less
Submitted 28 April, 2013; v1 submitted 29 November, 2011;
originally announced November 2011.
-
Entropic long range order in a 3D spin glass model
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
We uncover a new kind of entropic long range order in finite dimensional spin glasses. We study the link-diluted version of the Edwards-Anderson spin glass model with bimodal couplings (J=+/-1) on a 3D lattice. By using exact reduction algorithms, we prove that there exists a region of the phase diagram (at zero temperature and link density low enough), where spins are long range correlated, even…
▽ More
We uncover a new kind of entropic long range order in finite dimensional spin glasses. We study the link-diluted version of the Edwards-Anderson spin glass model with bimodal couplings (J=+/-1) on a 3D lattice. By using exact reduction algorithms, we prove that there exists a region of the phase diagram (at zero temperature and link density low enough), where spins are long range correlated, even if the ground states energy stiffness is null. In other words, in this region twisting the boundary conditions cost no energy, but spins are long range correlated by means of pure entropic effects.
△ Less
Submitted 4 January, 2011; v1 submitted 12 July, 2010;
originally announced July 2010.
