Showing 1–50 of 183 results for author: Ricci-Tersenghi, F

Microcanonical simulated annealing: Massively parallel Monte Carlo simulations with sporadic random-number generation

Authors: M. Bernaschi, L. A. Fernandez, I. González-Adalid Pemartín, E. Marinari, V. Martin-Mayor, G. Parisi, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, D. Yllanes

Abstract: Numerical simulations of models and theories that describe complex experimental systems $\unicode{x2014}$in fields like high-energy and condensed-matter physics$\unicode{x2014}$ are becoming increasingly important. Examples include lattice gauge theories, which can describe, among others, quantum chromodynamics (the Standard Model description of strong interactions between elementary particles), a… ▽ More Numerical simulations of models and theories that describe complex experimental systems $\unicode{x2014}$in fields like high-energy and condensed-matter physics$\unicode{x2014}$ are becoming increasingly important. Examples include lattice gauge theories, which can describe, among others, quantum chromodynamics (the Standard Model description of strong interactions between elementary particles), and spin-glass systems. Beyond fundamental research, these computational methods also find practical applications, among many others, in optimization, finance, and complex biological problems. However, Monte Carlo simulations, an important subcategory of these methods, are plagued by a major drawback: they are extremely greedy for (pseudo) random numbers. The total fraction of computer time dedicated to random-number generation increases as the hardware grows more sophisticated, and can get prohibitive for special-purpose computing platforms. We propose here a general-purpose microcanonical simulated annealing (MicSA) formalism that dramatically reduces such a burden. The algorithm is fully adapted to a massively parallel computation, as we show in the particularly demanding benchmark of the three-dimensional Ising spin glass. We carry out very stringent numerical tests of the new algorithm by comparing our results, obtained on GPUs, with high-precision standard (i.e., random-number-greedy) simulations performed on the Janus II custom-built supercomputer. In those cases where thermal equilibrium is reachable (i.e., in the paramagnetic phase), both simulations reach compatible values. More significantly, barring short-time corrections, a simple time rescaling suffices to map the MicSA off-equilibrium dynamics onto the results obtained with standard simulations. △ Less

Submitted 25 June, 2025; v1 submitted 19 June, 2025; originally announced June 2025.

Comments: 17 pages, 5 figures, 3 tables. Reuploaded to include some references and additional literature discussion

On the performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models

Authors: Luca Maria Del Bono, Federico Ricci-Tersenghi, Francesco Zamponi

Abstract: Recent years have seen a rise in the application of machine learning techniques to aid the simulation of hard-to-sample systems that cannot be studied using traditional methods. Despite the introduction of many different architectures and procedures, a wide theoretical understanding is still lacking, with the risk of suboptimal implementations. As a first step to address this gap, we provide here… ▽ More Recent years have seen a rise in the application of machine learning techniques to aid the simulation of hard-to-sample systems that cannot be studied using traditional methods. Despite the introduction of many different architectures and procedures, a wide theoretical understanding is still lacking, with the risk of suboptimal implementations. As a first step to address this gap, we provide here a complete analytic study of the widely-used Sequential Tempering procedure applied to a shallow MADE architecture for the Curie-Weiss model. The contribution of this work is twofold: firstly, we give a description of the optimal weights and of the training under Gradient Descent optimization. Secondly, we compare what happens in Sequential Tempering with and without the addition of local Metropolis Monte Carlo steps. We are thus able to give theoretical predictions on the best procedure to apply in this case. This work establishes a clear theoretical basis for the integration of machine learning techniques into Monte Carlo sampling and optimization. △ Less

Submitted 15 June, 2025; v1 submitted 28 May, 2025; originally announced May 2025.

Comments: 17 pages, 10 figures

Supervised and Unsupervised protocols for hetero-associative neural networks

Authors: Andrea Alessandrelli, Adriano Barra, Andrea Ladiana, Andrea Lepre, Federico Ricci-Tersenghi

Abstract: This paper introduces a learning framework for Three-Directional Associative Memory (TAM) models, extending the classical Hebbian paradigm to both supervised and unsupervised protocols within an hetero-associative setting. These neural networks consist of three interconnected layers of binary neurons interacting via generalized Hebbian synaptic couplings that allow learning, storage and retrieval… ▽ More This paper introduces a learning framework for Three-Directional Associative Memory (TAM) models, extending the classical Hebbian paradigm to both supervised and unsupervised protocols within an hetero-associative setting. These neural networks consist of three interconnected layers of binary neurons interacting via generalized Hebbian synaptic couplings that allow learning, storage and retrieval of structured triplets of patterns. By relying upon glassy statistical mechanical techniques (mainly replica theory and Guerra interpolation), we analyze the emergent computational properties of these networks, at work with random (Rademacher) datasets and at the replica-symmetric level of description: we obtain a set of self-consistency equations for the order parameters that quantify the critical dataset sizes (i.e. their thresholds for learning) and describe the retrieval performance of these networks, highlighting the differences between supervised and unsupervised protocols. Numerical simulations validate our theoretical findings and demonstrate the robustness of the captured picture about TAMs also at work with structured datasets. In particular, this study provides insights into the cooperative interplay of layers, beyond that of the neurons within the layers, with potential implications for optimal design of artificial neural network architectures. △ Less

Submitted 24 May, 2025; originally announced May 2025.

Comments: 55 pages, 11 figures

Interacting Copies of Random Constraint Satisfaction Problems

Authors: Maria Chiara Angelini, Louise Budzynski, Federico Ricci-Tersenghi

Abstract: We study a system of $y=2$ coupled copies of a well-known constraint satisfaction problem (random hypergraph bicoloring) to examine how the ferromagnetic coupling between the copies affects the properties of the solution space. We solve the replicated model by applying the cavity method to the supervariables taking $2^y$ values. Our results show that a coupling of strength $γ$ between the copies d… ▽ More We study a system of $y=2$ coupled copies of a well-known constraint satisfaction problem (random hypergraph bicoloring) to examine how the ferromagnetic coupling between the copies affects the properties of the solution space. We solve the replicated model by applying the cavity method to the supervariables taking $2^y$ values. Our results show that a coupling of strength $γ$ between the copies decreases the clustering threshold $α_d(γ)$, at which typical solutions shatters into disconnected components, therefore preventing numerical methods such as Monte Carlo Markov Chains from reaching equilibrium in polynomial time. This result needs to be reconciled with the observation that, in models with coupled copies, denser regions of the solution space should be more accessible. Additionally, we observe a change in the nature of the clustering phase transition, from discontinuous to continuous, in a wide $γ$ range. We investigate how the coupling affects the behavior of the Belief Propagation (BP) algorithm on finite-size instances and find that BP convergence is significantly impacted by the continuous transition. These results highlight the importance of better understanding algorithmic performance at the clustering transition, and call for a further exploration into the optimal use of re-weighting strategies designed to enhance algorithmic performances. △ Less

Submitted 21 April, 2025; originally announced April 2025.

Comments: 19 pages, 8 figures

Strong ergodicity breaking in dynamical mean-field equations for mixed p-spin glasses

Authors: Vincenzo Citro, Federico Ricci-Tersenghi

Abstract: The analytical solution to the out-of-equilibrium dynamics of mean-field spin glasses has profoundly shaped our understanding of glassy dynamics, which take place in many diverse physical systems. In particular, the idea that during the aging dynamics, the evolution becomes slower and slower, but keeps wandering in an unbounded space (a manifold of marginal states), thus forgetting any previously… ▽ More The analytical solution to the out-of-equilibrium dynamics of mean-field spin glasses has profoundly shaped our understanding of glassy dynamics, which take place in many diverse physical systems. In particular, the idea that during the aging dynamics, the evolution becomes slower and slower, but keeps wandering in an unbounded space (a manifold of marginal states), thus forgetting any previously found configuration, has been one of the key hypotheses to achieve an analytical solution. This hypothesis, called weak ergodicity breaking, has recently been questioned by numerical simulations and attempts to solve the dynamical mean-field equations (DMFE). In this work, we introduce a new integration scheme for solving DMFE that allows us to reach very large integration times, $t=O(10^6)$, in the solution of the spherical (3+4)-spin model, quenched from close to the mode coupling temperature down to zero temperature. Thanks to this new solution, we can provide solid evidence for strong ergodicity breaking in the out-of-equilibrium dynamics on mixed p-spin glass models. Our solution to the DMFE shows that the out-of-equilibrium dynamics undergo aging, but in a restricted space: the initial condition is never forgotten, and the dynamics takes place closer and closer to configurations reached at later times. During this new restricted aging dynamics, the fluctuation-dissipation relation is richer than expected. △ Less

Submitted 1 May, 2025; v1 submitted 16 April, 2025; originally announced April 2025.

Comments: 5 page, 4 figures

Algorithmic thresholds in combinatorial optimization depend on the time scaling

Authors: M. C. Angelini, M. Avila-González, F. D'Amico, D. Machado, R. Mulet, F. Ricci-Tersenghi

Abstract: In the last decades, many efforts have focused on analyzing typical-case hardness in optimization and inference problems. Some recent work has pointed out that polynomial algorithms exist, running with a time that grows more than linearly with the system size, which can do better than linear algorithms, finding solutions to random problems in a wider range of parameters. However, a theory for poly… ▽ More In the last decades, many efforts have focused on analyzing typical-case hardness in optimization and inference problems. Some recent work has pointed out that polynomial algorithms exist, running with a time that grows more than linearly with the system size, which can do better than linear algorithms, finding solutions to random problems in a wider range of parameters. However, a theory for polynomial and superlinear algorithms is in general lacking. In this paper, we examine the performance of the Simulated Annealing algorithm, a standard, versatile, and robust choice for solving optimization and inference problems, in the prototypical random $K$-Sat problem. For the first time, we show that the algorithmic thresholds depend on the time scaling of the algorithm with the size of the system. Indeed, one can identify not just one, but different thresholds for linear, quadratic, cubic regimes (and so on). This observation opens new directions in studying the typical case hardness in optimization problems. △ Less

Submitted 8 May, 2025; v1 submitted 15 April, 2025; originally announced April 2025.

Pushing the Boundary of Quantum Advantage in Hard Combinatorial Optimization with Probabilistic Computers

Authors: Shuvro Chowdhury, Navid Anjum Aadit, Andrea Grimaldi, Eleonora Raimondo, Atharva Raut, P. Aaron Lott, Johan H. Mentink, Marek M. Rams, Federico Ricci-Tersenghi, Massimo Chiappini, Luke S. Theogarajan, Tathagata Srimani, Giovanni Finocchio, Masoud Mohseni, Kerem Y. Camsari

Abstract: Recent demonstrations on specialized benchmarks have reignited excitement for quantum computers, yet whether they can deliver an advantage for practical real-world problems remains an open question. Here, we show that probabilistic computers (p-computers) when co-designed with hardware to implement powerful Monte Carlo algorithms can surpass state-of-the-art quantum annealers <a href="https://www.… ▽ More Recent demonstrations on specialized benchmarks have reignited excitement for quantum computers, yet whether they can deliver an advantage for practical real-world problems remains an open question. Here, we show that probabilistic computers (p-computers) when co-designed with hardware to implement powerful Monte Carlo algorithms can surpass state-of-the-art quantum annealers <a href="https://www.nature.com/articles/s41586-023-05867-2" target="_blank">[King et al., Nature (2023)]</a> in solving certain hard optimization problems. We focus on two key algorithms: discrete-time simulated quantum annealing (DT-SQA) and adaptive parallel tempering (APT), both applied to 3D spin glasses. For DT-SQA, we find that increasing the number of replicas improves residual energy scaling, while parallelizing fewer replicas across independent runs also achieves comparable scaling. Both strategies align with the theoretical expectations from extreme value theory. In addition, APT outperforms DT-SQA when supported by non-local isoenergetic cluster moves. Finite-size scaling analysis suggests a universal behavior that explains the superior performance of APT over both DT-SQA and quantum annealing. We show that these algorithms are readily implementable in modern hardware thanks to the mature semiconductor technology. Unlike software simulations, replicas can be monolithically housed on a single chip and a large number of spins can be updated in parallel and asynchronously, similar to a quantum annealer. We project that custom Field Programmable Gate Arrays (FPGA) or specialized chips leveraging massive parallelism can further accelerate these algorithms by orders of magnitude, while drastically improving energy efficiency. Our results raise the bar for a practical quantum advantage in optimization and present p-computers as scalable, energy-efficient hardware for real-world optimization problems. △ Less

Submitted 7 April, 2025; v1 submitted 13 March, 2025; originally announced March 2025.

Beyond Disorder: Unveiling Cooperativeness in Multidirectional Associative Memories

Authors: Andrea Alessandrelli, Adriano Barra, Andrea Ladiana, Andrea Lepre, Federico Ricci-Tersenghi

Abstract: By leveraging tools from the statistical mechanics of complex systems, in these short notes we extend the architecture of a neural network for hetero-associative memory (called three-directional associative memories, TAM) to explore supervised and unsupervised learning protocols. In particular, by providing entropic-heterogeneous datasets to its various layers, we predict and quantify a new emerge… ▽ More By leveraging tools from the statistical mechanics of complex systems, in these short notes we extend the architecture of a neural network for hetero-associative memory (called three-directional associative memories, TAM) to explore supervised and unsupervised learning protocols. In particular, by providing entropic-heterogeneous datasets to its various layers, we predict and quantify a new emergent phenomenon -- that we term {\em layer's cooperativeness} -- where the interplay of dataset entropies across network's layers enhances their retrieval capabilities Beyond those they would have without reciprocal influence. Naively we would expect layers trained with less informative datasets to develop smaller retrieval regions compared to those pertaining to layers that experienced more information: this does not happen and all the retrieval regions settle to the same amplitude, allowing for optimal retrieval performance globally. This cooperative dynamics marks a significant advancement in understanding emergent computational capabilities within disordered systems. △ Less

Submitted 6 March, 2025; originally announced March 2025.

Evidence of Replica Symmetry Breaking under the Nishimori conditions in epidemic inference on graphs

Authors: Alfredo Braunstein, Louise Budzynski, Matteo Mariani, Federico Ricci-Tersenghi

Abstract: In Bayesian inference, computing the posterior distribution from the data is typically a non-trivial problem, which usually requires approximations such as mean-field approaches or numerical methods, like the Monte Carlo Markov Chain. Being a high-dimensional distribution over a set of correlated variables, the posterior distribution can undergo the notorious replica symmetry breaking transition.… ▽ More In Bayesian inference, computing the posterior distribution from the data is typically a non-trivial problem, which usually requires approximations such as mean-field approaches or numerical methods, like the Monte Carlo Markov Chain. Being a high-dimensional distribution over a set of correlated variables, the posterior distribution can undergo the notorious replica symmetry breaking transition. When it happens, several mean-field methods and virtually every Monte Carlo scheme can not provide a reasonable approximation to the posterior and its marginals. Replica symmetry is believed to be guaranteed whenever the data is generated with known prior and likelihood distributions, namely under the so-called Nishimori conditions. In this paper, we break this belief, by providing a counter-example showing that, under the Nishimori conditions, replica symmetry breaking arises. Introducing a simple, geometrical model that can be thought of as a patient zero retrieval problem in a highly infectious regime of the epidemic Susceptible-Infectious model, we show that under the Nishimori conditions, there is evidence of replica symmetry breaking. We achieve this result by computing the instability of the replica symmetric cavity method toward the one step replica symmetry broken phase. The origin of this phenomenon -- replica symmetry breaking under the Nishimori conditions -- is likely due to the correlated disorder appearing in the epidemic models. △ Less

Submitted 28 February, 2025; v1 submitted 18 February, 2025; originally announced February 2025.

Comments: 17 pages, 7 figures

Networks of neural networks: more is different

Authors: Elena Agliari, Andrea Alessandrelli, Adriano Barra, Martino Salomone Centonze, Federico Ricci-Tersenghi

Abstract: The common thread behind the recent Nobel Prize in Physics to John Hopfield and those conferred to Giorgio Parisi in 2021 and Philip Anderson in 1977 is disorder. Quoting Philip Anderson: "more is different". This principle has been extensively demonstrated in magnetic systems and spin glasses, and, in this work, we test its validity on Hopfield neural networks to show how an assembly of these mod… ▽ More The common thread behind the recent Nobel Prize in Physics to John Hopfield and those conferred to Giorgio Parisi in 2021 and Philip Anderson in 1977 is disorder. Quoting Philip Anderson: "more is different". This principle has been extensively demonstrated in magnetic systems and spin glasses, and, in this work, we test its validity on Hopfield neural networks to show how an assembly of these models displays emergent capabilities that are not present at a single network level. Such an assembly is designed as a layered associative Hebbian network that, beyond accomplishing standard pattern recognition, spontaneously performs also pattern disentanglement. Namely, when inputted with a composite signal -- e.g., a musical chord -- it can return the single constituting elements -- e.g., the notes making up the chord. Here, restricting to notes coded as Rademacher vectors and chords that are their mixtures (i.e., spurious states), we use tools borrowed from statistical mechanics of disordered systems to investigate this task, obtaining the conditions over the model control-parameters such that pattern disentanglement is successfully executed. △ Less

Submitted 28 January, 2025; originally announced January 2025.

Comments: 28 pages, 11 figures

Report number: Roma01.Math

Spin-glass dynamics: experiment, theory and simulation

Authors: E. D. Dahlberg, I. González-Adalid Pemartín, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, R. L. Orbach, I. Paga, G. Parisi, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, D. Yllanes

Abstract: The study of spin-glass dynamics, long considered the paradigmatic complex system, has reached important milestones. The availability of high-quality single crystals has allowed the experimental measurement of spin-glass coherence lengths of almost macroscopic dimensions, while the advent of special-purpose massive computers enables dynamical simulations that approach experimental time and length… ▽ More The study of spin-glass dynamics, long considered the paradigmatic complex system, has reached important milestones. The availability of high-quality single crystals has allowed the experimental measurement of spin-glass coherence lengths of almost macroscopic dimensions, while the advent of special-purpose massive computers enables dynamical simulations that approach experimental time and length scales. This review provides an account of the quantitative convergence of these two avenues of research, with precise experimental measurements of the expected scaling laws and numerical reproduction of classic experimental results, such as memory and rejuvenation. The article opens with a brief review of the defining spin-glass properties, randomness and frustration, and their experimental consequences. These apparently simple characteristics are shown to generate rich and complex physics. Models are introduced that enable quantitative descriptions. After a summary of the main numerical results in equilibrium, paying particular attention to the concept of temperature chaos, this review examines off-equilibrium dynamics in the absence of a magnetic field and shows how it can be related to equilibrium structures through the fluctuation-dissipation relations. The nonlinear response at a given temperature is then developed, including experiments and scaling in the vicinity of the transition temperature $T_\mathrm{g}$. The consequences of temperature change -- including temperature chaos, rejuvenation, and memory -- are reviewed. The interpretation of these phenomena requires identifying several length scales relevant to dynamics, which, in turn, generate new insights. Finally, issues for future investigations are introduced, including what is to be nailed down theoretically, why the Ising Edwards-Anderson model is so successful at modeling spin-glass dynamics, and experiments yet to be undertaken. △ Less

Submitted 11 December, 2024; originally announced December 2024.

Comments: 53 pages, 54 figures. Submitted to Reviews of Modern Physics

Jamming the Random Lorentz Gas: Configurational Entropy, Crunching Geometry, and Critical Universality

Authors: Giampaolo Folena, Patrick Charbonneau, Peter K. Morse, Rafael Díaz Hernández Rojas, Federico Ricci-Tersenghi

Abstract: Deterministic optimization algorithms unequivocally partition a complex energy landscape in inherent structures (ISs) and their respective basins of attraction. But can these basins be defined solely through geometric principles? This question is particularly important when examining the jamming of hard spheres. We here consider this issue by proposing a geometric class of gradient descent-like al… ▽ More Deterministic optimization algorithms unequivocally partition a complex energy landscape in inherent structures (ISs) and their respective basins of attraction. But can these basins be defined solely through geometric principles? This question is particularly important when examining the jamming of hard spheres. We here consider this issue by proposing a geometric class of gradient descent-like algorithms, which we use to study a system in the hard-sphere universality class, the random Lorentz gas. The statistics of the resulting IS is found to be strictly inherited from those of Poisson-Voronoi tessellations. The landscape roughness is further found to give rise to a hierarchical organization of ISs which various algorithms explore differently. In particular, greedy and reluctant schemes tend to favor ISs of markedly different densities. The resulting ISs nevertheless robustly exhibit a universal force distribution, thus confirming the geometric nature of the jamming universality class. △ Less

Submitted 8 October, 2024; originally announced October 2024.

Comments: 16 pages, 11 figures

Soft modes in vector spin glass models on sparse random graphs

Authors: Silvio Franz, Cosimo Lupo, Flavio Nicoletti, Giorgio Parisi, Federico Ricci-Tersenghi

Abstract: We study numerically the Hessian of low-lying minima of vector spin glass models defined on random regular graphs. We consider the two-component (XY) and three-component (Heisenberg) spin glasses at zero temperature, subjected to the action of a randomly oriented external field. Varying the intensity of the external field, these models undergo a zero temperature phase transition from a paramagnet… ▽ More We study numerically the Hessian of low-lying minima of vector spin glass models defined on random regular graphs. We consider the two-component (XY) and three-component (Heisenberg) spin glasses at zero temperature, subjected to the action of a randomly oriented external field. Varying the intensity of the external field, these models undergo a zero temperature phase transition from a paramagnet at high field to a spin glass at low field. We study how the spectral properties of the Hessian depend on the magnetic field. In particular, we study the shape of the spectrum at low frequency and the localization properties of low energy eigenvectors across the transition. We find that in both phases the edge of the spectral density behaves as $λ^{3/2}$: such a behavior rules out the presence of a diverging spin-glass susceptibility $χ_{SG}=\langle 1/λ^2 \rangle$. As to low energy eigenvectors, we find that the softest eigenmodes are always localized in both phases of the two models. However, by studying in detail the geometry of low energy eigenmodes across different energy scales close to the lower edge of the spectrum, we find a different behavior for the two models at the transition: in the XY case, low energy modes are typically localized; at variance, in the Heisenberg case low-energy eigenmodes with a multi-modal structure (sort of ``delocalization'') appear at an energy scale that vanishes in the infinite size limit. These geometrically non-trivial excitations, which we call Concentrated and Delocalised Low Energy Modes (CDLEM), coexist with trivially localised excitations: we interpret their existence as a sign of critical behavior related to the onset of the spin glass phase. △ Less

Submitted 16 September, 2024; originally announced September 2024.

Comments: 15 pages, 8 figures

Journal ref: Phys. Rev. B 111, 014203 (2025)

Generalized hetero-associative neural networks

Authors: Elena Agliari, Andrea Alessandrelli, Adriano Barra, Martino Salomone Centonze, Federico Ricci-Tersenghi

Abstract: Auto-associative neural networks (e.g., the Hopfield model implementing the standard Hebbian prescription) serve as a foundational framework for pattern recognition and associative memory in statistical mechanics. However, their hetero-associative counterparts, though less explored, exhibit even richer computational capabilities. In this work, we examine a straightforward extension of Kosko's Bidi… ▽ More Auto-associative neural networks (e.g., the Hopfield model implementing the standard Hebbian prescription) serve as a foundational framework for pattern recognition and associative memory in statistical mechanics. However, their hetero-associative counterparts, though less explored, exhibit even richer computational capabilities. In this work, we examine a straightforward extension of Kosko's Bidirectional Associative Memory (BAM), introducing a Three-directional Associative Memory (TAM), that is a tripartite neural network equipped with generalized Hebbian weights. Through both analytical approaches (using replica-symmetric statistical mechanics) and computational methods (via Monte Carlo simulations), we derive phase diagrams within the space of control parameters, revealing a region where the network can successfully perform pattern recognition as well as other tasks tasks. In particular, it can achieve pattern disentanglement, namely, when presented with a mixture of patterns, the network can recover the original patterns. Furthermore, the system is capable of retrieving Markovian sequences of patterns and performing generalized frequency modulation. △ Less

Submitted 21 October, 2024; v1 submitted 12 September, 2024; originally announced September 2024.

Journal ref: J. Stat. Mech. (2025) 013302

Nearest-Neighbours Neural Network architecture for efficient sampling of statistical physics models

Authors: Luca Maria Del Bono, Federico Ricci-Tersenghi, Francesco Zamponi

Abstract: The task of sampling efficiently the Gibbs-Boltzmann distribution of disordered systems is important both for the theoretical understanding of these models and for the solution of practical optimization problems. Unfortunately, this task is known to be hard, especially for spin glasses at low temperatures. Recently, many attempts have been made to tackle the problem by mixing classical Monte Carlo… ▽ More The task of sampling efficiently the Gibbs-Boltzmann distribution of disordered systems is important both for the theoretical understanding of these models and for the solution of practical optimization problems. Unfortunately, this task is known to be hard, especially for spin glasses at low temperatures. Recently, many attempts have been made to tackle the problem by mixing classical Monte Carlo schemes with newly devised Neural Networks that learn to propose smart moves. In this article we introduce the Nearest-Neighbours Neural Network (4N) architecture, a physically-interpretable deep architecture whose number of parameters scales linearly with the size of the system and that can be applied to a large variety of topologies. We show that the 4N architecture can accurately learn the Gibbs-Boltzmann distribution for the two-dimensional Edwards-Anderson model, and specifically for some of its most difficult instances. In particular, it captures properties such as the energy, the correlation function and the overlap probability distribution. Finally, we show that the 4N performance increases with the number of layers, in a way that clearly connects to the correlation length of the system, thus providing a simple and interpretable criterion to choose the optimal depth. △ Less

Submitted 22 April, 2025; v1 submitted 28 July, 2024; originally announced July 2024.

Comments: Second version. 11 pages; SI: 5 pages

Journal ref: Mach. Learn.: Sci. Technol. 6, 025029 (2025)

A Very Effective and Simple Diffusion Reconstruction for the Diluted Ising Model

Authors: Stefano Bae, Enzo Marinari, Federico Ricci-Tersenghi

Abstract: Diffusion-based generative models are machine learning models that use diffusion processes to learn the probability distribution of high-dimensional data. In recent years, they have become extremely successful in generating multimedia content. However, it is still unknown if such models can be used to generate high-quality datasets of physical models. In this work, we use a Landau-Ginzburg-like di… ▽ More Diffusion-based generative models are machine learning models that use diffusion processes to learn the probability distribution of high-dimensional data. In recent years, they have become extremely successful in generating multimedia content. However, it is still unknown if such models can be used to generate high-quality datasets of physical models. In this work, we use a Landau-Ginzburg-like diffusion model to infer the distribution of a $2D$ bond-diluted Ising model. Our approach is simple and effective, and we show that the generated samples reproduce correctly the statistical and critical properties of the physical model. △ Less

Submitted 18 January, 2025; v1 submitted 9 July, 2024; originally announced July 2024.

Journal ref: Phys. Rev. E 111, L023301 (2025)

The most uniform distribution of points on the sphere

Authors: Luca Maria Del Bono, Flavio Nicoletti, Federico Ricci-Tersenghi

Abstract: How to distribute a set of points uniformly on a spherical surface is a very old problem that still lacks a definite answer. In this work, we introduce a physical measure of uniformity based on the distribution of distances between points, as an alternative to commonly adopted measures based on interaction potentials. We then use this new measure of uniformity to characterize several algorithms av… ▽ More How to distribute a set of points uniformly on a spherical surface is a very old problem that still lacks a definite answer. In this work, we introduce a physical measure of uniformity based on the distribution of distances between points, as an alternative to commonly adopted measures based on interaction potentials. We then use this new measure of uniformity to characterize several algorithms available in the literature. We also study the effect of optimizing the position of the points through the minimization of different interaction potentials via a gradient descent procedure. In this way, we can classify different algorithms and interaction potentials to find the one that generates the most uniform distribution of points on the sphere. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Comments: 17 pages, 15 figures

Journal ref: PLoS ONE 19, e0313863 (2024)

Analytical solution to Heisenberg spin glass models on sparse random graphs and their de Almeida-Thouless line

Authors: Luca Maria Del Bono, Flavio Nicoletti, Federico Ricci-Tersenghi

Abstract: Results regarding spin glass models are, to this day, mainly confined to models with Ising spins. Spin glass models with continuous spins exhibit interesting new physical behaviors related to the additional degrees of freedom, but have been primarily studied on fully connected topologies. Only recently some advancements have been made in the study of continuous models on sparse graphs. In this wor… ▽ More Results regarding spin glass models are, to this day, mainly confined to models with Ising spins. Spin glass models with continuous spins exhibit interesting new physical behaviors related to the additional degrees of freedom, but have been primarily studied on fully connected topologies. Only recently some advancements have been made in the study of continuous models on sparse graphs. In this work we partially fill this void by introducing a method to solve numerically the Belief Propagation equations for systems of Heisenberg spins on sparse random graphs via a discretization of the sphere. We introduce techniques to study the finite-temperature, finite-connectivity case as well as novel algorithms to deal with the zero-temperature and large connectivity limits. As an application, we locate the de Almeida-Thouless line for this class of models and the critical field at zero temperature, showing the full consistency of the methods presented. Beyond the specific results reported for Heisenberg models, the approaches presented in this paper have a much broader scope of application and pave the way to the solution of strongly disordered models with continuous variables. △ Less

Submitted 20 November, 2024; v1 submitted 24 June, 2024; originally announced June 2024.

Comments: 28 pages, 15 figures; added references

Journal ref: Phys. Rev. B 110, 184205 (2024)

Daydreaming Hopfield Networks and their surprising effectiveness on correlated data

Authors: Ludovica Serricchio, Dario Bocchi, Claudio Chilin, Raffaele Marino, Matteo Negri, Chiara Cammarota, Federico Ricci-Tersenghi

Abstract: To improve the storage capacity of the Hopfield model, we develop a version of the dreaming algorithm that perpetually reinforces the patterns to be stored (as in the Hebb rule), and erases the spurious memories (as in dreaming algorithms). For this reason, we called it Daydreaming. Daydreaming is not destructive and it converges asymptotically to stationary retrieval maps. When trained on random… ▽ More To improve the storage capacity of the Hopfield model, we develop a version of the dreaming algorithm that perpetually reinforces the patterns to be stored (as in the Hebb rule), and erases the spurious memories (as in dreaming algorithms). For this reason, we called it Daydreaming. Daydreaming is not destructive and it converges asymptotically to stationary retrieval maps. When trained on random uncorrelated examples, the model shows optimal performance in terms of the size of the basins of attraction of stored examples and the quality of reconstruction. We also train the Daydreaming algorithm on correlated data obtained via the random-features model and argue that it spontaneously exploits the correlations thus increasing even further the storage capacity and the size of the basins of attraction. Moreover, the Daydreaming algorithm is also able to stabilize the features hidden in the data. Finally, we test Daydreaming on the MNIST dataset and show that it still works surprisingly well, producing attractors that are close to unseen examples and class prototypes. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Journal ref: Neural Networks 186, 107216 (2025)

Small field chaos in spin glasses: universal predictions from the ultrametric tree and comparison with numerical simulations

Authors: Miguel Aguilar-Janita, Silvio Franz, Victor Martin-Mayor, Javier Moreno-Gordo, Giorgio Parisi, Federico Ricci-Tersenghi, Juan J. Ruiz-Lorenzo

Abstract: We study the chaotic behavior of the Gibbs state of spin-glasses under the application of an external magnetic field, in the crossover region where the field intensity scales proportional to $1/\sqrt{N}$, being $N$ the system size. We show that Replica Symmetry Breaking (RSB) theory provides universal predictions for chaotic behavior: they depend only on the zero-field overlap probability function… ▽ More We study the chaotic behavior of the Gibbs state of spin-glasses under the application of an external magnetic field, in the crossover region where the field intensity scales proportional to $1/\sqrt{N}$, being $N$ the system size. We show that Replica Symmetry Breaking (RSB) theory provides universal predictions for chaotic behavior: they depend only on the zero-field overlap probability function $P(q)$ and are independent of other features of the system. Using solely $P(q)$ as input we can analytically predict quantitatively the statistics of the states in a small field. In the infinite volume limit, each spin-glass sample is characterized by an infinite number of states that have a tree-like structure. We generate the corresponding probability distribution through efficient sampling using a representation based on the Bolthausen-Sznitman coalescent. In this way, we can compute quantitatively properties in the presence of a magnetic field in the crossover region, the overlap probability distribution in the presence of a small field and the degree of decorrelation as the field is increased. To test our computations, we have simulated the Bethe lattice spin glass and the 4D Edwards-Anderson model, finding in both cases excellent agreement with the universal predictions. △ Less

Submitted 27 September, 2024; v1 submitted 13 March, 2024; originally announced March 2024.

Comments: New version with modifications included after the review process and publication. 17 pages, 13 figures

Journal ref: PNAS 121 (40) e2404973121 (2024)

Multiscaling in the 3D critical site-diluted Ising ferromagnet

Authors: E. Marinari, V. Martin-Mayor, G. Parisi, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo

Abstract: We have studied numerically the appearance of multiscaling behavior in the three-dimensional ferromagnetic Ising site diluted model, in the form of a multifractal distribution of the decay exponents for the spatial correlation functions at the critical temperature. We have computed the exponents of the long-distance decay of higher moments of the correlation function, up to the 10th power, by stud… ▽ More We have studied numerically the appearance of multiscaling behavior in the three-dimensional ferromagnetic Ising site diluted model, in the form of a multifractal distribution of the decay exponents for the spatial correlation functions at the critical temperature. We have computed the exponents of the long-distance decay of higher moments of the correlation function, up to the 10th power, by studying three different quantities: global susceptibilities, local susceptibilities and correlation functions. We have found very clear evidences for multiscaling behavior. △ Less

Submitted 16 January, 2024; v1 submitted 13 September, 2023; originally announced September 2023.

Comments: 19 pages and 5 figures. Final version of the paper

Journal ref: J. Stat. Mech. (2024) 013301

Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems

Authors: Maria Chiara Angelini, Angelo Giorgio Cavaliere, Raffaele Marino, Federico Ricci-Tersenghi

Abstract: Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Me… ▽ More Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Metropolis Monte Carlo with a properly chosen temperature, which depends on the mini-batch size. This quantitative matching holds both at equilibrium and in the out-of-equilibrium regime, despite the two algorithms having fundamental differences (e.g.\ SGD does not satisfy detailed balance). Such equivalence allows us to use results about performances and limits of Monte Carlo algorithms to optimize the mini-batch size in the SGD-like algorithm and make it efficient at recovering the signal in hard inference problems. △ Less

Submitted 30 May, 2024; v1 submitted 11 September, 2023; originally announced September 2023.

Comments: 19 pages, 9 figures

Journal ref: Scientific Reports 14, 11638 (2024)

Parallel Learning by Multitasking Neural Networks

Authors: Elena Agliari, Andrea Alessandrelli, Adriano Barra, Federico Ricci-Tersenghi

Abstract: A modern challenge of Artificial Intelligence is learning multiple patterns at once (i.e.parallel learning). While this can not be accomplished by standard Hebbian associative neural networks, in this paper we show how the Multitasking Hebbian Network (a variation on theme of the Hopfield model working on sparse data-sets) is naturally able to perform this complex task. We focus on systems process… ▽ More A modern challenge of Artificial Intelligence is learning multiple patterns at once (i.e.parallel learning). While this can not be accomplished by standard Hebbian associative neural networks, in this paper we show how the Multitasking Hebbian Network (a variation on theme of the Hopfield model working on sparse data-sets) is naturally able to perform this complex task. We focus on systems processing in parallel a finite (up to logarithmic growth in the size of the network) amount of patterns, mirroring the low-storage level of standard associative neural networks at work with pattern recognition. For mild dilution in the patterns, the network handles them hierarchically, distributing the amplitudes of their signals as power-laws w.r.t. their information content (hierarchical regime), while, for strong dilution, all the signals pertaining to all the patterns are raised with the same strength (parallel regime). Further, confined to the low-storage setting (i.e., far from the spin glass limit), the presence of a teacher neither alters the multitasking performances nor changes the thresholds for learning: the latter are the same whatever the training protocol is supervised or unsupervised. Results obtained through statistical mechanics, signal-to-noise technique and Monte Carlo simulations are overall in perfect agreement and carry interesting insights on multiple learning at once: for instance, whenever the cost-function of the model is minimized in parallel on several patterns (in its description via Statistical Mechanics), the same happens to the standard sum-squared error Loss function (typically used in Machine Learning). △ Less

Submitted 8 August, 2023; originally announced August 2023.

Report number: Roma01.Math

Journal ref: J. Stat. Mech. (2023) 113401

Quantifying memory in spin glasses

Authors: Janus Collaboration, I. Paga, J. He, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel, B. Seoane , et al. (2 additional authors not shown)

Abstract: Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A thir… ▽ More Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A third coefficient has been recently presented by Freedberg et al. We show that these coefficients are physically equivalent by studying their temperature and waiting-time dependence. △ Less

Submitted 12 February, 2025; v1 submitted 5 July, 2023; originally announced July 2023.

Comments: 10 pages, 8 figures

Journal ref: Phys. Rev. Lett. 133, 256704 (2024)

Improved mean-field dynamical equations are able to detect the two-steps relaxation in glassy dynamics at low temperatures

Authors: David Machado, Roberto Mulet, Federico Ricci-Tersenghi

Abstract: We study the stochastic relaxation dynamics of the Ising p-spin model on a random graph, a well-known model with glassy dynamics at low temperatures. We introduce and discuss a new closure scheme for the master equation governing the continuous-time relaxation of the system, that translates into a set of differential equations for the evolution of local probabilities. The solution to these dynamic… ▽ More We study the stochastic relaxation dynamics of the Ising p-spin model on a random graph, a well-known model with glassy dynamics at low temperatures. We introduce and discuss a new closure scheme for the master equation governing the continuous-time relaxation of the system, that translates into a set of differential equations for the evolution of local probabilities. The solution to these dynamical mean-field equations describes very well the out-of-equilibrium dynamics at high temperatures, notwithstanding the key observation that the off-equilibrium probability measure contains higher-order interaction terms, not present in the equilibrium measure. In the low-temperature regime, the solution to the dynamical mean-field equations shows the correct two-step relaxation (a typical feature of the glassy dynamics), but with a relaxation timescale too short. We propose a solution to this problem by identifying the range of energies where entropic barriers play a key role and defining a renormalized microscopic timescale for the dynamical mean-field solution. The final result perfectly matches the complex out-of-equilibrium dynamics computed through extensive Monte Carlo simulations. △ Less

Submitted 1 November, 2023; v1 submitted 3 July, 2023; originally announced July 2023.

Comments: 24 pages, 9 figures

Journal ref: JSTAT 123301 (2023)

Multifractality in spin glasses

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz Sudupe, D. Navarro, I. Paga, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, D. Yllanes

Abstract: We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the comp… ▽ More We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the computation of the singularity spectrum and its corresponding Legendre transform. A comparatively small number of site pairs controls the average correlation that governs the response to a magnetic field. We explain how this scenario of dramatic fluctuations (at length scales smaller than the coherence length) can be reconciled with the smooth, self-averaging behavior that has long been considered to describe spin-glass dynamics. △ Less

Submitted 22 January, 2024; v1 submitted 7 June, 2023; originally announced June 2023.

Comments: 15 pages, 15 figures

Journal ref: PNAS 121, e2312880120 (2024)

Phase transitions in the mini-batch size for sparse and dense two-layer neural networks

Authors: Raffaele Marino, Federico Ricci-Tersenghi

Abstract: The use of mini-batches of data in training artificial neural networks is nowadays very common. Despite its broad usage, theories explaining quantitatively how large or small the optimal mini-batch size should be are missing. This work presents a systematic attempt at understanding the role of the mini-batch size in training two-layer neural networks. Working in the teacher-student scenario, with… ▽ More The use of mini-batches of data in training artificial neural networks is nowadays very common. Despite its broad usage, theories explaining quantitatively how large or small the optimal mini-batch size should be are missing. This work presents a systematic attempt at understanding the role of the mini-batch size in training two-layer neural networks. Working in the teacher-student scenario, with a sparse teacher, and focusing on tasks of different complexity, we quantify the effects of changing the mini-batch size $m$. We find that often the generalization performances of the student strongly depend on $m$ and may undergo sharp phase transitions at a critical value $m_c$, such that for $m<m_c$ the training process fails, while for $m>m_c$ the student learns perfectly or generalizes very well the teacher. Phase transitions are induced by collective phenomena firstly discovered in statistical mechanics and later observed in many fields of science. Observing a phase transition by varying the mini-batch size across different architectures raises several questions about the role of this hyperparameter in the neural network learning process. △ Less

Submitted 13 January, 2024; v1 submitted 10 May, 2023; originally announced May 2023.

Comments: 15 pages, 8 figures

Journal ref: Machine Learning: Science and Technology (2024)

Biased thermodynamics can explain the behaviour of smart optimization algorithms that work above the dynamical threshold

Authors: Angelo Giorgio Cavaliere, Federico Ricci-Tersenghi

Abstract: Random constraint satisfaction problems can display a very rich structure in the space of solutions, with often an ergodicity breaking -- also known as clustering or dynamical -- transition preceding the satisfiability threshold when the constraint-to-variables ratio $α$ is increased. However, smart algorithms start to fail finding solutions in polynomial time at some threshold $α_{\rm alg}$ which… ▽ More Random constraint satisfaction problems can display a very rich structure in the space of solutions, with often an ergodicity breaking -- also known as clustering or dynamical -- transition preceding the satisfiability threshold when the constraint-to-variables ratio $α$ is increased. However, smart algorithms start to fail finding solutions in polynomial time at some threshold $α_{\rm alg}$ which is algorithmic dependent and generally bigger than the dynamical one $α_d$. The reason for this discrepancy is due to the fact that $α_d$ is traditionally computed according to the uniform measure over all the solutions. Thus, while bounding the region where a uniform sampling of the solutions is easy, it cannot predict the performance of off-equilibrium processes, that are still able of finding atypical solutions even beyond $α_d$. Here we show that a reconciliation between algorithmic behaviour and thermodynamic prediction is nonetheless possible at least up to some threshold $α_d^{\rm opt}\geqα_d$, which is defined as the maximum value of the dynamical threshold computed on all possible probability measures over the solutions. We consider a simple Monte Carlo-based optimization algorithm, which is restricted to the solution space, and we demonstrate that sampling the equilibrium distribution of a biased measure improving on $α_d$ is still possible even beyond the ergodicity breaking point for the uniform measure, where other algorithms hopelessly enter the out-of-equilibrium regime. The conjecture we put forward is that many smart algorithms sample the solution space according to a biased measure: once this measure is identified, the algorithmic threshold is given by the corresponding ergodicity-breaking transition. △ Less

Submitted 26 March, 2023; originally announced March 2023.

On the superposition principle and non-linear response in spin glasses

Authors: I. Paga, Q. Zhai, M. Baity-Jesi, E. Calore, A. Cruz, C. Cummings, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, G. G. Kenning, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel , et al. (3 additional authors not shown)

Abstract: The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure… ▽ More The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure from linear response which they ascribe to the development of non-linear dynamics. The thrust of this paper is to develop a microscopic origin for this behavior by focusing on the time development of the spin glass correlation length, $ξ(t,t_\mathrm{w};H)$. Here, $t$ is the time after $H$ changes, and $t_\mathrm{w}$ is the time from the quench for $T>T_\mathrm{g}$ to the working temperature $T$ until $H$ changes. We connect the growth of $ξ(t,t_\mathrm{w};H)$ to the barrier heights $Δ(t_\mathrm{w})$ that set the dynamics. The effect of $H$ on the magnitude of $Δ(t_\mathrm{w})$ is responsible for affecting differently the two dynamical protocols associated with turning $H$ off (TRM, or thermoremanent magnetization) or on (ZFC, or zero field-cooled magnetization). In this paper, we display the difference between the zero-field cooled $ξ_{\text {ZFC}}(t,t_\mathrm{w};H)$ and the thermoremanent magnetization $ξ_{\text {TRM}}(t,t_\mathrm{w};H)$ correlation lengths as $H$ increases, both experimentally and through numerical simulations, corresponding to the violation of the extended principle of superposition in line with the finding of the Uppsala Group. △ Less

Submitted 26 June, 2023; v1 submitted 21 July, 2022; originally announced July 2022.

Comments: 23 pages and 18 figures

Journal ref: Phys. Rev. B 107, 214436- Published 23 June 2023

Memory and rejuvenation in spin glasses: aging systems are ruled by more than one length scale

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, I. Paga, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenat… ▽ More Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenation, these effects have thus far been impossible to simulate reliably. Yet, three recent developments convinced us to accept this challenge: first, the custom-built Janus II supercomputer makes it possible to carry out "numerical experiments" in which the very same quantities that can be measured in single crystals of CuMn are computed from the simulation, allowing for parallel analysis of the simulation/experiment data. Second, Janus II simulations have taught us how numerical and experimental length scales should be compared. Third, we have recently understood how temperature chaos materializes in aging dynamics. All three aspects have proved crucial for reliably reproducing rejuvenation and memory effects on the computer. Our analysis shows that (at least) three different length scales play a key role in aging dynamics, while essentially all theoretical analyses of the aging dynamics emphasize the presence and the crucial role of a single glassy correlation length. △ Less

Submitted 30 August, 2022; v1 submitted 13 July, 2022; originally announced July 2022.

Comments: Main text:13 pages, 4 figures SM: 7 pages, 8 figures

Journal ref: Nature Physics 19, 978-985 (2023)

The Ising spin glass on random graphs at zero temperature: not all spins are glassy in the glassy phase

Authors: Gianmarco Perrupato, Maria Chiara Angelini, Giorgio Parisi, Federico Ricci-Tersenghi, Tommaso Rizzo

Abstract: We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homoge… ▽ More We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homogeneously on the whole system. Indeed, there exist spins having the same effective local field in all local ground states, exactly as in the replica symmetric (RS) phase, while the spontaneous RSB manifests only on the remaining spins, whose fraction vanishes at criticality. The characterization in terms of spins having fixed or fluctuating local fields can be extended also to the random field Ising model (RFIM), in which case the fluctuating spins are the only responsible for the spontaneous magnetization in the ferromagnetic phase. Close to criticality we are able to connect the statistics of the local fields acting on the spins in the RSB phase with the correlation functions measured in the paramagnetic phase. Identifying the two types of spins on given instances of SG and RFIM, we show that they participate very differently to avalanches produced by flipping a single spin. From the scaling of the number of spins inducing RSB effects close to the critical point and using the $M$-layer expansion we estimate the upper critical dimension $D_U \geq 8$ for SG. △ Less

Submitted 10 November, 2022; v1 submitted 13 July, 2022; originally announced July 2022.

Comments: 8 pages, 6 figures

Journal ref: Phys. Rev. B 106, 174202 (2022)

The closest vector problem and the zero-temperature p-spin landscape for lossy compression

Authors: Alfredo Braunstein, Louise Budzynski, Stefano Crotti, Federico Ricci-Tersenghi

Abstract: We consider a high-dimensional random constrained optimization problem in which a set of binary variables is subjected to a linear system of equations. The cost function is a simple linear cost, measuring the Hamming distance with respect to a reference configuration. Despite its apparent simplicity, this problem exhibits a rich phenomenology. We show that different situations arise depending on t… ▽ More We consider a high-dimensional random constrained optimization problem in which a set of binary variables is subjected to a linear system of equations. The cost function is a simple linear cost, measuring the Hamming distance with respect to a reference configuration. Despite its apparent simplicity, this problem exhibits a rich phenomenology. We show that different situations arise depending on the random ensemble of linear systems. When each variable is involved in at most two linear constraints, we show that the problem can be partially solved analytically, in particular we show that upon convergence, the zero-temperature limit of the cavity equations returns the optimal solution. We then study the geometrical properties of more general random ensembles. In particular we observe a range in the density of constraints at which the systems enters a glassy phase where the cost function has many minima. Interestingly, the algorithmic performances are only sensitive to another phase transition affecting the structure of configurations allowed by the linear constraints. We also extend our results to variables belonging to $\text{GF}(q)$, the Galois Field of order $q$. We show that increasing the value of $q$ allows to achieve a better optimum, which is confirmed by the Replica Symmetric cavity method predictions. △ Less

Submitted 24 October, 2022; v1 submitted 1 July, 2022; originally announced July 2022.

Comments: 29 pages, 13 figures

Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent set

Authors: Maria Chiara Angelini, Federico Ricci-Tersenghi

Abstract: The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum inde… ▽ More The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum independent set (MIS). They conclude that "the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables." In this comment, we show that a simple greedy algorithm, running in almost linear time, can find solutions for the MIS problem of much better quality than the GNN. The greedy algorithm is faster by a factor of $10^4$ with respect to the GNN for problems with a million variables. We do not see any good reason for solving the MIS with these GNN, as well as for using a sledgehammer to crack nuts. In general, many claims of superiority of neural networks in solving combinatorial problems are at risk of being not solid enough, since we lack standard benchmarks based on really hard problems. We propose one of such hard benchmarks, and we hope to see future neural network optimizers tested on these problems before any claim of superiority is made. △ Less

Submitted 2 January, 2023; v1 submitted 27 June, 2022; originally announced June 2022.

Comments: Comment to "Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] https://www.nature.com/articles/s42256-022-00468-6

Journal ref: Nature Machine Intelligence (2022)

Limits and performances of algorithms based on simulated annealing in solving sparse hard inference problems

Authors: Maria Chiara Angelini, Federico Ricci-Tersenghi

Abstract: The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal… ▽ More The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal in the recovery of the planted solution because it gets attracted by glassy states that, instead, do not influence the BP algorithm. At variance with previous conjectures, we propose an analytic estimation for the SA algorithmic threshold by comparing the spinodal point of the paramagnetic phase and the dynamical critical temperature. This is a fundamental connection between thermodynamical phase transitions and out of equilibrium behavior of Glauber dynamics. We also study an improved version of SA, called replicated SA (RSA), where several weakly coupled replicas are cooled down together. We show numerical evidence that the algorithmic threshold for the RSA coincides with the Bayes optimal one. Finally, we develop an approximated analytical theory explaining the optimal performances of RSA and predicting the location of the transition towards the planted solution in the limit of a very large number of replicas. Our results for RSA support the idea that mismatching the parameters in the prior with respect to those of the generative model may produce an algorithm that is optimal and very robust. △ Less

Submitted 28 June, 2023; v1 submitted 9 June, 2022; originally announced June 2022.

Journal ref: Physical Review X 13.2 (2023): 021011

A generalized Hopfield model to store and retrieve mismatched memory patterns

Authors: Luca Leuzzi, Alberto Patti, Federico Ricci-Tersenghi

Abstract: We study a class of Hopfield models where the memories are represented by a mixture of Gaussian and binary variables and the neurons are Ising spins. We study the properties of this family of models as the relative weight of the two kinds of variables in the patterns varies. We quantitatively determine how the retrieval phase squeezes towards zero as the memory patterns contain a larger fraction o… ▽ More We study a class of Hopfield models where the memories are represented by a mixture of Gaussian and binary variables and the neurons are Ising spins. We study the properties of this family of models as the relative weight of the two kinds of variables in the patterns varies. We quantitatively determine how the retrieval phase squeezes towards zero as the memory patterns contain a larger fraction of mismatched variables. As the memory is purely Gaussian retrieval is lost for any positive storage capacity. It is shown that this comes about because of the spherical symmetry of the free energy in the Gaussian case. Introducing two different memory pattern overlaps between spin configurations and each contribution to the pattern from the two kinds of variables one can observe that the Gaussian parts of the patterns act as a noise, making retrieval more difficult. The basins of attraction of the states, the accuracy of the retrieval and the storage capacity are studied by means of Monte Carlo numerical simulations. We uncover that even in the limit where the network capacity shrinks to zero, the (few) retrieval states maintain a large basin of attraction and large overlaps with the mismatched patterns. So the network can be used for retrieval, but with a very small capacity. △ Less

Submitted 20 June, 2022; v1 submitted 9 April, 2022; originally announced April 2022.

Comments: 18 pages, 27 figures

Journal ref: J. Stat. Mech. (2022) 073301

Hard-Sphere Jamming through the Lens of Linear Optimization

Authors: Claudia Artiaco, Rafael Díaz Hernández Rojas, Giorgio Parisi, Federico Ricci-Tersenghi

Abstract: The jamming transition is ubiquitous. It is present in granular matter, colloids, glasses, and many other systems. Yet, it defines a critical point whose properties still need to be fully understood. A major breakthrough came about when the replica formalism was extended to build a mean-field theory that provides an exact description of the jamming transition of spherical particles in the infinite… ▽ More The jamming transition is ubiquitous. It is present in granular matter, colloids, glasses, and many other systems. Yet, it defines a critical point whose properties still need to be fully understood. A major breakthrough came about when the replica formalism was extended to build a mean-field theory that provides an exact description of the jamming transition of spherical particles in the infinite-dimensional limit. While such theory explains the jamming critical behavior of both soft and hard spheres, investigating the transition in finite-dimensional systems poses very difficult and different problems, in particular from the numerical point of view. Soft particles are modeled by continuous potentials; thus, their jamming point can be reached through efficient energy minimization algorithms. In contrast, the latter methods are inapplicable to hard-sphere (HS) systems since the interaction energy among the particles is always zero by construction. To overcome these difficulties, here we recast the jamming of hard spheres as a constrained optimization problem and introduce the CALiPPSO algorithm, capable of readily producing jammed HS packings without including any effective potential. This algorithm brings a HS configuration of arbitrary dimensions to its jamming point by solving a chain of linear optimization problems. We show that there is a strict correspondence between the force balance conditions of jammed packings and the properties of the optimal solutions of CALiPPSO, whence we prove analytically that our packings are always isostatic and in mechanical equilibrium. Furthermore, using extensive numerical simulations, we show that our algorithm is able to probe the complex structure of the free-energy landscape, finding qualitative agreement with mean-field predictions. We also characterize the algorithmic complexity of CALiPPSO and provide an open-source implementation of it. △ Less

Submitted 8 September, 2023; v1 submitted 10 March, 2022; originally announced March 2022.

Comments: Changed title to match the version published in PRE. Find our implementation of the CALiPPSO algorithm here: https://github.com/rdhr/CALiPPSO

Journal ref: Phys. Rev. E 106, 055310, 2022

Low energy excitations of mean-field glasses

Authors: Silvio Franz, Flavio Nicoletti, Federico Ricci-Tersenghi

Abstract: We study the linear excitations around typical energy minima of a mean-field disordered model with continuous degrees of freedom undergoing a Random First Order Transition (RFOT). Contrary to naive expectations, the spectra of linear excitations are ungapped and we find the presence of a pseudogap corresponding to localized excitations with arbitrary low excitation energy. Moving to deeper minima… ▽ More We study the linear excitations around typical energy minima of a mean-field disordered model with continuous degrees of freedom undergoing a Random First Order Transition (RFOT). Contrary to naive expectations, the spectra of linear excitations are ungapped and we find the presence of a pseudogap corresponding to localized excitations with arbitrary low excitation energy. Moving to deeper minima in the landscape, the excitations appear increasingly localized while their abundance decreases. Beside typical minima, there also exist rare ultra-stable minima, with an energy gap and no localised excitations. △ Less

Submitted 5 January, 2022; originally announced January 2022.

Nonequilibrium Monte Carlo for unfreezing variables in hard combinatorial optimization

Authors: Masoud Mohseni, Daniel Eppens, Johan Strumpfer, Raffaele Marino, Vasil Denchev, Alan K. Ho, Sergei V. Isakov, Sergio Boixo, Federico Ricci-Tersenghi, Hartmut Neven

Abstract: Optimizing highly complex cost/energy functions over discrete variables is at the heart of many open problems across different scientific disciplines and industries. A major obstacle is the emergence of many-body effects among certain subsets of variables in hard instances leading to critical slowing down or collective freezing for known stochastic local search strategies. An exponential computati… ▽ More Optimizing highly complex cost/energy functions over discrete variables is at the heart of many open problems across different scientific disciplines and industries. A major obstacle is the emergence of many-body effects among certain subsets of variables in hard instances leading to critical slowing down or collective freezing for known stochastic local search strategies. An exponential computational effort is generally required to unfreeze such variables and explore other unseen regions of the configuration space. Here, we introduce a quantum-inspired family of nonlocal Nonequilibrium Monte Carlo (NMC) algorithms by developing an adaptive gradient-free strategy that can efficiently learn key instance-wise geometrical features of the cost function. That information is employed on-the-fly to construct spatially inhomogeneous thermal fluctuations for collectively unfreezing variables at various length scales, circumventing costly exploration versus exploitation trade-offs. We apply our algorithm to two of the most challenging combinatorial optimization problems: random k-satisfiability (k-SAT) near the computational phase transitions and Quadratic Assignment Problems (QAP). We observe significant speedup and robustness over both specialized deterministic solvers and generic stochastic solvers. In particular, for 90% of random 4-SAT instances we find solutions that are inaccessible for the best specialized deterministic algorithm known as Survey Propagation (SP) with an order of magnitude improvement in the quality of solutions for the hardest 10% instances. We also demonstrate two orders of magnitude improvement in time-to-solution over the state-of-the-art generic stochastic solver known as Adaptive Parallel Tempering (APT). △ Less

Submitted 26 November, 2021; originally announced November 2021.

Comments: 28 pages, 18 figures

Optimization of the dynamic transition in the continuous coloring problem

Authors: Angelo Giorgio Cavaliere, Thibault Lesieur, Federico Ricci-Tersenghi

Abstract: Random constraint satisfaction problems can exhibit a phase where the number of constraints per variable $α$ makes the system solvable in theory on the one hand, but also makes the search for a solution hard, meaning that common algorithms such as Monte-Carlo method fail to find a solution. The onset of this hardness is deeply linked to the appearance of a dynamical phase transition where the phas… ▽ More Random constraint satisfaction problems can exhibit a phase where the number of constraints per variable $α$ makes the system solvable in theory on the one hand, but also makes the search for a solution hard, meaning that common algorithms such as Monte-Carlo method fail to find a solution. The onset of this hardness is deeply linked to the appearance of a dynamical phase transition where the phase space of the problem breaks into an exponential number of clusters. The exact position of this dynamical phase transition is not universal with respect to the details of the Hamiltonian one chooses to represent a given problem. In this paper, we develop some theoretical tools in order to find a systematic way to build a Hamiltonian that maximizes the dynamic $α_{\rm d}$ threshold. To illustrate our techniques, we will concentrate on the problem of continuous coloring, where one tries to set an angle $x_i \in [0;2π]$ on each node of a network in such a way that no adjacent nodes are closer than some threshold angle $θ$, that is $\cos(x_i - x_j) \leq \cosθ$. This problem can be both seen as a continuous version of the discrete graph coloring problem or as a one-dimensional version of the the Mari-Krzakala-Kurchan (MKK) model. The relevance of this model stems from the fact that continuous constraint satisfaction problems on sparse random graphs remain largely unexplored in statistical physics. We show that for sufficiently small angle $θ$ this model presents a random first order transition and compute the dynamical, condensation and Kesten-Stigum transitions; we also compare the analytical predictions with Monte Carlo simulations for values of $θ= 2π/q$, $q \in \mathbb{N}$. Choosing such values of $q$ allows us to easily compare our results with the renowned problem of discrete coloring. △ Less

Submitted 28 September, 2021; originally announced September 2021.

Journal ref: J. Stat. Mech. 113302 (2021)

Delocalization transition in low energy excitation modes of vector spin glasses

Authors: Silvio Franz, Flavio Nicoletti, Giorgio Parisi, Federico Ricci-Tersenghi

Abstract: We study the energy minima of the fully-connected $m$-components vector spin glass model at zero temperature in an external magnetic field for $m\ge 3$. The model has a zero temperature transition from a paramagnetic phase at high field to a spin glass phase at low field. We study the eigenvalues and eigenvectors of the Hessian in the minima of the Hamiltonian. The spectrum is gapless both in the… ▽ More We study the energy minima of the fully-connected $m$-components vector spin glass model at zero temperature in an external magnetic field for $m\ge 3$. The model has a zero temperature transition from a paramagnetic phase at high field to a spin glass phase at low field. We study the eigenvalues and eigenvectors of the Hessian in the minima of the Hamiltonian. The spectrum is gapless both in the paramagnetic and in the spin glass phase, with a pseudo-gap behaving as $λ^{m-1}$ in the paramagnetic phase and as $\sqrtλ$ in the spin glass phase. Despite the long-range nature of the model, the eigenstates close to the edge of the spectrum display quasi-localization properties. We show that the paramagnetic to spin glass transition corresponds to delocalization of the edge eigenvectors. We solve the model by the cavity method in the thermodynamic limit. We also perform numerical minimization of the Hamiltonian for $N\le 2048$ and compute the spectral properties, that show very strong corrections to the asymptotic scaling approaching the critical point. △ Less

Submitted 25 August, 2021; originally announced August 2021.

Journal ref: SciPost Phys. 12, 016 (2022)

Numerical test of the replica-symmetric Hamiltonian for the correlations of the critical state of spin glasses in a field

Authors: L. A. Fernandez, I. Gonzalez-Adalid Pemartin, V. Martin-Mayor, G. Parisi, F. Ricci-Tersenghi, T. Rizzo, J. J. Ruiz-Lorenzo, M. Veca

Abstract: A growing body of evidence indicates that the sluggish low-temperature dynamics of glass formers (e.g. supercooled liquids, colloids or spin glasses) is due to a growing correlation length. Which is the effective field theory that describes these correlations? The natural field theory was drastically simplified by Bray and Roberts in 1980. More than forty years later, we confirm the tenets of Bray… ▽ More A growing body of evidence indicates that the sluggish low-temperature dynamics of glass formers (e.g. supercooled liquids, colloids or spin glasses) is due to a growing correlation length. Which is the effective field theory that describes these correlations? The natural field theory was drastically simplified by Bray and Roberts in 1980. More than forty years later, we confirm the tenets of Bray and Roberts theory by studying the Ising spin glass in an externally applied magnetic field, both in four spatial dimensions (data obtained from the Janus collaboration) and on the Bethe lattice. △ Less

Submitted 10 April, 2022; v1 submitted 14 July, 2021; originally announced July 2021.

Comments: 8 pages, 4 figures, accepted in PRE

Journal ref: Phys. Rev. E 105, 054106 (2022)

Unexpected upper critical dimension for spin glass models in a field predicted by the loop expansion around the Bethe solution at zero temperature

Authors: Maria Chiara Angelini, Carlo Lucibello, Giorgio Parisi, Gianmarco Perrupato, Federico Ricci-Tersenghi, Tommaso Rizzo

Abstract: The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theo… ▽ More The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theory fails is $D_U \le 8$, at variance with the classical result $D_U = 6$ yielded by finite-temperature replica field theory. Our expansion around the Bethe lattice has two crucial differences with respect to the classical one. The finite connectivity $z$ of the lattice is directly included from the beginning in the Bethe lattice, while in the classical computation the finite connectivity is obtained through an expansion in $1/z$. Moreover, if one is interested in the zero temperature ($T = 0$) transition, one can directly expand around the $T = 0$ Bethe transition. The expansion directly at $T = 0$ is not possible in the classical framework because the fully connected spin glass does not have a transition at $T = 0$, being in the broken phase for any value of the external field. △ Less

Submitted 16 March, 2022; v1 submitted 31 March, 2021; originally announced March 2021.

Comments: 14 pages, 4 figures

Journal ref: Phys. Rev. Lett. 128, 075702 (2022)

How we are leading a 3-XORSAT challenge: from the energy landscape to the algorithm and its efficient implementation on GPUs

Authors: M. Bernaschi, M. Bisson, M. Fatica, E. Marinari, V. Martin-Mayor, G. Parisi, F. Ricci-Tersenghi

Abstract: A recent 3-XORSAT challenge required to minimize a very complex and rough energy function, typical of glassy models with a random first order transition and a golf course like energy landscape. We present the ideas beyond the quasi-greedy algorithm and its very efficient implementation on GPUs that are allowing us to rank first in such a competition. We suggest a better protocol to compare algorit… ▽ More A recent 3-XORSAT challenge required to minimize a very complex and rough energy function, typical of glassy models with a random first order transition and a golf course like energy landscape. We present the ideas beyond the quasi-greedy algorithm and its very efficient implementation on GPUs that are allowing us to rank first in such a competition. We suggest a better protocol to compare algorithmic performances and we also provide analytical predictions about the exponential growth of the times to find the solution in terms of free-energy barriers. △ Less

Submitted 24 February, 2021; v1 submitted 18 February, 2021; originally announced February 2021.

Comments: 7 pages, 7 figure, EPL format + SM (2 pages)

Journal ref: EPL, 133 (2021) 60005

Entropic barriers as a reason for hardness in both classical and quantum algorithms

Authors: Matteo Bellitti, Federico Ricci-Tersenghi, Antonello Scardicchio

Abstract: We study both classical and quantum algorithms to solve a hard optimization problem, namely 3-XORSAT on 3-regular random graphs. By introducing a new quasi-greedy algorithm that is not allowed to jump over large energy barriers, we show that the problem hardness is mainly due to entropic barriers. We study, both analytically and numerically, several optimization algorithms, finding that entropic b… ▽ More We study both classical and quantum algorithms to solve a hard optimization problem, namely 3-XORSAT on 3-regular random graphs. By introducing a new quasi-greedy algorithm that is not allowed to jump over large energy barriers, we show that the problem hardness is mainly due to entropic barriers. We study, both analytically and numerically, several optimization algorithms, finding that entropic barriers affect in a similar way classical local algorithms and quantum annealing. For the adiabatic algorithm, the difficulty we identify is distinct from that of tunnelling under large barriers, but does, nonetheless, give rise to exponential running (annealing) times. △ Less

Submitted 24 February, 2021; v1 submitted 30 January, 2021; originally announced February 2021.

Comments: 16 pages, 17 figures

Journal ref: Phys. Rev. Research 3, 043015 (2021)

Spin-glass dynamics in the presence of a magnetic field: exploration of microscopic properties

Authors: I. Paga, Q. Zhai, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel, B. Seoane, A. Tarancon , et al. (2 additional authors not shown)

Abstract: The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cool… ▽ More The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cooled down to a stabilised measuring temperature $T<T_\mathrm{g}$ and of the time $t$ after the magnetic field is changed. This correlation length is extracted experimentally for a CuMn 6 at. % single crystal, as well as for simulations on the Janus II special-purpose supercomputer, the latter with time and length scales comparable to experiment. The non-linear magnetic susceptibility is reported from experiment and simulations, using $ξ(t,t_\mathrm{w};T)$ as the scaling variable. Previous experiments are reanalysed, and disagreements about the nature of the Zeeman energy are resolved. The growth of the spin-glass magnetisation in zero-field magnetisation experiments, $M_\mathrm{ZFC}(t,t_\mathrm{w};T)$, is measured from simulations, verifying the scaling relationships in the dynamical or non-equilibrium regime. Our preliminary search for the de Almeida-Thouless line in $D=3$ is discussed. △ Less

Submitted 10 March, 2021; v1 submitted 4 January, 2021; originally announced January 2021.

Comments: 49 pages, figures 25

Journal ref: J. Stat. Mech. (2021) 033301

Finite size effects in the microscopic critical properties of jammed configurations: A comprehensive study of the effects of different types of disorder

Authors: Patrick Charbonneau, Eric I. Corwin, R. Cameron Dennis, Rafael Díaz Hernández Rojas, Harukuni Ikeda, Giorgio Parisi, Federico Ricci-Tersenghi

Abstract: Jamming criticality defines a universality class that includes systems as diverse as glasses, colloids, foams, amorphous solids, constraint satisfaction problems, neural networks, etc. A particularly interesting feature of this class is that small interparticle forces ($f$) and gaps ($h$) are distributed according to nontrivial power laws. A recently developed mean-field (MF) theory predicts the c… ▽ More Jamming criticality defines a universality class that includes systems as diverse as glasses, colloids, foams, amorphous solids, constraint satisfaction problems, neural networks, etc. A particularly interesting feature of this class is that small interparticle forces ($f$) and gaps ($h$) are distributed according to nontrivial power laws. A recently developed mean-field (MF) theory predicts the characteristic exponents of these distributions in the limit of very high spatial dimension, $d\rightarrow\infty$ and, remarkably, their values seemingly agree with numerical estimates in physically relevant dimensions, $d=2$ and $3$. These exponents are further connected through a pair of inequalities derived from stability conditions, and both theoretical predictions and previous numerical investigations suggest that these inequalities are saturated. Systems at the jamming point are thus only marginally stable. Despite the key physical role played by these exponents, their systematic evaluation has yet to be attempted. Here, we carefully test their value by analyzing the finite-size scaling of the distributions of $f$ and $h$ for various particle-based models for jamming. Both dimension and the direction of approach to the jamming point are also considered. We show that, in all models, finite-size effects are much more pronounced in the distribution of $h$ than in that of $f$. We thus conclude that gaps are correlated over considerably longer scales than forces. Additionally, remarkable agreement with MF predictions is obtained in all but one model, namely near-crystalline packings. Our results thus help to better delineate the domain of the jamming universality class. We furthermore uncover a secondary linear regime in the distribution tails of both $f$ and $h$. This surprisingly robust feature is understood to follow from the (near) isostaticity of our configurations. △ Less

Submitted 7 July, 2021; v1 submitted 21 November, 2020; originally announced November 2020.

Comments: Version accepted for publication

Journal ref: Phys. Rev. E 104, 014102 (2021)

Temperature chaos is present in off-equilibrium spin-glass dynamics

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, I. Paga, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of rec… ▽ More We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of recent and forthcoming experiments. This work has been made possible thanks to the most massive simulation to date of non-equilibrium dynamics, carried out on the Janus~II custom-built supercomputer. △ Less

Submitted 6 July, 2021; v1 submitted 18 November, 2020; originally announced November 2020.

Comments: Version accepted for publication in Communication Physics 10 pages, 9 figures

Journal ref: Communications Physics 4, 74 (2021)

Gradient descent dynamics in the mixed $p$-spin spherical model: finite size simulation and comparison with mean-field integration

Authors: Giampaolo Folena, Silvio Franz, Federico Ricci-Tersenghi

Abstract: We perform numerical simulations of a long-range spherical spin glass with two and three body interaction terms. We study the gradient descent dynamics and the inherent structures found after a quench from initial conditions, well thermalized at temperature $T_{in}$. In large systems, the dynamics strictly agrees with the integration of the mean-field dynamical equations. In particular, we confirm… ▽ More We perform numerical simulations of a long-range spherical spin glass with two and three body interaction terms. We study the gradient descent dynamics and the inherent structures found after a quench from initial conditions, well thermalized at temperature $T_{in}$. In large systems, the dynamics strictly agrees with the integration of the mean-field dynamical equations. In particular, we confirm the existence of an onset initial temperature, within the liquid phase, below which the energy of the inherent structures undoubtedly depends on $T_{in}$. This behavior is in contrast with that of pure models, where there is a 'threshold energy' that attracts all the initial configurations in the liquid. Our results strengthen the analogy between mean-field spin glass models and supercooled liquids. △ Less

Submitted 30 November, 2020; v1 submitted 15 July, 2020; originally announced July 2020.

Comments: 15 pages, 8 figures

MSC Class: 82C44 ACM Class: J.2

Journal ref: J. Stat. Mech. (2021) 033302

Scaling law describes the spin-glass response in theory, experiments and simulations

Authors: Q. Zhai, I. Paga, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel, B. Seoane, A. Tarancon , et al. (2 additional authors not shown)

Abstract: The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-g… ▽ More The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-glass correlation length. The scaling law is successfully tested against experimental measurements in a CuMn single crystal and against large-scale simulations on the Janus II dedicated computer. △ Less

Submitted 30 November, 2020; v1 submitted 7 July, 2020; originally announced July 2020.

Comments: Revised version, including supplemental material

Journal ref: Phys. Rev. Lett. 125, 237202 (2020)

Solving the fully-connected spherical $p$-spin model with the cavity method: equivalence with the replica results

Authors: Giacomo Gradenigo, Maria Chiara Angelini, Luca Leuzzi, Federico Ricci-Tersenghi

Abstract: The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to s… ▽ More The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to spherical models. Here we show how to write the cavity equations for spherical $p$-spin models on complete graphs, both in the Replica Symmetric (RS) ansatz (corresponding to Belief Propagation) and in the 1-step Replica Symmetry Breaking (1RSB) ansatz (corresponding to Survey Propagation). The cavity equations can be solved by a Gaussian (RS) and multivariate Gaussian (1RSB) ansatz for the distribution of the cavity fields. We compute the free energy in both ansatzes and check that the results are identical to the replica computation, predicting a phase transition to a 1RSB phase at low temperatures. The advantages of solving the model with the cavity method are many. The physical meaning of any ansatz for the cavity marginals is very clear. The cavity method works directly with the distribution of local quantities, which allows to generalize the method to dilute graphs. What we are presenting here is the first step towards the solution of the diluted version of the spherical $p$-spin model, which is a fundamental model in the theory of random lasers and interesting $per~se$ as an easier-to-simulate version of the classical fully-connected $p$-spin model. △ Less

Submitted 5 February, 2021; v1 submitted 3 July, 2020; originally announced July 2020.

Comments: 26 pages

Journal ref: J. Stat. Mech. 113302 (2020)