-
Networks of neural networks: more is different
Authors:
Elena Agliari,
Andrea Alessandrelli,
Adriano Barra,
Martino Salomone Centonze,
Federico Ricci-Tersenghi
Abstract:
The common thread behind the recent Nobel Prize in Physics to John Hopfield and those conferred to Giorgio Parisi in 2021 and Philip Anderson in 1977 is disorder. Quoting Philip Anderson: "more is different". This principle has been extensively demonstrated in magnetic systems and spin glasses, and, in this work, we test its validity on Hopfield neural networks to show how an assembly of these mod…
▽ More
The common thread behind the recent Nobel Prize in Physics to John Hopfield and those conferred to Giorgio Parisi in 2021 and Philip Anderson in 1977 is disorder. Quoting Philip Anderson: "more is different". This principle has been extensively demonstrated in magnetic systems and spin glasses, and, in this work, we test its validity on Hopfield neural networks to show how an assembly of these models displays emergent capabilities that are not present at a single network level. Such an assembly is designed as a layered associative Hebbian network that, beyond accomplishing standard pattern recognition, spontaneously performs also pattern disentanglement. Namely, when inputted with a composite signal -- e.g., a musical chord -- it can return the single constituting elements -- e.g., the notes making up the chord. Here, restricting to notes coded as Rademacher vectors and chords that are their mixtures (i.e., spurious states), we use tools borrowed from statistical mechanics of disordered systems to investigate this task, obtaining the conditions over the model control-parameters such that pattern disentanglement is successfully executed.
△ Less
Submitted 28 January, 2025;
originally announced January 2025.
-
The thermodynamic limit in mean field neural networks
Authors:
Elena Agliari,
Adriano Barra,
Pierluigi Bianco,
Alberto Fachechi,
Diego Pallara
Abstract:
In the last five decades, mean-field neural-networks have played a crucial role in modelling associative memories and, in particular, the Hopfield model has been extensively studied using tools borrowed from the statistical mechanics of spin glasses. However, achieving mathematical control of the infinite-volume limit of the model's free-energy has remained elusive, as the standard treatments deve…
▽ More
In the last five decades, mean-field neural-networks have played a crucial role in modelling associative memories and, in particular, the Hopfield model has been extensively studied using tools borrowed from the statistical mechanics of spin glasses. However, achieving mathematical control of the infinite-volume limit of the model's free-energy has remained elusive, as the standard treatments developed for spin-glasses have proven unfeasible. Here we address this long-standing problem by proving that a measure-concentration assumption for the order parameters of the theory is sufficient for the existence of the asymptotic limit of the model's free energy. The proof leverages the equivalence between the free energy of the Hopfield model and a linear combination of the free energies of a hard and a soft spin-glass, whose thermodynamic limits are rigorously known. Our work focuses on the replica-symmetry level of description (for which we recover the explicit expression of the free-energy found in the eighties via heuristic methods), yet, our scheme is expected to work also under (at least) the first step of replica symmetry breaking.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
Replica symmetry breaking in dense neural networks
Authors:
Linda Albanese,
Francesco Alemanno,
Andrea Alessandrelli,
Adriano Barra
Abstract:
Understanding the glassy nature of neural networks is pivotal both for theoretical and computational advances in Machine Learning and Theoretical Artificial Intelligence. Keeping the focus on dense associative Hebbian neural networks, the purpose of this paper is two-fold: at first we develop rigorous mathematical approaches to address properly a statistical mechanical picture of the phenomenon of…
▽ More
Understanding the glassy nature of neural networks is pivotal both for theoretical and computational advances in Machine Learning and Theoretical Artificial Intelligence. Keeping the focus on dense associative Hebbian neural networks, the purpose of this paper is two-fold: at first we develop rigorous mathematical approaches to address properly a statistical mechanical picture of the phenomenon of {\em replica symmetry breaking} (RSB) in these networks, then -- deepening results stemmed via these routes -- we aim to inspect the {\em glassiness} that they hide. In particular, regarding the methodology, we provide two techniques: the former is an adaptation of the transport PDE to the case, while the latter is an extension of Guerra's interpolation breakthrough. Beyond coherence among the results, either in replica symmetric and in the one-step replica symmetry breaking level of description, we prove the Gardner's picture and we identify the maximal storage capacity by a ground-state analysis in the Baldi-Venkatesh high-storage regime.
In the second part of the paper we investigate the glassy structure of these networks: in contrast with the replica symmetric scenario (RS), RSB actually stabilizes the spin-glass phase. We report huge differences w.r.t. the standard pairwise Hopfield limit: in particular, it is known that it is possible to express the free energy of the Hopfield neural network as a linear combination of the free energies of an hard spin glass (i.e. the Sherrington-Kirkpatrick model) and a soft spin glass (the Gaussian or "spherical" model). This is no longer true when interactions are more than pairwise (whatever the level of description, RS or RSB): for dense networks solely the free energy of the hard spin glass survives, proving a huge diversity in the underlying glassiness of associative neural networks.
△ Less
Submitted 25 November, 2021;
originally announced November 2021.
-
Replica symmetry breaking in neural networks: a few steps toward rigorous results
Authors:
Elena Agliari,
Linda Albanese,
Adriano Barra,
Gabriele Ottaviani
Abstract:
In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e., a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): this is…
▽ More
In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e., a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): this is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the Authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered at $J_0$ and with finite variance $J$; the mean $J_0$ plays the role of a signal to be detected in a noisy environment tuned by $J$, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at the K-th step (K arbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following the ziqqurat ansatz) and that the Mattis magnetization is self-averaging, we recover previous results obtained via replica-trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kühn (2RSB).
△ Less
Submitted 30 May, 2020;
originally announced June 2020.
-
Annealing and replica-symmetry in Deep Boltzmann Machines
Authors:
Diego Alberici,
Adriano Barra,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
In this paper we study the properties of the quenched pressure of a multi-layer spin-glass model (a deep Boltzmann Machine in artificial intelligence jargon) whose pairwise interactions are allowed between spins lying in adjacent layers and not inside the same layer nor among layers at distance larger than one. We prove a theorem that bounds the quenched pressure of such a K-layer machine in terms…
▽ More
In this paper we study the properties of the quenched pressure of a multi-layer spin-glass model (a deep Boltzmann Machine in artificial intelligence jargon) whose pairwise interactions are allowed between spins lying in adjacent layers and not inside the same layer nor among layers at distance larger than one. We prove a theorem that bounds the quenched pressure of such a K-layer machine in terms of K Sherrington-Kirkpatrick spin glasses and use it to investigate its annealed region. The replica-symmetric approximation of the quenched pressure is identified and its relation to the annealed one is considered. The paper also presents some observation on the model's architectural structure related to machine learning. Since escaping the annealed region is mandatory for a meaningful training, by squeezing such region we obtain thermodynamical constraints on the form factors. Remarkably, its optimal escape is achieved by requiring the last layer to scale sub-linearly in the network size.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
Dreaming neural networks: forgetting spurious memories and reinforcing pure ones
Authors:
Alberto Fachechi,
Elena Agliari,
Adriano Barra
Abstract:
The standard Hopfield model for associative neural networks accounts for biological Hebbian learning and acts as the harmonic oscillator for pattern recognition, however its maximal storage capacity is $α\sim 0.14$, far from the theoretical bound for symmetric networks, i.e. $α=1$. Inspired by sleeping and dreaming mechanisms in mammal brains, we propose an extension of this model displaying the s…
▽ More
The standard Hopfield model for associative neural networks accounts for biological Hebbian learning and acts as the harmonic oscillator for pattern recognition, however its maximal storage capacity is $α\sim 0.14$, far from the theoretical bound for symmetric networks, i.e. $α=1$. Inspired by sleeping and dreaming mechanisms in mammal brains, we propose an extension of this model displaying the standard on-line (awake) learning mechanism (that allows the storage of external information in terms of patterns) and an off-line (sleep) unlearning$\&$consolidating mechanism (that allows spurious-pattern removal and pure-pattern reinforcement): this obtained daily prescription is able to saturate the theoretical bound $α=1$, remaining also extremely robust against thermal noise. Both neural and synaptic features are analyzed both analytically and numerically. In particular, beyond obtaining a phase diagram for neural dynamics, we focus on synaptic plasticity and we give explicit prescriptions on the temporal evolution of the synaptic matrix. We analytically prove that our algorithm makes the Hebbian kernel converge with high probability to the projection matrix built over the pure stored patterns. Furthermore, we obtain a sharp and explicit estimate for the "sleep rate" in order to ensure such a convergence. Finally, we run extensive numerical simulations (mainly Monte Carlo sampling) to check the approximations underlying the analytical investigations (e.g., we developed the whole theory at the so called replica-symmetric level, as standard in the Amit-Gutfreund-Sompolinsky reference framework) and possible finite-size effects, finding overall full agreement with the theory.
△ Less
Submitted 29 October, 2018;
originally announced October 2018.
-
The Relativistic Hopfield network: rigorous results
Authors:
Elena Agliari,
Adriano Barra,
Matteo Notarnicola
Abstract:
The relativistic Hopfield model constitutes a generalization of the standard Hopfield model that is derived by the formal analogy between the statistical-mechanic framework embedding neural networks and the Lagrangian mechanics describing a fictitious single-particle motion in the space of the tuneable parameters of the network itself. In this analogy the cost-function of the Hopfield model plays…
▽ More
The relativistic Hopfield model constitutes a generalization of the standard Hopfield model that is derived by the formal analogy between the statistical-mechanic framework embedding neural networks and the Lagrangian mechanics describing a fictitious single-particle motion in the space of the tuneable parameters of the network itself. In this analogy the cost-function of the Hopfield model plays as the standard kinetic-energy term and its related Mattis overlap (naturally bounded by one) plays as the velocity. The Hamiltonian of the relativisitc model, once Taylor-expanded, results in a P-spin series with alternate signs: the attractive contributions enhance the information-storage capabilities of the network, while the repulsive contributions allow for an easier unlearning of spurious states, conferring overall more robustness to the system as a whole. Here we do not deepen the information processing skills of this generalized Hopfield network, rather we focus on its statistical mechanical foundation. In particular, relying on Guerra's interpolation techniques, we prove the existence of the infinite volume limit for the model free-energy and we give its explicit expression in terms of the Mattis overlaps. By extremizing the free energy over the latter we get the generalized self-consistent equations for these overlaps, as well as a picture of criticality that is further corroborated by a fluctuation analysis. These findings are in full agreement with the available previous results.
△ Less
Submitted 29 October, 2018;
originally announced October 2018.
-
Neural Networks retrieving Boolean patterns in a sea of Gaussian ones
Authors:
Elena Agliari,
Adriano Barra,
Chiara Longo,
Daniele Tantari
Abstract:
Restricted Boltzmann Machines are key tools in Machine Learning and are described by the energy function of bipartite spin-glasses. From a statistical mechanical perspective, they share the same Gibbs measure of Hopfield networks for associative memory. In this equivalence, weights in the former play as patterns in the latter. As Boltzmann machines usually require real weights to be trained with g…
▽ More
Restricted Boltzmann Machines are key tools in Machine Learning and are described by the energy function of bipartite spin-glasses. From a statistical mechanical perspective, they share the same Gibbs measure of Hopfield networks for associative memory. In this equivalence, weights in the former play as patterns in the latter. As Boltzmann machines usually require real weights to be trained with gradient descent like methods, while Hopfield networks typically store binary patterns to be able to retrieve, the investigation of a mixed Hebbian network, equipped with both real (e.g., Gaussian) and discrete (e.g., Boolean) patterns naturally arises. We prove that, in the challenging regime of a high storage of real patterns, where retrieval is forbidden, an extra load of Boolean patterns can still be retrieved, as long as the ratio among the overall load and the network size does not exceed a critical threshold, that turns out to be the same of the standard Amit-Gutfreund-Sompolinsky theory. Assuming replica symmetry, we study the case of a low load of Boolean patterns combining the stochastic stability and Hamilton-Jacobi interpolating techniques. The result can be extended to the high load by a non rigorous but standard replica computation argument.
△ Less
Submitted 15 March, 2017;
originally announced March 2017.
-
Exact solution of the van der Waals model in the critical region
Authors:
Adriano Barra,
Antonio Moro
Abstract:
The celebrated van der Waals model describes simple fluids in the thermodynamic limit and predicts the existence of a critical point associated to the gas-liquid phase transition. However the behaviour of critical isotherms according to the equation of state, where a gas-liquid phase transition occurs, significantly departs from experimental observations. The correct critical isotherms are heurist…
▽ More
The celebrated van der Waals model describes simple fluids in the thermodynamic limit and predicts the existence of a critical point associated to the gas-liquid phase transition. However the behaviour of critical isotherms according to the equation of state, where a gas-liquid phase transition occurs, significantly departs from experimental observations. The correct critical isotherms are heuristically re-established via the Maxwell equal areas rule. A long standing open problem in mean field theory is concerned with the analytic description of van der Waals isotherms for a finite size system that is consistent, in the thermodynamic limit, with the Maxwell prescription. Inspired by the theory of nonlinear conservation laws, we propose a novel mean field approach, based on statistical mechanics, that allows to calculate the van der Waals partition function for a system of large but finite number of particles $N$. Our partition function naturally extends to the whole space of thermodynamic variables, reproduces, in the thermodynamic limit $N\to \infty$, the classical results outside the critical region and automatically encodes Maxwell's prescription. We show that isothermal curves evolve in the space of thermodynamic variables like nonlinear breaking waves and the criticality is explained as the mechanism of formation of a classical hydrodynamic shock.
△ Less
Submitted 1 May, 2015; v1 submitted 5 December, 2014;
originally announced December 2014.
-
Meta-stable states in the hierarchical Dyson model drive parallel processing in the hierarchical Hopfield network
Authors:
Elena Agliari,
Adriano Barra,
Andrea Galluzzi,
Francesco Guerra,
Daniele Tantari,
Flavia Tavani
Abstract:
In this paper we introduce and investigate the statistical mechanics of hierarchical neural networks: First, we approach these systems à la Mattis, by thinking at the Dyson model as a single-pattern hierarchical neural network and we discuss the stability of different retrievable states as predicted by the related self-consistencies obtained from a mean-field bound and from a bound that bypasses t…
▽ More
In this paper we introduce and investigate the statistical mechanics of hierarchical neural networks: First, we approach these systems à la Mattis, by thinking at the Dyson model as a single-pattern hierarchical neural network and we discuss the stability of different retrievable states as predicted by the related self-consistencies obtained from a mean-field bound and from a bound that bypasses the mean-field limitation. The latter is worked out by properly reabsorbing fluctuations of the magnetization related to higher levels of the hierarchy into effective fields for the lower levels. Remarkably, mixing Amit's ansatz technique (to select candidate retrievable states) with the interpolation procedure (to solve for the free energy of these states) we prove that (due to gauge symmetry) the Dyson model accomplishes both serial and parallel processing. One step forward, we extend this scenario toward multiple stored patterns by implementing the Hebb prescription for learning within the couplings. This results in an Hopfield-like networks constrained on a hierarchical topology, for which, restricting to the low storage regime (where the number of patterns grows at most logarithmical with the amount of neurons), we prove the existence of the thermodynamic limit for the free energy and we give an explicit expression of its mean field bound and of the related improved bound
△ Less
Submitted 19 July, 2014;
originally announced July 2014.
-
Free-energy bounds for hierarchical spin models
Authors:
Michele Castellana,
Adriano Barra,
Francesco Guerra
Abstract:
In this paper we study two non-mean-field spin models built on a hierarchical lattice: The hierarchical Edward-Anderson model (HEA) of a spin glass, and Dyson's hierarchical model (DHM) of a ferromagnet. For the HEA, we prove the existence of the thermodynamic limit of the free energy and the replica-symmetry-breaking (RSB) free-energy bounds previously derived for the Sherrington-Kirkpatrick mode…
▽ More
In this paper we study two non-mean-field spin models built on a hierarchical lattice: The hierarchical Edward-Anderson model (HEA) of a spin glass, and Dyson's hierarchical model (DHM) of a ferromagnet. For the HEA, we prove the existence of the thermodynamic limit of the free energy and the replica-symmetry-breaking (RSB) free-energy bounds previously derived for the Sherrington-Kirkpatrick model of a spin glass. These RSB mean-field bounds are exact only if the order-parameter fluctuations (OPF) vanish: Given that such fluctuations are not negligible in non-mean-field models, we develop a novel strategy to tackle part of OPF in hierarchical models. The method is based on absorbing part of OPF of a block of spins into an effective Hamiltonian of the underlying spin blocks. We illustrate this method for DHM and show that, compared to the mean-field bound for the free energy, it provides a tighter non-mean-field bound, with a critical temperature closer to the exact one. To extend this method to the HEA model, a suitable generalization of Griffith's correlation inequalities for Ising ferromagnets is needed: Since correlation inequalities for spin glasses are still an open topic, we leave the extension of this method to hierarchical spin glasses as a future perspective.
△ Less
Submitted 17 March, 2014; v1 submitted 9 December, 2013;
originally announced December 2013.
-
Multi-species mean-field spin-glasses. Rigorous results
Authors:
Adriano Barra,
Pierluigi Contucci,
Emanuele Mingione,
Daniele Tantari
Abstract:
We study a multi-species spin glass system where the density of each species is kept fixed at increasing volumes. The model reduces to the Sherrington-Kirkpatrick one for the single species case. The existence of the thermodynamic limit is proved for all densities values under a convexity condition on the interaction. The thermodynamic properties of the model are investigated and the annealed, the…
▽ More
We study a multi-species spin glass system where the density of each species is kept fixed at increasing volumes. The model reduces to the Sherrington-Kirkpatrick one for the single species case. The existence of the thermodynamic limit is proved for all densities values under a convexity condition on the interaction. The thermodynamic properties of the model are investigated and the annealed, the replica symmetric and the replica symmetry breaking bounds are proved using Guerra's scheme. The annealed approximation is proved to be exact under a high temperature condition. We show that the replica symmetric solution has negative entropy at low temperatures. We study the properties of a suitably defined replica symmetry breaking solution and we optimise it within a ziggurat ansatz. The generalized order parameter is described by a Parisi-like partial differential equation.
△ Less
Submitted 10 April, 2014; v1 submitted 19 July, 2013;
originally announced July 2013.
-
Mean field spin glasses treated with PDE techniques
Authors:
Adriano Barra,
Gino Del Ferraro,
Daniele Tantari
Abstract:
Following an original idea of F. Guerra, in this notes we analyze the Sherrington-Kirkpatrick model from different perspectives, all sharing the underlying approach which consists in linking the resolution of the statistical mechanics of the model (e.g. solving for the free energy) to well-known partial differential equation (PDE) problems (in suitable spaces). The plan is then to solve the relate…
▽ More
Following an original idea of F. Guerra, in this notes we analyze the Sherrington-Kirkpatrick model from different perspectives, all sharing the underlying approach which consists in linking the resolution of the statistical mechanics of the model (e.g. solving for the free energy) to well-known partial differential equation (PDE) problems (in suitable spaces). The plan is then to solve the related PDE using techniques involved in their native field and lastly bringing back the solution in the proper statistical mechanics framework. Within this strand, after a streamlined test-case on the Curie-Weiss model to highlight the methods more than the physics behind, we solve the SK both at the replica symmetric and at the 1-RSB level, obtaining the correct expression for the free energy via an analogy to a Fourier equation and for the self-consistencies with an analogy to a Burger equation, whose shock wave develops exactly at critical noise level (triggering the phase transition). Our approach, beyond acting as a new alternative method (with respect to the standard routes) for tackling the complexity of spin glasses, links symmetries in PDE theory with constraints in statistical mechanics and, as a novel result from the theoretical physics perspective, we obtain a new class of polynomial identities (namely of Aizenman-Contucci type but merged within the Guerra's broken replica measures), whose interest lies in understanding, via the recent Panchenko breakthroughs, how to force the overlap organization to the ultrametric tree predicted by Parisi.
△ Less
Submitted 9 April, 2013;
originally announced April 2013.
-
Notes on the p-spin glass studied via Hamilton-Jacobi and Smooth-Cavity techniques
Authors:
Elena Agliari,
Adriano Barra,
Raffaella Burioni,
Aldo Di Biasio
Abstract:
In these notes, we continue our investigation of classical toy models of disordered statistical mechanics through various techniques recently developed and tested mainly on the paradigmatic SK spin glass. Here we consider the p-spin-glass model with Ising spins and interactions drawn from a normal distribution N[0,1]. After a general presentation of its properties (e.g. self-averaging of the free…
▽ More
In these notes, we continue our investigation of classical toy models of disordered statistical mechanics through various techniques recently developed and tested mainly on the paradigmatic SK spin glass. Here we consider the p-spin-glass model with Ising spins and interactions drawn from a normal distribution N[0,1]. After a general presentation of its properties (e.g. self-averaging of the free energy, existence of a suitable thermodynamic limit), we study its equilibrium behavior within the Hamilton-Jacobi framework and the smooth cavity approach. Through the former we find both the RS and the 1RSB expressions for the free energy, coupled with their self-consistent relations for the overlaps. Through the latter, we recover these results as irreducible expression, and we study the generalization of the overlap polynomial identities suitable for this model; a discussion on their deep connection with the structure of the internal energy and the entropy closes the investigation.
△ Less
Submitted 4 June, 2012; v1 submitted 21 November, 2011;
originally announced November 2011.
-
A Solvable Mean Field Model of a Gaussian Spin Glass
Authors:
Adriano Barra,
Giuseppe Genovese,
Francesco Guerra,
Daniele Tantari
Abstract:
We introduce a mean field spin glass model with gaussian distribuited spins and pairwise interactions, whose couplings are drawn randomly from a normal gaussian distribution too. We completely control the main thermodynamical properties of the model (free energy, phase diagram, fluctuations theory) in the whole phase space. In particular we prove that in thermodynamic limit the free energy equals…
▽ More
We introduce a mean field spin glass model with gaussian distribuited spins and pairwise interactions, whose couplings are drawn randomly from a normal gaussian distribution too. We completely control the main thermodynamical properties of the model (free energy, phase diagram, fluctuations theory) in the whole phase space. In particular we prove that in thermodynamic limit the free energy equals its replica symmetric expression.
△ Less
Submitted 17 May, 2012; v1 submitted 19 September, 2011;
originally announced September 2011.
-
Interpolating the Sherrington-Kirkpatrick replica trick
Authors:
Adriano Barra,
Francesco Guerra,
Emanuele Mingione
Abstract:
The interpolation techniques have become, in the past decades, a powerful approach to lighten several properties of spin glasses within a simple mathematical framework. Intrinsically, for their construction, these schemes were naturally implemented into the cavity field technique, or its variants as the stochastic stability or the random overlap structures. However the first and most famous approa…
▽ More
The interpolation techniques have become, in the past decades, a powerful approach to lighten several properties of spin glasses within a simple mathematical framework. Intrinsically, for their construction, these schemes were naturally implemented into the cavity field technique, or its variants as the stochastic stability or the random overlap structures. However the first and most famous approach to mean field statistical mechanics with quenched disorder is the replica trick. Among the models where these methods have been used (namely, dealing with frustration and complexity), probably the best known is the Sherrington-Kirkpatrick spin glass: In this paper we are pleased to apply the interpolation scheme to the replica trick framework and test it directly to the cited paradigmatic model: interestingly this allows to obtain easily the replica-symmetric control and, synergically with the broken replica bounds, a description of the full RSB scenario, both coupled with several minor theorems. Furthermore, by treating the amount of replicas $n\in(0,1]$ as an interpolating parameter (far from its original interpretation) this can be though of as a quenching temperature close to the one introduce in off-equilibrium approaches and, within this viewpoint, the proof of the attended commutativity of the zero replica and the infinite volume limits can be obtained.
△ Less
Submitted 26 October, 2015; v1 submitted 11 April, 2011;
originally announced April 2011.
-
Replica symmetry breaking in mean field spin glasses trough Hamilton-Jacobi technique
Authors:
Adriano Barra,
Aldo Di Biasio,
Francesco Guerra
Abstract:
During the last years, through the combined effort of the insight, coming from physical intuition and computer simulation, and the exploitation of rigorous mathematical methods, the main features of the mean field Sherrington-Kirkpatrick spin glass model have been firmly established. In particular, it has been possible to prove the existence and uniqueness of the infinite volume limit for the free…
▽ More
During the last years, through the combined effort of the insight, coming from physical intuition and computer simulation, and the exploitation of rigorous mathematical methods, the main features of the mean field Sherrington-Kirkpatrick spin glass model have been firmly established. In particular, it has been possible to prove the existence and uniqueness of the infinite volume limit for the free energy, and its Parisi expression, in terms of a variational principle, involving a functional order parameter. Even the expected property of ultrametricity, for the infinite volume states, seems to be near to a complete proof. The main structural feature of this model, and related models, is the deep phenomenon of spontaneous replica symmetry breaking (RSB), discovered by Parisi many years ago. By expanding on our previous work, the aim of this paper is to investigate a general frame, where replica symmetry breaking is embedded in a kind of mechanical scheme of the Hamilton-Jacobi type. Here, the analog of the "time" variable is a parameter characterizing the strength of the interaction, while the "space" variables rule out quantitatively the broken replica symmetry pattern. Starting from the simple cases, where annealing is assumed, or replica symmetry, we build up a progression of dynamical systems, with an increasing number of space variables, which allow to weaken the effect of the potential in the Hamilton-Jacobi equation, as the level of symmetry braking is increased. This new machinery allows to work out mechanically the general K-step RSB solutions, in a different interpretation with respect to the replica trick, and lightens easily their properties as existence or uniqueness.
△ Less
Submitted 26 March, 2010;
originally announced March 2010.
-
A certain class of Curie-Weiss models
Authors:
Giuseppe Genovese,
Adriano Barra
Abstract:
By using a formal analogy between statistical mechanics of mean field spin systems and analytical mechanics of viscous liquids -at first pointed out by Francesco Guerra, then recently developed by the authors- we give the thermodynamic limit of the free energy and the critical behavior of Curie Weiss models for a certain class of generalized spin variables. Then, with the same techniques, we giv…
▽ More
By using a formal analogy between statistical mechanics of mean field spin systems and analytical mechanics of viscous liquids -at first pointed out by Francesco Guerra, then recently developed by the authors- we give the thermodynamic limit of the free energy and the critical behavior of Curie Weiss models for a certain class of generalized spin variables. Then, with the same techniques, we give a complete picture of the bipartite Curie-Weiss model, dealing with the same class of generalized spins. Ultimately we analyze further the existence of a minmax principle for the latter which mirrors the standard variational principle of canonical thermodynamics when generalized to multiple interacting parties.
△ Less
Submitted 25 June, 2009;
originally announced June 2009.
-
A mechanical approach to mean field spin models
Authors:
Giuseppe Genovese,
Adriano Barra
Abstract:
Inspired by the bridge pioneered by Guerra among statistical mechanics on lattice and analytical mechanics on 1+1 continuous Euclidean space-time, we built a self-consistent method to solve for the thermodynamics of mean-field models defined on lattice, whose order parameters self average. We show the whole procedure by analyzing in full details the simplest test case, namely the Curie-Weiss mod…
▽ More
Inspired by the bridge pioneered by Guerra among statistical mechanics on lattice and analytical mechanics on 1+1 continuous Euclidean space-time, we built a self-consistent method to solve for the thermodynamics of mean-field models defined on lattice, whose order parameters self average. We show the whole procedure by analyzing in full details the simplest test case, namely the Curie-Weiss model. Further we report some applications also to models whose order parameters do not self-average, by using the Sherrington-Kirkpatrick spin glass as a guide.
△ Less
Submitted 7 May, 2009; v1 submitted 10 December, 2008;
originally announced December 2008.
-
Dilution Robustness for Mean Field Ferromagnets
Authors:
Adriano Barra,
Federico Camboni,
Pierluigi Contucci
Abstract:
In this work we compare two different random dilution of a mean field ferromagnet: the first model is built on a Bernoulli-diluted network while the second lives on a Poisson-diluted network. While it is known that the two models have in the thermodynamic limit the same free energy we investigate on the structural constraints that the two models must fulfill. We rigorously derive for each model…
▽ More
In this work we compare two different random dilution of a mean field ferromagnet: the first model is built on a Bernoulli-diluted network while the second lives on a Poisson-diluted network. While it is known that the two models have in the thermodynamic limit the same free energy we investigate on the structural constraints that the two models must fulfill. We rigorously derive for each model the set of identities for the multi-overlaps distribution using different methods for the two dilutions: constraints in the former model are obtained by studying the consequences of the self-averaging of the internal energy density, while in the latter are obtained by a stochastic-stability technique. Finally we prove that the identities emerging in the two models are the same, showing "robustness" of the ferromagnetic properties of diluted networks with respect to the details of dilution.
△ Less
Submitted 26 March, 2009; v1 submitted 8 December, 2008;
originally announced December 2008.
-
Parameter Evaluation of a Simple Mean-Field Model of Social Interaction
Authors:
Ignacio Gallo,
Adriano Barra,
Pierluigi Contucci
Abstract:
The aim of this work is to implement a statistical mechanics theory of social interaction, generalizing econometric discrete choice models. A class of simple mean field discrete models is introduced and discussed both from the theoretical and phenomenological point of view. We propose a parameter evaluation procedure and test it by fitting our model against three families of data coming from dif…
▽ More
The aim of this work is to implement a statistical mechanics theory of social interaction, generalizing econometric discrete choice models. A class of simple mean field discrete models is introduced and discussed both from the theoretical and phenomenological point of view. We propose a parameter evaluation procedure and test it by fitting our model against three families of data coming from different cases: the estimated interaction parameters are found to have similar positive values establishing a quantitative confirmation of the peer imitation behavior found in social psychology. Moreover all the values of the interaction parameters belong to the phase transition regime suggesting its possible role in the study of social systems.
△ Less
Submitted 20 November, 2008; v1 submitted 16 October, 2008;
originally announced October 2008.
