-
Limit theorems for the non-convex multispecies Curie-Weiss model
Authors:
Francesco Camilli,
Emanuele Mingione,
Godwin Osabutey
Abstract:
We study the thermodynamic properties of the generalized non-convex multispecies Curie-Weiss model, where interactions among different types of particles (forming the species) are encoded in a generic matrix. For spins with a generic prior distribution, we compute the pressure in the thermodynamic limit using simple interpolation techniques. For Ising spins, we further analyze the fluctuations of…
▽ More
We study the thermodynamic properties of the generalized non-convex multispecies Curie-Weiss model, where interactions among different types of particles (forming the species) are encoded in a generic matrix. For spins with a generic prior distribution, we compute the pressure in the thermodynamic limit using simple interpolation techniques. For Ising spins, we further analyze the fluctuations of the magnetization in the thermodynamic limit under the Boltzmann-Gibbs measure. It is shown that a central limit theorem holds for a rescaled and centered vector of species magnetizations, which converges to either a centered or non-centered multivariate normal distribution, depending on the rate of convergence of the relative sizes of the species.
△ Less
Submitted 27 February, 2025;
originally announced February 2025.
-
On the phase diagram of the multiscale mean-field spin-glass
Authors:
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione,
Daniele Tantari
Abstract:
In this paper we study the phase diagram of a Sherrington-Kirkpatrick (SK) model where the couplings are forced to thermalize at different times scales. Besides being a challenging generalization of the SK model, such settings may arise naturally in physics whenever part of the many degrees of freedom of a system relaxes to equilibrium considerably faster than the others. For this model we compute…
▽ More
In this paper we study the phase diagram of a Sherrington-Kirkpatrick (SK) model where the couplings are forced to thermalize at different times scales. Besides being a challenging generalization of the SK model, such settings may arise naturally in physics whenever part of the many degrees of freedom of a system relaxes to equilibrium considerably faster than the others. For this model we compute the asymptotic value of the second moment of the overlap distribution. Furthermore, we provide a rigorous sufficient condition for an annealed solution to hold, identifying a high temperature region. In addition, we also prove that for sufficiently low temperature the solution must present a number of replica symmetry breaking levels at least equal to the number of time scales already present in the multiscale model. Finally, we give a sufficient condition for the existence of gaps in the support of the functional order parameters.
△ Less
Submitted 1 December, 2024;
originally announced December 2024.
-
Ferromagnetic Ising Model on multiregular random graphs
Authors:
Diego Alberici,
Pierluigi Contucci,
Emanuele Mingione,
Filippo Zimmaro
Abstract:
A family of multispecies Ising models on generalized regular random graphs is investigated in the thermodynamic limit. The architecture is specified by class-dependent couplings and magnetic fields. We prove that the magnetizations, neighbours correlations and free energy converge to suitable functions evaluated at the solution of a belief propagation fixed point equation. In absence of magnetic f…
▽ More
A family of multispecies Ising models on generalized regular random graphs is investigated in the thermodynamic limit. The architecture is specified by class-dependent couplings and magnetic fields. We prove that the magnetizations, neighbours correlations and free energy converge to suitable functions evaluated at the solution of a belief propagation fixed point equation. In absence of magnetic fields, a phase transition is identified and the corresponding critical parameters are determined by the spectral radius of a low-dimensional matrix.
△ Less
Submitted 21 March, 2024;
originally announced March 2024.
-
Central limit theorem for the overlaps on the Nishimori line
Authors:
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
The overlap distribution of the Sherrington-Kirkpatrick model on the Nishimori line has been proved to be self averaging for large volumes. Here we study the joint distribution of the rescaled overlaps around their common mean and prove that it converges to a Gaussian vector.
The overlap distribution of the Sherrington-Kirkpatrick model on the Nishimori line has been proved to be self averaging for large volumes. Here we study the joint distribution of the rescaled overlaps around their common mean and prove that it converges to a Gaussian vector.
△ Less
Submitted 25 June, 2023; v1 submitted 31 May, 2023;
originally announced May 2023.
-
Limit theorems for the cubic mean-field Ising model
Authors:
Pierluigi Contucci,
Emanuele Mingione,
Godwin Osabutey
Abstract:
We study a mean-field spin model with three- and two-body interactions. The equilibrium measure for large volumes is shown to have three pure states, the phases of the model. They include the two with opposite magnetization and an unpolarized one with zero magnetization, merging at the critical point. We prove that the central limit theorem holds for a suitably rescaled magnetization, while its vi…
▽ More
We study a mean-field spin model with three- and two-body interactions. The equilibrium measure for large volumes is shown to have three pure states, the phases of the model. They include the two with opposite magnetization and an unpolarized one with zero magnetization, merging at the critical point. We prove that the central limit theorem holds for a suitably rescaled magnetization, while its violation with the typical quartic behavior appears at the critical point.
△ Less
Submitted 14 July, 2024; v1 submitted 25 March, 2023;
originally announced March 2023.
-
On the convergence to the non-equilibrium steady state of a Langevin dynamics with widely separated time scales and different temperatures
Authors:
Diego Alberici,
Nicolas Macris,
Emanuele Mingione
Abstract:
We study the solution of the two-temperatures Fokker-Planck equation and rigorously analyse its convergence towards an explicit non-equilibrium stationary measure for long time and two widely separated time scales. The exponential rates of convergence are estimated assuming the validity of logarithmic Sobolev inequalities for the conditional and marginal distributions of the limit measure. We show…
▽ More
We study the solution of the two-temperatures Fokker-Planck equation and rigorously analyse its convergence towards an explicit non-equilibrium stationary measure for long time and two widely separated time scales. The exponential rates of convergence are estimated assuming the validity of logarithmic Sobolev inequalities for the conditional and marginal distributions of the limit measure. We show that these estimates are sharp in the exactly solvable case of a quadratic potential. We discuss a few examples where the logarithmic Sobolev inequalities are satisfied through simple, though not optimal, criteria. In particular we consider a spin-glass model with slowly varying external magnetic fields whose non-equilibrium measure corresponds to Guerra's hierarchical construction appearing in Talagrand's proof of the Parisi formula.
△ Less
Submitted 10 March, 2023; v1 submitted 21 December, 2021;
originally announced December 2021.
-
An inference problem in a mismatched setting: a spin-glass model with Mattis interaction
Authors:
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
The Wigner spiked model in a mismatched setting is studied with the finite temperature Statistical Mechanics approach through its representation as a Sherrington-Kirkpatrick model with added Mattis interaction. The exact solution of the model with Ising spins is rigorously proved to be given by a variational principle on two order parameters, the Parisi overlap distribution and the Mattis magnetiz…
▽ More
The Wigner spiked model in a mismatched setting is studied with the finite temperature Statistical Mechanics approach through its representation as a Sherrington-Kirkpatrick model with added Mattis interaction. The exact solution of the model with Ising spins is rigorously proved to be given by a variational principle on two order parameters, the Parisi overlap distribution and the Mattis magnetization. The latter is identified by an ordinary variational principle and turns out to concentrate in the thermodynamic limit. The solution leads to the computation of the Mean Square Error of the mismatched reconstruction. The Gaussian signal distribution case is investigated and the corresponding phase diagram is identified.
△ Less
Submitted 28 January, 2022; v1 submitted 24 July, 2021;
originally announced July 2021.
-
The solution of the deep Boltzmann machine on the Nishimori line
Authors:
Diego Alberici,
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
The deep Boltzmann machine on the Nishimori line with a finite number of layers is exactly solved by a theorem that expresses its pressure through a finite dimensional variational problem of min-max type. In the absence of magnetic fields the order parameter is shown to exhibit a phase transition.
The deep Boltzmann machine on the Nishimori line with a finite number of layers is exactly solved by a theorem that expresses its pressure through a finite dimensional variational problem of min-max type. In the absence of magnetic fields the order parameter is shown to exhibit a phase transition.
△ Less
Submitted 9 July, 2021; v1 submitted 27 December, 2020;
originally announced December 2020.
-
Stationarization and Multithermalization in spin glasses
Authors:
Pierluigi Contucci,
Federico Corberi,
Jorge Kurchan,
Emanuele Mingione
Abstract:
We develop further the study of a system in contact with a multibath having different temperatures at widely separated timescales. We consider those systems that do not thermalize in finite times when in contact with an ordinary bath but may do so in contact with a multibath. Thermodynamic integration is possible, thus allowing one to recover the stationary distribution on the basis of measurement…
▽ More
We develop further the study of a system in contact with a multibath having different temperatures at widely separated timescales. We consider those systems that do not thermalize in finite times when in contact with an ordinary bath but may do so in contact with a multibath. Thermodynamic integration is possible, thus allowing one to recover the stationary distribution on the basis of measurements performed in a `multi-reversible' transformation. We show that following such a protocol the system is at each step described by a generalization of the Boltzmann-Gibbs distribution, that has been studied in the past. Guerra's bound interpolation scheme for spin-glasses is closely related to this: by translating it into a dynamical setting, we show how it may actually be implemented in practice. The phase diagram plane of temperature vs "number of replicas", long studied in spin-glasses, in our approach becomes simply that of the two temperatures the system is in contact with. We suggest that this representation may be used to directly compare phenomenological and mean-field inspired models.Finally, we show how an approximate out of equilibrium probability distribution may be inferred experimentally on the basis of measurements along an almost reversible transformation.
△ Less
Submitted 28 March, 2021; v1 submitted 7 December, 2020;
originally announced December 2020.
-
The multi-species mean-field spin-glass on the Nishimori line
Authors:
Diego Alberici,
Francesco Camilli,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
In this paper we study a multi-species disordered model on the Nishimori line. The typical properties of this line, a set of identities and inequalities among correlation functions, allow us to prove the replica symmetry i.e. the concentration of the order parameter. When the interaction structure is elliptic we rigorously compute the exact solution of the model in terms of a finite dimensional va…
▽ More
In this paper we study a multi-species disordered model on the Nishimori line. The typical properties of this line, a set of identities and inequalities among correlation functions, allow us to prove the replica symmetry i.e. the concentration of the order parameter. When the interaction structure is elliptic we rigorously compute the exact solution of the model in terms of a finite dimensional variational principle and we study its properties.
△ Less
Submitted 26 December, 2020; v1 submitted 17 July, 2020;
originally announced July 2020.
-
Deep Boltzmann machines: rigorous results at arbitrary depth
Authors:
Diego Alberici,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
A class of deep Boltzmann machines is considered in the simplified framework of a quenched system with Gaussian noise and independent entries. The quenched pressure of a $K$-layers spin glass model is studied allowing interactions only among consecutive layers. A lower bound for the pressure is found in terms of a convex combination of $K$ Sherrington-Kirkpatrick models and used to study the annea…
▽ More
A class of deep Boltzmann machines is considered in the simplified framework of a quenched system with Gaussian noise and independent entries. The quenched pressure of a $K$-layers spin glass model is studied allowing interactions only among consecutive layers. A lower bound for the pressure is found in terms of a convex combination of $K$ Sherrington-Kirkpatrick models and used to study the annealed and replica symmetric regimes of the system. A map with a one dimensional monomer-dimer system is identified and used to rigorously control the annealed region at arbitrary depth $K$ with the methods introduced by Heilmann and Lieb. The compression of this high noise region displays a remarkable phenomenon of localisation of the processing layers. Furthermore a replica symmetric lower bound for the limiting quenched pressure of the model is obtained in a suitable region of the parameters and the replica symmetric pressure is proved to have a unique stationary point.
△ Less
Submitted 9 April, 2020;
originally announced April 2020.
-
Annealing and replica-symmetry in Deep Boltzmann Machines
Authors:
Diego Alberici,
Adriano Barra,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
In this paper we study the properties of the quenched pressure of a multi-layer spin-glass model (a deep Boltzmann Machine in artificial intelligence jargon) whose pairwise interactions are allowed between spins lying in adjacent layers and not inside the same layer nor among layers at distance larger than one. We prove a theorem that bounds the quenched pressure of such a K-layer machine in terms…
▽ More
In this paper we study the properties of the quenched pressure of a multi-layer spin-glass model (a deep Boltzmann Machine in artificial intelligence jargon) whose pairwise interactions are allowed between spins lying in adjacent layers and not inside the same layer nor among layers at distance larger than one. We prove a theorem that bounds the quenched pressure of such a K-layer machine in terms of K Sherrington-Kirkpatrick spin glasses and use it to investigate its annealed region. The replica-symmetric approximation of the quenched pressure is identified and its relation to the annealed one is considered. The paper also presents some observation on the model's architectural structure related to machine learning. Since escaping the annealed region is mandatory for a meaningful training, by squeezing such region we obtain thermodynamical constraints on the form factors. Remarkably, its optimal escape is achieved by requiring the last layer to scale sub-linearly in the network size.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
Equilibrium and Dynamics of a Multi-Bath Sherrington-Kirkpatrick Model
Authors:
Pierluigi Contucci,
Jorge Kurchan,
Emanuele Mingione
Abstract:
In this paper we study the equilibrium statistical mechanical as well as the dynamical properties of a Sherrington and Kirkpatrick model in a multi-bath setting introduced in [4]. We show that the free energy per particle in the thermodynamical limit obeys a variational principle of Parisi type. The relation between the resulting order parameters is discussed.
In this paper we study the equilibrium statistical mechanical as well as the dynamical properties of a Sherrington and Kirkpatrick model in a multi-bath setting introduced in [4]. We show that the free energy per particle in the thermodynamical limit obeys a variational principle of Parisi type. The relation between the resulting order parameters is discussed.
△ Less
Submitted 5 March, 2019;
originally announced March 2019.
-
A Multi-Scale Spin-Glass Mean-Field Model
Authors:
Pierluigi Contucci,
Emanuele Mingione
Abstract:
In this paper a multi-scale version of the Sherrington and Kirkpatrick model is introduced and studied. The pressure per particle in the thermodynamical limit is proved to obey a variational principle of Parisi type. The result is achieved by means of lower and upper bounds. The lower bound is obtained with a Ruelle cascade using the interpolation technique, while the upper bound exploits factoris…
▽ More
In this paper a multi-scale version of the Sherrington and Kirkpatrick model is introduced and studied. The pressure per particle in the thermodynamical limit is proved to obey a variational principle of Parisi type. The result is achieved by means of lower and upper bounds. The lower bound is obtained with a Ruelle cascade using the interpolation technique, while the upper bound exploits factorisation properties of the equilibrium measure and the synchronisation technique
△ Less
Submitted 23 October, 2018; v1 submitted 2 April, 2018;
originally announced April 2018.
-
Two populations mean-field monomer-dimer model
Authors:
Diego Alberici,
Emanuele Mingione
Abstract:
A two populations mean-field monomer-dimer model including both hard-core and attractive interactions between dimers is considered. The pressure density in the thermodynamic limit is proved to satisfy a three-dimensional variational principle. A detailed analysis is made in the limit in which one population is much smaller than the other and a ferromagnetic mean-field phase transition is found.
A two populations mean-field monomer-dimer model including both hard-core and attractive interactions between dimers is considered. The pressure density in the thermodynamic limit is proved to satisfy a three-dimensional variational principle. A detailed analysis is made in the limit in which one population is much smaller than the other and a ferromagnetic mean-field phase transition is found.
△ Less
Submitted 22 June, 2017;
originally announced June 2017.
-
Mean-Field Monomer-Dimer models. A review
Authors:
Diego Alberici,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
A collection of rigorous results for a class of mean-field monomer-dimer models is presented. It includes a Gaussian representation for the partition function that is shown to considerably simplify the proofs. The solutions of the quenched diluted case and the random monomer case are explained. The presence of the attractive component of the Van der Waals potential is considered and the coexistenc…
▽ More
A collection of rigorous results for a class of mean-field monomer-dimer models is presented. It includes a Gaussian representation for the partition function that is shown to considerably simplify the proofs. The solutions of the quenched diluted case and the random monomer case are explained. The presence of the attractive component of the Van der Waals potential is considered and the coexistence phase coexistence transition analysed. In particular the breakdown of the central limit theorem is illustrated at the critical point where a non Gaussian, quartic exponential distribution is found for the number of monomers centered and rescaled with the volume to the power 3/4.
△ Less
Submitted 29 December, 2016;
originally announced December 2016.
-
Aggregation models on hypergraphs
Authors:
Diego Alberici,
Pierluigi Contucci,
Emanuele Mingione,
Marco Molari
Abstract:
Following a newly introduced approach by Rasetti and Merelli we investigate the possibility to extract topological information about the space where interacting systems are modelled. From the statistical datum of their observable quantities, like the correlation functions, we show how to reconstruct the activities of their constitutive parts which embed the topological information. The procedure i…
▽ More
Following a newly introduced approach by Rasetti and Merelli we investigate the possibility to extract topological information about the space where interacting systems are modelled. From the statistical datum of their observable quantities, like the correlation functions, we show how to reconstruct the activities of their constitutive parts which embed the topological information. The procedure is implemented on a class of polymer models on hypergraphs with hard-core interactions. We show that the model fulfils a set of iterative relations for the partition function that generalise those introduced by Heilmann and Lieb for the monomer-dimer case. After translating those relations into structural identities for the correlation functions we use them to test the precision and the robustness of the inverse problem. Finally the possible presence of a further interaction of peer-to-peer type is considered and a criterion to discover it is identified.
△ Less
Submitted 19 October, 2016; v1 submitted 30 July, 2016;
originally announced August 2016.
-
Limit theorems for monomer-dimer mean-field models with attractive potential
Authors:
Diego Alberici,
Pierluigi Contucci,
Micaela Fedele,
Emanuele Mingione
Abstract:
The number of monomers, in a monomer-dimer mean-field model with an attractive potential, fluctuates according to the central limit theorem when the parameters are outside the critical curve. At the critical point the model belongs to the same universality class of the mean-field ferromagnet. Along the critical curve the monomer and dimer phases coexist.
The number of monomers, in a monomer-dimer mean-field model with an attractive potential, fluctuates according to the central limit theorem when the parameters are outside the critical curve. At the critical point the model belongs to the same universality class of the mean-field ferromagnet. Along the critical curve the monomer and dimer phases coexist.
△ Less
Submitted 13 June, 2015;
originally announced June 2015.
-
A mean-field monomer-dimer model with random monomer activities. Exact solution and rigorous results
Authors:
Diego Alberici,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
Independent random monomer activities are considered on a mean-feld monomer-dimer model. Under very general conditions on the randomness the model is shown to have a self-averaging pressure density that obeys a solvable variational principle. The dimer density is exactly computed in the thermodynamic limit and shown to be a smooth function.
Independent random monomer activities are considered on a mean-feld monomer-dimer model. Under very general conditions on the randomness the model is shown to have a self-averaging pressure density that obeys a solvable variational principle. The dimer density is exactly computed in the thermodynamic limit and shown to be a smooth function.
△ Less
Submitted 7 February, 2015; v1 submitted 22 September, 2014;
originally announced September 2014.
-
A mean-field monomer-dimer model with attractive interaction. The exact solution
Authors:
Diego Alberici,
Pierluigi Contucci,
Emanuele Mingione
Abstract:
A mean-field monomer-dimer model which includes an attractive interaction among both monomers and dimers is introduced and its exact solution rigorously derived. The Heilmann-Lieb method for the pure hard-core interacting case is used to compute upper and lower bounds for the pressure. The bounds are shown to coincide in the thermodynamic limit for a suitable choice of the monomer density m. The c…
▽ More
A mean-field monomer-dimer model which includes an attractive interaction among both monomers and dimers is introduced and its exact solution rigorously derived. The Heilmann-Lieb method for the pure hard-core interacting case is used to compute upper and lower bounds for the pressure. The bounds are shown to coincide in the thermodynamic limit for a suitable choice of the monomer density m. The consistency equation characterising m is studied in the phase space (h, J), where h tunes the monomer potential and J the attractive potential. The critical point and exponents are computed and show that the model is in the mean-field ferromagnetic universality class.
△ Less
Submitted 25 November, 2013;
originally announced November 2013.
-
Multi-species mean-field spin-glasses. Rigorous results
Authors:
Adriano Barra,
Pierluigi Contucci,
Emanuele Mingione,
Daniele Tantari
Abstract:
We study a multi-species spin glass system where the density of each species is kept fixed at increasing volumes. The model reduces to the Sherrington-Kirkpatrick one for the single species case. The existence of the thermodynamic limit is proved for all densities values under a convexity condition on the interaction. The thermodynamic properties of the model are investigated and the annealed, the…
▽ More
We study a multi-species spin glass system where the density of each species is kept fixed at increasing volumes. The model reduces to the Sherrington-Kirkpatrick one for the single species case. The existence of the thermodynamic limit is proved for all densities values under a convexity condition on the interaction. The thermodynamic properties of the model are investigated and the annealed, the replica symmetric and the replica symmetry breaking bounds are proved using Guerra's scheme. The annealed approximation is proved to be exact under a high temperature condition. We show that the replica symmetric solution has negative entropy at low temperatures. We study the properties of a suitably defined replica symmetry breaking solution and we optimise it within a ziggurat ansatz. The generalized order parameter is described by a Parisi-like partial differential equation.
△ Less
Submitted 10 April, 2014; v1 submitted 19 July, 2013;
originally announced July 2013.
-
Factorization properties in d-dimensional spin glasses. Rigorous results and some perspectives
Authors:
Pierluigi Contucci,
Emanuele Mingione,
Shannon Starr
Abstract:
In this paper we show that d-dimensional Gaussian spin glass models are strongly stochastically stable, fulfill the Ghirlanda-Guerra identities in distribution and the ultrametricity property.
In this paper we show that d-dimensional Gaussian spin glass models are strongly stochastically stable, fulfill the Ghirlanda-Guerra identities in distribution and the ultrametricity property.
△ Less
Submitted 24 February, 2013; v1 submitted 20 December, 2012;
originally announced December 2012.
-
Interpolating the Sherrington-Kirkpatrick replica trick
Authors:
Adriano Barra,
Francesco Guerra,
Emanuele Mingione
Abstract:
The interpolation techniques have become, in the past decades, a powerful approach to lighten several properties of spin glasses within a simple mathematical framework. Intrinsically, for their construction, these schemes were naturally implemented into the cavity field technique, or its variants as the stochastic stability or the random overlap structures. However the first and most famous approa…
▽ More
The interpolation techniques have become, in the past decades, a powerful approach to lighten several properties of spin glasses within a simple mathematical framework. Intrinsically, for their construction, these schemes were naturally implemented into the cavity field technique, or its variants as the stochastic stability or the random overlap structures. However the first and most famous approach to mean field statistical mechanics with quenched disorder is the replica trick. Among the models where these methods have been used (namely, dealing with frustration and complexity), probably the best known is the Sherrington-Kirkpatrick spin glass: In this paper we are pleased to apply the interpolation scheme to the replica trick framework and test it directly to the cited paradigmatic model: interestingly this allows to obtain easily the replica-symmetric control and, synergically with the broken replica bounds, a description of the full RSB scenario, both coupled with several minor theorems. Furthermore, by treating the amount of replicas $n\in(0,1]$ as an interpolating parameter (far from its original interpretation) this can be though of as a quenching temperature close to the one introduce in off-equilibrium approaches and, within this viewpoint, the proof of the attended commutativity of the zero replica and the infinite volume limits can be obtained.
△ Less
Submitted 26 October, 2015; v1 submitted 11 April, 2011;
originally announced April 2011.
