-
On the performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models
Authors:
Luca Maria Del Bono,
Federico Ricci-Tersenghi,
Francesco Zamponi
Abstract:
Recent years have seen a rise in the application of machine learning techniques to aid the simulation of hard-to-sample systems that cannot be studied using traditional methods. Despite the introduction of many different architectures and procedures, a wide theoretical understanding is still lacking, with the risk of suboptimal implementations. As a first step to address this gap, we provide here…
▽ More
Recent years have seen a rise in the application of machine learning techniques to aid the simulation of hard-to-sample systems that cannot be studied using traditional methods. Despite the introduction of many different architectures and procedures, a wide theoretical understanding is still lacking, with the risk of suboptimal implementations. As a first step to address this gap, we provide here a complete analytic study of the widely-used Sequential Tempering procedure applied to a shallow MADE architecture for the Curie-Weiss model. The contribution of this work is twofold: firstly, we give a description of the optimal weights and of the training under Gradient Descent optimization. Secondly, we compare what happens in Sequential Tempering with and without the addition of local Metropolis Monte Carlo steps. We are thus able to give theoretical predictions on the best procedure to apply in this case. This work establishes a clear theoretical basis for the integration of machine learning techniques into Monte Carlo sampling and optimization.
△ Less
Submitted 15 June, 2025; v1 submitted 28 May, 2025;
originally announced May 2025.
-
adabmDCA 2.0 -- a flexible but easy-to-use package for Direct Coupling Analysis
Authors:
Lorenzo Rosset,
Roberto Netti,
Anna Paola Muntoni,
Martin Weigt,
Francesco Zamponi
Abstract:
In this methods article, we provide a flexible but easy-to-use implementation of Direct Coupling Analysis (DCA) based on Boltzmann machine learning, together with a tutorial on how to use it. The package \texttt{adabmDCA 2.0} is available in different programming languages (C++, Julia, Python) usable on different architectures (single-core and multi-core CPU, GPU) using a common front-end interfac…
▽ More
In this methods article, we provide a flexible but easy-to-use implementation of Direct Coupling Analysis (DCA) based on Boltzmann machine learning, together with a tutorial on how to use it. The package \texttt{adabmDCA 2.0} is available in different programming languages (C++, Julia, Python) usable on different architectures (single-core and multi-core CPU, GPU) using a common front-end interface. In addition to several learning protocols for dense and sparse generative DCA models, it allows to directly address common downstream tasks like residue-residue contact prediction, mutational-effect prediction, scoring of sequence libraries and generation of artificial sequences for sequence design. It is readily applicable to protein and RNA sequence data.
△ Less
Submitted 30 January, 2025;
originally announced January 2025.
-
Nearest-Neighbours Neural Network architecture for efficient sampling of statistical physics models
Authors:
Luca Maria Del Bono,
Federico Ricci-Tersenghi,
Francesco Zamponi
Abstract:
The task of sampling efficiently the Gibbs-Boltzmann distribution of disordered systems is important both for the theoretical understanding of these models and for the solution of practical optimization problems. Unfortunately, this task is known to be hard, especially for spin glasses at low temperatures. Recently, many attempts have been made to tackle the problem by mixing classical Monte Carlo…
▽ More
The task of sampling efficiently the Gibbs-Boltzmann distribution of disordered systems is important both for the theoretical understanding of these models and for the solution of practical optimization problems. Unfortunately, this task is known to be hard, especially for spin glasses at low temperatures. Recently, many attempts have been made to tackle the problem by mixing classical Monte Carlo schemes with newly devised Neural Networks that learn to propose smart moves. In this article we introduce the Nearest-Neighbours Neural Network (4N) architecture, a physically-interpretable deep architecture whose number of parameters scales linearly with the size of the system and that can be applied to a large variety of topologies. We show that the 4N architecture can accurately learn the Gibbs-Boltzmann distribution for the two-dimensional Edwards-Anderson model, and specifically for some of its most difficult instances. In particular, it captures properties such as the energy, the correlation function and the overlap probability distribution. Finally, we show that the 4N performance increases with the number of layers, in a way that clearly connects to the correlation length of the system, thus providing a simple and interpretable criterion to choose the optimal depth.
△ Less
Submitted 22 April, 2025; v1 submitted 28 July, 2024;
originally announced July 2024.
-
Microscopic observation of two-level systems in a metallic glass model
Authors:
Felix C. Mocanu,
Ludovic Berthier,
Simone Ciarella,
Dmytro Khomenko,
David R. Reichman,
Camille Scalliet,
Francesco Zamponi
Abstract:
The low-temperature quasi-universal behavior of amorphous solids has been attributed to the existence of spatially-localized tunneling defects found in the low-energy regions of the potential energy landscape. Computational models of glasses can be studied to elucidate the microscopic nature of these defects. Recent simulation work has demonstrated the means of generating stable glassy configurati…
▽ More
The low-temperature quasi-universal behavior of amorphous solids has been attributed to the existence of spatially-localized tunneling defects found in the low-energy regions of the potential energy landscape. Computational models of glasses can be studied to elucidate the microscopic nature of these defects. Recent simulation work has demonstrated the means of generating stable glassy configurations for models that mimic metallic glasses using the swap Monte Carlo algorithm. Building on these studies, we present an extensive exploration of the glassy metabasins of the potential energy landscape of a variant of the most widely used model of metallic glasses. We carefully identify tunneling defects and reveal their depletion with increased glass stability. The density of tunneling defects near the experimental glass transition temperature appears to be in good agreement with experimental measurements.
△ Less
Submitted 4 January, 2023; v1 submitted 20 September, 2022;
originally announced September 2022.
-
Supervised perceptron learning vs unsupervised Hebbian unlearning: Approaching optimal memory retrieval in Hopfield-like networks
Authors:
Marco Benedetti,
Enrico Ventura,
Enzo Marinari,
Giancarlo Ruocco,
Francesco Zamponi
Abstract:
The Hebbian unlearning algorithm, i.e. an unsupervised local procedure used to improve the retrieval properties in Hopfield-like neural networks, is numerically compared to a supervised algorithm to train a linear symmetric perceptron. We analyze the stability of the stored memories: basins of attraction obtained by the Hebbian unlearning technique are found to be comparable in size to those obtai…
▽ More
The Hebbian unlearning algorithm, i.e. an unsupervised local procedure used to improve the retrieval properties in Hopfield-like neural networks, is numerically compared to a supervised algorithm to train a linear symmetric perceptron. We analyze the stability of the stored memories: basins of attraction obtained by the Hebbian unlearning technique are found to be comparable in size to those obtained in the symmetric perceptron, while the two algorithms are found to converge in the same region of Gardner's space of interactions, having followed similar learning paths. A geometric interpretation of Hebbian unlearning is proposed to explain its optimal performances. Because the Hopfield model is also a prototypical model of disordered magnetic system, it might be possible to translate our results to other models of interest for memory storage in materials.
△ Less
Submitted 7 March, 2022; v1 submitted 31 December, 2021;
originally announced January 2022.
-
V-, U-, L-, or W-shaped economic recovery after COVID: Insights from an Agent Based Model
Authors:
Dhruv Sharma,
Jean-Philippe Bouchaud,
Stanislao Gualdi,
Marco Tarzia,
Francesco Zamponi
Abstract:
We discuss the impact of a Covid-19--like shock on a simple model economy, described by the previously developed Mark-0 Agent-Based Model. We consider a mixed supply and demand shock, and show that depending on the shock parameters (amplitude and duration), our model economy can display V-shaped, U-shaped or W-shaped recoveries, and even an L-shaped output curve with permanent output loss. This is…
▽ More
We discuss the impact of a Covid-19--like shock on a simple model economy, described by the previously developed Mark-0 Agent-Based Model. We consider a mixed supply and demand shock, and show that depending on the shock parameters (amplitude and duration), our model economy can display V-shaped, U-shaped or W-shaped recoveries, and even an L-shaped output curve with permanent output loss. This is due to the economy getting trapped in a self-sustained "bad" state. We then discuss two policies that attempt to moderate the impact of the shock: giving easy credit to firms, and the so-called helicopter money, i.e. injecting new money into the households savings. We find that both policies are effective if strong enough. We highlight the potential danger of terminating these policies too early, although inflation is substantially increased by lax access to credit. Finally, we consider the impact of a second lockdown. While we only discuss a limited number of scenarios, our model is flexible and versatile enough to accommodate a wide variety of situations, thus serving as a useful exploratory tool for a qualitative, scenario-based understanding of post-Covid recovery. The corresponding code is available on-line.
△ Less
Submitted 22 February, 2021; v1 submitted 15 June, 2020;
originally announced June 2020.
-
Good speciation and endogenous business cycles in a constraint satisfaction macroeconomic model
Authors:
Dhruv Sharma,
Jean-Philippe Bouchaud,
Marco Tarzia,
Francesco Zamponi
Abstract:
We introduce a prototype agent-based model of the macroeconomy, with budgetary constraints at its core. The model is related to a class of constraint satisfaction problems (CSPs), which has been thoroughly investigated in computer science. The CSP paradigm allows us to propose an alternative price-setting mechanism: given agents' preferences and budgets, what set of prices satisfies the maximum nu…
▽ More
We introduce a prototype agent-based model of the macroeconomy, with budgetary constraints at its core. The model is related to a class of constraint satisfaction problems (CSPs), which has been thoroughly investigated in computer science. The CSP paradigm allows us to propose an alternative price-setting mechanism: given agents' preferences and budgets, what set of prices satisfies the maximum number of agents? Such an approach permits the coupling of production and output within the economy to the allowed level of debt in a simplified framework. Within our model, we identify three different regimes upon varying the amount of debt that each agent can accumulate before defaulting. In presence of a very loose constraint on debt, endogenous crises leading to waves of synchronized bankruptcies are present. In the opposite regime of very tight debt constraining, the bankruptcy rate is extremely high and the economy remains structure-less. In an intermediate regime, the economy is stable with very low bankruptcy rate and no aggregate-level crises. This third regime displays a rich phenomenology:the system spontaneously and dynamically self-organizes in a set of cheap and expensive goods (i.e. some kind of "speciation"), with switches triggered by random fluctuations and feedback loops. Our analysis confirms the central role that debt levels play in the stability of the economy. More generally, our model shows that constraints at the individual scale can generate highly complex patterns at the aggregate level.
△ Less
Submitted 11 June, 2021; v1 submitted 24 May, 2020;
originally announced May 2020.
-
Aligning biological sequences by exploiting residue conservation and coevolution
Authors:
Anna Paola Muntoni,
Andrea Pagnani,
Martin Weigt,
Francesco Zamponi
Abstract:
Sequences of nucleotides (for DNA and RNA) or amino acids (for proteins) are central objects in biology. Among the most important computational problems is that of sequence alignment, i.e. arranging sequences from different organisms in such a way to identify similar regions, to detect evolutionary relationships between sequences, and to predict biomolecular structure and function. This is typical…
▽ More
Sequences of nucleotides (for DNA and RNA) or amino acids (for proteins) are central objects in biology. Among the most important computational problems is that of sequence alignment, i.e. arranging sequences from different organisms in such a way to identify similar regions, to detect evolutionary relationships between sequences, and to predict biomolecular structure and function. This is typically addressed through profile models, which capture position-specificities like conservation in sequences, but assume an independent evolution of different positions. Over the last years, it has been well established that coevolution of different amino-acid positions is essential for maintaining three-dimensional structure and function. Modeling approaches based on inverse statistical physics can catch the coevolution signal in sequence ensembles; and they are now widely used in predicting protein structure, protein-protein interactions, and mutational landscapes. Here, we present DCAlign, an efficient alignment algorithm based on an approximate message-passing strategy, which is able to overcome the limitations of profile models, to include coevolution among positions in a general way, and to be therefore universally applicable to protein- and RNA-sequence alignment without the need of using complementary structural information. The potential of DCAlign is carefully explored using well-controlled simulated data, as well as real protein and RNA sequences.
△ Less
Submitted 13 November, 2020; v1 submitted 18 May, 2020;
originally announced May 2020.
-
Optimal Inflation Target: Insights from an Agent-Based Model
Authors:
Jean-Philippe Bouchaud,
Stanislao Gualdi,
Marco Tarzia,
Francesco Zamponi
Abstract:
Which level of inflation should Central Banks be targeting? We investigate this issue in the context of a simplified Agent Based Model of the economy. Depending on the value of the parameters that describe the behaviour of agents (in particular inflation anticipations), we find a rich variety of behaviour at the macro-level. Without any active monetary policy, our ABM economy can be in a high infl…
▽ More
Which level of inflation should Central Banks be targeting? We investigate this issue in the context of a simplified Agent Based Model of the economy. Depending on the value of the parameters that describe the behaviour of agents (in particular inflation anticipations), we find a rich variety of behaviour at the macro-level. Without any active monetary policy, our ABM economy can be in a high inflation/high output state, or in a low inflation/low output state. Hyper-inflation, deflation and "business cycles" between coexisting states are also found. We then introduce a Central Bank with a Taylor rule-based inflation target, and study the resulting aggregate variables. Our main result is that too-low inflation targets are in general detrimental to a CB-monitored economy. One symptom is a persistent under-realisation of inflation, perhaps similar to the current macroeconomic situation. Higher inflation targets are found to improve both unemployment and negative interest rate episodes. Our results are compared with the predictions of the standard DSGE model.
△ Less
Submitted 8 February, 2018; v1 submitted 15 September, 2017;
originally announced September 2017.
-
Monetary Policy and Dark Corners in a stylized Agent-Based Model
Authors:
Stanislao Gualdi,
Marco Tarzia,
Francesco Zamponi,
Jean-Philippe Bouchaud
Abstract:
We extend in a minimal way the stylized model introduced in in "Tipping Points in Macroeconomic Agent Based Models" [JEDC 50, 29-61 (2015)], with the aim of investigating the role and efficacy of monetary policy of a `Central Bank' that sets the interest rate such as to steer the economy towards a prescribed inflation and employment level. Our major finding is that provided its policy is not too a…
▽ More
We extend in a minimal way the stylized model introduced in in "Tipping Points in Macroeconomic Agent Based Models" [JEDC 50, 29-61 (2015)], with the aim of investigating the role and efficacy of monetary policy of a `Central Bank' that sets the interest rate such as to steer the economy towards a prescribed inflation and employment level. Our major finding is that provided its policy is not too aggressive (in a sense detailed in the paper) the Central Bank is successful in achieving its goals. However, the existence of different equilibrium states of the economy, separated by phase boundaries (or "dark corners"), can cause the monetary policy itself to trigger instabilities and be counter-productive. In other words, the Central Bank must navigate in a narrow window: too little is not enough, too much leads to instabilities and wildly oscillating economies. This conclusion strongly contrasts with the prediction of DSGE models.
△ Less
Submitted 12 January, 2016; v1 submitted 2 January, 2015;
originally announced January 2015.
-
Tipping points in macroeconomic Agent-Based models
Authors:
Stanislao Gualdi,
Marco Tarzia,
Francesco Zamponi,
Jean-Philippe Bouchaud
Abstract:
The aim of this work is to explore the possible types of phenomena that simple macroeconomic Agent-Based models (ABM) can reproduce. We propose a methodology, inspired by statistical physics, that characterizes a model through its 'phase diagram' in the space of parameters. Our first motivation is to understand the large macro-economic fluctuations observed in the 'Mark I' ABM. Our major finding i…
▽ More
The aim of this work is to explore the possible types of phenomena that simple macroeconomic Agent-Based models (ABM) can reproduce. We propose a methodology, inspired by statistical physics, that characterizes a model through its 'phase diagram' in the space of parameters. Our first motivation is to understand the large macro-economic fluctuations observed in the 'Mark I' ABM. Our major finding is the generic existence of a phase transition between a 'good economy' where unemployment is low, and a 'bad economy' where unemployment is high. We introduce a simpler framework that allows us to show that this transition is robust against many modifications of the model, and is generically induced by an asymmetry between the rate of hiring and the rate of firing of the firms. The unemployment level remains small until a tipping point, beyond which the economy suddenly collapses. If the parameters are such that the system is close to this transition, any small fluctuation is amplified as the system jumps between the two equilibria. We have explored several natural extensions of the model. One is to introduce a bankruptcy threshold, limiting the leverage of firms. This leads to a rich phase diagram with, in particular, a region where acute endogenous crises occur, during which the unemployment rate shoots up before the economy can recover. We also introduce simple wage policies. This leads to inflation (in the 'good' phase) or deflation (in the 'bad' phase), but leaves the overall phase diagram of the model essentially unchanged. We have also started exploring the effect of simple monetary policies that attempt to contain rising unemployment and defang crises. We end the paper with general comments on the usefulness of ABMs to model macroeconomic phenomena, in particular in view of the time needed to reach a steady state that raises the issue of ergodicity in these models.
△ Less
Submitted 20 August, 2014; v1 submitted 11 July, 2013;
originally announced July 2013.
-
Time-dependent Nonlinear Optical Susceptibility of an Out-of-Equilibrium Soft Material
Authors:
Neda Ghofraniha,
Claudio Conti,
Giancarlo Ruocco,
Francesco Zamponi
Abstract:
We investigate the time-dependent nonlinear optical absorption of a clay dispersion (Laponite) in organic dye (Rhodamine B) water solution displaying liquid-arrested state transition. Specifically, we determine the characteristic time $τ_D$ of the nonlinear susceptibility build-up due as to the Soret effect. By comparing $τ_D$ with the relaxation time provided by standard dynamic light scatterin…
▽ More
We investigate the time-dependent nonlinear optical absorption of a clay dispersion (Laponite) in organic dye (Rhodamine B) water solution displaying liquid-arrested state transition. Specifically, we determine the characteristic time $τ_D$ of the nonlinear susceptibility build-up due as to the Soret effect. By comparing $τ_D$ with the relaxation time provided by standard dynamic light scattering measurements we report on the decoupling of the two collective diffusion times at the two very different length scales during the aging of the out-of-equilibrium system. With this demonstration experiment we also show the potentiality of nonlinear optics measurements in the study of the late stage of arrest in soft materials.
△ Less
Submitted 26 January, 2009; v1 submitted 23 January, 2008;
originally announced January 2008.
-
Mode-locking transitions in nano-structured weakly disordered lasers
Authors:
L. Angelani,
C. Conti,
L. Prignano,
G. Ruocco,
F. Zamponi
Abstract:
We report on a statistical approach to mode-locking transitions of nano-structured laser cavities characterized by an enhanced density of states. We show that the equations for the interacting modes can be mapped onto a statistical model exhibiting a first order thermodynamic transition, with the average mode-energy playing the role of inverse temperature. The transition corresponds to a phase-l…
▽ More
We report on a statistical approach to mode-locking transitions of nano-structured laser cavities characterized by an enhanced density of states. We show that the equations for the interacting modes can be mapped onto a statistical model exhibiting a first order thermodynamic transition, with the average mode-energy playing the role of inverse temperature. The transition corresponds to a phase-locking of modes. Extended modes lead to a mean-field like model, while in presence of localized modes, as due to a small disorder, the model has short range interactions. We show that simple scaling arguments lead to observable differences between transitions involving extended modes and those involving localized modes. We also show that the dynamics of the light modes can be exactly solved, predicting a jump in the relaxation time of the coherence functions at the transition. Finally, we link the thermodynamic transition to a topological singularity of the phase space, as previously reported for similar models.
△ Less
Submitted 1 December, 2006;
originally announced December 2006.
-
Glassy behavior of light in random lasers
Authors:
Luca Angelani,
Claudio Conti,
Giancarlo Ruocco,
Francesco Zamponi
Abstract:
A theoretical analysis [Angelani et al., Phys. Rev. Lett. 96, 065702 (2006)] predicts glassy behaviour of light in a nonlinear random medium. This implies slow dynamics related to the presence of many metastable states. We consider very general equations (that also apply to other systems, like Bose-Condensed gases) describing light in a disordered non-linear medium and through some approximation…
▽ More
A theoretical analysis [Angelani et al., Phys. Rev. Lett. 96, 065702 (2006)] predicts glassy behaviour of light in a nonlinear random medium. This implies slow dynamics related to the presence of many metastable states. We consider very general equations (that also apply to other systems, like Bose-Condensed gases) describing light in a disordered non-linear medium and through some approximations we relate them to a mean-field spin-glass-like model. The model is solved by the replica method, and replica-symmetry breaking phase transition is predicted. The transition describes a mode-locking process in which the phases of the modes are locked to random (history and sample-dependent) values. The results are based on very general theory, and embrace a variety of physical phenomena.
△ Less
Submitted 12 September, 2006; v1 submitted 10 April, 2006;
originally announced April 2006.
-
Glassy behavior of light
Authors:
L. Angelani,
C. Conti,
G. Ruocco,
F. Zamponi
Abstract:
We study the nonlinear dynamics of a multi-mode random laser using the methods of statistical physics of disordered systems. A replica-symmetry breaking phase transition is predicted as a function of the pump intensity. We thus show that light propagating in a random non-linear medium displays glassy behavior, i.e. the photon gas has a multitude of metastable states and a non vanishing complexit…
▽ More
We study the nonlinear dynamics of a multi-mode random laser using the methods of statistical physics of disordered systems. A replica-symmetry breaking phase transition is predicted as a function of the pump intensity. We thus show that light propagating in a random non-linear medium displays glassy behavior, i.e. the photon gas has a multitude of metastable states and a non vanishing complexity, corresponding to mode-locking processes in random lasers. The present work reveals the existence of new physical phenomena, and demonstrates how nonlinear optics and random lasers can be a benchmark for the modern theory of complex systems and glasses.
△ Less
Submitted 17 November, 2005;
originally announced November 2005.
