-
Finding the right path: statistical mechanics of connected solutions in constraint satisfaction problems
Authors:
Damien Barbier
Abstract:
We define and study a statistical mechanics ensemble that characterizes connected solutions in constraint satisfaction problems (CSPs). Built around a well-known local entropy bias, it allows us to better identify hardness transitions in problems where the energy landscape is dominated by isolated solutions. We apply this new device to the symmetric binary perceptron model (SBP), and study how its…
▽ More
We define and study a statistical mechanics ensemble that characterizes connected solutions in constraint satisfaction problems (CSPs). Built around a well-known local entropy bias, it allows us to better identify hardness transitions in problems where the energy landscape is dominated by isolated solutions. We apply this new device to the symmetric binary perceptron model (SBP), and study how its manifold of connected solutions behaves. We choose this particular problem because, while its typical solutions are isolated, it can be solved using local algorithms for a certain range of constraint density $α$ and threshold $κ$. With this new ensemble, we unveil the presence of a cluster composed of delocalized connected solutions. In particular, we demonstrate its stability until a critical threshold $κ^{\rm no-mem}_{\rm loc.\, stab.}$ (dependent on $α$). This transition appears as paths of solutions shatter, a phenomenon that more conventional statistical mechanics approaches fail to grasp. Finally, we compared our predictions to simulations. For this, we used a modified Monte-Carlo algorithm, designed specifically to target these delocalized solutions. We obtained, as predicted, that the algorithm finds solutions until $κ\approxκ^{\rm no-mem}_{\rm loc.\, stab.}$.
△ Less
Submitted 27 May, 2025;
originally announced May 2025.
-
The phase diagram of compressed sensing with $\ell_0$-norm regularization
Authors:
Damien Barbier,
Carlo Lucibello,
Luca Saglietti,
Florent Krzakala,
Lenka Zdeborová
Abstract:
Noiseless compressive sensing is a two-steps setting that allows for undersampling a sparse signal and then reconstructing it without loss of information. The LASSO algorithm, based on $\lone$ regularization, provides an efficient and robust to address this problem, but it fails in the regime of very high compression rate. Here we present two algorithms based on $\lzero$-norm regularization instea…
▽ More
Noiseless compressive sensing is a two-steps setting that allows for undersampling a sparse signal and then reconstructing it without loss of information. The LASSO algorithm, based on $\lone$ regularization, provides an efficient and robust to address this problem, but it fails in the regime of very high compression rate. Here we present two algorithms based on $\lzero$-norm regularization instead that outperform the LASSO in terms of compression rate in the Gaussian design setting for measurement matrix. These algorithms are based on the Approximate Survey Propagation, an algorithmic family within the Approximate Message Passing class. In the large system limit, they can be rigorously tracked through State Evolution equations and it is possible to exactly predict the range compression rates for which perfect signal reconstruction is possible. We also provide a statistical physics analysis of the $\lzero$-norm noiseless compressive sensing model. We show the existence of both a replica symmetric state and a 1-step replica symmmetry broken (1RSB) state for sufficiently low $\lzero$-norm regularization. The recovery limits of our algorithms are linked to the behavior of the 1RSB solution.
△ Less
Submitted 22 August, 2024; v1 submitted 31 July, 2024;
originally announced August 2024.
-
How to escape atypical regions in the symmetric binary perceptron: a journey through connected-solutions states
Authors:
Damien Barbier
Abstract:
We study the binary symmetric perceptron model, and in particular its atypical solutions. While the solution-space of this problem is dominated by isolated configurations, it is also solvable for a certain range of constraint density $α$ and threshold $κ$. We provide in this paper a statistical measure probing sequences of solutions, where two consecutive elements shares a strong overlap. After si…
▽ More
We study the binary symmetric perceptron model, and in particular its atypical solutions. While the solution-space of this problem is dominated by isolated configurations, it is also solvable for a certain range of constraint density $α$ and threshold $κ$. We provide in this paper a statistical measure probing sequences of solutions, where two consecutive elements shares a strong overlap. After simplifications, we test its predictions by comparing it to Monte-Carlo simulations. We obtain good agreement and show that connected states with a Markovian correlation profile can fully decorrelate from their initialization only for $κ>κ_{\rm no-mem.\, state}$ ($κ_{\rm no-mem.\, state}\sim \sqrt{0.91\log(N)}$ for $α=0.5$ and $N$ being the dimension of the problem). For $κ<κ_{\rm no-mem.\, state}$, we show that decorrelated sequences still exist but have a non-trivial correlations profile. To study this regime we introduce an $Ansatz$ for the correlations that we label as the nested Markov chain.
△ Less
Submitted 30 January, 2025; v1 submitted 8 August, 2024;
originally announced August 2024.
-
On the Atypical Solutions of the Symmetric Binary Perceptron
Authors:
Damien Barbier,
Ahmed El Alaoui,
Florent Krzakala,
Lenka Zdeborová
Abstract:
We study the random binary symmetric perceptron problem, focusing on the behavior of rare high-margin solutions. While most solutions are isolated, we demonstrate that these rare solutions are part of clusters of extensive entropy, heuristically corresponding to non-trivial fixed points of an approximate message-passing algorithm. We enumerate these clusters via a local entropy, defined as a Franz…
▽ More
We study the random binary symmetric perceptron problem, focusing on the behavior of rare high-margin solutions. While most solutions are isolated, we demonstrate that these rare solutions are part of clusters of extensive entropy, heuristically corresponding to non-trivial fixed points of an approximate message-passing algorithm. We enumerate these clusters via a local entropy, defined as a Franz-Parisi potential, which we rigorously evaluate using the first and second moment methods in the limit of a small constraint density $α$ (corresponding to vanishing margin $κ$) under a certain assumption on the concentration of the entropy. This examination unveils several intriguing phenomena: i) We demonstrate that these clusters have an entropic barrier in the sense that the entropy as a function of the distance from the reference high-margin solution is non-monotone when $κ\le 1.429 \sqrt{-α/\logα}$, while it is monotone otherwise, and that they have an energetic barrier in the sense that there are no solutions at an intermediate distance from the reference solution when $κ\le 1.239 \sqrt{-α/ \logα}$. The critical scaling of the margin $κ$ in $\sqrt{-α/\logα}$ corresponds to the one obtained from the earlier work of Gamarnik et al. (2022) for the overlap-gap property, a phenomenon known to present a barrier to certain efficient algorithms. ii) We establish using the replica method that the complexity (the logarithm of the number of clusters of such solutions) versus entropy (the logarithm of the number of solutions in the clusters) curves are partly non-concave and correspond to very large values of the Parisi parameter, with the equilibrium being reached when the Parisi parameter diverges.
△ Less
Submitted 28 June, 2024; v1 submitted 4 October, 2023;
originally announced October 2023.
-
Compressed sensing with l0-norm: statistical physics analysis and algorithms for signal recovery
Authors:
D. Barbier,
C Lucibello,
L. Saglietti,
F. Krzakala,
L. Zdeborova
Abstract:
Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently, the algorithm offering the best tradeoff between compression rate, robustness, and speed for compressive sensing is the LASSO (l1-norm bias) algorithm. However,…
▽ More
Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently, the algorithm offering the best tradeoff between compression rate, robustness, and speed for compressive sensing is the LASSO (l1-norm bias) algorithm. However, many studies have pointed out the possibility that the implementation of lp-norms biases, with p smaller than one, could give better performance while sacrificing convexity. In this work, we focus specifically on the extreme case of the l0-based reconstruction, a task that is complicated by the discontinuity of the loss. In the first part of the paper, we describe via statistical physics methods, and in particular the replica method, how the solutions to this optimization problem are arranged in a clustered structure. We observe two distinct regimes: one at low compression rate where the signal can be recovered exactly, and one at high compression rate where the signal cannot be recovered accurately. In the second part, we present two message-passing algorithms based on our first results for the l0-norm optimization problem. The proposed algorithms are able to recover the signal at compression rates higher than the ones achieved by LASSO while being computationally efficient.
△ Less
Submitted 24 April, 2023;
originally announced April 2023.
-
Generalised Gibbs Ensemble for spherically constrained harmonic models
Authors:
Damien Barbier,
Leticia F. Cugliandolo,
Gustavo S. Lozano,
Nicolás Nessi
Abstract:
We build and analytically calculate the Generalised Gibbs Ensemble partition function of the integrable Soft Neumann Model. This is the model of a classical particle which is constrained to move, on average over the initial conditions, on an $N$ dimensional sphere, and feels the effect of anisotropic harmonic potentials. We derive all relevant averaged static observables in the (thermodynamic)…
▽ More
We build and analytically calculate the Generalised Gibbs Ensemble partition function of the integrable Soft Neumann Model. This is the model of a classical particle which is constrained to move, on average over the initial conditions, on an $N$ dimensional sphere, and feels the effect of anisotropic harmonic potentials. We derive all relevant averaged static observables in the (thermodynamic) $N\rightarrow\infty$ limit. We compare them to their long-term dynamic averages finding excellent agreement in all phases of a non-trivial phase diagram determined by the characteristics of the initial conditions and the amount of energy injected or extracted in an instantaneous quench. We discuss the implications of our results for the proper Neumann model in which the spherical constraint is imposed strictly.
△ Less
Submitted 5 July, 2022; v1 submitted 6 April, 2022;
originally announced April 2022.
-
Destruction of Localization by Thermal Inclusions: Anomalous Transport and Griffiths Effects in the Anderson and André-Aubry-Harper Models
Authors:
Xhek Turkeshi,
Damien Barbier,
Leticia F. Cugliandolo,
Marco Schirò,
Marco Tarzia
Abstract:
We discuss and compare two recently proposed toy models for anomalous transport and Griffiths effects in random systems near the Many-Body Localization transitions: the random dephasing model, which adds thermal inclusions in an Anderson Insulator as local Markovian dephasing channels that heat up the system, and the random Gaussian Orthogonal Ensemble (GOE) approach which models them in terms of…
▽ More
We discuss and compare two recently proposed toy models for anomalous transport and Griffiths effects in random systems near the Many-Body Localization transitions: the random dephasing model, which adds thermal inclusions in an Anderson Insulator as local Markovian dephasing channels that heat up the system, and the random Gaussian Orthogonal Ensemble (GOE) approach which models them in terms of ensembles of random regular graphs. For these two settings we discuss and compare transport and dissipative properties and their statistics. We show that both types of dissipation lead to similar Griffiths-like phenomenology, with the GOE bath being less effective in thermalising the system due to its finite bandwidth. We then extend these models to the case of a quasi-periodic potential as described by the André-Aubry-Harper model coupled to random thermal inclusions, that we show to display, for large strength of the quasiperiodic potential, a similar phenomenology to the one of the purely random case. In particular, we show the emergence of subdiffusive transport and broad statistics of the local density of states, suggestive of Griffiths like effects arising from the interplay between quasiperiodic localization and random coupling to the baths.
△ Less
Submitted 24 April, 2022; v1 submitted 29 November, 2021;
originally announced November 2021.
-
Finite size effects and loss of self-averageness in the relaxational dynamics of the spherical Sherrington-Kirkpatrick model
Authors:
Damien Barbier,
Pedro H. de Freitas Pimenta,
Leticia F. Cugliandolo,
Daniel A. Stariolo
Abstract:
We revisit the gradient descent dynamics of the spherical Sherrington-Kirkpatrick ($p=2$) model with finite number of degrees of freedom. For fully random initial conditions we confirm that the relaxation takes place in three time regimes: a first algebraic one controlled by the decay of the eigenvalue distribution of the random exchange interaction matrix at its edge in the infinite size limit; a…
▽ More
We revisit the gradient descent dynamics of the spherical Sherrington-Kirkpatrick ($p=2$) model with finite number of degrees of freedom. For fully random initial conditions we confirm that the relaxation takes place in three time regimes: a first algebraic one controlled by the decay of the eigenvalue distribution of the random exchange interaction matrix at its edge in the infinite size limit; a faster algebraic one determined by the distribution of the gap between the two extreme eigenvalues; and a final exponential one determined by the minimal gap sampled in the disorder average. We also analyse the finite size effects on the relaxation from initial states which are almost projected on the saddles of the potential energy landscape, and we show that for deviations scaling as $N^{-ν}$ from perfect alignment the system escapes the initial configuration in a time-scale scaling as $\ln N$ after which the dynamics no longer "self-averages" with respect to the initial conditions. We prove these statements with a combination of analytic and numerical methods.
△ Less
Submitted 1 April, 2021; v1 submitted 23 March, 2021;
originally announced March 2021.
-
(Non equilibrium) Thermodynamics of Integrable models: The Generalized Gibbs Ensemble description of the classical Neumann Model
Authors:
Damien Barbier,
Leticia F. Cugliandolo,
Gustavo S. Lozano,
Nicolas Nessi
Abstract:
We study a classical integrable (Neumann) model describing the motion of a particle on the sphere, subject to harmonic forces. We tackle the problem in the infinite dimensional limit by introducing a soft version in which the spherical constraint is imposed only on average over initial conditions. We show that the Generalized Gibbs Ensemble captures the long-time averages of the soft model. We rev…
▽ More
We study a classical integrable (Neumann) model describing the motion of a particle on the sphere, subject to harmonic forces. We tackle the problem in the infinite dimensional limit by introducing a soft version in which the spherical constraint is imposed only on average over initial conditions. We show that the Generalized Gibbs Ensemble captures the long-time averages of the soft model. We reveal the full dynamic phase diagram with extended, quasi-condensed, coordinate-, and coordinate and momentum-condensed phases. The scaling properties of the fluctuations allow us to establish in which cases the strict and soft spherical constraints are equivalent, confirming the validity of the GGE hypothesis for the Neumann model on a large portion of the dynamic phase diagram.
△ Less
Submitted 28 July, 2020;
originally announced July 2020.
-
A constrained TAP approach for disordered spin models: application to the mixed spherical case
Authors:
Damien Barbier,
Leticia Cugliandolo
Abstract:
We revisit the metastability properties of the mixed p-spin spherical disordered models. Firstly, using known methods, we show that there is temperature chaos in a broad range of temperatures. Secondly, we modify the definition of the Thouless-Anderson-Palmer free energy density by including constraints that enforce a chosen overlap between the searched metastable states and another reference stat…
▽ More
We revisit the metastability properties of the mixed p-spin spherical disordered models. Firstly, using known methods, we show that there is temperature chaos in a broad range of temperatures. Secondly, we modify the definition of the Thouless-Anderson-Palmer free energy density by including constraints that enforce a chosen overlap between the searched metastable states and another reference state, that could be a characteristic one of a different temperature. We argue that this refined analysis provides clues to understand the weird behaviour of the low temperature relaxation dynamics of these models, and suggests ways to improve the treatment of the initial conditions to overcome the difficulties encountered so far.
△ Less
Submitted 16 June, 2020; v1 submitted 27 November, 2019;
originally announced November 2019.
-
Pre-asymptotic dynamics of the infinite size Neumann (p=2 spherical) model
Authors:
Damien Barbier,
Leticia F. Cugliandolo,
Gustavo S. Lozano,
Nicolas Nessi,
Marco Picco,
Alessandro Tartaglia
Abstract:
In this contribution we further study the classical disordered p=2 spherical model with Hamiltonian dynamics, or in integrable systems terms, the Neumann model, in the infinite size limit. We summarise the asymptotic results that some of us presented in a recent publication, and we deepen the analysis of the pre-asymptotic dynamics. We also discuss the possible description of the asymptotic steady…
▽ More
In this contribution we further study the classical disordered p=2 spherical model with Hamiltonian dynamics, or in integrable systems terms, the Neumann model, in the infinite size limit. We summarise the asymptotic results that some of us presented in a recent publication, and we deepen the analysis of the pre-asymptotic dynamics. We also discuss the possible description of the asymptotic steady state with a Generalised Gibbs Ensemble.
△ Less
Submitted 18 February, 2019;
originally announced February 2019.
-
Hybrid integrated optical waveguides in glass for enhanced visible photoluminescence of nanoemitters
Authors:
J. Beltran Madrigal,
R. Tellez-limon,
F. Gardillou,
D. Barbier,
W. Geng,
C. Couteau,
R. Salas-montiel,
S. Blaize
Abstract:
Integrated optical devices able to control light matter interactions on the nanoscale have attracted the attention of the scientific community in recent years. However, most of these devices are based on silicon waveguides, limiting their use for telecommunication wavelengths. In this contribution, we propose an integrated device that operates with light in the visible spectrum. The proposed devic…
▽ More
Integrated optical devices able to control light matter interactions on the nanoscale have attracted the attention of the scientific community in recent years. However, most of these devices are based on silicon waveguides, limiting their use for telecommunication wavelengths. In this contribution, we propose an integrated device that operates with light in the visible spectrum. The proposed device is a hybrid structure consisting of a high-refractive-index layer placed on top of an ion-exchanged glass waveguide. We demonstrate that this hybrid structure serves as an efficient light coupler for the excitation of nanoemitters. The numerical and experimental results show that the device can enhance the electromagnetic field confinement up to 11 times, allowing a higher photoluminescence signal from nanocrystals placed on its surface. The designed device opens new perspectives in the generation of new optical devices suitable for quantum information or for optical sensing.
△ Less
Submitted 3 September, 2018;
originally announced September 2018.
-
Influence of severe plastic deformation on the precipitation hardening of a FeSiTi steel
Authors:
Amélie Fillon,
Xavier Sauvage,
Arnaud Pougis,
Olivier Bouaziz,
David Barbier,
Roxane Arruffat,
Laszlo Toth
Abstract:
The combined strengthening effects of grain refinement and high precipitated volume fraction (~6at.%) on the mechanical properties of FeSiTi alloy subjected to SPD processing prior to aging treatment were investigated by atom probe tomography and scanning transmission electron microscopy. It was shown that the refinement of the microstructure affects the precipitation kinetics and the spatial dist…
▽ More
The combined strengthening effects of grain refinement and high precipitated volume fraction (~6at.%) on the mechanical properties of FeSiTi alloy subjected to SPD processing prior to aging treatment were investigated by atom probe tomography and scanning transmission electron microscopy. It was shown that the refinement of the microstructure affects the precipitation kinetics and the spatial distribution of the secondary hardening intermetallic phase, which was observed to nucleate heterogeneously on dislocations and sub-grain boundaries. It was revealed that alloys successively subjected to these two strengthening mechanisms exhibit a lower increase in mechanical strength than a simple estimation based on the summation of the two individual strengthening mechanisms.
△ Less
Submitted 7 September, 2012;
originally announced September 2012.
