-
Emblems of pair density waves: dual identity of topological defects and their transport signatures
Authors:
Omri Lesser,
Chunli Huang,
James P. Sethna,
Eun-Ah Kim
Abstract:
The pair density wave (PDW) exemplifies intertwined orders in strongly correlated systems. A recent discovery of superconductivity in a quarter-metal state offers the first experimental system where a pure PDW without uniform superconductivity is suspected, offering a unique opportunity to examine the consequences of intertwined orders. A pure two-dimensional PDW supports an unusual fractional exc…
▽ More
The pair density wave (PDW) exemplifies intertwined orders in strongly correlated systems. A recent discovery of superconductivity in a quarter-metal state offers the first experimental system where a pure PDW without uniform superconductivity is suspected, offering a unique opportunity to examine the consequences of intertwined orders. A pure two-dimensional PDW supports an unusual fractional excitation as its topological defect (TD). A TD simultaneously winds the phase of the Cooper pair and distorts the amplitude modulation -- a dual role reflecting its intertwined character. As a vortex, a TD carries fractional vorticity of $\frac{1}{3} h/2e$, whose movement would cause resistance. As a crystalline defect, a TD can be sourced by charge disorder in the system. We show that experimentally observed resistive switching can originate from mobile TDs, while a small magnetic field will restore zero resistance by blocking their motion. The resulting resistive state exhibits extreme anisotropy and a Hall response, with the Hall angle determined by the angle between the current and the TD's Burgers vector. These features will serve as confirmation of the dual identity of topological defects as emblems of PDW order.
△ Less
Submitted 9 June, 2025;
originally announced June 2025.
-
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models
Authors:
Jialin Mao,
Itay Griniasty,
Yan Sun,
Mark K. Transtrum,
James P. Sethna,
Pratik Chaudhari
Abstract:
Recent experiments have shown that training trajectories of multiple deep neural networks with different architectures, optimization algorithms, hyper-parameter settings, and regularization methods evolve on a remarkably low-dimensional "hyper-ribbon-like" manifold in the space of probability distributions. Inspired by the similarities in the training trajectories of deep networks and linear netwo…
▽ More
Recent experiments have shown that training trajectories of multiple deep neural networks with different architectures, optimization algorithms, hyper-parameter settings, and regularization methods evolve on a remarkably low-dimensional "hyper-ribbon-like" manifold in the space of probability distributions. Inspired by the similarities in the training trajectories of deep networks and linear networks, we analytically characterize this phenomenon for the latter. We show, using tools in dynamical systems theory, that the geometry of this low-dimensional manifold is controlled by (i) the decay rate of the eigenvalues of the input correlation matrix of the training data, (ii) the relative scale of the ground-truth output to the weights at the beginning of training, and (iii) the number of steps of gradient descent. By analytically computing and bounding the contributions of these quantities, we characterize phase boundaries of the region where hyper-ribbons are to be expected. We also extend our analysis to kernel machines and linear models that are trained with stochastic gradient descent.
△ Less
Submitted 13 May, 2025;
originally announced May 2025.
-
Rigidity transitions in anisotropic networks happen in multiple steps
Authors:
William Y. Wang,
Stephen J. Thornton,
Bulbul Chakraborty,
Anna Barth,
Navneet Singh,
Japheth Omonira,
Jonathan A. Michel,
Moumita Das,
James P. Sethna,
Itai Cohen
Abstract:
We study how the rigidity transition in a triangular lattice changes as a function of anisotropy by preferentially filling bonds on the lattice in one direction. We discover that the onset of rigidity in anisotropic spring networks arises in at least two steps, reminiscent of the two-step melting transition in two dimensional crystals. In particular, our simulations demonstrate that the percolatio…
▽ More
We study how the rigidity transition in a triangular lattice changes as a function of anisotropy by preferentially filling bonds on the lattice in one direction. We discover that the onset of rigidity in anisotropic spring networks arises in at least two steps, reminiscent of the two-step melting transition in two dimensional crystals. In particular, our simulations demonstrate that the percolation of stress-supporting bonds happens at different critical volume fractions along different directions. By examining each independent component of the elasticity tensor, we determine universal exponents and develop universal scaling functions to analyze isotropic rigidity percolation as a multicritical point. We expect that these results will be important for elucidating the underlying mechanical phase transitions governing the properties of biological materials ranging from the cytoskeletons of cells to the extracellular networks of tissues such as tendon where the networks are often preferentially aligned.
△ Less
Submitted 13 September, 2024;
originally announced September 2024.
-
Universal scaling solution for a rigidity transition: renormalization group flows near the upper critical dimension
Authors:
Stephen J. Thornton,
Danilo B. Liarte,
Itai Cohen,
James P. Sethna
Abstract:
Rigidity transitions induced by the formation of system-spanning disordered rigid clusters, like the jamming transition, can be well-described in most physically relevant dimensions by mean-field theories. A dynamical mean-field theory commonly used to study these transitions, the coherent potential approximation (CPA), shows logarithmic corrections in $2$ dimensions. By solving the theory in arbi…
▽ More
Rigidity transitions induced by the formation of system-spanning disordered rigid clusters, like the jamming transition, can be well-described in most physically relevant dimensions by mean-field theories. A dynamical mean-field theory commonly used to study these transitions, the coherent potential approximation (CPA), shows logarithmic corrections in $2$ dimensions. By solving the theory in arbitrary dimensions and extracting the universal scaling predictions, we show that these logarithmic corrections are a symptom of an upper critical dimension $d_{u}=2$, below which the critical exponents are modified. We recapitulate Ken Wilson's phenomenology of the $(4-ε)$-dimensional Ising model, but with the upper critical dimension reduced to $2$. We interpret this using normal form theory as a transcritical bifurcation in the RG flows and extract the universal nonlinear coefficients to make explicit predictions for the behavior near $2$ dimensions. This bifurcation is driven by a variable that is dangerously irrelevant in all dimensions $d>2$ which incorporates the physics of long-wavelength phonons and low-frequency elastic dissipation. We derive universal scaling functions from the CPA sufficient to predict all linear response in randomly diluted isotropic elastic systems in all dimensions.
△ Less
Submitted 13 August, 2024; v1 submitted 19 July, 2024;
originally announced July 2024.
-
Jamming memory into acoustically trained dense suspensions under shear
Authors:
Edward Y. X. Ong,
Anna R. Barth,
Navneet Singh,
Meera Ramaswamy,
Abhishek Shetty,
Bulbul Chakraborty,
James P. Sethna,
Itai Cohen
Abstract:
Systems driven far from equilibrium often retain structural memories of their processing history. This memory has, in some cases, been shown to dramatically alter the material response. For example, work hardening in crystalline metals can alter the hardness, yield strength, and tensile strength to prevent catastrophic failure. Whether memory of processing history can be similarly exploited in flo…
▽ More
Systems driven far from equilibrium often retain structural memories of their processing history. This memory has, in some cases, been shown to dramatically alter the material response. For example, work hardening in crystalline metals can alter the hardness, yield strength, and tensile strength to prevent catastrophic failure. Whether memory of processing history can be similarly exploited in flowing systems, where significantly larger changes in structure should be possible, remains poorly understood. Here, we demonstrate a promising route to embedding such useful memories. We build on work showing that exposing a sheared dense suspension to acoustic perturbations of different power allows for dramatically tuning the sheared suspension viscosity and underlying structure. We find that, for sufficiently dense suspensions, upon removing the acoustic perturbations, the suspension shear jams with shear stress contributions from the maximum compressive and maximum extensive axes that reflect the acoustic training. Because the contributions from these two orthogonal axes to the total shear stress are antagonistic, it is possible to tune the resulting suspension response in surprising ways. For example, we show that differently trained sheared suspensions exhibit: 1) different susceptibility to the same acoustic perturbation; 2) orders of magnitude changes in their instantaneous viscosities upon shear reversal; and 3) even a shear stress that increases in magnitude upon shear cessation. To further illustrate the power of this approach for controlling suspension properties, we demonstrate that flowing states well below the shear jamming threshold can be shear jammed via acoustic training. Collectively, our work paves the way for using acoustically induced memory in dense suspensions to generate rapidly and widely tunable materials.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
Phase transitions beyond criticality: extending Ising universal scaling functions to describe entire phases
Authors:
David Hathcock,
James P. Sethna
Abstract:
Universal scaling laws only apply asymptotically near critical phase transitions. We propose a general scheme, based on normal form theory of renormalization group flows, for incorporating corrections to scaling that quantitatively describe the entire neighboring phases. Expanding Onsager's exact solution of the 2D Ising model about the critical point, we identify a special coordinate with radius…
▽ More
Universal scaling laws only apply asymptotically near critical phase transitions. We propose a general scheme, based on normal form theory of renormalization group flows, for incorporating corrections to scaling that quantitatively describe the entire neighboring phases. Expanding Onsager's exact solution of the 2D Ising model about the critical point, we identify a special coordinate with radius of convergence covering the entire physical temperature range, $0<T<\infty$. Without an exact solution, we demonstrate that using solely the critical singularity with low- and high-temperature expansions leads to exponentially converging approximations across all temperatures for both the 2D and 3D Ising free energies and the 3D magnetization. We discuss challenges and opportunities for future work.
△ Less
Submitted 4 August, 2024; v1 submitted 28 February, 2024;
originally announced February 2024.
-
The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold
Authors:
Jialin Mao,
Itay Griniasty,
Han Kheng Teoh,
Rahul Ramesh,
Rubing Yang,
Mark K. Transtrum,
James P. Sethna,
Pratik Chaudhari
Abstract:
We develop information-geometric techniques to analyze the trajectories of the predictions of deep networks during training. By examining the underlying high-dimensional probabilistic models, we reveal that the training process explores an effectively low-dimensional manifold. Networks with a wide range of architectures, sizes, trained using different optimization methods, regularization technique…
▽ More
We develop information-geometric techniques to analyze the trajectories of the predictions of deep networks during training. By examining the underlying high-dimensional probabilistic models, we reveal that the training process explores an effectively low-dimensional manifold. Networks with a wide range of architectures, sizes, trained using different optimization methods, regularization techniques, data augmentation techniques, and weight initializations lie on the same manifold in the prediction space. We study the details of this manifold to find that networks with different architectures follow distinguishable trajectories but other factors have a minimal influence; larger networks train along a similar manifold as that of smaller networks, just faster; and networks initialized at very different parts of the prediction space converge to the solution along a similar manifold.
△ Less
Submitted 19 March, 2024; v1 submitted 2 May, 2023;
originally announced May 2023.
-
Universal scaling function ansatz for finite-temperature jamming
Authors:
Sean A. Ridout,
Andrea J. Liu,
James P. Sethna
Abstract:
We cast a nonzero-temperature analysis of the jamming transition into the framework of a scaling ansatz. We show that four distinct regimes for scaling exponents of thermodynamic derivatives of the free energy such as pressure, bulk and shear moduli, can be consolidated by introducing a universal scaling function with two branches. Both the original analysis and the scaling theory assume that the…
▽ More
We cast a nonzero-temperature analysis of the jamming transition into the framework of a scaling ansatz. We show that four distinct regimes for scaling exponents of thermodynamic derivatives of the free energy such as pressure, bulk and shear moduli, can be consolidated by introducing a universal scaling function with two branches. Both the original analysis and the scaling theory assume that the system always resides in a single basis in the energy landscape. The two branches are separated by a line $T^*(Δφ)$ in the $T-Δφ$ plane, where $Δφ=φ-φ_c^Λ$ is the deviation of the packing fraction from its critical, jamming value, $φ_c^Λ$, for that basin. The branch for $T<T^*(Δφ)$ reduces at $T=0$ to an earlier scaling ansatz that is restricted to $T=0$, $Δφ\ge 0$, while the branch for $T>T^*(Δφ)$ reproduces exponents observed for thermal hard spheres. In contrast to the usual scenario for critical phenomena, the two branches are characterized by different exponents. We suggest that this unusual feature can be resolved by the existence of a dangerous irrelevant variable $u$, which can appear to modify exponents if the leading $u=0$ term is sufficiently small in the regime described by one of the two branches of the scaling function.
△ Less
Submitted 27 March, 2024; v1 submitted 21 April, 2023;
originally announced April 2023.
-
Normal forms, universal scaling functions, and extending the validity of the RG
Authors:
James P. Sethna,
David Hathcock,
Jaron Kent-Dobias,
Archishman Raju
Abstract:
Our community has a deep and sophisticated understanding of phase transitions and their universal scaling functions. We outline and advocate an ambitious program to use this understanding as an anchor for describing the surrounding phases. We explain how to use normal form theory to write universal scaling functions in systems where the renormalization-group flows cannot be linearized. We use the…
▽ More
Our community has a deep and sophisticated understanding of phase transitions and their universal scaling functions. We outline and advocate an ambitious program to use this understanding as an anchor for describing the surrounding phases. We explain how to use normal form theory to write universal scaling functions in systems where the renormalization-group flows cannot be linearized. We use the 2d Ising model to demonstrate how to calculate high-precision implementations of universal scaling functions, and how to extend them into a complete description of the surrounding phases. We discuss prospects and challenges involved into extending these early successes to the many other systems where the RG has successfully described emergent scale invariance, making them invaluable tools for engineers, biologists, and social scientists studying complex systems.
△ Less
Submitted 24 April, 2023; v1 submitted 31 March, 2023;
originally announced April 2023.
-
Bifurcation instructed design of multistate machines
Authors:
Teaya Yang,
David Hathcock,
Yuchao Chen,
Paul McEuen,
James P. Sethna,
Itai Cohen,
Itay Griniasty
Abstract:
We propose a novel design paradigm for multistate machines where transitions from one state to another are organized by bifurcations of multiple equilibria of the energy landscape describing the collective interactions of the machine components. This design paradigm is attractive since, near bifurcations, small variations in a few control parameters can result in large changes to the system's stat…
▽ More
We propose a novel design paradigm for multistate machines where transitions from one state to another are organized by bifurcations of multiple equilibria of the energy landscape describing the collective interactions of the machine components. This design paradigm is attractive since, near bifurcations, small variations in a few control parameters can result in large changes to the system's state providing an emergent lever mechanism. Further, the topological configuration of transitions between states near such bifurcations ensures robust operation, making the machine less sensitive to fabrication errors and noise. To design such machines, we develop and implement a new efficient algorithm that searches for interactions between the machine components that give rise to energy landscapes with these bifurcation structures. We demonstrate a proof of concept for this approach by designing magneto elastic machines whose motions are primarily guided by their magnetic energy landscapes and show that by operating near bifurcations we can achieve multiple transition pathways between states. This proof of concept demonstration illustrates the power of this approach, which could be especially useful for soft robotics and at the microscale where typical macroscale designs are difficult to implement.
△ Less
Submitted 4 January, 2023;
originally announced January 2023.
-
Jamming and Unusual Charge Density Fluctuations of Strange Metals
Authors:
Stephen J. Thornton,
Danilo B. Liarte,
Peter Abbamonte,
James P. Sethna,
Debanjan Chowdhury
Abstract:
The strange metallic regime across a number of high-temperature superconducting materials presents numerous challenges to the classic theory of Fermi liquid metals. Recent measurements of the dynamical charge response of strange metals, including optimally doped cuprates, have revealed a broad, featureless continuum of excitations, extending over much of the Brillouin zone. The collective density…
▽ More
The strange metallic regime across a number of high-temperature superconducting materials presents numerous challenges to the classic theory of Fermi liquid metals. Recent measurements of the dynamical charge response of strange metals, including optimally doped cuprates, have revealed a broad, featureless continuum of excitations, extending over much of the Brillouin zone. The collective density oscillations of this strange metal decay into the continuum in a manner that is at odds with the expectations of Fermi liquid theory. Inspired by these observations, we investigate the phenomenology of bosonic collective modes and the particle-hole excitations in a class of strange metals by making an analogy to the phonons of classical lattices falling apart across an unconventional jamming-like transition associated with the onset of rigidity. By making comparisons to the experimentally measured dynamical response functions, we reproduce many of the qualitative features using the above framework. We conjecture that the dynamics of electronic charge density over an intermediate range of energy scales in a class of strongly correlated metals can be at the brink of a jamming-like transition.
△ Less
Submitted 14 July, 2023; v1 submitted 28 October, 2022;
originally announced October 2022.
-
Avalanches and deformation in glasses and disordered systems
Authors:
Alberto Rosso,
James P. Sethna,
Matthieu Wyart
Abstract:
In this chapter, we discuss avalanches in glasses and disordered systems, and the macroscopic dynamical behavior that they mediate. We briefly review three classes of systems where avalanches are observed: depinning transition of disordered interfaces, yielding of amorphous materials, and the jamming transition. Without extensive formalism, we discuss results gleaned from theoretical approaches --…
▽ More
In this chapter, we discuss avalanches in glasses and disordered systems, and the macroscopic dynamical behavior that they mediate. We briefly review three classes of systems where avalanches are observed: depinning transition of disordered interfaces, yielding of amorphous materials, and the jamming transition. Without extensive formalism, we discuss results gleaned from theoretical approaches -- mean-field theory, scaling and exponent relations, the renormalization group, and a few results from replica theory. We focus both on the remarkably sophisticated physics of avalanches and on relatively new approaches to the macroscopic flow behavior exhibited past the depinning/yielding transition.
△ Less
Submitted 1 September, 2022; v1 submitted 8 August, 2022;
originally announced August 2022.
-
Power laws in physics
Authors:
James P. Sethna
Abstract:
Getting the most from power-law-type data can be challenging. James Sethna points out some of the pitfalls in studying power laws arising from emergent scale invariance, as well as important opportunities.
Getting the most from power-law-type data can be challenging. James Sethna points out some of the pitfalls in studying power laws arising from emergent scale invariance, as well as important opportunities.
△ Less
Submitted 5 August, 2022;
originally announced August 2022.
-
Average Evolution and Size-Topology Relations for Coarsening 2d Dry Foams
Authors:
Anthony T. Chieco,
James P. Sethna,
Douglas J. Durian
Abstract:
Two-dimensional dry foams coarsen according to the von Neumann law as $dA/dt \propto (n-6)$ where $n$ is the number of sides of a bubble with area $A$. Such foams reach a self-similar scaling state where area and side-number distributions are stationary. Combining self-similarity with the von Neumann law, we derive time derivatives of moments of the bubble area distribution and a relation connecti…
▽ More
Two-dimensional dry foams coarsen according to the von Neumann law as $dA/dt \propto (n-6)$ where $n$ is the number of sides of a bubble with area $A$. Such foams reach a self-similar scaling state where area and side-number distributions are stationary. Combining self-similarity with the von Neumann law, we derive time derivatives of moments of the bubble area distribution and a relation connecting area moments with averages of the side-number distribution that are weighted by powers of bubble area. To test these predictions, we collect and analyze high precision image data for a large number of bubbles squashed between parallel acrylic plates and allowed to coarsen into the self-similar scaling state. We find good agreement for moments ranging from two to twenty.
△ Less
Submitted 5 July, 2022; v1 submitted 23 May, 2022;
originally announced May 2022.
-
Incorporating tunability into a universal scaling framework for shear thickening
Authors:
Meera Ramaswamy,
Itay Griniasty,
James P Sethna,
Bulbul Chakraborty,
Itai Cohen
Abstract:
Recently, we proposed a universal scaling framework that shows shear thickening in dense suspensions is governed by the crossover between two critical points: one associated with frictionless isotropic jamming and a second corresponding to frictional shear jamming. Here, we show that orthogonal perturbations to the flows, an effective method for tuning shear thickening, can also be folded into thi…
▽ More
Recently, we proposed a universal scaling framework that shows shear thickening in dense suspensions is governed by the crossover between two critical points: one associated with frictionless isotropic jamming and a second corresponding to frictional shear jamming. Here, we show that orthogonal perturbations to the flows, an effective method for tuning shear thickening, can also be folded into this universal scaling framework. Specifically, we show that the effect of adding in orthogonal shear perturbations (OSP) can be incorporated by simply altering the scaling variable to include a multiplicative term that decreases with the normalized OSP strain rate. These results demonstrate the broad applicability of our scaling framework, and illustrate how it can be modified to incorporate other complex flow fields.
△ Less
Submitted 4 May, 2022;
originally announced May 2022.
-
Universal scaling for disordered viscoelastic matter II: Collapses, global behavior and spatio-temporal properties
Authors:
Danilo B. Liarte,
Stephen J. Thornton,
Eric Schwen,
Itai Cohen,
Debanjan Chowdhury,
James P. Sethna
Abstract:
Disordered viscoelastic materials are ubiquitous and exhibit fascinating invariant scaling properties. In a companion article, we have presented comprehensive new results for the critical behavior of the dynamic susceptibility of disordered elastic systems near the onset of rigidity. Here we provide additional details of the derivation of the singular scaling forms of the longitudinal response nea…
▽ More
Disordered viscoelastic materials are ubiquitous and exhibit fascinating invariant scaling properties. In a companion article, we have presented comprehensive new results for the critical behavior of the dynamic susceptibility of disordered elastic systems near the onset of rigidity. Here we provide additional details of the derivation of the singular scaling forms of the longitudinal response near both jamming and rigidity percolation. We then discuss global aspects associated with these forms, and make scaling collapse plots for both undamped and overdamped dynamics in both the rigid and floppy phases. We also derive critical exponents, invariant scaling combinations and analytical formulas for universal scaling functions of several quantities such as transverse and density responses, elastic moduli, viscosities, and correlation functions. Finally, we discuss tentative experimental protocols to measure these behaviors in colloidal suspensions.
△ Less
Submitted 28 February, 2022;
originally announced February 2022.
-
Dissipation by surface states in superconducting RF cavities
Authors:
Sean Deyo,
Michelle Kelley,
Nathan Sitaraman,
Thomas Oseroff,
Danilo B. Liarte,
Tomas Arias,
Matthias Liepe,
James P. Sethna
Abstract:
Recent experiments on superconducting cavities have found that under large radio-frequency (RF) electromagnetic fields the quality factor can improve with increasing field amplitude, a so-called "anti-Q slope." Linear theories of dissipation break down under these extreme conditions and are unable to explain this behavior. We numerically solve the Bogoliubov-de Gennes equations at the surface of a…
▽ More
Recent experiments on superconducting cavities have found that under large radio-frequency (RF) electromagnetic fields the quality factor can improve with increasing field amplitude, a so-called "anti-Q slope." Linear theories of dissipation break down under these extreme conditions and are unable to explain this behavior. We numerically solve the Bogoliubov-de Gennes equations at the surface of a superconductor in a parallel AC magnetic field, finding that at large fields there are quasiparticle surface states with energies below the bulk value of the superconducting gap. As the field oscillates, such states emerge and disappear with every cycle. We consider the dissipation resulting from inelastic quasiparticle-phonon scattering into these states and investigate the ability of this mechanism to explain features of the experimental observations, including the field dependence of the quality factor. We find that this mechanism is likely not the dominant source of dissipation and does not produce an anti-Q slope by itself; however, we demonstrate in a modified two-fluid model how these bound states can play a role in producing an anti-Q slope.
△ Less
Submitted 19 September, 2022; v1 submitted 19 January, 2022;
originally announced January 2022.
-
Information geometry for multiparameter models: New perspectives on the origin of simplicity
Authors:
Katherine N. Quinn,
Michael C. Abbott,
Mark K. Transtrum,
Benjamin B. Machta,
James P. Sethna
Abstract:
Complex models in physics, biology, economics, and engineering are often sloppy, meaning that the model parameters are not well determined by the model predictions for collective behavior. Many parameter combinations can vary over decades without significant changes in the predictions. This review uses information geometry to explore sloppiness and its deep relation to emergent theories. We introd…
▽ More
Complex models in physics, biology, economics, and engineering are often sloppy, meaning that the model parameters are not well determined by the model predictions for collective behavior. Many parameter combinations can vary over decades without significant changes in the predictions. This review uses information geometry to explore sloppiness and its deep relation to emergent theories. We introduce the model manifold of predictions, whose coordinates are the model parameters. Its hyperribbon structure explains why only a few parameter combinations matter for the behavior. We review recent rigorous results that connect the hierarchy of hyperribbon widths to approximation theory, and to the smoothness of model predictions under changes of the control variables. We discuss recent geodesic methods to find simpler models on nearby boundaries of the model manifold -- emergent theories with fewer parameters that explain the behavior equally well. We discuss a Bayesian prior which optimizes the mutual information between model parameters and experimental data, naturally favoring points on the emergent boundary theories and thus simpler models. We introduce a `projected maximum likelihood' prior that efficiently approximates this optimal prior, and contrast both to the poor behavior of the traditional Jeffreys prior. We discuss the way the renormalization group coarse-graining in statistical mechanics introduces a flow of the model manifold, and connect stiff and sloppy directions along the model manifold with relevant and irrelevant eigendirections of the renormalization group. Finally, we discuss recently developed `intensive' embedding methods, allowing one to visualize the predictions of arbitrary probabilistic models as low-dimensional projections of an isometric embedding, and illustrate our method by generating the model manifold of the Ising model.
△ Less
Submitted 22 September, 2022; v1 submitted 13 November, 2021;
originally announced November 2021.
-
Universal scaling of shear thickening transitions
Authors:
Meera Ramaswamy,
Itay Griniasty,
Danilo B. Liarte,
Abhishek Shetty,
Eleni Katifori,
Emanuela Del Gado,
James P. Sethna,
Bulbul Chakraborty,
Itai Cohen
Abstract:
Nearly all dense suspensions undergo dramatic and abrupt thickening transitions in their flow behaviour when sheared at high stresses. Such transitions occur when the dominant interactions between the suspended particles shift from hydrodynamic to frictional. Here, we interpret abrupt shear thickening as a precursor to a rigidity transition and give a complete theory of the viscosity in terms of a…
▽ More
Nearly all dense suspensions undergo dramatic and abrupt thickening transitions in their flow behaviour when sheared at high stresses. Such transitions occur when the dominant interactions between the suspended particles shift from hydrodynamic to frictional. Here, we interpret abrupt shear thickening as a precursor to a rigidity transition and give a complete theory of the viscosity in terms of a universal crossover scaling function from the frictionless jamming point to a rigidity transition associated with friction, anisotropy, and shear. Strikingly, we find experimentally that for two different systems -- cornstarch in glycerol and silica spheres in glycerol -- the viscosity can be collapsed onto a single universal curve over a wide range of stresses and volume fractions. The collapse reveals two separate scaling regimes, due to a crossover between frictionless isotropic jamming and frictional shear jamming, with different critical exponents. The material-specific behaviour due to the microscale particle interactions is incorporated into a scaling variable governing the proximity to shear jamming that depends on both stress and volume fraction. This reformulation opens the door to importing the vast theoretical machinery developed to understand equilibrium critical phenomena to elucidate fundamental physical aspects of the shear thickening transition.
△ Less
Submitted 22 May, 2023; v1 submitted 28 July, 2021;
originally announced July 2021.
-
Universal scaling for disordered viscoelastic matter near the onset of rigidity
Authors:
Danilo B. Liarte,
Stephen J. Thornton,
Eric Schwen,
Itai Cohen,
Debanjan Chowdhury,
James P. Sethna
Abstract:
The onset of rigidity in interacting liquids, as they undergo a transition to a disordered solid, is associated with a rearrangement of the low-frequency vibrational spectrum. In this letter, we derive scaling forms for the singular dynamical response of disordered viscoelastic networks near both jamming and rigidity percolation. Using effective-medium theory, we extract critical exponents, invari…
▽ More
The onset of rigidity in interacting liquids, as they undergo a transition to a disordered solid, is associated with a rearrangement of the low-frequency vibrational spectrum. In this letter, we derive scaling forms for the singular dynamical response of disordered viscoelastic networks near both jamming and rigidity percolation. Using effective-medium theory, we extract critical exponents, invariant scaling combinations and analytical formulas for universal scaling functions near these transitions. Our scaling forms describe the behavior in space and time near the various onsets of rigidity, for rigid and floppy phases and the crossover region, including diverging length and time scales at the transitions.
△ Less
Submitted 20 October, 2022; v1 submitted 12 March, 2021;
originally announced March 2021.
-
Analysis of Magnetic Vortex Dissipation in Sn-Segregated Boundaries in Nb$_3$Sn Superconducting RF Cavities
Authors:
Jared Carlson,
Alden Pack,
Mark K. Transtrum,
Jaeyel Lee,
David N. Seidman,
Danilo B. Liarte,
Nathan Sitaraman,
Alen Senanian,
Michelle Kelley,
James P. Sethna,
Tomas Arias,
Sam Posen
Abstract:
We study mechanisms of vortex nucleation in Nb$_3$Sn Superconducting RF (SRF) cavities using a combination of experimental, theoretical, and computational methods. Scanning transmission electron microscopy (STEM) image and energy dispersive spectroscopy (EDS) of some Nb$_3$Sn cavities show Sn segregation at grain boundaries in Nb$_3$Sn with Sn concentration as high as $\sim$35 at.\% and widths…
▽ More
We study mechanisms of vortex nucleation in Nb$_3$Sn Superconducting RF (SRF) cavities using a combination of experimental, theoretical, and computational methods. Scanning transmission electron microscopy (STEM) image and energy dispersive spectroscopy (EDS) of some Nb$_3$Sn cavities show Sn segregation at grain boundaries in Nb$_3$Sn with Sn concentration as high as $\sim$35 at.\% and widths $\sim$3 nm in chemical composition. Using ab initio calculations, we estimate the effect excess tin has on the local superconducting properties of the material. We model Sn segregation as a lowering of the local critical temperature. We then use time-dependent Ginzburg-Landau theory to understand the role of segregation on magnetic vortex nucleation. Our simulations indicate that the grain boundaries act as both nucleation sites for vortex penetration and pinning sites for vortices after nucleation. Depending on the magnitude of the applied field, vortices may remain pinned in the grain boundary or penetrate the grain itself. We estimate the superconducting losses due to vortices filling grain boundaries and compare with observed performance degradation with higher magnetic fields. We estimate that the quality factor may decrease by an order of magnitude ($10^{10}$ to $10^9$) at typical operating fields if 0.03\% of the grain boundaries actively nucleate vortices. We additionally estimate the volume that would need to be filled with vortices to match experimental observations of cavity heating.
△ Less
Submitted 20 December, 2020; v1 submitted 6 March, 2020;
originally announced March 2020.
-
Visualizing probabilistic models in Minkowski space with intensive symmetrized Kullback-Leibler embedding
Authors:
Han Kheng Teoh,
Katherine N. Quinn,
Jaron Kent-Dobias,
Colin B. Clement,
Qingyang Xu,
James P. Sethna
Abstract:
We show that the predicted probability distributions for any $N$-parameter statistical model taking the form of an exponential family can be explicitly and analytically embedded isometrically in a $N{+}N$-dimensional Minkowski space. That is, the model predictions can be visualized as control parameters are varied, preserving the natural distance between probability distributions. All pairwise dis…
▽ More
We show that the predicted probability distributions for any $N$-parameter statistical model taking the form of an exponential family can be explicitly and analytically embedded isometrically in a $N{+}N$-dimensional Minkowski space. That is, the model predictions can be visualized as control parameters are varied, preserving the natural distance between probability distributions. All pairwise distances between model instances are given by the symmetrized Kullback-Leibler divergence. We give formulas for these intensive symmetrized Kullback Leibler (isKL) coordinate embeddings, and illustrate the resulting visualizations with the Bernoulli (coin toss) problem, the ideal gas, $n$ sided die, the nonlinear least squares fit, and the Gaussian fit. We highlight how isKL can be used to determine the minimum number of parameters needed to describe probabilistic data, and conclude by visualizing the prediction space of the two-dimensional Ising model, where we examine the manifold behavior near its critical point.
△ Less
Submitted 2 July, 2020; v1 submitted 12 December, 2019;
originally announced December 2019.
-
Weird scaling for 2-D avalanches: Curing the faceting, and scaling in the lower critical dimension
Authors:
L. X. Hayden,
Archishman Raju,
James P. Sethna
Abstract:
The non-equilibrium random-field Ising model is well studied, yet there are outstanding questions. In two dimensions, power law scaling approaches fail and the critical disorder is difficult to pin down. Additionally, the presence of faceting on the square lattice creates avalanches that are lattice dependent at small scales. We propose two methods which we find solve these issues. First, we perfo…
▽ More
The non-equilibrium random-field Ising model is well studied, yet there are outstanding questions. In two dimensions, power law scaling approaches fail and the critical disorder is difficult to pin down. Additionally, the presence of faceting on the square lattice creates avalanches that are lattice dependent at small scales. We propose two methods which we find solve these issues. First, we perform large scale simulations on a Voronoi lattice to mitigate the effects of faceting. Secondly, the invariant arguments of the universal scaling functions necessary to perform scaling collapses can be directly determined using our recent normal form theory of the Renormalization Group. This method has proven useful in cleanly capturing the complex behavior which occurs in both the lower and upper critical dimensions of systems and here captures the 2D NE-RFIM behavior well. The obtained scaling collapses span over a range of a factor of ten in the disorder and a factor of $10^4$ in avalanche cutoff. They are consistent with a critical disorder at zero and with a lower critical dimension for the model equal to two.
△ Less
Submitted 30 September, 2019; v1 submitted 25 June, 2019;
originally announced June 2019.
-
Reaction rates and the noisy saddle-node bifurcation: Renormalization group for barrier crossing
Authors:
David Hathcock,
James P. Sethna
Abstract:
Barrier crossing calculations in chemical reaction-rate theory typically assume that the barrier is large compared to the temperature. When the barrier vanishes, however, there is a qualitative change in behavior. Instead of crossing a barrier, particles slide down a sloping potential. We formulate a renormalization group description of this noisy saddle-node transition. We derive the universal sc…
▽ More
Barrier crossing calculations in chemical reaction-rate theory typically assume that the barrier is large compared to the temperature. When the barrier vanishes, however, there is a qualitative change in behavior. Instead of crossing a barrier, particles slide down a sloping potential. We formulate a renormalization group description of this noisy saddle-node transition. We derive the universal scaling behavior and corrections to scaling for the mean escape time in overdamped systems with arbitrary barrier height. We also develop an accurate approximation to the full distribution of barrier escape times by approximating the eigenvalues of the Fokker-Plank operator as equally spaced. This lets us derive a family of distributions that captures the barrier crossing times for arbitrary barrier height. Our critical theory draws links between barrier crossing in chemistry, the renormalization group, and bifurcation theory.
△ Less
Submitted 22 October, 2020; v1 submitted 19 February, 2019;
originally announced February 2019.
-
Visualizing probabilistic models: Intensive Principal Component Analysis
Authors:
Katherine N. Quinn,
Colin B. Clement,
Francesco De Bernardis,
Michael D. Niemack,
James P. Sethna
Abstract:
Unsupervised learning makes manifest the underlying structure of data without curated training and specific problem definitions. However, the inference of relationships between data points is frustrated by the `curse of dimensionality' in high-dimensions. Inspired by replica theory from statistical mechanics, we consider replicas of the system to tune the dimensionality and take the limit as the n…
▽ More
Unsupervised learning makes manifest the underlying structure of data without curated training and specific problem definitions. However, the inference of relationships between data points is frustrated by the `curse of dimensionality' in high-dimensions. Inspired by replica theory from statistical mechanics, we consider replicas of the system to tune the dimensionality and take the limit as the number of replicas goes to zero. The result is the intensive embedding, which is not only isometric (preserving local distances) but allows global structure to be more transparently visualized. We develop the Intensive Principal Component Analysis (InPCA) and demonstrate clear improvements in visualizations of the Ising model of magnetic spins, a neural network, and the dark energy cold dark matter (ΛCDM) model as applied to the Cosmic Microwave Background.
△ Less
Submitted 10 May, 2019; v1 submitted 5 October, 2018;
originally announced October 2018.
-
Chebyshev approximation and the global geometry of sloppy models
Authors:
Katherine N. Quinn,
Heather Wilber,
Alex Townsend,
James P. Sethna
Abstract:
Sloppy models are complex nonlinear models with outcomes that are significantly affected by only a small subset of parameter combinations. Despite forming an important universality class and arising frequently in practice, formal and systematic explanations of sloppiness are lacking. By unifying geometric interpretations of sloppiness with Chebyshev approximation theory, we offer such an explanati…
▽ More
Sloppy models are complex nonlinear models with outcomes that are significantly affected by only a small subset of parameter combinations. Despite forming an important universality class and arising frequently in practice, formal and systematic explanations of sloppiness are lacking. By unifying geometric interpretations of sloppiness with Chebyshev approximation theory, we offer such an explanation, and show how sloppiness can be described explicitly in terms of model smoothness. Our approach results in universal bounds on model predictions for classes of smooth models, and our bounds capture global geometric features that are intrinsic to their model manifolds. We illustrate these ideas using three disparate models: exponential decay, reaction rates from an enzyme-catalysed chemical reaction, and an epidemiology model of an infected population.
△ Less
Submitted 22 September, 2018;
originally announced September 2018.
-
Morphology of renormalization-group flow for the de Almeida-Thouless-Gardner universality class
Authors:
Patrick Charbonneau,
Yi Hu,
Archishman Raju,
James P. Sethna,
Sho Yaida
Abstract:
A replica-symmetry-breaking phase transition is predicted in a host of disordered media. The criticality of the transition has, however, long been questioned below its upper critical dimension, six, due to the absence of a critical fixed point in the renormalization-group flows at one-loop order. A recent two-loop analysis revealed a possible strong-coupling fixed point but, given the uncontrolled…
▽ More
A replica-symmetry-breaking phase transition is predicted in a host of disordered media. The criticality of the transition has, however, long been questioned below its upper critical dimension, six, due to the absence of a critical fixed point in the renormalization-group flows at one-loop order. A recent two-loop analysis revealed a possible strong-coupling fixed point but, given the uncontrolled nature of perturbative analysis in the strong-coupling regime, debate persists. Here we examine the nature of the transition as a function of spatial dimension and show that the strong-coupling fixed point can go through a Hopf bifurcation, resulting in a critical limit cycle and a concomitant discrete scale invariance. We further investigate a different renormalization scheme and argue that the basin of attraction of the strong-coupling fixed point/limit cycle may thus stay finite for all dimensions.
△ Less
Submitted 6 August, 2018;
originally announced August 2018.
-
Vortex dynamics and losses due to pinning: Dissipation from trapped magnetic flux in resonant superconducting radio-frequency cavities
Authors:
Danilo B. Liarte,
Daniel Hall,
Peter N. Koufalis,
Akira Miyazaki,
Alen Senanian,
Matthias Liepe,
James P. Sethna
Abstract:
We use a model of vortex dynamics and collective weak pinning theory to study the residual dissipation due to trapped magnetic flux in a dirty superconductor. Using simple estimates, approximate analytical calculations, and numerical simulations, we make predictions and comparisons with experiments performed in CERN and Cornell on resonant superconducting radio-frequency NbCu, doped-Nb and Nb$_3$S…
▽ More
We use a model of vortex dynamics and collective weak pinning theory to study the residual dissipation due to trapped magnetic flux in a dirty superconductor. Using simple estimates, approximate analytical calculations, and numerical simulations, we make predictions and comparisons with experiments performed in CERN and Cornell on resonant superconducting radio-frequency NbCu, doped-Nb and Nb$_3$Sn cavities. We invoke hysteretic losses originating in a rugged pinning potential landscape to explain the linear behavior of the sensitivity of the residual resistance to trapped magnetic flux as a function of the amplitude of the radio-frequency field. Our calculations also predict and describe the crossover from hysteretic-dominated to viscous-dominated regimes of dissipation. We propose simple formulas describing power losses and crossover behavior, which can be used to guide the tuning of material parameters to optimize cavity performance.
△ Less
Submitted 22 October, 2018; v1 submitted 3 August, 2018;
originally announced August 2018.
-
Reexamining the renormalization group: Period doubling onset of chaos
Authors:
Archishman Raju,
James P Sethna
Abstract:
We explore fundamental questions about the renormalization group through a detailed re-examination of Feigenbaum's period doubling route to chaos. In the space of one-humped maps, the renormalization group characterizes the behavior near any critical point by the behavior near the fixed point. We show that this fixed point is far from unique, and characterize a submanifold of fixed points of alter…
▽ More
We explore fundamental questions about the renormalization group through a detailed re-examination of Feigenbaum's period doubling route to chaos. In the space of one-humped maps, the renormalization group characterizes the behavior near any critical point by the behavior near the fixed point. We show that this fixed point is far from unique, and characterize a submanifold of fixed points of alternative RG transformations. We build on this framework to systematically distinguish and analyze the allowed singular and `gauge' (analytic and redundant) corrections to scaling, explaining numerical results from the literature. Our analysis inspires several conjectures for critical phenomena in statistical mechanics.
△ Less
Submitted 25 July, 2018;
originally announced July 2018.
-
Cluster representations and the Wolff algorithm in arbitrary external fields
Authors:
Jaron Kent-Dobias,
James P Sethna
Abstract:
We introduce a natural way to extend celebrated spin-cluster Monte Carlo algorithms for fast thermal lattice simulations at criticality, like Wolff, to systems in arbitrary fields, be they linear magnetic vector fields or nonlinear anisotropic ones. By generalizing the 'ghost spin' representation to one with a 'ghost transformation,' global invariance to spin symmetry transformations is restored a…
▽ More
We introduce a natural way to extend celebrated spin-cluster Monte Carlo algorithms for fast thermal lattice simulations at criticality, like Wolff, to systems in arbitrary fields, be they linear magnetic vector fields or nonlinear anisotropic ones. By generalizing the 'ghost spin' representation to one with a 'ghost transformation,' global invariance to spin symmetry transformations is restored at the cost of an extra degree of freedom which lives in the space of symmetry transformations. The ordinary cluster-building process can then be run on the new representation. We show that this extension preserves the scaling of accelerated dynamics in the absence of a field for Ising, Potts, and $\mathrm O(n)$ models and demonstrate the method's use in modelling the presence of novel nonlinear fields. We also provide a C++ library for the method's convenient implementation for arbitrary models.
△ Less
Submitted 22 October, 2018; v1 submitted 10 May, 2018;
originally announced May 2018.
-
Yield precursor dislocation avalanches in small crystals: the irreversibility transition
Authors:
Xiaoyue Ni,
Haolu Zhang,
Danilo B. Liarte,
Louis W. McFaul,
Karin A. Dahmen,
James P. Sethna,
Julia R. Greer
Abstract:
The transition from elastic to plastic deformation in crystalline metals shares history dependence and scale-invariant avalanche signature with other non-equilibrium systems under external loading: dilute colloidal suspensions, plastically-deformed amorphous solids, granular materials, and dislocation-based simulations of crystals. These other systems exhibit transitions with clear analogies to wo…
▽ More
The transition from elastic to plastic deformation in crystalline metals shares history dependence and scale-invariant avalanche signature with other non-equilibrium systems under external loading: dilute colloidal suspensions, plastically-deformed amorphous solids, granular materials, and dislocation-based simulations of crystals. These other systems exhibit transitions with clear analogies to work hardening and yield stress, with many typically undergoing purely elastic behavior only after 'training' through repeated cyclic loading; studies in these other systems show a power law scaling of the hysteresis loop extent and of the training time as the peak load approaches a so-called reversible-irreversible transition (RIT). We discover here that deformation of small crystals shares these key characteristics: yielding and hysteresis in uniaxial compression experiments of single-crystalline Cu nano- and micro-pillars decay under repeated cyclic loading. The amplitude and decay time of the yield precursor avalanches diverge as the peak stress approaches failure stress for each pillar, with a power law scaling virtually equivalent to RITs in other nonequilibrium systems.
△ Less
Submitted 19 June, 2019; v1 submitted 12 February, 2018;
originally announced February 2018.
-
Information loss under coarse-graining: a geometric approach
Authors:
Archishman Raju,
Benjamin B. Machta,
James P. Sethna
Abstract:
We use information geometry, in which the local distance between models measures their distinguishability from data, to quantify the flow of information under the renormalization group. We show that information about relevant parameters is preserved, with distances along relevant directions maintained under flow. By contrast, irrelevant parameters become less distinguishable under the flow, with d…
▽ More
We use information geometry, in which the local distance between models measures their distinguishability from data, to quantify the flow of information under the renormalization group. We show that information about relevant parameters is preserved, with distances along relevant directions maintained under flow. By contrast, irrelevant parameters become less distinguishable under the flow, with distances along irrelevant directions contracting according to renormalization group exponents. We develop a covariant formalism to understand the contraction of the model manifold. We then apply our tools to understand the emergence of the diffusion equation and more general statistical systems described by a free energy. Our results give an information-theoretic justification of universality in terms of the flow of the model manifold under coarse-graining.
△ Less
Submitted 17 October, 2018; v1 submitted 16 October, 2017;
originally announced October 2017.
-
Visualizing theory space: Isometric embedding of probabilistic predictions, from the Ising model to the cosmic microwave background
Authors:
Katherine N. Quinn,
Francesco De Bernardis,
Michael D. Niemack,
James P. Sethna
Abstract:
We develop an intensive embedding for visualizing the space of all predictions for probabalistic models, using replica theory. Our embedding is isometric (preserves the distinguishability between models) and faithful (yields low-dimensional visualizations of models with simple emergent behavior). We apply our intensive embedding to the Ising model of statistical mechanics and the $Λ$CDM model appl…
▽ More
We develop an intensive embedding for visualizing the space of all predictions for probabalistic models, using replica theory. Our embedding is isometric (preserves the distinguishability between models) and faithful (yields low-dimensional visualizations of models with simple emergent behavior). We apply our intensive embedding to the Ising model of statistical mechanics and the $Λ$CDM model applied to cosmic microwave background radiation. It provides an intuitive, quantitative visualization applicable to renormalization-group calculations and optimal experimental design.
△ Less
Submitted 6 September, 2017;
originally announced September 2017.
-
Finding stability domains and escape rates in kicked Hamiltonians
Authors:
Archishman Raju,
Sayan Choudhury,
David L. Rubin,
Amie Wilkinson,
James P. Sethna
Abstract:
We use an effective Hamiltonian to characterize particle dynamics and find escape rates in a periodically kicked Hamiltonian. We study a model of particles in storage rings that is described by a chaotic symplectic map. Ignoring the resonances, the dynamics typically has a finite region in phase space where it is stable. Inherent noise in the system leads to particle loss from this stable region.…
▽ More
We use an effective Hamiltonian to characterize particle dynamics and find escape rates in a periodically kicked Hamiltonian. We study a model of particles in storage rings that is described by a chaotic symplectic map. Ignoring the resonances, the dynamics typically has a finite region in phase space where it is stable. Inherent noise in the system leads to particle loss from this stable region. The competition of this noise with radiation damping, which increases stability, determines the escape rate. Determining this `aperture' and finding escape rates is therefore an important physical problem. We compare the results of two different perturbation theories and a variational method to estimate this stable region. Including noise, we derive analytical estimates for the steady-state populations (and the resulting beam emittance), for the escape rate in the small damping regime, and compare them with numerical simulations.
△ Less
Submitted 28 July, 2017;
originally announced July 2017.
-
Smooth and global Ising universal scaling functions
Authors:
Jaron Kent-Dobias,
James P. Sethna
Abstract:
We describe a method for approximating the universal scaling functions for the Ising model in a field. By making use of parametric coordinates, the free energy scaling function has a polynomial series everywhere. Its form is taken to be a sum of the simplest functions that contain the singularities which must be present: the Langer essential singularity and the Yang--Lee edge singularity. Requirin…
▽ More
We describe a method for approximating the universal scaling functions for the Ising model in a field. By making use of parametric coordinates, the free energy scaling function has a polynomial series everywhere. Its form is taken to be a sum of the simplest functions that contain the singularities which must be present: the Langer essential singularity and the Yang--Lee edge singularity. Requiring that the function match series expansions in the low- and high-temperature zero-field limits fixes the parametric coordinate transformation. For the two-dimensional Ising model, we show that this procedure converges exponentially with the order to which the series are matched, up to seven digits of accuracy. To facilitate use, we provide Python and Mathematica implementations of the code at both lowest order (three digit) and high accuracy.
△ Less
Submitted 28 October, 2021; v1 submitted 12 July, 2017;
originally announced July 2017.
-
Normal form for renormalization groups
Authors:
Archishman Raju,
Colin B. Clement,
Lorien X. Hayden,
Jaron P. Kent-Dobias,
Danilo B. Liarte,
D. Zeb Rocklin,
James P. Sethna
Abstract:
The results of the renormalization group are commonly advertised as the existence of power law singularities near critical points. The classic predictions are often violated and logarithmic and exponential corrections are treated on a case-by-case basis. We use the mathematics of normal form theory to systematically group these into universality families of seemingly unrelated systems united by co…
▽ More
The results of the renormalization group are commonly advertised as the existence of power law singularities near critical points. The classic predictions are often violated and logarithmic and exponential corrections are treated on a case-by-case basis. We use the mathematics of normal form theory to systematically group these into universality families of seemingly unrelated systems united by common scaling variables. We recover and explain the existing literature and predict the nonlinear generalization for the universal homogeneous scaling functions. We show that this procedure leads to a better handling of the singularity even in classic cases and elaborate our framework using several examples.
△ Less
Submitted 21 February, 2019; v1 submitted 31 May, 2017;
originally announced June 2017.
-
Jeffrey's prior sampling of deep sigmoidal networks
Authors:
Lorien X. Hayden,
Alexander A. Alemi,
Paul H. Ginsparg,
James P. Sethna
Abstract:
Neural networks have been shown to have a remarkable ability to uncover low dimensional structure in data: the space of possible reconstructed images form a reduced model manifold in image space. We explore this idea directly by analyzing the manifold learned by Deep Belief Networks and Stacked Denoising Autoencoders using Monte Carlo sampling. The model manifold forms an only slightly elongated h…
▽ More
Neural networks have been shown to have a remarkable ability to uncover low dimensional structure in data: the space of possible reconstructed images form a reduced model manifold in image space. We explore this idea directly by analyzing the manifold learned by Deep Belief Networks and Stacked Denoising Autoencoders using Monte Carlo sampling. The model manifold forms an only slightly elongated hyperball with actual reconstructed data appearing predominantly on the boundaries of the manifold. In connection with the results we present, we discuss problems of sampling high-dimensional manifolds as well as recent work [M. Transtrum, G. Hart, and P. Qiu, Submitted (2014)] discussing the relation between high dimensional geometry and model reduction.
△ Less
Submitted 25 May, 2017;
originally announced May 2017.
-
Light Microscopy at Maximal Precision
Authors:
Matthew Bierbaum,
Brian D. Leahy,
Alexander A. Alemi,
Itai Cohen,
James P. Sethna
Abstract:
Microscopy is the workhorse of the physical and life sciences, producing crisp images of everything from atoms to cells well beyond the capabilities of the human eye. However, the analysis of these images is frequently little better than automated manual marking. Here, we revolutionize the analysis of microscopy images, extracting all the information theoretically contained in a complex microscope…
▽ More
Microscopy is the workhorse of the physical and life sciences, producing crisp images of everything from atoms to cells well beyond the capabilities of the human eye. However, the analysis of these images is frequently little better than automated manual marking. Here, we revolutionize the analysis of microscopy images, extracting all the information theoretically contained in a complex microscope image. Using a generic, methodological approach, we extract the information by fitting experimental images with a detailed optical model of the microscope, a method we call Parameter Extraction from Reconstructing Images (PERI). As a proof of principle, we demonstrate this approach with a confocal image of colloidal spheres, improving measurements of particle positions and radii by 100x over current methods and attaining the maximum possible accuracy. With this unprecedented resolution, we measure nanometer-scale colloidal interactions in dense suspensions solely with light microscopy, a previously impossible feat. Our approach is generic and applicable to imaging methods from brightfield to electron microscopy, where we expect accuracies of 1 nm and 0.1 pm, respectively.
△ Less
Submitted 23 February, 2017;
originally announced February 2017.
-
A KIM-compliant potfit for fitting sloppy interatomic potentials: Application to the EDIP model for silicon
Authors:
Mingjian Wen,
Junhao Li,
Peter Brommer,
Ryan S. Elliott,
James P. Sethna,
Ellad B. Tadmor
Abstract:
Fitted interatomic potentials are widely used in atomistic simulations thanks to their ability to compute the energy and forces on atoms quickly. However, the simulation results crucially depend on the quality of the potential being used. Force matching is a method aimed at constructing reliable and transferable interatomic potentials by matching the forces computed by the potential as closely as…
▽ More
Fitted interatomic potentials are widely used in atomistic simulations thanks to their ability to compute the energy and forces on atoms quickly. However, the simulation results crucially depend on the quality of the potential being used. Force matching is a method aimed at constructing reliable and transferable interatomic potentials by matching the forces computed by the potential as closely as possible, with those obtained from first principles calculations. The potfit program is an implementation of the force-matching method that optimizes the potential parameters using a global minimization algorithm followed by a local minimization polish. We extended potfit in two ways. First, we adapted the code to be compliant with the KIM Application Programming Interface (API) standard (part of the Knowledgebase of Interatomic Models Project). This makes it possible to use potfit to fit many KIM potential models, not just those prebuilt into the potfit code. Second, we incorporated the geodesic Levenberg--Marquardt (LM) minimization algorithm into potfit as a new local minimization algorithm. The extended potfit was tested by generating a training set using the KIM Environment-Dependent Interatomic Potential (EDIP) model for silicon and using potfit to recover the potential parameters from different initial guesses. The results show that EDIP is a "sloppy model" in the sense that its predictions are insensitive to some of its parameters, which makes fitting more difficult. We find that the geodesic LM algorithm is particularly efficient for this case. The extended potfit code is the first step in developing a KIM-based fitting framework for interatomic potentials for bulk and two dimensional materials. The code is available for download via https://www.potfit.net.
△ Less
Submitted 11 November, 2016;
originally announced November 2016.
-
Deformation of crystals: Connections with statistical physics
Authors:
James P. Sethna,
Matthew K. Bierbaum,
Karin A. Dahmen,
Carl P. Goodrich,
Julia R. Greer,
Lorien X. Hayden,
Jaron P. Kent-Dobias,
Edward D. Lee,
Danilo B. Liarte,
Xiaoyue Ni,
Katherine N. Quinn,
Archishman Raju,
D. Zeb Rocklin,
Ashivni Shekhawat,
Stefano Zapperi
Abstract:
We give a bird's-eye view of the plastic deformation of crystals aimed at the statistical physics community, and a broad introduction into the statistical theories of forced rigid systems aimed at the plasticity community. Memory effects in magnets, spin glasses, charge density waves, and dilute colloidal suspensions are discussed in relation to the onset of plastic yielding in crystals. Dislocati…
▽ More
We give a bird's-eye view of the plastic deformation of crystals aimed at the statistical physics community, and a broad introduction into the statistical theories of forced rigid systems aimed at the plasticity community. Memory effects in magnets, spin glasses, charge density waves, and dilute colloidal suspensions are discussed in relation to the onset of plastic yielding in crystals. Dislocation avalanches and complex dislocation tangles are discussed via a brief introduction to the renormalization group and scaling. Analogies to emergent scale invariance in fracture, jamming, coarsening, and a variety of depinning transitions are explored. Dislocation dynamics in crystals challenges non equilibrium statistical physics. Statistical physics provides both cautionary tales of subtle memory effects in nonequilibrium systems, and systematic tools designed to address complex scale-invariant behavior on multiple length and time scales.
△ Less
Submitted 17 November, 2016; v1 submitted 19 September, 2016;
originally announced September 2016.
-
Measuring nonlinear stresses generated by defects in 3D colloidal crystals
Authors:
Neil Y. C. Lin,
Matthew Bierbaum,
Peter Schall,
James P. Sethna,
Itai Cohen
Abstract:
The mechanical, structural and functional properties of crystals are determined by their defects and the distribution of stresses surrounding these defects has broad implications for the understanding of transport phenomena. When the defect density rises to levels routinely found in real-world materials, transport is governed by local stresses that are predominantly nonlinear. Such stress fields h…
▽ More
The mechanical, structural and functional properties of crystals are determined by their defects and the distribution of stresses surrounding these defects has broad implications for the understanding of transport phenomena. When the defect density rises to levels routinely found in real-world materials, transport is governed by local stresses that are predominantly nonlinear. Such stress fields however, cannot be measured using conventional bulk and local measurement techniques. Here, we report direct and spatially resolved experimental measurements of the nonlinear stresses surrounding colloidal crystalline defect cores, and show that the stresses at vacancy cores generate attractive interactions between them. We also directly visualize the softening of crystalline regions surrounding dislocation cores, and find that stress fluctuations in quiescent polycrystals are uniformly distributed rather than localized at grain boundaries, as is the case in strained atomic polycrystals. Nonlinear stress measurements have important implications for strain hardening, yield, and fatigue.
△ Less
Submitted 1 September, 2016;
originally announced September 2016.
-
Emergent SO(3) Symmetry of the Frictionless Shear Jamming Transition
Authors:
Marco Baity-Jesi,
Carl P. Goodrich,
Andrea J. Liu,
Sidney R. Nagel,
James P. Sethna
Abstract:
We study the shear jamming of athermal frictionless soft spheres, and find that in the thermodynamic limit, a shear-jammed state exists with different elastic properties from the isotropically-jammed state. For example, shear-jammed states can have a non-zero residual shear stress in the thermodynamic limit that arises from long-range stress-stress correlations. As a result, the ratio of the shear…
▽ More
We study the shear jamming of athermal frictionless soft spheres, and find that in the thermodynamic limit, a shear-jammed state exists with different elastic properties from the isotropically-jammed state. For example, shear-jammed states can have a non-zero residual shear stress in the thermodynamic limit that arises from long-range stress-stress correlations. As a result, the ratio of the shear and bulk moduli, which in isotropically-jammed systems vanishes as the jamming transition is approached from above, instead approaches a constant. Despite these striking differences, we argue that in a deeper sense, the shear jamming and isotropic jamming transitions actually have the same symmetry, and that the differences can be fully understood by rotating the six-dimensional basis of the elastic modulus tensor.
△ Less
Submitted 23 March, 2017; v1 submitted 1 September, 2016;
originally announced September 2016.
-
Theoretical estimates of maximum fields in superconducting resonant radio frequency cavities: Stability theory, disorder, and laminates
Authors:
Danilo B. Liarte,
Sam Posen,
Mark K. Transtrum,
Gianluigi Catelani,
Matthias Liepe,
James P. Sethna
Abstract:
Theoretical limits to the performance of superconductors in high magnetic fields parallel to their surfaces are of key relevance to current and future accelerating cavities, especially those made of new higher-Tc materials such as Nb$_3$Sn, NbN, and MgB$_2$. Indeed, beyond the so-called superheating field $H_{\mathcal{sh}}$, flux will spontaneously penetrate even a perfect superconducting surface…
▽ More
Theoretical limits to the performance of superconductors in high magnetic fields parallel to their surfaces are of key relevance to current and future accelerating cavities, especially those made of new higher-Tc materials such as Nb$_3$Sn, NbN, and MgB$_2$. Indeed, beyond the so-called superheating field $H_{\mathcal{sh}}$, flux will spontaneously penetrate even a perfect superconducting surface and ruin the performance. We present intuitive arguments and simple estimates for $H_{\mathcal{sh}}$, and combine them with our previous rigorous calculations, which we summarize. We briefly discuss experimental measurements of the superheating field, comparing to our estimates. We explore the effects of materials anisotropy and the danger of disorder in nucleating vortex entry. Will we need to control surface orientation in the layered compound MgB$_2$? Can we estimate theoretically whether dirt and defects make these new materials fundamentally more challenging to optimize than niobium? Finally, we discuss and analyze recent proposals to use thin superconducting layers or laminates to enhance the performance of superconducting cavities. Flux entering a laminate can lead to so-called pancake vortices; we consider the physics of the dislocation motion and potential re-annihilation or stabilization of these vortices after their entry.
△ Less
Submitted 26 October, 2016; v1 submitted 30 July, 2016;
originally announced August 2016.
-
Ginzburg-Landau theory of the superheating field anisotropy of layered superconductors
Authors:
Danilo B. Liarte,
Mark K. Transtrum,
James P. Sethna
Abstract:
We investigate the effects of material anisotropy on the superheating field of layered superconductors. We provide an intuitive argument both for the existence of a superheating field, and its dependence on anisotropy, for $κ= λ/ ξ$ (the ratio of magnetic to superconducting healing lengths) both large and small. On the one hand, the combination of our estimates with published results using a two-g…
▽ More
We investigate the effects of material anisotropy on the superheating field of layered superconductors. We provide an intuitive argument both for the existence of a superheating field, and its dependence on anisotropy, for $κ= λ/ ξ$ (the ratio of magnetic to superconducting healing lengths) both large and small. On the one hand, the combination of our estimates with published results using a two-gap model for MgB${}_2$ suggests high anisotropy of the superheating field near zero temperature. On the other hand, within Ginzburg-Landau theory for a single gap, we see that the superheating field shows significant anisotropy only when the crystal anisotropy is large and the Ginzburg-Landau parameter $κ$ is small. We then conclude that only small anisotropies in the superheating field are expected for typical unconventional superconductors near the critical temperature. Using a generalized form of Ginzburg Landau theory, we do a quantitative calculation for the anisotropic superheating field by mapping the problem to the isotropic case, and present a phase diagram in terms of anisotropy and $κ$, showing type I, type II, or mixed behavior (within Ginzburg-Landau theory), and regions where each asymptotic solution is expected. We estimate anisotropies for a number of different materials, and discuss the importance of these results for radio-frequency cavities for particle accelerators.
△ Less
Submitted 28 September, 2016; v1 submitted 11 February, 2016;
originally announced February 2016.
-
The weirdest martensite: Smectic liquid crystal microstructure and Weyl-Poincaré invariance
Authors:
Danilo B. Liarte,
Matthew Bierbaum,
Ricardo A. Mosna,
Randall D. Kamien,
James P. Sethna
Abstract:
Smectic liquid crystals are remarkable, beautiful examples of materials microstructure, with ordered patterns of geometrically perfect ellipses and hyperbolas. The solution of the complex problem of filling three-dimensional space with domains of focal conics under constraining boundary conditions yields a set of strict rules, which are similar to the compatibility conditions in a martensitic crys…
▽ More
Smectic liquid crystals are remarkable, beautiful examples of materials microstructure, with ordered patterns of geometrically perfect ellipses and hyperbolas. The solution of the complex problem of filling three-dimensional space with domains of focal conics under constraining boundary conditions yields a set of strict rules, which are similar to the compatibility conditions in a martensitic crystal. Here we present the rules giving compatible conditions for the concentric circle domains found at two-dimensional smectic interfaces with planar boundary conditions. Using configurations generated by numerical simulations, we develop a clustering algorithm to decompose the planar boundaries into domains. The interfaces between different domains agree well with the smectic compatibility conditions. We also discuss generalizations of our approach to describe the full three-dimensional smectic domains, where the variant symmetry group is the Weyl-Poincaré group of Lorentz boosts, translations, rotations, and dilatations.
△ Less
Submitted 18 February, 2016; v1 submitted 6 November, 2015;
originally announced November 2015.
-
Scaling theory for the jamming transition
Authors:
Carl P. Goodrich,
Andrea J. Liu,
James P. Sethna
Abstract:
We propose a scaling ansatz for the elastic energy of a system near the critical jamming transition in terms of three relevant fields: the compressive strain $Δφ$ relative to the critical jammed state, the shear strain $ε$, and the inverse system size $1/N$. We also use $ΔZ$, the number of contacts relative to the minimum required at jamming, as an underlying control parameter. Our scaling theory…
▽ More
We propose a scaling ansatz for the elastic energy of a system near the critical jamming transition in terms of three relevant fields: the compressive strain $Δφ$ relative to the critical jammed state, the shear strain $ε$, and the inverse system size $1/N$. We also use $ΔZ$, the number of contacts relative to the minimum required at jamming, as an underlying control parameter. Our scaling theory predicts new exponents, exponent equalities and scaling collapses for energy, pressure and shear stress that we verify with numerical simulations of jammed packings of soft spheres. It also yields new insight into why the shear and bulk moduli exhibit different scalings; the difference arises because the shear stress vanishes as $1/\sqrt{N}$ while the pressure approaches a constant in the thermodynamic limit. The success of the scaling ansatz implies that the jamming transition exhibits an emergent scale invariance, and that it should be possible to develop a renormalization-group theory for jamming.
△ Less
Submitted 12 October, 2015;
originally announced October 2015.
-
Pinning Susceptibility: The effect of dilute, quenched disorder on jamming
Authors:
Amy L. Graves,
Samer Nashed,
Elliot Padgett,
Carl P. Goodrich,
Andrea J. Liu,
James P. Sethna
Abstract:
We study the effect of dilute pinning on the jamming transition. Pinning reduces the average contact number needed to jam unpinned particles and shifts the jamming threshold to lower densities, leading to a pinning susceptibility, $χ_p$. Our main results are that this susceptibility obeys scaling form and diverges in the thermodynamic limit as $χ_p \propto |φ- φ_c^\infty|^{-γ_p}$ where…
▽ More
We study the effect of dilute pinning on the jamming transition. Pinning reduces the average contact number needed to jam unpinned particles and shifts the jamming threshold to lower densities, leading to a pinning susceptibility, $χ_p$. Our main results are that this susceptibility obeys scaling form and diverges in the thermodynamic limit as $χ_p \propto |φ- φ_c^\infty|^{-γ_p}$ where $φ_c^\infty$ is the jamming threshold in the absence of pins. Finite-size scaling arguments yield these values with associated statistical (systematic) errors $γ_p = 1.018 \pm 0.026 (0.291) $ in $d=2$ and $γ_p =1.534 \pm 0.120 (0.822)$ in $d=3$. Logarithmic corrections raise the exponent in $d=2$ to close to the $d=3$ value, although the systematic errors are very large.
△ Less
Submitted 18 May, 2016; v1 submitted 2 September, 2015;
originally announced September 2015.
-
Shielding superconductors with thin films
Authors:
Sam Posen,
Mark K. Transtrum,
Gianluigi Catelani,
Matthias U. Liepe,
James P. Sethna
Abstract:
Determining the optimal arrangement of superconducting layers to withstand large amplitude AC magnetic fields is important for certain applications such as superconducting radiofrequency cavities. In this paper, we evaluate the shielding potential of the superconducting film/insulating film/superconductor (SIS') structure, a configuration that could provide benefits in screening large AC magnetic…
▽ More
Determining the optimal arrangement of superconducting layers to withstand large amplitude AC magnetic fields is important for certain applications such as superconducting radiofrequency cavities. In this paper, we evaluate the shielding potential of the superconducting film/insulating film/superconductor (SIS') structure, a configuration that could provide benefits in screening large AC magnetic fields. After establishing that for high frequency magnetic fields, flux penetration must be avoided, the superheating field of the structure is calculated in the London limit both numerically and, for thin films, analytically. For intermediate film thicknesses and realistic material parameters we also solve numerically the Ginzburg-Landau equations. It is shown that a small enhancement of the superheating field is possible, on the order of a few percent, for the SIS' structure relative to a bulk superconductor of the film material, if the materials and thicknesses are chosen appropriately.
△ Less
Submitted 28 June, 2015;
originally announced June 2015.
-
Sloppiness and Emergent Theories in Physics, Biology, and Beyond
Authors:
Mark K. Transtrum,
Benjamin Machta,
Kevin Brown,
Bryan C. Daniels,
Christopher R. Myers,
James P. Sethna
Abstract:
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are `sloppy', i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher Information Matrix, which we inter…
▽ More
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are `sloppy', i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher Information Matrix, which we interpret as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. We show how the manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.
△ Less
Submitted 30 January, 2015;
originally announced January 2015.
-
Visualization, coarsening and flow dynamics of focal conic domains in simulated Smectic-A liquid crystals
Authors:
Danilo B. Liarte,
Matthew Bierbaum,
Muxin Zhang,
Brian D. Leahy,
Itai Cohen,
James P. Sethna
Abstract:
Smectic liquid crystals vividly illustrate the subtle interplay of broken translational and orientational symmetries, by exhibiting defect structures forming geometrically perfect confocal ellipses and hyperbolas. Here, we develop and numerically implement an effective theory to study the dynamics of focal conic domains in smectic-A liquid crystals. We use the information about the smectic's struc…
▽ More
Smectic liquid crystals vividly illustrate the subtle interplay of broken translational and orientational symmetries, by exhibiting defect structures forming geometrically perfect confocal ellipses and hyperbolas. Here, we develop and numerically implement an effective theory to study the dynamics of focal conic domains in smectic-A liquid crystals. We use the information about the smectic's structure and energy density provided by our simulations to develop several novel visualization tools for the focal conics. Our simulations accurately describe both simple and extensional shear, which we compare to experiments, and provide additional insight into the coarsening dynamics of focal conic domains.
△ Less
Submitted 30 November, 2015; v1 submitted 29 December, 2014;
originally announced December 2014.