-
Blume-Emery-Griffiths model on Random Graphs
Authors:
R. Erichsen Jr.,
Alexandre Silveira,
S. G. Magalhaes
Abstract:
The Blume-Emery-Griffiths model with a random crystal field is studied in a random graph architecture, in which the average connectivity is a controllable parameter. The disordered average over the graph realizations is treated by replica symmetry formalism of order parameter functions. A self-consistent equation for the distribution of local fields is derived and numerically solved by a populatio…
▽ More
The Blume-Emery-Griffiths model with a random crystal field is studied in a random graph architecture, in which the average connectivity is a controllable parameter. The disordered average over the graph realizations is treated by replica symmetry formalism of order parameter functions. A self-consistent equation for the distribution of local fields is derived and numerically solved by a population dynamics algorithm. The results show that the average connectivity amounts to changes in the topology of the phase diagrams. Phase diagrams for representative values of the model parameters are compared with those obtained for fully connected mean field and renormalization group approaches.
△ Less
Submitted 1 February, 2023;
originally announced February 2023.
-
Geometrical Frustration and Cluster Spin Glass with Random Graphs
Authors:
Alexandre Silveira,
R. Erichsen Jr.,
S. G. Magalhaes
Abstract:
We develop a novel method based in the sparse random graph to account the interplay between geometric frustration and disorder in cluster magnetism. Our theory allows to introduce the cluster network connectivity as a controllable parameter. Two types of inner cluster geometry are considered: triangular and tetrahedral. The theory was developed for a general, non-uniform intra-cluster interactions…
▽ More
We develop a novel method based in the sparse random graph to account the interplay between geometric frustration and disorder in cluster magnetism. Our theory allows to introduce the cluster network connectivity as a controllable parameter. Two types of inner cluster geometry are considered: triangular and tetrahedral. The theory was developed for a general, non-uniform intra-cluster interactions, but in the present paper the results presented correspond to uniform, anti-ferromagnetic (AF) intra-clusters interactions $J_{0}/J$. The clusters are represented by nodes on a finite connectivity random graph, and the inter-cluster interactions are random Gaussian distributed. The graph realizations are treated in replica theory using the formalism of order parameter functions, which allows to calculate the distribution of local fields and, as a consequence, the relevant observable. In the case of triangular cluster geometry, there is the onset of a classical Spin Liquid state at a temperature $T^{*}/J$ and then, a Cluster Spin Glass (CSG) phase at a temperature $T_{f}/J$. The CSG ground state is robust even for very weak disorder or large negative $J_{0}/J$. These results does not depend on the network connectivity. Nevertheless, variations in the connectivity strongly affect the level of frustration $f_{p}=-Θ_{CW}/T_{f}$ for large $J_{0}/J$. In contrast, for the non-frustrated tetrahedral cluster geometry, the CSG ground state is suppressed for weak disorder or large negative $J_{0}/J$. The CSG boundary phase presents a re-entrance which is dependent on the network connectivity.
△ Less
Submitted 13 April, 2021;
originally announced April 2021.
-
Ising spin glass in a random network with a gaussian random field
Authors:
R. Erichsen Jr,
A. Silveira,
S. G. Magalhaes
Abstract:
We investigate thermodynamic phase transitions of the joint presence of spin glass (SG) and random field (RF) using a random graph model that allows us to deal with the quenched disorder. Therefore, the connectivity becomes a controllable parameter in our theory, allowing us to answer what the differences are between this description and the mean-field theory i.e., the fully connected theory. We h…
▽ More
We investigate thermodynamic phase transitions of the joint presence of spin glass (SG) and random field (RF) using a random graph model that allows us to deal with the quenched disorder. Therefore, the connectivity becomes a controllable parameter in our theory, allowing us to answer what the differences are between this description and the mean-field theory i.e., the fully connected theory. We have considered the random network random field Ising model where the spin exchange interaction as well as the RF are random variables following a Gaussian distribution. The results were found within the replica symmetric (RS) approximation, whose stability is obtained using the two-replica method. This also puts our work in the context of a broader discussion, which is the RS stability as a function of the connectivity. In particular, our results show that for small connectivity there is a region at zero temperature where the RS solution remains stable above a given value of the magnetic field no matter the strength of RF. Consequently, our results show important differences with the crossover between the RF and SG regimes predicted by the fully connected theory.
△ Less
Submitted 22 February, 2021;
originally announced February 2021.
-
Unfolding of phases and multicritical points in the Classical Anisotropic van Hemmen Spin Glass Model with Random Field
Authors:
S. G. Magalhaes,
I. C. Berger,
R. Erichsen Jr
Abstract:
We study magnetic properties of the 3-state spin ($S_{i}=0$ and $\pm 1$) spin glass (SG) van Hemmen model with ferromagnetic interaction $J_0$ under a random field (RF). The RF follows a bimodal distribution The combined effect of the crystal field $D$ and the special type of on-site random interaction of the van Hemmen model engenders the unfolding of the SG phases for strong enough RF, i. e., in…
▽ More
We study magnetic properties of the 3-state spin ($S_{i}=0$ and $\pm 1$) spin glass (SG) van Hemmen model with ferromagnetic interaction $J_0$ under a random field (RF). The RF follows a bimodal distribution The combined effect of the crystal field $D$ and the special type of on-site random interaction of the van Hemmen model engenders the unfolding of the SG phases for strong enough RF, i. e., instead of one SG phase, we found two SG phases. Moreover, as $J_0$ is finite, there is also the unfolding of the mixed phase (with the SG order parameter and the spontaneous magnetization simultaneously finite) in four distinct phases. The emergence of these new phases separated by first and second order line transitions produces a multiplication of triple and multicritical points.
△ Less
Submitted 17 January, 2019;
originally announced January 2019.
-
Phase transitions in the three-state Ising spin-glass model with finite connectivity
Authors:
R. Erichsen Jr.,
W. K. Theumann
Abstract:
The statistical mechanics of a two-state Ising spin-glass model with finite random connectivity, in which each site is connected to a finite number of other sites, is extended in this work within the replica technique to study the phase transitions in the three-state Ghatak-Sherrington (or random Blume-Capel) model of a spin glass with a crystal field term. The replica symmetry ansatz for the orde…
▽ More
The statistical mechanics of a two-state Ising spin-glass model with finite random connectivity, in which each site is connected to a finite number of other sites, is extended in this work within the replica technique to study the phase transitions in the three-state Ghatak-Sherrington (or random Blume-Capel) model of a spin glass with a crystal field term. The replica symmetry ansatz for the order function is expressed in terms of a two-dimensional effective-field distribution which is determined numerically by means of a population dynamics procedure. Phase diagrams are obtained exhibiting phase boundaries which have a reentrance with both a continuous and a genuine first-order transition with a discontinuity in the entropy. This may be seen as "inverse freezing", which has been studied extensively lately, as a process either with or without exchange of latent heat.
△ Less
Submitted 16 June, 2011;
originally announced June 2011.
-
Synchronous versus sequential updating in the three-state Ising neural network with variable dilution
Authors:
D. Bolle',
R. Erichsen Jr,
T. Verbeiren
Abstract:
The three-state Ising neural network with synchronous updating and variable dilution is discussed starting from the appropriate Hamiltonians. The thermodynamic and retrieval properties are examined using replica mean-field theory. Capacity-temperature phase diagrams are derived for several values of the pattern activity and different gradations of dilution, and the information content is calcula…
▽ More
The three-state Ising neural network with synchronous updating and variable dilution is discussed starting from the appropriate Hamiltonians. The thermodynamic and retrieval properties are examined using replica mean-field theory. Capacity-temperature phase diagrams are derived for several values of the pattern activity and different gradations of dilution, and the information content is calculated. The results are compared with those for sequential updating. The effect of self-coupling is established. Also the dynamics is studied using the generating function technique for both synchronous and sequential updating. Typical flow diagrams for the overlap order parameter are presented. The differences with the signal-to-noise approach are outlined.
△ Less
Submitted 19 July, 2005;
originally announced July 2005.
-
From ballistic to Brownian vortex motion in complex oscillatory media
Authors:
Jörn Davidsen,
Ronaldo Erichsen,
Raymond Kapral,
Hugues Chaté
Abstract:
We show that the breaking of the rotation symmetry of spiral waves in two-dimensional complex (period-doubled or chaotic) oscillatory media by synchronization defect lines (SDL) is accompanied by an intrinsic drift of the pattern. Single vortex motion changes from ballistic flights at a well-defined angle from the SDL to Brownian-like diffusion when the turbulent character of the medium increase…
▽ More
We show that the breaking of the rotation symmetry of spiral waves in two-dimensional complex (period-doubled or chaotic) oscillatory media by synchronization defect lines (SDL) is accompanied by an intrinsic drift of the pattern. Single vortex motion changes from ballistic flights at a well-defined angle from the SDL to Brownian-like diffusion when the turbulent character of the medium increases. It gives rise, in non-turbulent multi-spiral regimes, to a novel ``vortex liquid''.
△ Less
Submitted 19 October, 2004;
originally announced October 2004.
-
The three-state layered neural network with finite dilution
Authors:
W. K. Theumann,
R. Erichsen Jr
Abstract:
The dynamics and the stationary states of an exactly solvable three-state layered feed-forward neural network model with asymmetric synaptic connections, finite dilution and low pattern activity are studied in extension of a recent work on a recurrent network. Detailed phase diagrams are obtained for the stationary states and for the time evolution of the retrieval overlap with a single pattern.…
▽ More
The dynamics and the stationary states of an exactly solvable three-state layered feed-forward neural network model with asymmetric synaptic connections, finite dilution and low pattern activity are studied in extension of a recent work on a recurrent network. Detailed phase diagrams are obtained for the stationary states and for the time evolution of the retrieval overlap with a single pattern. It is shown that the network develops instabilities for low thresholds and that there is a gradual improvement in network performance with increasing threshold up to an optimal stage. The robustness to synaptic noise is checked and the effects of dilution and of variable threshold on the information content of the network are also established.
△ Less
Submitted 19 January, 2004;
originally announced January 2004.
-
A layered neural network with three-state neurons optimizing the mutual information
Authors:
D. Bolle,
R. Erichsen, Jr.,
W. K. Theumann
Abstract:
The time evolution of an exactly solvable layered feedforward neural network with three-state neurons and optimizing the mutual information is studied for arbitrary synaptic noise (temperature). Detailed stationary temperature-capacity and capacity-activity phase diagrams are obtained. The model exhibits pattern retrieval, pattern-fluctuation retrieval and spin-glass phases. It is found that the…
▽ More
The time evolution of an exactly solvable layered feedforward neural network with three-state neurons and optimizing the mutual information is studied for arbitrary synaptic noise (temperature). Detailed stationary temperature-capacity and capacity-activity phase diagrams are obtained. The model exhibits pattern retrieval, pattern-fluctuation retrieval and spin-glass phases. It is found that there is an improved performance in the form of both a larger critical capacity and information content compared with three-state Ising-type layered network models. Flow diagrams reveal that saddle-point solutions associated with fluctuation overlaps slow down considerably the flow of the network states towards the stable fixed-points.
△ Less
Submitted 26 May, 2003;
originally announced May 2003.
-
Time evolution of the extremely diluted Blume-Emery-Griffiths neural network
Authors:
D. Bolle',
D. R. C. Dominguez,
R. Erichsen Jr.,
E. Korutcheva,
W. K. Theumann
Abstract:
The time evolution of the extremely diluted Blume-Emery-Griffiths neural network model is studied, and a detailed equilibrium phase diagram is obtained exhibiting pattern retrieval, fluctuation retrieval and self-sustained activity phases. It is shown that saddle-point solutions associated with fluctuation overlaps slow down considerably the flow of the network states towards the retrieval fixed…
▽ More
The time evolution of the extremely diluted Blume-Emery-Griffiths neural network model is studied, and a detailed equilibrium phase diagram is obtained exhibiting pattern retrieval, fluctuation retrieval and self-sustained activity phases. It is shown that saddle-point solutions associated with fluctuation overlaps slow down considerably the flow of the network states towards the retrieval fixed points. A comparison of the performance with other three-state networks is also presented.
△ Less
Submitted 14 August, 2002; v1 submitted 14 August, 2002;
originally announced August 2002.
-
Retrieval and Chaos in Extremely Diluted Non-Monotonic Neural Networks
Authors:
M. S. Mainieri,
R. Erichsen Jr
Abstract:
We discuss, in this paper, the dynamical properties of extremely diluted, non-monotonic neural networks. Assuming parallel updating and the Hebb prescription for the synaptic connections, a flow equation for the macroscopic overlap is derived. A rich dynamical phase diagram was obtained, showing a stable retrieval phase, as well as a cycle two and chaotic behavior. Numerical simulations were per…
▽ More
We discuss, in this paper, the dynamical properties of extremely diluted, non-monotonic neural networks. Assuming parallel updating and the Hebb prescription for the synaptic connections, a flow equation for the macroscopic overlap is derived. A rich dynamical phase diagram was obtained, showing a stable retrieval phase, as well as a cycle two and chaotic behavior. Numerical simulations were performed, showing good agreement with analytical results. Furthermore, the simulations give an additional insight into the microscopic dynamical behavior during the chaotic phase. It is shown that the freezing of individual neuron states is related to the structure of chaotic attractors.
△ Less
Submitted 6 February, 2002;
originally announced February 2002.
-
Retrieval behavior and thermodynamic properties of symmetrically diluted Q-Ising neural networks
Authors:
W. K. Theumann,
R. Erichsen Jr
Abstract:
The retrieval behavior and thermodynamic properties of symmetrically diluted Q-Ising neural networks are derived and studied in replica-symmetric mean-field theory generalizing earlier works on either the fully connected or the symmetrical extremely diluted network. Capacity-gain parameter phase diagrams are obtained for the Q=3, Q=4 and $Q=\infty$ state networks with uniformly distributed patte…
▽ More
The retrieval behavior and thermodynamic properties of symmetrically diluted Q-Ising neural networks are derived and studied in replica-symmetric mean-field theory generalizing earlier works on either the fully connected or the symmetrical extremely diluted network. Capacity-gain parameter phase diagrams are obtained for the Q=3, Q=4 and $Q=\infty$ state networks with uniformly distributed patterns of low activity in order to search for the effects of a gradual dilution of the synapses. It is shown that enlarged regions of continuous changeover into a region of optimal performance are obtained for finite stochastic noise and small but finite connectivity. The de Almeida-Thouless lines of stability are obtained for arbitrary connectivity, and the resulting phase diagrams are used to draw conclusions on the behavior of symmetrically diluted networks with other pattern distributions of either high or low activity.
△ Less
Submitted 28 August, 2001; v1 submitted 6 July, 2001;
originally announced July 2001.
-
Categorization in fully connected multi-state neural network models
Authors:
R. Erichsen,
W. K. Theumann,
D. R. C. Dominguez
Abstract:
The categorization ability of fully connected neural network models, with either discrete or continuous Q-state units, is studied in this work in replica symmetric mean-field theory. Hierarchically correlated multi-state patterns in a two level structure of ancestors and descendents (examples) are embedded in the network and the categorization task consists in recognizing the ancestors when the…
▽ More
The categorization ability of fully connected neural network models, with either discrete or continuous Q-state units, is studied in this work in replica symmetric mean-field theory. Hierarchically correlated multi-state patterns in a two level structure of ancestors and descendents (examples) are embedded in the network and the categorization task consists in recognizing the ancestors when the network is trained exclusively with their descendents. Explicit results for the dependence of the equilibrium properties of a Q=3-state model and a $Q=\infty$-state model are obtained in the form of phase diagrams and categorization curves. A strong improvement of the categorization ability is found when the network is trained with examples of low activity. The categorization ability is found to be robust to finite threshold and synaptic noise. The Almeida-Thouless lines that limit the validity of the replica-symmetric results, are also obtained.
△ Less
Submitted 1 October, 1999;
originally announced October 1999.
-
Optimally adapted multi-state neural networks trained with noise
Authors:
R. Erichsen Jr.,
W. K. Theumann
Abstract:
The principle of adaptation in a noisy retrieval environment is extended here to a diluted attractor neural network of Q-state neurons trained with noisy data. The network is adapted to an appropriate noisy training overlap and training activity which are determined self-consistently by the optimized retrieval attractor overlap and activity. The optimized storage capacity and the corresponding r…
▽ More
The principle of adaptation in a noisy retrieval environment is extended here to a diluted attractor neural network of Q-state neurons trained with noisy data. The network is adapted to an appropriate noisy training overlap and training activity which are determined self-consistently by the optimized retrieval attractor overlap and activity. The optimized storage capacity and the corresponding retriever overlap are considerably enhanced by an adequate threshold in the states. Explicit results for improved optimal performance and new retriever phase diagrams are obtained for Q=3 and Q=4, with coexisting phases over a wide range of thresholds. Most of the interesting results are stable to replica-symmetry-breaking fluctuations.
△ Less
Submitted 20 October, 1998;
originally announced October 1998.
-
A canonical ensemble approach to graded-response perceptrons
Authors:
D. Bolle,
R. Erichsen Jr
Abstract:
Perceptrons with graded input-output relations and a limited output precision are studied within the Gardner-Derrida canonical ensemble approach. Soft non- negative error measures are introduced allowing for extended retrieval properties. In particular, the performance of these systems for a linear and quadratic error measure, corresponding to the perceptron respectively the adaline learning alg…
▽ More
Perceptrons with graded input-output relations and a limited output precision are studied within the Gardner-Derrida canonical ensemble approach. Soft non- negative error measures are introduced allowing for extended retrieval properties. In particular, the performance of these systems for a linear and quadratic error measure, corresponding to the perceptron respectively the adaline learning algorithm, is compared with the performance for a rigid error measure, simply counting the number of errors. Replica-symmetry-breaking effects are evaluated.
△ Less
Submitted 6 February, 1998;
originally announced February 1998.
