-
Self-organized Collapse of Societies
Authors:
Alexander Jochim,
Stefan Bornholdt
Abstract:
Why are human societies unstable? Theories based on the observation of recurring patterns in historical data indicate that economic inequality, as well as social factors are key drivers. So far, models of this phenomenon are more macroscopic in nature. However, basic mechanisms at work could be accessible to minimal mathematical models. Here we combine a simple mechanism for economic growth with a…
▽ More
Why are human societies unstable? Theories based on the observation of recurring patterns in historical data indicate that economic inequality, as well as social factors are key drivers. So far, models of this phenomenon are more macroscopic in nature. However, basic mechanisms at work could be accessible to minimal mathematical models. Here we combine a simple mechanism for economic growth with a mechanism for the spreading of social dissatisfaction. Broad wealth distributions generated by the economic mechanism eventually trigger social unrest and the destruction of wealth, leading to an emerging pattern of boom and bust. We find that the model time scales compare well with empirical data. The model emphasizes the role of broad (power law) wealth distributions for dynamical social phenomena.
△ Less
Submitted 21 June, 2025;
originally announced June 2025.
-
A toy model for brain criticality: self-organized excitation/inhibition ratio and the role of network clustering
Authors:
Lorenz Baumgarten,
Stefan Bornholdt
Abstract:
The critical brain hypothesis receives increasing support from recent experimental results. It postulates that the brain is at a critical point between an ordered and a chaotic regime, sometimes referred to as the "edge of chaos." Another central observation of neuroscience is the principle of excitation-inhibition balance: Certain brain networks exhibit a remarkably constant ratio between excitat…
▽ More
The critical brain hypothesis receives increasing support from recent experimental results. It postulates that the brain is at a critical point between an ordered and a chaotic regime, sometimes referred to as the "edge of chaos." Another central observation of neuroscience is the principle of excitation-inhibition balance: Certain brain networks exhibit a remarkably constant ratio between excitation and inhibition. When this balance is perturbed, the network shifts away from the critical point, as may for example happen during epileptic seizures. However, it is as of yet unclear what mechanisms balance the neural dynamics towards this excitation-inhibition ratio that ensures critical brain dynamics. Here we introduce a simple yet biologically plausible toy model of a self-organized critical neural network with a self-organizing excitation to inhibition ratio. The model only requires a neuron to have local information of its own recent activity and changes connections between neurons accordingly. We find that the network evolves to a state characterized by avalanche distributions following universal scaling laws typical of criticality, and to a specific excitation to inhibition ratio. The model connects the two questions of brain criticality and of a specific excitation/inhibition balance observed in the brain to a common origin or mechanism. From the perspective of the statistical mechanics of such networks, the model uses the excitation/inhibition ratio as control parameter of a phase transition, which enables criticality at arbitrary high connectivities. We find that network clustering plays a crucial role for this phase transition to occur.
△ Less
Submitted 7 February, 2022;
originally announced February 2022.
-
Universal computation using localized limit-cycle attractors in neural networks
Authors:
Lorenz Baumgarten,
Stefan Bornholdt
Abstract:
Neural networks are dynamical systems that compute with their dynamics. One example is the Hopfield model, forming an associative memory which stores patterns as global attractors of the network dynamics. From studies of dynamical networks it is well known that localized attractors also exist. Yet, they have not been used in computing paradigms. Here we show that interacting localized attractors i…
▽ More
Neural networks are dynamical systems that compute with their dynamics. One example is the Hopfield model, forming an associative memory which stores patterns as global attractors of the network dynamics. From studies of dynamical networks it is well known that localized attractors also exist. Yet, they have not been used in computing paradigms. Here we show that interacting localized attractors in threshold networks can result in universal computation. We develop a rewiring algorithm that builds universal Boolean gates in a biologically inspired two-dimensional threshold network with randomly placed and connected nodes using collision-based computing. We aim at demonstrating the computational capabilities and the ability to control local limit cycle attractors in such networks by creating simple Boolean gates by means of these local activations. The gates use glider guns, i.e., localized activity that periodically generates "gliders" of activity that propagate through space. Several such gliders are made to collide, and the result of their interaction is used as the output of a Boolean gate. We show that these gates can be used to build a universal computer.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
Self-organized criticality in neural networks from activity-based rewiring
Authors:
Stefan Landmann,
Lorenz Baumgarten,
Stefan Bornholdt
Abstract:
Neural systems process information in a dynamical regime between silence and chaotic dynamics. This has lead to the criticality hypothesis which suggests that neural systems reach such a state by self-organizing towards the critical point of a dynamical phase transition. Here, we study a minimal neural network model that exhibits self-organized criticality in the presence of stochastic noise using…
▽ More
Neural systems process information in a dynamical regime between silence and chaotic dynamics. This has lead to the criticality hypothesis which suggests that neural systems reach such a state by self-organizing towards the critical point of a dynamical phase transition. Here, we study a minimal neural network model that exhibits self-organized criticality in the presence of stochastic noise using a rewiring rule which only utilizes local information. For network evolution, incoming links are added to a node or deleted, depending on the node's average activity. Based on this rewiring-rule only, the network evolves towards a critcal state, showing typical power-law distributed avalanche statistics. The observed exponents are in accord with criticality as predicted by dynamical scaling theory, as well as with the observed exponents of neural avalanches. The critical state of the model is reached autonomously without need for parameter tuning, is independent of initial conditions, is robust under stochastic noise, and independent of details of the implementation as different variants of the model indicate. We argue that this supports the hypothesis that real neural systems may utilize similar mechanisms to self-organize towards criticality especially during early developmental stages.
△ Less
Submitted 24 September, 2020;
originally announced September 2020.
-
Discrimination emerging through spontaneous symmetry breaking in a spatial prisoner's dilemma model with multiple labels
Authors:
Gorm Gruner Jensen,
Frederik Tischel,
Stefan Bornholdt
Abstract:
Social discrimination seems to be a persistent phenomenon in many cultures. It is important to understand the mechanisms that lead people to judge others by the group to which they belong, rather than individual qualities. It was recently shown that evolutionary (imitation) dynamics can lead to a hierarchical discrimination between agents marked with observable, but otherwise meaningless, labels.…
▽ More
Social discrimination seems to be a persistent phenomenon in many cultures. It is important to understand the mechanisms that lead people to judge others by the group to which they belong, rather than individual qualities. It was recently shown that evolutionary (imitation) dynamics can lead to a hierarchical discrimination between agents marked with observable, but otherwise meaningless, labels. These findings suggest that it can give useful insight, to describe the phenomenon of social discrimination in terms of spontaneous symmetry breaking. The investigations so far have, however, only considered binary labels. In this contribution we extend the investigations to models with up to seven different labels. We find the features known from the binary label model remain remarkably robust when the number of labels is increased. We also discover a new feature, namely that it is more likely for neighbours to have strategies which are similar, in the sense that they agree on how to act towards a subset of the labels.
△ Less
Submitted 18 June, 2019;
originally announced June 2019.
-
Inhibition as a determinant of activity and criticality in dynamical networks
Authors:
Joao Pinheiro Neto,
Marcus A. M. de Aguiar,
José A. Brum,
Stefan Bornholdt
Abstract:
A certain degree of inhibition is a common trait of dynamical networks in nature, ranging from neuronal and biochemical networks, to social and technological networks. We study here the role of inhibition in a representative dynamical network model, characterizing the dynamics of random threshold networks with both excitatory and inhibitory links. Varying the fraction of excitatory links has a str…
▽ More
A certain degree of inhibition is a common trait of dynamical networks in nature, ranging from neuronal and biochemical networks, to social and technological networks. We study here the role of inhibition in a representative dynamical network model, characterizing the dynamics of random threshold networks with both excitatory and inhibitory links. Varying the fraction of excitatory links has a strong effect on the network's population activity and its sensitivity to perturbation. The average degree $K$, known to have a strong effect on the dynamics when small, loses its influence on the dynamics as its value increases. Instead, the strength of inhibition is a determinant of dynamics and sensitivity here, allowing for criticality only in a specific corridor of inhibition. This criticality corridor requires that excitation dominates, while the balance region corresponds to maximum sensitivity to perturbation. We develop mean-field approximations of the population activity and sensitivity and find that the network dynamics is independent of degree distribution for high $K$. In a minimal model of an adaptive threshold network we demonstrate how the dynamics remains robust against changes in the topology. This adaptive model can be extended in order to generate networks with a controllable activity distribution and specific topologies.
△ Less
Submitted 23 December, 2017;
originally announced December 2017.
-
Self-organized criticality in neural network models
Authors:
Matthias Rybarsch,
Stefan Bornholdt
Abstract:
It has long been argued that neural networks have to establish and maintain a certain intermediate level of activity in order to keep away from the regimes of chaos and silence. Strong evidence for criticality has been observed in terms of spatio-temporal activity avalanches first in cultures of rat cortex by Beggs and Plenz (2003) and subsequently in many more experimental setups. These findings…
▽ More
It has long been argued that neural networks have to establish and maintain a certain intermediate level of activity in order to keep away from the regimes of chaos and silence. Strong evidence for criticality has been observed in terms of spatio-temporal activity avalanches first in cultures of rat cortex by Beggs and Plenz (2003) and subsequently in many more experimental setups. These findings sparked intense research on theoretical models for criticality and avalanche dynamics in neural networks, where usually some dynamical order parameter is fed back onto the network topology by adapting the synaptic couplings. We here give an overview of existing theoretical models of dynamical networks. While most models emphasize biological and neurophysiological detail, our path here is different: we pick up the thread of an early self-organized critical neural network model by Bornholdt and Roehl (2001) and test its applicability in the light of experimental data. Keeping the simplicity of early models, and at the same time lifting the drawback of a spin formulation with respect to the biological system, we here study an improved model (Rybarsch and Bornholdt, 2012b) and show that it adapts to criticality exhibiting avalanche statistics that compare well with experimental data without the need for parameter tuning.
△ Less
Submitted 13 December, 2012;
originally announced December 2012.
-
Morphogenesis by coupled regulatory networks: Reliable control of positional information and proportion regulation
Authors:
Thimo Rohlf,
Stefan Bornholdt
Abstract:
Based on a non-equilibrium mechanism for spatial pattern formation we study how position information can be controlled by locally coupled discrete dynamical networks, similar to gene regulation networks of cells in a developing multicellular organism. As an example we study the developmental problems of domain formation and proportion regulation in the presence of noise, as well as in the presen…
▽ More
Based on a non-equilibrium mechanism for spatial pattern formation we study how position information can be controlled by locally coupled discrete dynamical networks, similar to gene regulation networks of cells in a developing multicellular organism. As an example we study the developmental problems of domain formation and proportion regulation in the presence of noise, as well as in the presence of cell flow. We find that networks that solve this task exhibit a hierarchical structure of information processing and are of similar complexity as developmental circuits of living cells. Proportion regulation is scalable with system size and leads to sharp, precisely localized boundaries of gene expression domains, even for large numbers of cells. A detailed analysis of noise-induced dynamics, using a mean-field approximation, shows that noise in gene expression states stabilizes (rather than disrupts) the spatial pattern in the presence of cell movements, both for stationary as well as growing systems. Finally, we discuss how this mechanism could be realized in the highly dynamic environment of growing tissues in multi-cellular organisms.
△ Less
Submitted 25 August, 2009;
originally announced August 2009.
-
Self-organized criticality and adaptation in discrete dynamical networks
Authors:
Thimo Rohlf,
Stefan Bornholdt
Abstract:
It has been proposed that adaptation in complex systems is optimized at the critical boundary between ordered and disordered dynamical regimes. Here, we review models of evolving dynamical networks that lead to self-organization of network topology based on a local coupling between a dynamical order parameter and rewiring of network connectivity, with convergence towards criticality in the limit…
▽ More
It has been proposed that adaptation in complex systems is optimized at the critical boundary between ordered and disordered dynamical regimes. Here, we review models of evolving dynamical networks that lead to self-organization of network topology based on a local coupling between a dynamical order parameter and rewiring of network connectivity, with convergence towards criticality in the limit of large network size $N$. In particular, two adaptive schemes are discussed and compared in the context of Boolean Networks and Threshold Networks: 1) Active nodes loose links, frozen nodes aquire new links, 2) Nodes with correlated activity connect, de-correlated nodes disconnect. These simple local adaptive rules lead to co-evolution of network topology and -dynamics. Adaptive networks are strikingly different from random networks: They evolve inhomogeneous topologies and broad plateaus of homeostatic regulation, dynamical activity exhibits $1/f$ noise and attractor periods obey a scale-free distribution. The proposed co-evolutionary mechanism of topological self-organization is robust against noise and does not depend on the details of dynamical transition rules. Using finite-size scaling, it is shown that networks converge to a self-organized critical state in the thermodynamic limit. Finally, we discuss open questions and directions for future research, and outline possible applications of these models to adaptive systems in diverse areas.
△ Less
Submitted 6 November, 2008;
originally announced November 2008.
-
Robustness as an Evolutionary Principle
Authors:
Stefan Bornholdt,
Kim Sneppen
Abstract:
We suggest to simulate evolution of complex organisms constrained by the sole requirement of robustness in their expression patterns. This scenario is illustrated by evolving discrete logical networks with epigenetic properties. Evidence for dynamical features in the evolved networks is found that can be related to biological observables.
We suggest to simulate evolution of complex organisms constrained by the sole requirement of robustness in their expression patterns. This scenario is illustrated by evolving discrete logical networks with epigenetic properties. Evidence for dynamical features in the evolved networks is found that can be related to biological observables.
△ Less
Submitted 20 March, 2000;
originally announced March 2000.
-
Topological Evolution of Dynamical Networks: Global Criticality from Local Dynamics
Authors:
Stefan Bornholdt,
Thimo Rohlf
Abstract:
We evolve network topology of an asymmetrically connected threshold network by a simple local rewiring rule: quiet nodes grow links, active nodes lose links. This leads to convergence of the average connectivity of the network towards the critical value $K_c =2$ in the limit of large system size $N$. How this principle could generate self-organization in natural complex systems is discussed for…
▽ More
We evolve network topology of an asymmetrically connected threshold network by a simple local rewiring rule: quiet nodes grow links, active nodes lose links. This leads to convergence of the average connectivity of the network towards the critical value $K_c =2$ in the limit of large system size $N$. How this principle could generate self-organization in natural complex systems is discussed for two examples: neural networks and regulatory networks in the genome.
△ Less
Submitted 21 June, 2000; v1 submitted 13 March, 2000;
originally announced March 2000.
-
Beyond Hebb: Exclusive-OR and Biological Learning
Authors:
Konstantin Klemm,
Stefan Bornholdt,
Heinz Georg Schuster
Abstract:
A learning algorithm for multilayer neural networks based on biologically plausible mechanisms is studied. Motivated by findings in experimental neurobiology, we consider synaptic averaging in the induction of plasticity changes, which happen on a slower time scale than firing dynamics. This mechanism is shown to enable learning of the exclusive-OR (XOR) problem without the aid of error back-pro…
▽ More
A learning algorithm for multilayer neural networks based on biologically plausible mechanisms is studied. Motivated by findings in experimental neurobiology, we consider synaptic averaging in the induction of plasticity changes, which happen on a slower time scale than firing dynamics. This mechanism is shown to enable learning of the exclusive-OR (XOR) problem without the aid of error back-propagation, as well as to increase robustness of learning in the presence of noise.
△ Less
Submitted 24 March, 2000; v1 submitted 15 September, 1999;
originally announced September 1999.
-
Annealing schedule from population dynamics
Authors:
Stefan Bornholdt
Abstract:
We introduce a dynamical annealing schedule for population-based optimization algorithms with mutation. On the basis of a statistical mechanics formulation of the population dynamics, the mutation rate adapts to a value maximizing expected rewards at each time step. Thereby, the mutation rate is eliminated as a free parameter from the algorithm.
We introduce a dynamical annealing schedule for population-based optimization algorithms with mutation. On the basis of a statistical mechanics formulation of the population dynamics, the mutation rate adapts to a value maximizing expected rewards at each time step. Thereby, the mutation rate is eliminated as a free parameter from the algorithm.
△ Less
Submitted 4 March, 1999;
originally announced March 1999.
-
Genetic algorithm dynamics on a rugged landscape
Authors:
Stefan Bornholdt
Abstract:
The genetic algorithm is an optimization procedure motivated by biological evolution and is successfully applied to optimization problems in different areas. A statistical mechanics model for its dynamics is proposed based on the parent-child fitness correlation of the genetic operators, making it applicable to general fitness landscapes. It is compared to a recent model based on a maximum entro…
▽ More
The genetic algorithm is an optimization procedure motivated by biological evolution and is successfully applied to optimization problems in different areas. A statistical mechanics model for its dynamics is proposed based on the parent-child fitness correlation of the genetic operators, making it applicable to general fitness landscapes. It is compared to a recent model based on a maximum entropy ansatz. Finally it is applied to modeling the dynamics of a genetic algorithm on the rugged fitness landscape of the NK model.
△ Less
Submitted 4 March, 1999;
originally announced March 1999.
-
Neutral Mutations and Punctuated Equilibrium in Evolving Genetic Networks
Authors:
Stefan Bornholdt,
Kim Sneppen
Abstract:
Boolean networks may be viewed as idealizations of biological genetic networks, where each node is represented by an on-off switch which is a function of the binary output from some other nodes. We evolve connectivity in a single Boolean network, and demonstrate how the sole requirement of sequential matching of attractors may open for an evolution that exhibits punctuated equilibrium.
Boolean networks may be viewed as idealizations of biological genetic networks, where each node is represented by an on-off switch which is a function of the binary output from some other nodes. We evolve connectivity in a single Boolean network, and demonstrate how the sole requirement of sequential matching of attractors may open for an evolution that exhibits punctuated equilibrium.
△ Less
Submitted 4 March, 1999; v1 submitted 23 August, 1997;
originally announced August 1997.
-
Hierarchical Crossover and Probability Landscapes of Genetic Operators
Authors:
Stefan Bornholdt,
Heinz Georg Schuster
Abstract:
The time evolution of a simple model for crossover is discussed. A variant of this model with an improved exploration behavior in phase space is derived as a subset of standard one- and multi-point crossover operations. This model is solved analytically in the flat fitness case. Numerical simulations compare the way of phase space exploration of different genetic operators. In the case of a non-fl…
▽ More
The time evolution of a simple model for crossover is discussed. A variant of this model with an improved exploration behavior in phase space is derived as a subset of standard one- and multi-point crossover operations. This model is solved analytically in the flat fitness case. Numerical simulations compare the way of phase space exploration of different genetic operators. In the case of a non-flat fitness landscape, numerical solutions of the evolution equations point out ways to estimate premature convergence.
△ Less
Submitted 28 April, 1995;
originally announced April 1995.
