-
Equivalence of Additive and Multiplicative Coupling in Spiking Neural Networks
Authors:
Georg Börner,
Fabio Schittler Neves,
Marc Timme
Abstract:
Spiking neural network models characterize the emergent collective dynamics of circuits of biological neurons and help engineer neuro-inspired solutions across fields. Most dynamical systems' models of spiking neural networks typically exhibit one of two major types of interactions: First, the response of a neuron's state variable to incoming pulse signals (spikes) may be additive and independent…
▽ More
Spiking neural network models characterize the emergent collective dynamics of circuits of biological neurons and help engineer neuro-inspired solutions across fields. Most dynamical systems' models of spiking neural networks typically exhibit one of two major types of interactions: First, the response of a neuron's state variable to incoming pulse signals (spikes) may be additive and independent of its current state. Second, the response may depend on the current neuron's state and multiply a function of the state variable. Here we reveal that spiking neural network models with additive coupling are equivalent to models with multiplicative coupling for simultaneously modified intrinsic neuron time evolution. As a consequence, the same collective dynamics can be attained by state-dependent multiplicative and constant (state-independent) additive coupling. Such a mapping enables the transfer of theoretical insights between spiking neural network models with different types of interaction mechanisms as well as simpler and more effective engineering applications.
△ Less
Submitted 11 April, 2023; v1 submitted 31 March, 2023;
originally announced April 2023.
-
Chromatic polynomials of random graphs
Authors:
Frank Van Bussel,
Christoph Ehrlich,
Denny Fliegner,
Sebastian Stolzenberg,
Marc Timme
Abstract:
Chromatic polynomials and related graph invariants are central objects in both graph theory and statistical physics. Computational difficulties, however, have so far restricted studies of such polynomials to graphs that were either very small, very sparse or highly structured. Recent algorithmic advances (Timme et al 2009 New J. Phys. 11 023001) now make it possible to compute chromatic polynomial…
▽ More
Chromatic polynomials and related graph invariants are central objects in both graph theory and statistical physics. Computational difficulties, however, have so far restricted studies of such polynomials to graphs that were either very small, very sparse or highly structured. Recent algorithmic advances (Timme et al 2009 New J. Phys. 11 023001) now make it possible to compute chromatic polynomials for moderately sized graphs of arbitrary structure and number of edges. Here we present chromatic polynomials of ensembles of random graphs with up to 30 vertices, over the entire range of edge density. We specifically focus on the locations of the zeros of the polynomial in the complex plane. The results indicate that the chromatic zeros of random graphs have a very consistent layout. In particular, the crossing point, the point at which the chromatic zeros with non-zero imaginary part approach the real axis, scales linearly with the average degree over most of the density range. While the scaling laws obtained are purely empirical, if they continue to hold in general there are significant implications: the crossing points of chromatic zeros in the thermodynamic limit separate systems with zero ground state entropy from systems with positive ground state entropy, the latter an exception to the third law of thermodynamics.
△ Less
Submitted 18 September, 2017;
originally announced September 2017.
-
From State Estimation to Network Reconstruction
Authors:
Farnaz Basiri,
Jose Casadiego,
Marc Timme,
Dirk Witthaut
Abstract:
We develop methods to efficiently reconstruct the topology and line parameters of a power grid from the measurement of nodal variables. We propose two compressed sensing algorithms that minimize the amount of necessary measurement resources by exploiting network sparsity, symmetry of connections and potential prior knowledge about the connectivity. The algorithms are reciprocal to established stat…
▽ More
We develop methods to efficiently reconstruct the topology and line parameters of a power grid from the measurement of nodal variables. We propose two compressed sensing algorithms that minimize the amount of necessary measurement resources by exploiting network sparsity, symmetry of connections and potential prior knowledge about the connectivity. The algorithms are reciprocal to established state estimation methods, where nodal variables are estimated from few measurements given the network structure. Hence, they enable an advanced grid monitoring where both state and structure of a grid are subject to uncertainties or missing information.
△ Less
Submitted 28 January, 2017;
originally announced January 2017.
-
Dynamic information routing in complex networks
Authors:
Christoph Kirst,
Marc Timme,
Demian Battaglia
Abstract:
Flexible information routing fundamentally underlies the function of many biological and artificial networks. Yet, how such systems may specifically communicate and dynamically route information is not well understood. Here we identify a generic mechanism to route information on top of collective dynamical reference states in complex networks. Switching between collective dynamics induces flexible…
▽ More
Flexible information routing fundamentally underlies the function of many biological and artificial networks. Yet, how such systems may specifically communicate and dynamically route information is not well understood. Here we identify a generic mechanism to route information on top of collective dynamical reference states in complex networks. Switching between collective dynamics induces flexible reorganization of information sharing and routing patterns, as quantified by delayed mutual information and transfer entropy measures between activities of a network's units. We demonstrate the power of this generic mechanism specifically for oscillatory dynamics and analyze how individual unit properties, the network topology and external inputs coact to systematically organize information routing. For multi-scale, modular architectures, we resolve routing patterns at all levels. Interestingly, local interventions within one sub-network may remotely determine non-local network-wide communication. These results help understanding and designing information routing patterns across systems where collective dynamics co-occurs with a communication function.
△ Less
Submitted 16 October, 2015;
originally announced October 2015.
-
Controlling Chaos Faster
Authors:
Christian Bick,
Christoph Kolodziejski,
Marc Timme
Abstract:
Predictive Feedback Control is an easy-to-implement method to stabilize unknown unstable periodic orbits in chaotic dynamical systems. Predictive Feedback Control is severely limited because asymptotic convergence speed decreases with stronger instabilities which in turn are typical for larger target periods, rendering it harder to effectively stabilize periodic orbits of large period. Here, we st…
▽ More
Predictive Feedback Control is an easy-to-implement method to stabilize unknown unstable periodic orbits in chaotic dynamical systems. Predictive Feedback Control is severely limited because asymptotic convergence speed decreases with stronger instabilities which in turn are typical for larger target periods, rendering it harder to effectively stabilize periodic orbits of large period. Here, we study stalled chaos control, where the application of control is stalled to make use of the chaotic, uncontrolled dynamics, and introduce an adaptation paradigm to overcome this limitation and speed up convergence. This modified control scheme is not only capable of stabilizing more periodic orbits than the original Predictive Feedback Control but also speeds up convergence for typical chaotic maps, as illustrated in both theory and application. The proposed adaptation scheme provides a way to tune parameters online, yielding a broadly applicable, fast chaos control that converges reliably, even for periodic orbits of large period.
△ Less
Submitted 19 February, 2014;
originally announced February 2014.
-
Adapting Predictive Feedback Chaos Control for Optimal Convergence Speed
Authors:
Christian Bick,
Marc Timme,
Christoph Kolodziejski
Abstract:
Stabilizing unstable periodic orbits in a chaotic invariant set not only reveals information about its structure but also leads to various interesting applications. For the successful application of a chaos control scheme, convergence speed is of crucial importance. Here we present a predictive feedback chaos control method that adapts a control parameter online to yield optimal asymptotic converg…
▽ More
Stabilizing unstable periodic orbits in a chaotic invariant set not only reveals information about its structure but also leads to various interesting applications. For the successful application of a chaos control scheme, convergence speed is of crucial importance. Here we present a predictive feedback chaos control method that adapts a control parameter online to yield optimal asymptotic convergence speed. We study the adaptive control map both analytically and numerically and prove that it converges at least linearly to a value determined by the spectral radius of the control map at the periodic orbit to be stabilized. The method is easy to implement algorithmically and may find applications for adaptive online control of biological and engineering systems.
△ Less
Submitted 6 January, 2012;
originally announced January 2012.
-
Chaos in Symmetric Phase Oscillator Networks
Authors:
Christian Bick,
Marc Timme,
Danilo Paulikat,
Dirk Rathlev,
Peter Ashwin
Abstract:
Phase-coupled oscillators serve as paradigmatic models of networks of weakly interacting oscillatory units in physics and biology. The order parameter which quantifies synchronization was so far found to be chaotic only in systems with inhomogeneities. Here we show that even symmetric systems of identical oscillators may not only exhibit chaotic dynamics, but also chaotically fluctuating order par…
▽ More
Phase-coupled oscillators serve as paradigmatic models of networks of weakly interacting oscillatory units in physics and biology. The order parameter which quantifies synchronization was so far found to be chaotic only in systems with inhomogeneities. Here we show that even symmetric systems of identical oscillators may not only exhibit chaotic dynamics, but also chaotically fluctuating order parameters. Our findings imply that neither inhomogeneities nor amplitude variations are necessary to obtain chaos, i.e., nonlinear interactions of phases give rise to the necessary instabilities.
△ Less
Submitted 13 October, 2011; v1 submitted 11 May, 2011;
originally announced May 2011.
-
Impact of Single Links in Competitive Percolation -- How complex networks grow under competition
Authors:
Jan Nagler,
Anna Levina,
Marc Timme
Abstract:
How a complex network is connected crucially impacts its dynamics and function. Percolation, the transition to extensive connectedness upon gradual addition of links, was long believed to be continuous but recent numerical evidence on "explosive percolation" suggests that it might as well be discontinuous if links compete for addition. Here we analyze the microscopic mechanisms underlying disconti…
▽ More
How a complex network is connected crucially impacts its dynamics and function. Percolation, the transition to extensive connectedness upon gradual addition of links, was long believed to be continuous but recent numerical evidence on "explosive percolation" suggests that it might as well be discontinuous if links compete for addition. Here we analyze the microscopic mechanisms underlying discontinuous percolation processes and reveal a strong impact of single link additions. We show that in generic competitive percolation processes, including those displaying explosive percolation, single links do not induce a discontinuous gap in the largest cluster size in the thermodynamic limit. Nevertheless, our results highlight that for large finite systems single links may still induce observable gaps because gap sizes scale weakly algebraically with system size. Several essentially macroscopic clusters coexist immediately before the transition, thus announcing discontinuous percolation. These results explain how single links may drastically change macroscopic connectivity in networks where links add competitively.
△ Less
Submitted 4 March, 2011;
originally announced March 2011.
-
Counting Complex Disordered States by Efficient Pattern Matching: Chromatic Polynomials and Potts Partition Functions
Authors:
Marc Timme,
Frank van Bussel,
Denny Fliegner,
Sebastian Stolzenberg
Abstract:
Counting problems, determining the number of possible states of a large system under certain constraints, play an important role in many areas of science. They naturally arise for complex disordered systems in physics and chemistry, in mathematical graph theory, and in computer science. Counting problems, however, are among the hardest problems to access computationally. Here, we suggest a novel…
▽ More
Counting problems, determining the number of possible states of a large system under certain constraints, play an important role in many areas of science. They naturally arise for complex disordered systems in physics and chemistry, in mathematical graph theory, and in computer science. Counting problems, however, are among the hardest problems to access computationally. Here, we suggest a novel method to access a benchmark counting problem, finding chromatic polynomials of graphs. We develop a vertex-oriented symbolic pattern matching algorithm that exploits the equivalence between the chromatic polynomial and the zero-temperature partition function of the Potts antiferromagnet on the same graph. Implementing this bottom-up algorithm using appropriate computer algebra, the new method outperforms standard top-down methods by several orders of magnitude, already for moderately sized graphs. As a first application, we compute chromatic polynomials of samples of the simple cubic lattice, for the first time computationally accessing three-dimensional lattices of physical relevance. The method offers straightforward generalizations to several other counting problems.
△ Less
Submitted 27 April, 2009;
originally announced April 2009.
-
Partial Reset in Pulse-Coupled Oscillators
Authors:
Christoph Kirst,
Marc Timme
Abstract:
Pulse-coupled threshold units serve as paradigmatic models for a wide range of complex systems. When the state variable of a unit crosses a threshold, the unit sends a pulse that is received by other units, thereby mediating the interactions. At the same time, the state variable of the sending unit is reset. Here we study pulse-coupled models with a reset that may be partial only and is mediated…
▽ More
Pulse-coupled threshold units serve as paradigmatic models for a wide range of complex systems. When the state variable of a unit crosses a threshold, the unit sends a pulse that is received by other units, thereby mediating the interactions. At the same time, the state variable of the sending unit is reset. Here we study pulse-coupled models with a reset that may be partial only and is mediated by a partial reset function. Such a partial reset characterizes intrinsic physical or biophysical features of a unit (e.g., resistive coupling between dendrite and soma of compartmental neurons) and at the same time makes possible a rigorous mathematical investigation of the collective network dynamics.
The partial reset acts as a desynchronization mechanism. For all-to-all pulse-coupled oscillators an increase in the strength of the partial reset causes a sequence of desynchronizing bifurcations from the fully synchronous state via states with large clusters of synchronized units through states with smaller clusters to complete asynchrony. We analytically derive sufficient and necessary conditions for the existence and stability of periodic cluster states on the local dynamics of the oscillators and on the partial reset function to reveal the mechanism underlying the desynchronization transition. We show that the entire sequence may occur due to arbitrarily small changes of the partial reset and is robust against structural perturbations.
△ Less
Submitted 9 December, 2008;
originally announced December 2008.
-
The simplest problem in the collective dynamics of neural networks: Is synchrony stable?
Authors:
Marc Timme,
Fred Wolf
Abstract:
For spiking neural networks we consider the stability problem of global synchrony, arguably the simplest non-trivial collective dynamics in such networks. We find that even this simplest dynamical problem -- local stability of synchrony -- is non-trivial to solve and requires novel methods for its solution. The dynamics in the vicinity of the synchronous state is determined by a multitude of lin…
▽ More
For spiking neural networks we consider the stability problem of global synchrony, arguably the simplest non-trivial collective dynamics in such networks. We find that even this simplest dynamical problem -- local stability of synchrony -- is non-trivial to solve and requires novel methods for its solution. The dynamics in the vicinity of the synchronous state is determined by a multitude of linear operators, in contrast to a single stability matrix in conventional linear stability theory. This unusual property qualitatively depends on network topology and may be neglected for globally coupled homogeneous networks. For generic networks, however, the number of operators increases exponentially with the size of the network. We present methods to treat this multi-operator problem exactly. First, based on the Gershgorin and Perron-Frobenius theorems, we derive bounds on the eigenvalues that provide important information about the synchronization process but are not sufficient to establish the asymptotic stability or instability of the synchronous state. We then present a complete analysis of asymptotic stability for topologically strongly connected networks using simple graph-theoretical considerations. For inhibitory interactions between dissipative (leaky) oscillatory neurons the synchronous state is stable, independent of the parameters and the network connectivity. These results indicate that pulse-like interactions play a profound role in network dynamical systems, and in particular in the dynamics of biological synchronization, unless the coupling is homogeneous and all-to-all.
△ Less
Submitted 24 October, 2008;
originally announced October 2008.
-
Unstable Attractors: Existence and Robustness in Networks of Oscillators With Delayed Pulse Coupling
Authors:
Peter Ashwin,
Marc Timme
Abstract:
We consider unstable attractors; Milnor attractors $A$ such that, for some neighbourhood $U$ of $A$, almost all initial conditions leave $U$. Previous research strongly suggests that unstable attractors exist and even occur robustly (i.e. for open sets of parameter values) in a system modelling biological phenomena, namely in globally coupled oscillators with delayed pulse interactions.
In the…
▽ More
We consider unstable attractors; Milnor attractors $A$ such that, for some neighbourhood $U$ of $A$, almost all initial conditions leave $U$. Previous research strongly suggests that unstable attractors exist and even occur robustly (i.e. for open sets of parameter values) in a system modelling biological phenomena, namely in globally coupled oscillators with delayed pulse interactions.
In the first part of this paper we give a rigorous definition of unstable attractors for general dynamical systems. We classify unstable attractors into two types, depending on whether or not there is a neighbourhood of the attractor that intersects the basin in a set of positive measure. We give examples of both types of unstable attractor; these examples have non-invertible dynamics that collapse certain open sets onto stable manifolds of saddle orbits.
In the second part we give the first rigorous demonstration of existence and robust occurrence of unstable attractors in a network of oscillators with delayed pulse coupling. Although such systems are technically hybrid systems of delay differential equations with discontinuous `firing' events, we show that their dynamics reduces to a finite dimensional hybrid system system after a finite time and hence we can discuss Milnor attractors for this reduced finite dimensional system. We prove that for an open set of phase resetting functions there are saddle periodic orbits that are unstable attractors.
△ Less
Submitted 17 January, 2005;
originally announced January 2005.