-
Conditions for wave trains in spiking neural networks
Authors:
Johanna Senk,
Karolína Korvasová,
Jannis Schuecker,
Espen Hagen,
Tom Tetzlaff,
Markus Diesmann,
Moritz Helias
Abstract:
Spatiotemporal patterns such as traveling waves are frequently observed in recordings of neural activity. The mechanisms underlying the generation of such patterns are largely unknown. Previous studies have investigated the existence and uniqueness of different types of waves or bumps of activity using neural-field models, phenomenological coarse-grained descriptions of neural-network dynamics. Bu…
▽ More
Spatiotemporal patterns such as traveling waves are frequently observed in recordings of neural activity. The mechanisms underlying the generation of such patterns are largely unknown. Previous studies have investigated the existence and uniqueness of different types of waves or bumps of activity using neural-field models, phenomenological coarse-grained descriptions of neural-network dynamics. But it remains unclear how these insights can be transferred to more biologically realistic networks of spiking neurons, where individual neurons fire irregularly. Here, we employ mean-field theory to reduce a microscopic model of leaky integrate-and-fire (LIF) neurons with distance-dependent connectivity to an effective neural-field model. In contrast to existing phenomenological descriptions, the dynamics in this neural-field model depends on the mean and the variance in the synaptic input, both determining the amplitude and the temporal structure of the resulting effective coupling kernel. For the neural-field model we employ liner stability analysis to derive conditions for the existence of spatial and temporal oscillations and wave trains, that is, temporally and spatially periodic traveling waves. We first prove that wave trains cannot occur in a single homogeneous population of neurons, irrespective of the form of distance dependence of the connection probability. Compatible with the architecture of cortical neural networks, wave trains emerge in two-population networks of excitatory and inhibitory neurons as a combination of delay-induced temporal oscillations and spatial oscillations due to distance-dependent connectivity profiles. Finally, we demonstrate quantitative agreement between predictions of the analytically tractable neural-field model and numerical simulations of both networks of nonlinear rate-based units and networks of LIF neurons.
△ Less
Submitted 23 September, 2019; v1 submitted 18 January, 2018;
originally announced January 2018.
-
How the connectivity structure of neuronal networks influences responses to oscillatory stimuli
Authors:
Hannah Bos,
Jannis Schücker,
Moritz Helias
Abstract:
Propagation of oscillatory signals through the cortex and coherence is shaped by the connectivity structure of neuronal circuits. This study systematically investigates the network and stimulus properties that shape network responses. The results show how input to a cortical column model of the primary visual cortex excites dynamical modes determined by the laminar pattern. Stimulating the inhibit…
▽ More
Propagation of oscillatory signals through the cortex and coherence is shaped by the connectivity structure of neuronal circuits. This study systematically investigates the network and stimulus properties that shape network responses. The results show how input to a cortical column model of the primary visual cortex excites dynamical modes determined by the laminar pattern. Stimulating the inhibitory neurons in the upper layer reproduces experimentally observed resonances at gamma frequency whose origin can be traced back to two anatomical sub-circuits. We develop this result systematically: Initially, we highlight the effect of stimulus amplitude and filter properties of the neurons on their response to oscillatory stimuli. Subsequently, we analyze the amplification of oscillatory stimuli by the effective network structure. We demonstrate that the amplification of stimuli, as well as their visibility in different populations, can be explained by specific network patterns. Inspired by experimental results we ask whether the anatomical origin of oscillations can be inferred by applying oscillatory stimuli. We find that different network motifs can generate similar responses to oscillatory input, showing that resonances in the network response cannot, straightforwardly, be assigned to the motifs they emerge from. Applying the analysis to a spiking model of a cortical column, we characterize how the dynamic mode structure, which is induced by the laminar connectivity, processes external input. In particular, we show that a stimulus applied to specific populations typically elicits responses of several interacting modes. The resulting network response is therefore composed of a multitude of contributions and can therefore neither be assigned to a single mode nor do the observed resonances necessarily coincide with the intrinsic resonances of the circuit.
△ Less
Submitted 26 April, 2017;
originally announced April 2017.
-
Integration of continuous-time dynamics in a spiking neural network simulator
Authors:
Jan Hahne,
David Dahmen,
Jannis Schuecker,
Andreas Frommer,
Matthias Bolten,
Moritz Helias,
Markus Diesmann
Abstract:
Contemporary modeling approaches to the dynamics of neural networks consider two main classes of models: biologically grounded spiking neurons and functionally inspired rate-based units. The unified simulation framework presented here supports the combination of the two for multi-scale modeling approaches, the quantitative validation of mean-field approaches by spiking network simulations, and an…
▽ More
Contemporary modeling approaches to the dynamics of neural networks consider two main classes of models: biologically grounded spiking neurons and functionally inspired rate-based units. The unified simulation framework presented here supports the combination of the two for multi-scale modeling approaches, the quantitative validation of mean-field approaches by spiking network simulations, and an increase in reliability by usage of the same simulation code and the same network model specifications for both model classes. While most efficient spiking simulations rely on the communication of discrete events, rate models require time-continuous interactions between neurons. Exploiting the conceptual similarity to the inclusion of gap junctions in spiking network simulations, we arrive at a reference implementation of instantaneous and delayed interactions between rate-based models in a spiking network simulator. The separation of rate dynamics from the general connection and communication infrastructure ensures flexibility of the framework. We further demonstrate the broad applicability of the framework by considering various examples from the literature ranging from random networks to neural field models. The study provides the prerequisite for interactions between rate-based and spiking models in a joint simulation.
△ Less
Submitted 31 October, 2016;
originally announced October 2016.
-
Functional methods for disordered neural networks
Authors:
Jannis Schuecker,
Sven Goedeke,
David Dahmen,
Moritz Helias
Abstract:
Neural networks of the brain form one of the most complex systems we know. Many qualitative features of the emerging collective phenomena, such as correlated activity, stability, response to inputs, chaotic and regular behavior, can, however, be understood in simple models that are accessible to a treatment in statistical mechanics, or, more precisely, classical statistical field theory.
This tu…
▽ More
Neural networks of the brain form one of the most complex systems we know. Many qualitative features of the emerging collective phenomena, such as correlated activity, stability, response to inputs, chaotic and regular behavior, can, however, be understood in simple models that are accessible to a treatment in statistical mechanics, or, more precisely, classical statistical field theory.
This tutorial presents the fundamentals behind contemporary developments in the theory of neural networks of rate units that are based on methods from statistical mechanics of classical systems with a large number of interacting degrees of freedom. In particular we will focus on a relevant class of systems that have quenched (time independent) disorder. In neural networks, the main source of disorder arises from random synaptic couplings between neurons. These systems are in many respects similar to spin glasses. The tutorial therefore also explains the methods for these disordered systems as far as they are applied in neuroscience.
The presentation consists of two parts. In the first part we introduce stochastic differential equations in the Martin - Siggia - Rose - De Dominicis - Janssen path integral formalism. In the second part we employ this language to derive the dynamic mean-field theory for deterministic random networks, the basis of the seminal work by Sompolinsky, Crisanti, Sommers 1988, as well as a recent extension to stochastic dynamics.
△ Less
Submitted 15 June, 2016; v1 submitted 22 May, 2016;
originally announced May 2016.
-
Optimal sequence memory in driven random networks
Authors:
Jannis Schuecker,
Sven Goedeke,
Moritz Helias
Abstract:
Autonomous randomly coupled neural networks display a transition to chaos at a critical coupling strength. We here investigate the effect of a time-varying input on the onset of chaos and the resulting consequences for information processing. Dynamic mean-field theory yields the statistics of the activity, the maximum Lyapunov exponent, and the memory capacity of the network. We find an exact cond…
▽ More
Autonomous randomly coupled neural networks display a transition to chaos at a critical coupling strength. We here investigate the effect of a time-varying input on the onset of chaos and the resulting consequences for information processing. Dynamic mean-field theory yields the statistics of the activity, the maximum Lyapunov exponent, and the memory capacity of the network. We find an exact condition that determines the transition from stable to chaotic dynamics and the sequential memory capacity in closed form. The input suppresses chaos by a dynamic mechanism, shifting the transition to significantly larger coupling strengths than predicted by local stability analysis. Beyond linear stability, a regime of coexistent locally expansive, but non-chaotic dynamics emerges that optimizes the capacity of the network to store sequential input.
△ Less
Submitted 22 September, 2017; v1 submitted 6 March, 2016;
originally announced March 2016.
-
Fundamental activity constraints lead to specific interpretations of the connectome
Authors:
Jannis Schuecker,
Maximilian Schmidt,
Sacha J. van Albada,
Markus Diesmann,
Moritz Helias
Abstract:
The continuous integration of experimental data into coherent models of the brain is an increasing challenge of modern neuroscience. Such models provide a bridge between structure and activity, and identify the mechanisms giving rise to experimental observations. Nevertheless, structurally realistic network models of spiking neurons are necessarily underconstrained even if experimental data on bra…
▽ More
The continuous integration of experimental data into coherent models of the brain is an increasing challenge of modern neuroscience. Such models provide a bridge between structure and activity, and identify the mechanisms giving rise to experimental observations. Nevertheless, structurally realistic network models of spiking neurons are necessarily underconstrained even if experimental data on brain connectivity are incorporated to the best of our knowledge. Guided by physiological observations, any model must therefore explore the parameter ranges within the uncertainty of the data. Based on simulation results alone, however, the mechanisms underlying stable and physiologically realistic activity often remain obscure. We here employ a mean-field reduction of the dynamics, which allows us to include activity constraints into the process of model construction. We shape the phase space of a multi-scale network model of the vision-related areas of macaque cortex by systematically refining its connectivity. Fundamental constraints on the activity, i.e., prohibiting quiescence and requiring global stability, prove sufficient to obtain realistic layer- and area-specific activity. Only small adaptations of the structure are required, showing that the network operates close to an instability. The procedure identifies components of the network critical to its collective dynamics and creates hypotheses for structural data and future experiments. The method can be applied to networks involving any neuron model with a known gain function.
△ Less
Submitted 2 March, 2017; v1 submitted 10 September, 2015;
originally announced September 2015.
-
Modulated escape from a metastable state driven by colored noise
Authors:
Jannis Schuecker,
Markus Diesmann,
Moritz Helias
Abstract:
Many phenomena in nature are described by excitable systems driven by colored noise. The temporal correlations in the fluctuations hinder an analytical treatment. We here present a general method of reduction to a white-noise system, capturing the color of the noise by effective and time-dependent boundary conditions. We apply the formalism to a model of the excitability of neuronal membranes, the…
▽ More
Many phenomena in nature are described by excitable systems driven by colored noise. The temporal correlations in the fluctuations hinder an analytical treatment. We here present a general method of reduction to a white-noise system, capturing the color of the noise by effective and time-dependent boundary conditions. We apply the formalism to a model of the excitability of neuronal membranes, the leaky integrate-and-fire neuron model, revealing an analytical expression for the linear response of the system valid up to moderate frequencies. The closed form analytical expression enables the characterization of the response properties of such excitable units and the assessment of oscillations emerging in networks thereof.
△ Less
Submitted 20 November, 2015; v1 submitted 3 November, 2014;
originally announced November 2014.
-
Reduction of colored noise in excitable systems to white noise and dynamic boundary conditions
Authors:
Jannis Schuecker,
Markus Diesmann,
Moritz Helias
Abstract:
A recent study on the effect of colored driving noise on the escape from a metastable state derives an analytic expression of the transfer function of the leaky integrate-and-fire neuron model subject to colored noise. Here we present an alternative derivation of the results, taking into account time-dependent boundary conditions explicitly. This systematic approach may facilitate future extension…
▽ More
A recent study on the effect of colored driving noise on the escape from a metastable state derives an analytic expression of the transfer function of the leaky integrate-and-fire neuron model subject to colored noise. Here we present an alternative derivation of the results, taking into account time-dependent boundary conditions explicitly. This systematic approach may facilitate future extensions beyond first order perturbation theory. The analogy of the quantum harmonic oscillator to the LIF neuron model subject to white noise enables a derivation of the well known transfer function simpler than the original approach. We offer a pedagogical presentation including all intermediate steps of the calculations.
△ Less
Submitted 13 October, 2015; v1 submitted 23 October, 2014;
originally announced October 2014.