Showing 1–16 of 16 results for author: Rotter, S

Spike Train Cumulants for Linear-Nonlinear Poisson Cascade Models

Authors: Michael Kordovan, Stefan Rotter

Abstract: Spiking activity in cortical networks is nonlinear in nature. The linear-nonlinear cascade model, some versions of which are also known as point-process generalized linear model, can efficiently capture the nonlinear dynamics exhibited by such networks. Of particular interest in such models are theoretical predictions of spike train statistics. However, due to the moment-closure problem, approxima… ▽ More Spiking activity in cortical networks is nonlinear in nature. The linear-nonlinear cascade model, some versions of which are also known as point-process generalized linear model, can efficiently capture the nonlinear dynamics exhibited by such networks. Of particular interest in such models are theoretical predictions of spike train statistics. However, due to the moment-closure problem, approximations are inevitable. We suggest here a series expansion that explains how higher-order moments couple to lower-order ones. Our approach makes predictions in terms of certain integrals, the so-called loop integrals. In previous studies these integrals have been evaluated numerically, but numerical instabilities are sometimes encountered rendering the results unreliable. Analytic solutions are presented here to overcome this problem, and to arrive at more robust evaluations. We were able to deduce these analytic solutions by switching to Fourier space and making use of complex analysis, specifically Cauchy's residue theorem. We formalized the loop integrals and explicitly solved them for specific response functions. To quantify the importance of these corrections for spike train cumulants, we numerically simulated spiking networks and compared their sample statistics to our theoretical predictions. Our results demonstrate that the magnitude of the nonlinear corrections depends on the working point of the nonlinear network dynamics, and that it is related to the eigenvalues of the mean-field stability matrix. For our example, the corrections for the firing rates are in the range between 4 % and 21 % on average. Precise and robust predictions of spike train statistics accounting for nonlinear effects are, for example, highly relevant for theories involving spike-timing dependent plasticity (STDP). △ Less

Submitted 14 January, 2020; originally announced January 2020.

Comments: 45 pages, 8 figures

Bifurcation analysis of the dynamics of interacting populations of spiking networks

Authors: Fereshteh Lagzi, Fatihcan M. Atay, Stefan Rotter

Abstract: We analyze the collective dynamics of hierarchically structured networks of densely connected spiking neurons. These networks of sub-networks may represent interactions between cell assemblies or different nuclei in the brain. The dynamical activity pattern that results from these interactions depends on the strength of synaptic coupling between them. Importantly, the overall dynamics of a brain r… ▽ More We analyze the collective dynamics of hierarchically structured networks of densely connected spiking neurons. These networks of sub-networks may represent interactions between cell assemblies or different nuclei in the brain. The dynamical activity pattern that results from these interactions depends on the strength of synaptic coupling between them. Importantly, the overall dynamics of a brain region in the absence of external input, so called ongoing brain activity, has been attributed to the dynamics of such interactions. In our study, two different network scenarios are considered: a system with one inhibitory and two excitatory sub-networks, and a network representation with three inhibitory sub-networks. To study the effect of synaptic strength on the global dynamics of the network, two parameters for relative couplings between these sub-networks are considered. For each case, a co-dimension two bifurcation analysis is performed and the results have been compared to large-scale network simulations. Our analysis shows that Generalized Lotka-Volterra (GLV) equations, well-known in predator-prey studies, yield a meaningful population-level description for the collective behavior of spiking neuronal interaction, which have a hierarchical structure. In particular, we observed a striking equivalence between the bifurcation diagrams of spiking neuronal networks and their corresponding GLV equations. This study gives new insight on the behavior of neuronal assemblies, and can potentially suggest new mechanisms for altering the dynamical patterns of spiking networks based on changing the synaptic strength between some groups of neurons. △ Less

Submitted 13 September, 2018; originally announced September 2018.

From Correlation to Causation: Estimation of Effective Connectivity from Continuous Brain Signals based on Zero-Lag Covariance

Authors: Jonathan Schiefer, Alexander Niederbühl, Volker Pernice, Carolin Lennartz, Pierre LeVan, Jürgen Henning, Stefan Rotter

Abstract: Knowing brain connectivity is of great importance both in basic research and for clinical applications. We are proposing a method to infer directed connectivity from zero-lag covariances of neuronal activity recorded at multiple sites. This allows us to identify causal relations that are reflected in neuronal population activity. To derive our strategy, we assume a generic linear model of interact… ▽ More Knowing brain connectivity is of great importance both in basic research and for clinical applications. We are proposing a method to infer directed connectivity from zero-lag covariances of neuronal activity recorded at multiple sites. This allows us to identify causal relations that are reflected in neuronal population activity. To derive our strategy, we assume a generic linear model of interacting continuous variables, the components of which represent the activity of local neuronal populations. The suggested method for inferring connectivity from recorded signals exploits the fact that the covariance matrix derived from the observed activity contains information about the existence, the direction and the sign of connections. Assuming a sparsely coupled network, we disambiguate the underlying causal structure via $L^1$-minimization. In general, this method is suited to infer effective connectivity from resting state data of various types. We show that our method is applicable over a broad range of structural parameters regarding network size and connection probability of the network. We also explored parameters affecting its activity dynamics, like the eigenvalue spectrum. Also, based on the simulation of suitable Ornstein-Uhlenbeck processes to model BOLD dynamics, we show that with our method it is possible to estimate directed connectivity from zero-lag covariances derived from such signals. In this study, we consider measurement noise and unobserved nodes as additional confounding factors. Furthermore, we investigate the amount of data required for a reliable estimate. Additionally, we apply the proposed method on a fMRI dataset. The resulting network exhibits a tendency for close-by areas being connected as well as inter-hemispheric connections between corresponding areas. Also, we found that a large fraction of identified connections were inhibitory. △ Less

Submitted 9 April, 2018; v1 submitted 8 August, 2017; originally announced August 2017.

Comments: 18 pages, 10 figures

Journal ref: PLoS Comput Biol 14(3): e1006056 (2018)

Associative properties of structural plasticity based on firing rate homeostasis in recurrent neuronal networks

Authors: Júlia V Gallinaro, Stefan Rotter

Abstract: Correlation-based Hebbian plasticity is thought to shape neuronal connectivity during development and learning, whereas homeostatic plasticity would stabilize network activity. Here we investigate another, new aspect of this dichotomy: Can Hebbian associative properties also emerge as a network effect from a plasticity rule based on homeostatic principles on the neuronal level? To address this que… ▽ More Correlation-based Hebbian plasticity is thought to shape neuronal connectivity during development and learning, whereas homeostatic plasticity would stabilize network activity. Here we investigate another, new aspect of this dichotomy: Can Hebbian associative properties also emerge as a network effect from a plasticity rule based on homeostatic principles on the neuronal level? To address this question, we simulated a recurrent network of leaky integrate-and-fire neurons, in which excitatory connections are subject to a structural plasticity rule based on firing rate homeostasis. We show that a subgroup of neurons develop stronger within-group connectivity as a consequence of receiving stronger external stimulation. In an experimentally well-documented scenario we show that feature specific connectivity, similar to what has been observed in rodent visual cortex, can emerge from such a plasticity rule. The experience-dependent structural changes triggered by stimulation are long-lasting and decay only slowly when the neurons are exposed again to unspecific external inputs. △ Less

Submitted 24 February, 2018; v1 submitted 9 June, 2017; originally announced June 2017.

Comments: 19 pages, 4 figures

Joint Statistics of Strongly Correlated Neurons via Dimensional Reduction

Authors: Taskin Deniz, Stefan Rotter

Abstract: The relative timing of action potentials in neurons recorded from local cortical networks often shows a non-trivial dependence, which is then quantified by cross-correlation functions. Theoretical models emphasize that such spike train correlations are an inevitable consequence of two neurons being part of the same network and sharing some synaptic input. For non-linear neuron models, however, exp… ▽ More The relative timing of action potentials in neurons recorded from local cortical networks often shows a non-trivial dependence, which is then quantified by cross-correlation functions. Theoretical models emphasize that such spike train correlations are an inevitable consequence of two neurons being part of the same network and sharing some synaptic input. For non-linear neuron models, however, explicit correlation functions are difficult to compute analytically, and perturbative methods work only for weak shared input. In order to treat strong correlations, we suggest here an alternative non-perturbative method. Specifically, we study the case of two leaky integrate-and-fire neurons with strong shared input. Correlation functions derived from simulated spike trains fit our theoretical predictions very accurately. Using our method, we computed the non-linear correlation transfer as well as correlation functions that are asymmetric due to inhomogeneous intrinsic parameters or unequal input. △ Less

Submitted 4 September, 2016; originally announced September 2016.

Comments: 40 pages, 11 figures. Submitted to IOP-Journal of Physics A

Solving the 2-Dimensional Fokker-Planck Equation for Strongly Correlated Neurons

Authors: Taskin Deniz, Stefan Rotter

Abstract: Pairs of neurons in brain networks often share much of the input they receive from other neurons. Due to essential non-linearities of neuronal dynamics, the consequences for the correlation of the output spike trains are not well understood in the strongly correlated regime. Here we consider two leaky integrate-and-fire neurons with correlated white noise input. We analyze this scenario using a no… ▽ More Pairs of neurons in brain networks often share much of the input they receive from other neurons. Due to essential non-linearities of neuronal dynamics, the consequences for the correlation of the output spike trains are not well understood in the strongly correlated regime. Here we consider two leaky integrate-and-fire neurons with correlated white noise input. We analyze this scenario using a novel non-perturbative approach. Hence our treatment covers both weakly and strongly correlated dynamics, generalizing previous results based on linear response theory. △ Less

Submitted 28 May, 2016; v1 submitted 12 April, 2016; originally announced April 2016.

Comments: 11 pages, 5 figures

Journal ref: Phys. Rev. E 95, 012412 (2017)

Cumulants of Hawkes point processes

Authors: Stojan Jovanović, John Hertz, Stefan Rotter

Abstract: We derive explicit, closed-form expressions for the cumulant densities of a multivariate, self-exciting Hawkes point process, generalizing a result of Hawkes in his earlier work on the covariance density and Bartlett spectrum of such processes. To do this, we represent the Hawkes process in terms of a Poisson cluster process and show how the cumulant density formulas can be derived by enumeratin… ▽ More We derive explicit, closed-form expressions for the cumulant densities of a multivariate, self-exciting Hawkes point process, generalizing a result of Hawkes in his earlier work on the covariance density and Bartlett spectrum of such processes. To do this, we represent the Hawkes process in terms of a Poisson cluster process and show how the cumulant density formulas can be derived by enumerating all possible "family trees", representing complex interactions between point events. We also consider the problem of computing the integrated cumulants, characterizing the average measure of correlated activity between events of different types, and derive the relevant equations. △ Less

Submitted 3 March, 2015; v1 submitted 18 September, 2014; originally announced September 2014.

Comments: 11 pages, 4 figures

Journal ref: Phys. Rev. E 91, 042802 (2015)

Distribution of Orientation Selectivity in Recurrent Networks of Spiking Neurons with Different Random Topologies

Authors: Sadra Sadeh, Stefan Rotter

Abstract: Neurons in the primary visual cortex are more or less selective for the orientation of a light bar used for stimulation. A broad distribution of individual grades of orientation selectivity has in fact been reported in all species. A possible reason for emergence of broad distributions is the recurrent network within which the stimulus is being processed. Here we compute the distribution of orient… ▽ More Neurons in the primary visual cortex are more or less selective for the orientation of a light bar used for stimulation. A broad distribution of individual grades of orientation selectivity has in fact been reported in all species. A possible reason for emergence of broad distributions is the recurrent network within which the stimulus is being processed. Here we compute the distribution of orientation selectivity in randomly connected model networks that are equipped with different spatial patterns of connectivity. We show that, for a wide variety of connectivity patterns, a linear theory based on firing rates accurately approximates the outcome of direct numerical simulations of networks of spiking neurons. Distance dependent connectivity in networks with a more biologically realistic structure does not compromise our linear analysis, as long as the linearized dynamics, and hence the uniform asynchronous irregular activity state, remain stable. We conclude that linear mechanisms of stimulus processing are indeed responsible for the emergence of orientation selectivity and its distribution in recurrent networks with functionally heterogeneous synaptic connectivity. △ Less

Submitted 7 November, 2014; v1 submitted 1 June, 2014; originally announced June 2014.

Comments: 12 figures

Mean-Field Analysis of Orientation Selectivity in Inhibition-Dominated Networks of Spiking Neurons

Authors: Sadra Sadeh, Stefano Cardanobile, Stefan Rotter

Abstract: Mechanisms underlying the emergence of orientation selectivity in the primary visual cortex are highly debated. Here we study the contribution of inhibition-dominated random recurrent networks to orientation selectivity, and more generally to sensory processing. By simulating and analyzing large-scale networks of spiking neurons, we investigate tuning amplification and contrast invariance of orien… ▽ More Mechanisms underlying the emergence of orientation selectivity in the primary visual cortex are highly debated. Here we study the contribution of inhibition-dominated random recurrent networks to orientation selectivity, and more generally to sensory processing. By simulating and analyzing large-scale networks of spiking neurons, we investigate tuning amplification and contrast invariance of orientation selectivity in these networks. In particular, we show how selective attenuation of the common mode and amplification of the modulation component take place in these networks. Selective attenuation of the baseline, which is governed by the exceptional eigenvalue of the connectivity matrix, removes the unspecific, redundant signal component and ensures the invariance of selectivity across different contrasts. Selective amplification of modulation, which is governed by the operating regime of the network and depends on the strength of coupling, amplifies the informative signal component and thus increases the signal-to-noise ratio. Here, we perform a mean-field analysis which accounts for this process. △ Less

Submitted 1 June, 2014; v1 submitted 19 January, 2014; originally announced January 2014.

Comments: 19 figures

Journal ref: SpringerPlus 3: 148, 2014

Impact of intrinsic biophysical diversity on the activity of spiking neurons

Authors: Man Yi Yim, Ad Aertsen, Stefan Rotter

Abstract: We study the effect of intrinsic heterogeneity on the activity of a population of leaky integrate-and-fire neurons. By rescaling the dynamical equation, we derive mathematical relations between multiple neuronal parameters and a fluctuating input noise. To this end, common input to heterogeneous neurons is conceived as an identical noise with neuron-specific mean and variance. As a consequence, th… ▽ More We study the effect of intrinsic heterogeneity on the activity of a population of leaky integrate-and-fire neurons. By rescaling the dynamical equation, we derive mathematical relations between multiple neuronal parameters and a fluctuating input noise. To this end, common input to heterogeneous neurons is conceived as an identical noise with neuron-specific mean and variance. As a consequence, the neuronal output rates can differ considerably, and their relative spike timing becomes desynchronized. This theory can quantitatively explain some recent experimental findings. △ Less

Submitted 19 February, 2013; v1 submitted 27 August, 2012; originally announced August 2012.

Comments: 4 pages, 5 figures

Journal ref: Phys. Rev. E 87, 032710 (2013)

Recurrent Interactions in Spiking Networks with Arbitrary Topology

Authors: Volker Pernice, Benjamin Staude, Stefano Cardanobile, Stefan Rotter

Abstract: The population activity of random networks of excitatory and inhibitory leaky integrate-and-fire (LIF) neurons has been studied extensively. In particular, a state of asynchronous activity with low firing rates and low pairwise correlations emerges in sparsely connected networks. We apply linear response theory to evaluate the influence of detailed network structure on neuron dynamics. It turns ou… ▽ More The population activity of random networks of excitatory and inhibitory leaky integrate-and-fire (LIF) neurons has been studied extensively. In particular, a state of asynchronous activity with low firing rates and low pairwise correlations emerges in sparsely connected networks. We apply linear response theory to evaluate the influence of detailed network structure on neuron dynamics. It turns out that pairwise correlations induced by direct and indirect network connections can be related to the matrix of direct linear interactions. Furthermore, we study the influence of characteristics of the neuron model. Interpreting the reset as self-inhibition we examine its influence, via the spectrum of single neuron activity, on network autocorrelation functions and the overall correlation level. The neuron model also affects the form of interaction kernels and consequently the time-dependent correlation functions. We finally find that a linear instability of networks with Erdős-Rényi topology coincides with a global transition to a highly correlated network state. Our work shows that recurrent interactions have a profound impact on spike train statistics and provides tools to study effects of specific network topologies. △ Less

Submitted 22 March, 2012; v1 submitted 31 December, 2011; originally announced January 2012.

Comments: 7 pages, 6 figures, to be published in Physical Review E

Discovering universal statistical laws of complex networks

Authors: Stefano Cardanobile, Volker Pernice, Moritz Deger, Stefan Rotter

Abstract: Different network models have been suggested for the topology underlying complex interactions in natural systems. These models are aimed at replicating specific statistical features encountered in real-world networks. However, it is rarely considered to which degree the results obtained for one particular network class can be extrapolated to real-world networks. We address this issue by comparing… ▽ More Different network models have been suggested for the topology underlying complex interactions in natural systems. These models are aimed at replicating specific statistical features encountered in real-world networks. However, it is rarely considered to which degree the results obtained for one particular network class can be extrapolated to real-world networks. We address this issue by comparing different classical and more recently developed network models with respect to their generalisation power, which we identify with large structural variability and absence of constraints imposed by the construction scheme. After having identified the most variable networks, we address the issue of which constraints are common to all network classes and are thus suitable candidates for being generic statistical laws of complex networks. In fact, we find that generic, not model-related dependencies between different network characteristics do exist. This allows, for instance, to infer global features from local ones using regression models trained on networks with high generalisation power. Our results confirm and extend previous findings regarding the synchronisation properties of neural networks. Our method seems especially relevant for large networks, which are difficult to map completely, like the neural networks in the brain. The structure of such large networks cannot be fully sampled with the present technology. Our approach provides a method to estimate global properties of under-sampled networks with good approximation. Finally, we demonstrate on three different data sets (C. elegans' neuronal network, R. prowazekii's metabolic network, and a network of synonyms extracted from Roget's Thesaurus) that real-world networks have statistical relations compatible with those obtained using regression models. △ Less

Submitted 15 December, 2011; originally announced December 2011.

Journal ref: PLoS ONE 7(6): e37911 (2012)

The perfect integrator driven by Poisson input and its approximation in the diffusion limit

Authors: Moritz Helias, Moritz Deger, Stefan Rotter, Markus Diesmann

Abstract: In this note we consider the perfect integrator driven by Poisson process input. We derive its equilibrium and response properties and contrast them to the approximations obtained by applying the diffusion approximation. In particular, the probability density in the vicinity of the threshold differs, which leads to altered response properties of the system in equilibrium. In this note we consider the perfect integrator driven by Poisson process input. We derive its equilibrium and response properties and contrast them to the approximations obtained by applying the diffusion approximation. In particular, the probability density in the vicinity of the threshold differs, which leads to altered response properties of the system in equilibrium. △ Less

Submitted 22 November, 2010; v1 submitted 18 October, 2010; originally announced October 2010.

Comments: 7 pages, 3 figures, v2: corrected authors in reference

Non-equilibrium dynamics of stochastic point processes with refractoriness

Authors: Moritz Deger, Moritz Helias, Stefano Cardanobile, Fatihcan M. Atay, Stefan Rotter

Abstract: Stochastic point processes with refractoriness appear frequently in the quantitative analysis of physical and biological systems, such as the generation of action potentials by nerve cells, the release and reuptake of vesicles at a synapse, and the counting of particles by detector devices. Here we present an extension of renewal theory to describe ensembles of point processes with time varying in… ▽ More Stochastic point processes with refractoriness appear frequently in the quantitative analysis of physical and biological systems, such as the generation of action potentials by nerve cells, the release and reuptake of vesicles at a synapse, and the counting of particles by detector devices. Here we present an extension of renewal theory to describe ensembles of point processes with time varying input. This is made possible by a representation in terms of occupation numbers of two states: Active and refractory. The dynamics of these occupation numbers follows a distributed delay differential equation. In particular, our theory enables us to uncover the effect of refractoriness on the time-dependent rate of an ensemble of encoding point processes in response to modulation of the input. We present exact solutions that demonstrate generic features, such as stochastic transients and oscillations in the step response as well as resonances, phase jumps and frequency doubling in the transfer of periodic signals. We show that a large class of renewal processes can indeed be regarded as special cases of the model we analyze. Hence our approach represents a widely applicable framework to define and analyze non-stationary renewal processes. △ Less

Submitted 24 June, 2010; v1 submitted 19 February, 2010; originally announced February 2010.

Comments: 8 pages, 4 figures

MSC Class: 60G55

Journal ref: Phys Rev E 82, 021129 (2010)

A Fokker-Planck formalism for diffusion with finite increments and absorbing boundaries

Authors: M. Helias, M. Deger, S. Rotter, M. Diesmann

Abstract: Gaussian white noise is frequently used to model fluctuations in physical systems. In Fokker-Planck theory, this leads to a vanishing probability density near the absorbing boundary of threshold models. Here we derive the boundary condition for the stationary density of a first-order stochastic differential equation for additive finite-grained Poisson noise and show that the response properties… ▽ More Gaussian white noise is frequently used to model fluctuations in physical systems. In Fokker-Planck theory, this leads to a vanishing probability density near the absorbing boundary of threshold models. Here we derive the boundary condition for the stationary density of a first-order stochastic differential equation for additive finite-grained Poisson noise and show that the response properties of threshold units are qualitatively altered. Applied to the integrate-and-fire neuron model, the response turns out to be instantaneous rather than exhibiting low-pass characteristics, highly non-linear, and asymmetric for excitation and inhibition. The novel mechanism is exhibited on the network level and is a generic property of pulse-coupled systems of threshold units. △ Less

Submitted 13 November, 2009; v1 submitted 13 August, 2009; originally announced August 2009.

Comments: Consists of two parts: main article (3 figures) plus supplementary text (3 extra figures)

Multiplicatively interacting point processes and applications to neural modeling

Authors: Stefano Cardanobile, Stefan Rotter

Abstract: We introduce a nonlinear modification of the classical Hawkes process, which allows inhibitory couplings between units without restrictions. The resulting system of interacting point processes provides a useful mathematical model for recurrent networks of spiking neurons with exponential transfer functions. The expected rates of all neurons in the network are approximated by a first-order differ… ▽ More We introduce a nonlinear modification of the classical Hawkes process, which allows inhibitory couplings between units without restrictions. The resulting system of interacting point processes provides a useful mathematical model for recurrent networks of spiking neurons with exponential transfer functions. The expected rates of all neurons in the network are approximated by a first-order differential system. We study the stability of the solutions of this equation, and use the new formalism to implement a winner-takes-all network that operates robustly for a wide range of parameters. Finally, we discuss relations with the generalised linear model that is widely used for the analysis of spike trains. △ Less

Submitted 3 November, 2009; v1 submitted 9 April, 2009; originally announced April 2009.

Comments: 22 pages, 7 figures. Submitted to J. Comp. Neurosci. Overall changes according to suggestions of different reviewers. A conceptual error in a derivation has been corrected

MSC Class: 60K35; 92B20; 60G55