-
Mathematical studies of the dynamics of finite-size binary neural networks: A review of recent progress
Authors:
Diego Fasoli,
Stefano Panzeri
Abstract:
Traditional mathematical approaches to studying analytically the dynamics of neural networks rely on the mean-field approximation, which is rigorously applicable only to networks of infinite size. However, all existing real biological networks have finite size, and many of them, such as microscopic circuits in invertebrates, are composed only of a few tens of neurons. Thus, it is important to be a…
▽ More
Traditional mathematical approaches to studying analytically the dynamics of neural networks rely on the mean-field approximation, which is rigorously applicable only to networks of infinite size. However, all existing real biological networks have finite size, and many of them, such as microscopic circuits in invertebrates, are composed only of a few tens of neurons. Thus, it is important to be able to extend to small-size networks our ability to study analytically neural dynamics. Analytical solutions of the dynamics of finite-size neural networks have remained elusive for many decades, because the powerful methods of statistical analysis, such as the central limit theorem and the law of large numbers, do not apply to small networks. In this article, we critically review recent progress on the study of the dynamics of small networks composed of binary neurons. In particular, we review the mathematical techniques we developed for studying the bifurcations of the network dynamics, the dualism between neural activity and membrane potentials, cross-neuron correlations, and pattern storage in stochastic networks. Finally, we highlight key challenges that remain open, future directions for further progress, and possible implications of our results for neuroscience.
△ Less
Submitted 29 April, 2019;
originally announced April 2019.
-
From Local Chaos to Critical Slowing Down: A Theory of the Functional Connectivity of Small Neural Circuits
Authors:
Diego Fasoli,
Anna Cattani,
Stefano Panzeri
Abstract:
Functional connectivity is a fundamental property of neural networks that quantifies the segregation and integration of information between cortical areas. Due to mathematical complexity, a theory that could explain how the parameters of mesoscopic networks composed of a few tens of neurons affect the functional connectivity is still to be formulated. Yet, many interesting problems in neuroscience…
▽ More
Functional connectivity is a fundamental property of neural networks that quantifies the segregation and integration of information between cortical areas. Due to mathematical complexity, a theory that could explain how the parameters of mesoscopic networks composed of a few tens of neurons affect the functional connectivity is still to be formulated. Yet, many interesting problems in neuroscience involve the study of networks composed of a small number of neurons. Based on a recent study of the dynamics of small neural circuits, we combine the analysis of local bifurcations of multi-population neural networks of arbitrary size with the analytical calculation of the functional connectivity. We study the functional connectivity in different regimes, showing that external stimuli cause the network to switch from asynchronous states characterized by weak correlation and low variability (local chaos), to synchronous states characterized by strong correlations and wide temporal fluctuations (critical slowing down). Local chaos typically occurs in large networks, but here we show that it can also be generated by strong stimuli in small neural circuits. On the other side, critical slowing down is expected to occur when the stimulus moves the network close to a local bifurcation. In particular, strongly positive correlations occur at the saddle-node and Andronov-Hopf bifurcations of the network, while strongly negative correlations occur when the network undergoes a spontaneous symmetry-breaking at the branching-point bifurcations. These results prove that the functional connectivity of firing-rate network models is strongly affected by the external stimuli even if the anatomical connections are fixed, and suggest an effective mechanism through which biological networks can dynamically modulate the encoding and integration of sensory information.
△ Less
Submitted 26 May, 2016; v1 submitted 24 May, 2016;
originally announced May 2016.
-
The complexity of dynamics in small neural circuits
Authors:
Diego Fasoli,
Anna Cattani,
Stefano Panzeri
Abstract:
Mean-field theory is a powerful tool for studying large neural networks. However, when the system is composed of a few neurons, macroscopic differences between the mean-field approximation and the real behavior of the network can arise. Here we introduce a study of the dynamics of a small firing-rate network with excitatory and inhibitory populations, in terms of local and global bifurcations of t…
▽ More
Mean-field theory is a powerful tool for studying large neural networks. However, when the system is composed of a few neurons, macroscopic differences between the mean-field approximation and the real behavior of the network can arise. Here we introduce a study of the dynamics of a small firing-rate network with excitatory and inhibitory populations, in terms of local and global bifurcations of the neural activity. Our approach is analytically tractable in many respects, and sheds new light on the finite-size effects of the system. In particular, we focus on the formation of multiple branching solutions of the neural equations through spontaneous symmetry-breaking, since this phenomenon increases considerably the complexity of the dynamical behavior of the network. For these reasons, branching points may reveal important mechanisms through which neurons interact and process information, which are not accounted for by the mean-field approximation.
△ Less
Submitted 22 July, 2015; v1 submitted 30 June, 2015;
originally announced June 2015.
-
Correlation structure of stochastic neural networks with generic connectivity matrices
Authors:
D. Fasoli,
O. Faugeras
Abstract:
Using a perturbative expansion for weak synaptic weights and weak sources of randomness, we calculate the correlation structure of neural networks with generic connectivity matrices. In detail, the perturbative parameters are the mean and the standard deviation of the synaptic weights, together with the standard deviations of the background noise of the membrane potentials and of their initial con…
▽ More
Using a perturbative expansion for weak synaptic weights and weak sources of randomness, we calculate the correlation structure of neural networks with generic connectivity matrices. In detail, the perturbative parameters are the mean and the standard deviation of the synaptic weights, together with the standard deviations of the background noise of the membrane potentials and of their initial conditions. We also show how to determine the correlation structure of the system when the synaptic connections have a random topology. This analysis is performed on rate neurons described by Wilson and Cowan equations, since this allows us to find analytic results. Moreover, the perturbative expansion can be developed at any order and for a generic connectivity matrix. We finally show an example of application of this technique for a particular case of biologically relevant topology of the synaptic connections.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
-
Finite size effects in the correlation structure of stochastic neural networks: analysis of different connectivity matrices and failure of the mean-field theory
Authors:
D. Fasoli,
O. Faugeras
Abstract:
We quantify the finite size effects in a stochastic network made up of rate neurons, for several kinds of recurrent connectivity matrices. This analysis is performed by means of a perturbative expansion of the neural equations, where the perturbative parameters are the intensities of the sources of randomness in the system. In detail, these parameters are the variances of the background or input n…
▽ More
We quantify the finite size effects in a stochastic network made up of rate neurons, for several kinds of recurrent connectivity matrices. This analysis is performed by means of a perturbative expansion of the neural equations, where the perturbative parameters are the intensities of the sources of randomness in the system. In detail, these parameters are the variances of the background or input noise, of the initial conditions and of the distribution of the synaptic weights. The technique developed in this article can be used to study systems which are invariant under the exchange of the neural indices and it allows us to quantify the correlation structure of the network, in terms of pairwise and higher order correlations between the neurons. We also determine the relation between the correlation and the external input of the network, showing that strong signals coming from the environment reduce significantly the amount of correlation between the neurons. Moreover we prove that in general the phenomenon of propagation of chaos does not occur, even in the thermodynamic limit, due to the correlation structure of the 3 sources of randomness considered in the model. Furthermore, we show that the propagation of chaos does not depend only on the number of neurons in the network, but also and mainly on the number of incoming connections per neuron. To conclude, we prove that for special values of the parameters of the system the neurons become perfectly correlated, a phenomenon that we have called stochastic synchronization. These discoveries clearly prevent the use of the mean-field theory in the description of the neural network.
△ Less
Submitted 8 July, 2013;
originally announced July 2013.
-
Mean Field description of and propagation of chaos in recurrent multipopulation networks of Hodgkin-Huxley and Fitzhugh-Nagumo neurons
Authors:
Javier Baladron,
Diego Fasoli,
Olivier Faugeras,
Jonathan Touboul
Abstract:
We derive the mean-field equations arising as the limit of a network of interacting spiking neurons, as the number of neurons goes to infinity. The neurons belong to a fixed number of populations and are represented either by the Hodgkin-Huxley model or by one of its simplified version, the Fitzhugh-Nagumo model. The synapses between neurons are either electrical or chemical. The network is assume…
▽ More
We derive the mean-field equations arising as the limit of a network of interacting spiking neurons, as the number of neurons goes to infinity. The neurons belong to a fixed number of populations and are represented either by the Hodgkin-Huxley model or by one of its simplified version, the Fitzhugh-Nagumo model. The synapses between neurons are either electrical or chemical. The network is assumed to be fully connected. The maximum conductances vary randomly. Under the condition that all neurons initial conditions are drawn independently from the same law that depends only on the population they belong to, we prove that a propagation of chaos phenomenon takes places, namely that in the mean-field limit, any finite number of neurons become independent and, within each population, have the same probability distribution. This probability distribution is solution of a set of implicit equations, either nonlinear stochastic differential equations resembling the McKean-Vlasov equations, or non-local partial differential equations resembling the McKean-Vlasov-Fokker- Planck equations. We prove the well-posedness of these equations, i.e. the existence and uniqueness of a solution. We also show the results of some preliminary numerical experiments that indicate that the mean-field equations are a good representation of the mean activity of a finite size network, even for modest sizes. These experiment also indicate that the McKean-Vlasov-Fokker- Planck equations may be a good way to understand the mean-field dynamics through, e.g., a bifurcation analysis.
△ Less
Submitted 19 October, 2011;
originally announced October 2011.
