-
Firing rate distributions in plastic networks of spiking neurons
Authors:
Marina Vegué,
Antoine Allard,
Patrick Desrosiers
Abstract:
In recurrent networks of leaky integrate-and-fire (LIF) neurons, mean-field theory has proven successful in describing various statistical properties of neuronal activity at equilibrium, such as firing rate distributions. Mean-field theory has been applied to networks in which either the synaptic weights are homogeneous across synapses and the number of incoming connections of individual neurons i…
▽ More
In recurrent networks of leaky integrate-and-fire (LIF) neurons, mean-field theory has proven successful in describing various statistical properties of neuronal activity at equilibrium, such as firing rate distributions. Mean-field theory has been applied to networks in which either the synaptic weights are homogeneous across synapses and the number of incoming connections of individual neurons is heterogeneous, or vice versa. Here we extend the previous mean-field formalisms to treat networks in which these two sources of structural heterogeneity occur simultaneously, including networks whose synapses are subject to plastic, activity-dependent modulation. The plasticity in our model is mediated by the introduction of one spike trace per neuron: a chemical signal that is released every time the neuron emits a spike and which is degraded over time. The temporal evolution of the trace is controlled by its degradation rate $r_p$ and by the neuron's underlying firing rate $ν$. When the ratio $α=ν/ r_p$ tends to infinity, the trace can be rescaled to be a reliable estimation of the neuron's firing rate. In this regime, the value of any synaptic weight at equilibrium is a function of the pre- and post-synaptic firing rates, and this relation can be used in the mean-field formalism. The solution to the mean-field equations specifies the firing rate and synaptic weight distributions at equilibrium. These equations are exact in the limit of reliable traces but they already provide accurate results when the degradation rate lies within a reasonable range, as we show by comparison with simulations of the full neuronal dynamics in networks composed of excitatory and inhibitory LIF neurons. Overall, this work offers a way to explore and better understand the way in which plasticity shapes both activity and structure in neuronal networks.
△ Less
Submitted 9 November, 2023;
originally announced November 2023.
-
The determining role of covariances in large networks of stochastic neurons
Authors:
Vincent Painchaud,
Patrick Desrosiers,
Nicolas Doyon
Abstract:
Biological neural networks are notoriously hard to model due to their stochastic behavior and high dimensionality. We tackle this problem by constructing a dynamical model of both the expectations and covariances of the fractions of active and refractory neurons in the network's populations. We do so by describing the evolution of the states of individual neurons with a continuous-time Markov chai…
▽ More
Biological neural networks are notoriously hard to model due to their stochastic behavior and high dimensionality. We tackle this problem by constructing a dynamical model of both the expectations and covariances of the fractions of active and refractory neurons in the network's populations. We do so by describing the evolution of the states of individual neurons with a continuous-time Markov chain, from which we formally derive a low-dimensional dynamical system. This is done by solving a moment closure problem in a way that is compatible with the nonlinearity and boundedness of the activation function. Our dynamical system captures the behavior of the high-dimensional stochastic model even in cases where the mean-field approximation fails to do so. Taking into account the second-order moments modifies the solutions that would be obtained with the mean-field approximation, and can lead to the appearance or disappearance of fixed points and limit cycles. We moreover perform numerical experiments where the mean-field approximation leads to periodically oscillating solutions, while the solutions of the second-order model can be interpreted as an average taken over many realizations of the stochastic model. Altogether, our results highlight the importance of including higher moments when studying stochastic networks and deepen our understanding of correlated neuronal activity.
△ Less
Submitted 20 November, 2023; v1 submitted 19 December, 2022;
originally announced December 2022.
-
Beyond Wilson-Cowan dynamics: oscillations and chaos without inhibition
Authors:
Vincent Painchaud,
Nicolas Doyon,
Patrick Desrosiers
Abstract:
Fifty years ago, Wilson and Cowan developed a mathematical model to describe the activity of neural populations. In this seminal work, they divided the cells in three groups: active, sensitive and refractory, and obtained a dynamical system to describe the evolution of the average firing rates of the populations. In the present work, we investigate the impact of the often neglected refractory stat…
▽ More
Fifty years ago, Wilson and Cowan developed a mathematical model to describe the activity of neural populations. In this seminal work, they divided the cells in three groups: active, sensitive and refractory, and obtained a dynamical system to describe the evolution of the average firing rates of the populations. In the present work, we investigate the impact of the often neglected refractory state and show that taking it into account can introduce new dynamics. Starting from a continuous-time Markov chain, we perform a rigorous derivation of a mean-field model that includes the refractory fractions of populations as dynamical variables. Then, we perform bifurcation analysis to explain the occurance of periodic solutions in cases where the classical Wilson-Cowan does not predict oscillations. We also show that our mean-field model is able to predict chaotic behavior in the dynamics of networks with as little as two populations.
△ Less
Submitted 30 May, 2022; v1 submitted 1 April, 2022;
originally announced April 2022.
