Showing 1–16 of 16 results for author: Slotine, J

Neuron-Astrocyte Associative Memory

Authors: Leo Kozachkov, Jean-Jacques Slotine, Dmitry Krotov

Abstract: Astrocytes, the most abundant type of glial cell, play a fundamental role in memory. Despite most hippocampal synapses being contacted by an astrocyte, there are no current theories that explain how neurons, synapses, and astrocytes might collectively contribute to memory function. We demonstrate that fundamental aspects of astrocyte morphology and physiology naturally lead to a dynamic, high-capa… ▽ More Astrocytes, the most abundant type of glial cell, play a fundamental role in memory. Despite most hippocampal synapses being contacted by an astrocyte, there are no current theories that explain how neurons, synapses, and astrocytes might collectively contribute to memory function. We demonstrate that fundamental aspects of astrocyte morphology and physiology naturally lead to a dynamic, high-capacity associative memory system. The neuron-astrocyte networks generated by our framework are closely related to popular machine learning architectures known as Dense Associative Memories or Modern Hopfield Networks. In their known biological implementations the ratio of stored memories to the number of neurons remains constant, despite the growth of the network size. Our work demonstrates that neuron-astrocyte networks follow superior, supralinear memory scaling laws, outperforming all known biological implementations of Dense Associative Memory. This theoretical link suggests the exciting and previously unnoticed possibility that memories could be stored, at least in part, within astrocytes rather than solely in the synaptic weights between neurons. △ Less

Submitted 22 July, 2024; v1 submitted 14 November, 2023; originally announced November 2023.

Comments: Main text: 14 pages, 3 figures. Appendix: 8 pages, 2 figures

Contraction Properties of the Global Workspace Primitive

Authors: Michaela Ennis, Leo Kozachkov, Jean-Jacques Slotine

Abstract: To push forward the important emerging research field surrounding multi-area recurrent neural networks (RNNs), we expand theoretically and empirically on the provably stable RNNs of RNNs introduced by Kozachkov et al. in "RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks". We prove relaxed stability conditions for salient special cases of this architecture, mos… ▽ More To push forward the important emerging research field surrounding multi-area recurrent neural networks (RNNs), we expand theoretically and empirically on the provably stable RNNs of RNNs introduced by Kozachkov et al. in "RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks". We prove relaxed stability conditions for salient special cases of this architecture, most notably for a global workspace modular structure. We then demonstrate empirical success for Global Workspace Sparse Combo Nets with a small number of trainable parameters, not only through strong overall test performance but also greater resilience to removal of individual subnetworks. These empirical results for the global workspace inter-area topology are contingent on stability preservation, highlighting the relevance of our theoretical work for enabling modular RNN success. Further, by exploring sparsity in the connectivity structure between different subnetwork modules more broadly, we improve the state of the art performance for stable RNNs on benchmark sequence processing tasks, thus underscoring the general utility of specialized graph structures for multi-area RNNs. △ Less

Submitted 2 October, 2023; originally announced October 2023.

RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks

Authors: Leo Kozachkov, Michaela Ennis, Jean-Jacques Slotine

Abstract: Recurrent neural networks (RNNs) are widely used throughout neuroscience as models of local neural activity. Many properties of single RNNs are well characterized theoretically, but experimental neuroscience has moved in the direction of studying multiple interacting areas, and RNN theory needs to be likewise extended. We take a constructive approach towards this problem, leveraging tools from non… ▽ More Recurrent neural networks (RNNs) are widely used throughout neuroscience as models of local neural activity. Many properties of single RNNs are well characterized theoretically, but experimental neuroscience has moved in the direction of studying multiple interacting areas, and RNN theory needs to be likewise extended. We take a constructive approach towards this problem, leveraging tools from nonlinear control theory and machine learning to characterize when combinations of stable RNNs will themselves be stable. Importantly, we derive conditions which allow for massive feedback connections between interacting RNNs. We parameterize these conditions for easy optimization using gradient-based techniques, and show that stability-constrained "networks of networks" can perform well on challenging sequential-processing benchmark tasks. Altogether, our results provide a principled approach towards understanding distributed, modular function in the brain. △ Less

Submitted 29 January, 2023; v1 submitted 16 June, 2021; originally announced June 2021.

Comments: Published as a conference paper at NeurIPS 2022

Solving constraint-satisfaction problems with distributed neocortical-like neuronal networks

Authors: Ueli Rutishauser, Jean-Jacques Slotine, Rodney J. Douglas

Abstract: Finding actions that satisfy the constraints imposed by both external inputs and internal representations is central to decision making. We demonstrate that some important classes of constraint satisfaction problems (CSPs) can be solved by networks composed of homogeneous cooperative-competitive modules that have connectivity similar to motifs observed in the superficial layers of neocortex. The w… ▽ More Finding actions that satisfy the constraints imposed by both external inputs and internal representations is central to decision making. We demonstrate that some important classes of constraint satisfaction problems (CSPs) can be solved by networks composed of homogeneous cooperative-competitive modules that have connectivity similar to motifs observed in the superficial layers of neocortex. The winner-take-all modules are sparsely coupled by programming neurons that embed the constraints onto the otherwise homogeneous modular computational substrate. We show rules that embed any instance of the CSPs planar four-color graph coloring, maximum independent set, and Sudoku on this substrate, and provide mathematical proofs that guarantee these graph coloring problems will convergence to a solution. The network is composed of non-saturating linear threshold neurons. Their lack of right saturation allows the overall network to explore the problem space driven through the unstable dynamics generated by recurrent excitation. The direction of exploration is steered by the constraint neurons. While many problems can be solved using only linear inhibitory constraints, network performance on hard problems benefits significantly when these negative constraints are implemented by non-linear multiplicative inhibition. Overall, our results demonstrate the importance of instability rather than stability in network computation, and also offer insight into the computational role of dual inhibitory mechanisms in neural circuits. △ Less

Submitted 14 January, 2018; originally announced January 2018.

Comments: Accepted manuscript, in press, Neural Computation (2018)

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Authors: Alireza Alemi, Christian Machens, Sophie Denève, Jean-Jacques Slotine

Abstract: Understanding how recurrent neural circuits can learn to implement dynamical systems is a fundamental challenge in neuroscience. The credit assignment problem, i.e. determining the local contribution of each synapse to the network's global output error, is a major obstacle in deriving biologically plausible local learning rules. Moreover, spiking recurrent networks implementing such tasks should n… ▽ More Understanding how recurrent neural circuits can learn to implement dynamical systems is a fundamental challenge in neuroscience. The credit assignment problem, i.e. determining the local contribution of each synapse to the network's global output error, is a major obstacle in deriving biologically plausible local learning rules. Moreover, spiking recurrent networks implementing such tasks should not be hugely costly in terms of number of neurons and spikes, as they often are when adapted from rate models. Finally, these networks should be robust to noise and neural deaths in order to sustain these representations in the face of such naturally occurring perturbation. We approach this problem by fusing the theory of efficient, balanced spiking networks (EBN) with nonlinear adaptive control theory. Local learning rules are ensured by feeding back into the network its own error, resulting in a synaptic plasticity rule depending solely on presynaptic inputs and post-synaptic feedback. The spiking efficiency and robustness of the network are guaranteed by maintaining a tight excitatory/inhibitory balance, ensuring that each spike represents a local projection of the global output error and minimizes a loss function. The resulting networks can learn to implement complex dynamics with very small numbers of neurons and spikes, exhibit the same spike train variability as observed experimentally, and are extremely robust to noise and neuronal loss. △ Less

Submitted 4 August, 2017; v1 submitted 22 May, 2017; originally announced May 2017.

Comments: minor editorial changes

Synchronization and Noise: A Mechanism for Regularization in Neural Systems

Authors: Jake Bouvrie, Jean-Jacques Slotine

Abstract: To learn and reason in the presence of uncertainty, the brain must be capable of imposing some form of regularization. Here we suggest, through theoretical and computational arguments, that the combination of noise with synchronization provides a plausible mechanism for regularization in the nervous system. The functional role of regularization is considered in a general context in which coupled c… ▽ More To learn and reason in the presence of uncertainty, the brain must be capable of imposing some form of regularization. Here we suggest, through theoretical and computational arguments, that the combination of noise with synchronization provides a plausible mechanism for regularization in the nervous system. The functional role of regularization is considered in a general context in which coupled computational systems receive inputs corrupted by correlated noise. Noise on the inputs is shown to impose regularization, and when synchronization upstream induces time-varying correlations across noise variables, the degree of regularization can be calibrated over time. The proposed mechanism is explored first in the context of a simple associative learning problem, and then in the context of a hierarchical sensory coding task. The resulting qualitative behavior coincides with experimental data from visual cortex. △ Less

Submitted 5 December, 2013; originally announced December 2013.

Comments: 32 pages, 7 figures. under review

MSC Class: 37N25

Nonlinear Observer Design and Synchronization Analysis for Classical Models of Neural Oscillators

Authors: Ranjeetha Bharath, Jean-Jacques Slotine

Abstract: This work explores four nonlinear classical models of neural oscillators, the Hodgkin-Huxley model, the Fitzhugh-Nagumo model, the Morris-Lecar model, and the Hindmarsh-Rose model. Nonlinear contraction theory is used to develop observers and perform synchronization analysis on these systems. Neural oscillation and signaling models are based on the biological function of the neuron, with behavior… ▽ More This work explores four nonlinear classical models of neural oscillators, the Hodgkin-Huxley model, the Fitzhugh-Nagumo model, the Morris-Lecar model, and the Hindmarsh-Rose model. Nonlinear contraction theory is used to develop observers and perform synchronization analysis on these systems. Neural oscillation and signaling models are based on the biological function of the neuron, with behavior mediated through the channeling of ions across the cell membrane. The variable assumed to be measured is the membrane potential, which may be obtained empirically through the use of a neuronal force-clamp system, or may be transmitted through the axon to other neurons. All other variables are estimated by using partial state or full state observers. Basic observer rate convergence analysis is performed for the Fitzhugh Nagumo system, partial state observer design is performed for the Morris-Lecar system, and basic synchronization analysis is performed for both the Fitzhugh-Nagumo and the Hodgkin-Huxley systems. △ Less

Submitted 1 October, 2013; originally announced October 2013.

Competition through selective inhibitory synchrony

Authors: Ueli Rutishauser, Jean-Jacques Slotine, Rodney J. Douglas

Abstract: Models of cortical neuronal circuits commonly depend on inhibitory feedback to control gain, provide signal normalization, and to selectively amplify signals using winner-take-all (WTA) dynamics. Such models generally assume that excitatory and inhibitory neurons are able to interact easily, because their axons and dendrites are co-localized in the same small volume. However, quantitative neuroana… ▽ More Models of cortical neuronal circuits commonly depend on inhibitory feedback to control gain, provide signal normalization, and to selectively amplify signals using winner-take-all (WTA) dynamics. Such models generally assume that excitatory and inhibitory neurons are able to interact easily, because their axons and dendrites are co-localized in the same small volume. However, quantitative neuroanatomical studies of the dimensions of axonal and dendritic trees of neurons in the neocortex show that this co-localization assumption is not valid. In this paper we describe a simple modification to the WTA circuit design that permits the effects of distributed inhibitory neurons to be coupled through synchronization, and so allows a single WTA to be distributed widely in cortical space, well beyond the arborization of any single inhibitory neuron, and even across different cortical areas. We prove by non-linear contraction analysis, and demonstrate by simulation that distributed WTA sub-systems combined by such inhibitory synchrony are inherently stable. We show analytically that synchronization is substantially faster than winner selection. This circuit mechanism allows networks of independent WTAs to fully or partially compete with each other. △ Less

Submitted 3 April, 2012; v1 submitted 13 January, 2012; originally announced January 2012.

Comments: in press at Neural computation; 4 figures

Journal ref: Neural Comput. 2012 Aug;24(8):2033-52

Collective stability of networks of winner-take-all circuits

Authors: Ueli Rutishauser, Rodney J. Douglas, Jean-Jacques Slotine

Abstract: The neocortex has a remarkably uniform neuronal organization, suggesting that common principles of processing are employed throughout its extent. In particular, the patterns of connectivity observed in the superficial layers of the visual cortex are consistent with the recurrent excitation and inhibitory feedback required for cooperative-competitive circuits such as the soft winner-take-all (WTA).… ▽ More The neocortex has a remarkably uniform neuronal organization, suggesting that common principles of processing are employed throughout its extent. In particular, the patterns of connectivity observed in the superficial layers of the visual cortex are consistent with the recurrent excitation and inhibitory feedback required for cooperative-competitive circuits such as the soft winner-take-all (WTA). WTA circuits offer interesting computational properties such as selective amplification, signal restoration, and decision making. But, these properties depend on the signal gain derived from positive feedback, and so there is a critical trade-off between providing feedback strong enough to support the sophisticated computations, while maintaining overall circuit stability. We consider the question of how to reason about stability in very large distributed networks of such circuits. We approach this problem by approximating the regular cortical architecture as many interconnected cooperative-competitive modules. We demonstrate that by properly understanding the behavior of this small computational module, one can reason over the stability and convergence of very large networks composed of these modules. We obtain parameter ranges in which the WTA circuit operates in a high-gain regime, is stable, and can be aggregated arbitrarily to form large stable networks. We use nonlinear Contraction Theory to establish conditions for stability in the fully nonlinear case, and verify these solutions using numerical simulations. The derived bounds allow modes of operation in which the WTA network is multi-stable and exhibits state-dependent persistent activities. Our approach is sufficiently general to reason systematically about the stability of any network, biological or technological, composed of networks of small modules that express competition through shared inhibition. △ Less

Submitted 16 May, 2011; originally announced May 2011.

Comments: 7 Figures

Journal ref: Neural computation 23(3):735-773, 2011

Synchronization and Redundancy: Implications for Robustness of Neural Learning and Decision Making

Authors: Jake Bouvrie, Jean-Jacques Slotine

Abstract: Learning and decision making in the brain are key processes critical to survival, and yet are processes implemented by non-ideal biological building blocks which can impose significant error. We explore quantitatively how the brain might cope with this inherent source of error by taking advantage of two ubiquitous mechanisms, redundancy and synchronization. In particular we consider a neural proce… ▽ More Learning and decision making in the brain are key processes critical to survival, and yet are processes implemented by non-ideal biological building blocks which can impose significant error. We explore quantitatively how the brain might cope with this inherent source of error by taking advantage of two ubiquitous mechanisms, redundancy and synchronization. In particular we consider a neural process whose goal is to learn a decision function by implementing a nonlinear gradient dynamics. The dynamics, however, are assumed to be corrupted by perturbations modeling the error which might be incurred due to limitations of the biology, intrinsic neuronal noise, and imperfect measurements. We show that error, and the associated uncertainty surrounding a learned solution, can be controlled in large part by trading off synchronization strength among multiple redundant neural systems against the noise amplitude. The impact of the coupling between such redundant systems is quantified by the spectrum of the network Laplacian, and we discuss the role of network topology in synchronization and in reducing the effect of noise. A range of situations in which the mechanisms we model arise in brain science are discussed, and we draw attention to experimental evidence suggesting that cortical circuits capable of implementing the computations of interest here can be found on several scales. Finally, simulations comparing theoretical bounds to the relevant empirical quantities show that the theoretical estimates we derive can be tight. △ Less

Submitted 16 April, 2011; v1 submitted 21 October, 2010; originally announced October 2010.

Comments: Preprint, accepted for publication in Neural Computation

MSC Class: 92B99

Global convergence of quorum-sensing networks

Authors: Giovanni Russo, Jean-Jacques E. Slotine

Abstract: In many natural synchronization phenomena, communication between individual elements occurs not directly, but rather through the environment. One of these instances is bacterial quorum sensing, where bacteria release signaling molecules in the environment which in turn are sensed and used for population coordination. Extending this motivation to a general non- linear dynamical system context, this… ▽ More In many natural synchronization phenomena, communication between individual elements occurs not directly, but rather through the environment. One of these instances is bacterial quorum sensing, where bacteria release signaling molecules in the environment which in turn are sensed and used for population coordination. Extending this motivation to a general non- linear dynamical system context, this paper analyzes synchronization phenomena in networks where communication and coupling between nodes are mediated by shared dynamical quan- tities, typically provided by the nodes' environment. Our model includes the case when the dynamics of the shared variables themselves cannot be neglected or indeed play a central part. Applications to examples from systems biology illustrate the approach. △ Less

Submitted 3 May, 2010; v1 submitted 29 March, 2010; originally announced March 2010.

Comments: Version 2: minor editions, added section on noise. Number of pages: 36.

How synchronization protects from noise

Authors: Nicolas Tabareau, Jean-Jacques Slotine, Quang-Cuong Pham

Abstract: Synchronization phenomena are pervasive in biology. In neuronal networks, the mechanisms of synchronization have been extensively studied from both physiological and computational viewpoints. The functional role of synchronization has also attracted much interest and debate. In particular, synchronization may allow distant sites in the brain to communicate and cooperate with each other, and ther… ▽ More Synchronization phenomena are pervasive in biology. In neuronal networks, the mechanisms of synchronization have been extensively studied from both physiological and computational viewpoints. The functional role of synchronization has also attracted much interest and debate. In particular, synchronization may allow distant sites in the brain to communicate and cooperate with each other, and therefore it may play a role in temporal binding and in attention and sensory-motor integration mechanisms. In this article, we study another role for synchronization: the so-called "collective enhancement of precision." We argue, in a full nonlinear dynamical context, that synchronization may help protect interconnected neurons from the influence of random perturbations -- intrinsic neuronal noise -- which affect all neurons in the nervous system. This property may allow reliable computations to be carried out even in the presence of significant noise (as experimentally found e.g., in retinal ganglion cells in primates), as mathematically it is key to obtaining meaningful downstream signals, whether in terms of precisely-timed interaction (temporal coding), population coding, or frequency coding. Using stochastic contraction theory, we show how synchronization of nonlinear dynamical systems helps protect these systems from random perturbations. Our main contribution is a mathematical proof that, under specific quantified conditions, the impact of noise on each individual system and on the spatial mean can essentially be cancelled through synchronization. Similar concepts may be applicable to questions in systems biology. △ Less

Submitted 18 June, 2009; v1 submitted 28 December, 2007; originally announced January 2008.

Comments: 14 pages, 5 figures

Neuronal networks and controlled symmetries, a generic framework

Authors: Léonard Gérard, Jean-Jacques Slotine

Abstract: The extraordinary computational power of the brain may be related in part to the fact that each of the smaller neural networks that compose it can behave transiently in many different ways, depending on its inputs. Mathematically, input continuity helps to show how a large network, constructed recursively from smaller blocks, can exhibit robust specific properties according to its input. By exte… ▽ More The extraordinary computational power of the brain may be related in part to the fact that each of the smaller neural networks that compose it can behave transiently in many different ways, depending on its inputs. Mathematically, input continuity helps to show how a large network, constructed recursively from smaller blocks, can exhibit robust specific properties according to its input. By extending earlier work on synchrony and symmetry, we exploit input continuity of contracting systems to ensure robust control of diverse spatial and spatio-temporal symmetries of the output signal in such a network. △ Less

Submitted 29 March, 2008; v1 submitted 27 December, 2006; originally announced December 2006.

Comments: Last editorial changes, long version of the paper

Stable Concurrent Synchronization in Dynamic System Networks

Authors: Quang-Cuong Pham, Jean-Jacques Slotine

Abstract: In a network of dynamical systems, concurrent synchronization is a regime where multiple groups of fully synchronized elements coexist. In the brain, concurrent synchronization may occur at several scales, with multiple ``rhythms'' interacting and functional assemblies combining neural oscillators of many different types. Mathematically, stable concurrent synchronization corresponds to convergen… ▽ More In a network of dynamical systems, concurrent synchronization is a regime where multiple groups of fully synchronized elements coexist. In the brain, concurrent synchronization may occur at several scales, with multiple ``rhythms'' interacting and functional assemblies combining neural oscillators of many different types. Mathematically, stable concurrent synchronization corresponds to convergence to a flow-invariant linear subspace of the global state space. We derive a general condition for such convergence to occur globally and exponentially. We also show that, under mild conditions, global convergence to a concurrently synchronized regime is preserved under basic system combinations such as negative feedback or hierarchies, so that stable concurrently synchronized aggregates of arbitrary size can be constructed. Robustnesss of stable concurrent synchronization to variations in individual dynamics is also quantified. Simple applications of these results to classical questions in systems neuroscience and robotics are discussed. △ Less

Submitted 1 June, 2006; v1 submitted 27 October, 2005; originally announced October 2005.

Comments: 32 pages, 12 figures. More detailed proofs were given in section 2. Section 3.4 on robust synchronization was added

K-Winners-Take-All Computation with Neural Oscillators

Authors: Wei Wang, Jean-Jacques E. Slotine

Abstract: Artificial spike-based computation, inspired by models of computation in the central nervous system, may present significant performance advantages over traditional methods for specific types of large scale problems. This paper describes very simple network architectures for k-winners-take-all and soft-winner-take-all computation using neural oscillators. Fast convergence is achieved from arbitr… ▽ More Artificial spike-based computation, inspired by models of computation in the central nervous system, may present significant performance advantages over traditional methods for specific types of large scale problems. This paper describes very simple network architectures for k-winners-take-all and soft-winner-take-all computation using neural oscillators. Fast convergence is achieved from arbitrary initial conditions, which makes the networks particularly suitable to track time-varying inputs. △ Less

Submitted 31 December, 2003; originally announced January 2004.

Comments: 9 pages, 4 figures

Fast Computation with Neural Oscillators

Authors: Wei Wang, Jean-Jacques E. Slotine

Abstract: Artificial spike-based computation, inspired by models of computations in the central nervous system, may present significant performance advantages over traditional methods for specific types of large scale problems. In this paper, we study new models for two common instances of such computation, winner-take-all and coincidence detection. In both cases, very fast convergence is achieved indepen… ▽ More Artificial spike-based computation, inspired by models of computations in the central nervous system, may present significant performance advantages over traditional methods for specific types of large scale problems. In this paper, we study new models for two common instances of such computation, winner-take-all and coincidence detection. In both cases, very fast convergence is achieved independent of initial conditions, and network complexity is linear in the number of inputs. △ Less

Submitted 17 December, 2003; originally announced December 2003.

Comments: 7 pages, 5 figures