Showing 1–28 of 28 results for author: Muller, E

Modeling the influences of non-local connectomic projections on geometrically constrained cortical dynamics

Authors: Rishikesan Maran, Eli J. Müller, Ben D. Fulcher

Abstract: The function and dynamics of the cortex are fundamentally shaped by the specific wiring configurations of its constituent axonal fibers, also known as the connectome. However, many dynamical properties of macroscale cortical activity are well captured by instead describing the activity as propagating waves across the cortical surface, constrained only by the surface's two-dimensional geometry. It… ▽ More The function and dynamics of the cortex are fundamentally shaped by the specific wiring configurations of its constituent axonal fibers, also known as the connectome. However, many dynamical properties of macroscale cortical activity are well captured by instead describing the activity as propagating waves across the cortical surface, constrained only by the surface's two-dimensional geometry. It thus remains an open question why the local geometry of the cortex can successfully capture macroscale cortical dynamics, despite neglecting the specificity of Fast-conducting, Non-local Projections (FNPs) which are known to mediate the rapid and non-local propagation of activity between remote neural populations. Here we address this question by developing a novel mathematical model of macroscale cortical activity in which cortical populations interact both by a continuous sheet and by an additional set of FNPs wired independently of the sheet's geometry. By simulating the model across a range of connectome topologies, external inputs, and timescales, we demonstrate that the addition of FNPs strongly shape the model dynamics of rapid, stimulus-evoked responses on fine millisecond timescales ($\lessapprox 30~\text{ms}$), but contribute relatively little to slower, spontaneous fluctuations over longer timescales ($> 30~\text{ms}$), which increasingly resemble geometrically constrained dynamics without FNPs. Our results suggest that the discrepant views regarding the relative contributions of local (geometric) and non-local (connectomic) cortico-cortical interactions are context-dependent: While FNPs specified by the connectome are needed to capture rapid communication between specific distant populations (as per the rapid processing of sensory inputs), they play a relatively minor role in shaping slower spontaneous fluctuations (as per resting-state functional magnetic resonance imaging). △ Less

Submitted 24 June, 2025; originally announced June 2025.

A mathematical language for linking fine-scale structure in spikes from hundreds to thousands of neurons with behaviour

Authors: Alexandra N. Busch, Roberto C. Budzinski, Federico W. Pasini, Ján Mináč, Jonathan A. Michaels, Megan Roussy, Roberto A. Gulli, Benjamin W. Corrigan, J. Andrew Pruszynski, Julio Martinez-Trujillo, Lyle E. Muller

Abstract: Recent advances in neural recording technology allow simultaneously recording action potentials from hundreds to thousands of neurons in awake, behaving animals. However, characterizing spike patterns in the resulting data, and linking these patterns to behaviour, remains a challenging task. The lack of a rigorous mathematical language for variable numbers of events (spikes) emitted by multiple ag… ▽ More Recent advances in neural recording technology allow simultaneously recording action potentials from hundreds to thousands of neurons in awake, behaving animals. However, characterizing spike patterns in the resulting data, and linking these patterns to behaviour, remains a challenging task. The lack of a rigorous mathematical language for variable numbers of events (spikes) emitted by multiple agents (neurons) is an important limiting factor. We introduce a new mathematical operation to decompose complex spike patterns into a set of simple, structured elements. This creates a mathematical language that allows comparing spike patterns across trials, detecting sub-patterns, and making links to behaviour via a clear distance measure. We apply the method to dual Utah array recordings from macaque prefrontal cortex, where this technique reveals previously unseen structure that can predict both memory-guided decisions and errors in a virtual-reality working memory task. These results demonstrate that this technique provides a powerful new approach to understand structure in the spike times of neural populations, at a scale that will continue to grow more and more rapidly in upcoming years. △ Less

Submitted 14 January, 2025; v1 submitted 4 December, 2024; originally announced December 2024.

Multi-timescale synaptic plasticity on analog neuromorphic hardware

Authors: Amani Atoui, Jakob Kaiser, Sebastian Billaudelle, Philipp Spilger, Eric Müller, Jannik Luboeinski, Christian Tetzlaff, Johannes Schemmel

Abstract: As numerical simulations grow in complexity, their demands on computing time and energy increase. Hardware accelerators offer significant efficiency gains in many computationally intensive scientific fields, but their use in computational neuroscience remains limited. Neuromorphic substrates, such as the BrainScaleS architectures, offer significant advantages, especially for studying complex plast… ▽ More As numerical simulations grow in complexity, their demands on computing time and energy increase. Hardware accelerators offer significant efficiency gains in many computationally intensive scientific fields, but their use in computational neuroscience remains limited. Neuromorphic substrates, such as the BrainScaleS architectures, offer significant advantages, especially for studying complex plasticity rules that require extended simulation runtimes. This work presents the implementation of a calcium-based plasticity rule that integrates calcium dynamics based on the synaptic tagging-and-capture hypothesis on the BrainScaleS-2 system. The implementation of the plasticity rule for a single synapse involves incorporating the calcium dynamics and the plasticity rule equations. The calcium dynamics are mapped to the analog circuits of BrainScaleS-2, while the plasticity rule equations are numerically solved on its embedded digital processors. The main hardware constraints include the speed of the processors and the use of integer arithmetic. By adjusting the timestep of the numerical solver and introducing stochastic rounding, we demonstrate that BrainScaleS-2 accurately emulates a single synapse following a calcium-based plasticity rule across four stimulation protocols and validate our implementation against a software reference model. △ Less

Submitted 3 December, 2024; originally announced December 2024.

Spatial structure facilitates evolutionary rescue by drug resistance

Authors: Cecilia Fruet, Ella Linxia Müller, Claude Loverdo, Anne-Florence Bitbol

Abstract: Bacterial populations often have complex spatial structures, which can impact their evolution. Here, we study how spatial structure affects the evolution of antibiotic resistance in a bacterial population. We consider a minimal model of spatially structured populations where all demes (i.e., subpopulations) are identical and connected to each other by identical migration rates. We show that spatia… ▽ More Bacterial populations often have complex spatial structures, which can impact their evolution. Here, we study how spatial structure affects the evolution of antibiotic resistance in a bacterial population. We consider a minimal model of spatially structured populations where all demes (i.e., subpopulations) are identical and connected to each other by identical migration rates. We show that spatial structure can facilitate the survival of a bacterial population to antibiotic treatment, starting from a sensitive inoculum. Specifically, the bacterial population can be rescued if antibiotic resistant mutants appear and are present when drug is added, and spatial structure can impact the fate of these mutants and the probability that they are present. Indeed, the probability of fixation of neutral or deleterious mutations providing drug resistance is increased in smaller populations. This promotes local fixation of resistant mutants in the structured population, which facilitates evolutionary rescue by drug resistance in the rare mutation regime. Once the population is rescued by resistance, migrations allow resistant mutants to spread in all demes. Our main result that spatial structure facilitates evolutionary rescue by antibiotic resistance extends to more complex spatial structures, and to the case where there are resistant mutants in the inoculum. △ Less

Submitted 20 December, 2024; v1 submitted 11 September, 2024; originally announced September 2024.

Analyzing the Brain's Dynamic Response to Targeted Stimulation using Generative Modeling

Authors: Rishikesan Maran, Eli J. Müller, Ben D. Fulcher

Abstract: Generative models of brain activity have been instrumental in testing hypothesized mechanisms underlying brain dynamics against experimental datasets. Beyond capturing the key mechanisms underlying spontaneous brain dynamics, these models hold an exciting potential for understanding the mechanisms underlying the dynamics evoked by targeted brain-stimulation techniques. This paper delves into this… ▽ More Generative models of brain activity have been instrumental in testing hypothesized mechanisms underlying brain dynamics against experimental datasets. Beyond capturing the key mechanisms underlying spontaneous brain dynamics, these models hold an exciting potential for understanding the mechanisms underlying the dynamics evoked by targeted brain-stimulation techniques. This paper delves into this emerging application, using concepts from dynamical systems theory to argue that the stimulus-evoked dynamics in such experiments may be shaped by new types of mechanisms distinct from those that dominate spontaneous dynamics. We review and discuss: (i) the targeted experimental techniques across spatial scales that can both perturb the brain to novel states and resolve its relaxation trajectory back to spontaneous dynamics; and (ii) how we can understand these dynamics in terms of mechanisms using physiological, phenomenological, and data-driven models. A tight integration of targeted stimulation experiments with generative quantitative modeling provides an important opportunity to uncover novel mechanisms of brain dynamics that are difficult to detect in spontaneous settings. △ Less

Submitted 15 November, 2024; v1 submitted 29 July, 2024; originally announced July 2024.

Unified neural field theory of brain dynamics underlying oscillations in Parkinson's disease and generalized epilepsies

Authors: Eli J Müller, Sacha J van Albada, Jong-Won Kim, Peter A Robinson

Abstract: The mechanisms underlying pathologically synchronized neural oscillations in Parkinson's disease (PD) and generalized epilepsies are jointly explored via a neural field model of the corticothalamic-basal ganglia (CTBG) system. The basal ganglia (BG) are approximated as a single effective population and their roles in modulating oscillatory corticothalamic (CT) dynamics and vice versa are analyzed.… ▽ More The mechanisms underlying pathologically synchronized neural oscillations in Parkinson's disease (PD) and generalized epilepsies are jointly explored via a neural field model of the corticothalamic-basal ganglia (CTBG) system. The basal ganglia (BG) are approximated as a single effective population and their roles in modulating oscillatory corticothalamic (CT) dynamics and vice versa are analyzed. Besides normal EEG rhythms, enhanced activity around 4 Hz and 20 Hz exists in the model, consistent with characteristic frequencies in PD. These rhythms result from resonances in loops between the BG and CT populations, analogous to those underlying epileptic oscillations in a previous CT model. Dopamine depletion is argued to weaken the dampening of these resonances in PD, and network connections explain the significant coherence between BG, thalamic, and cortical activity around 4-8 Hz and 20 Hz. Parallels between the afferent and efferent connection sites of the thalamic reticular nucleus (TRN) and BG predict low dopamine to correspond to a reduced likelihood of tonic-clonic (grand mal) seizures, agreeing with experimental findings. Further, the model predicts an increased likelihood of absence (petit mal) seizure resulting from low dopamine levels matching experimental findings. Suppression of absence seizure activity is shown when afferent and efferent BG connections to the CT system are strengthened, consistent with other CTBG modeling studies. The BG are demonstrated to suppress activity of the CTBG system near tonic-clonic seizure states, providing insight into the reported efficacy of current treatments in BG circuits. Sleep states of the TRN are also found to suppress pathological PD activity matching observations. Overall, the findings demonstrate strong parallels between coherent oscillations in generalized epilepsies and PD, and provide insights into possible comorbidities. △ Less

Submitted 24 January, 2024; originally announced January 2024.

Journal ref: Journal of Theoretical Biology (2017) 428, 132-146

Learning to combine top-down context and feed-forward representations under ambiguity with apical and basal dendrites

Authors: Nizar Islah, Guillaume Etter, Mashbayar Tugsbayar, Tugce Gurbuz, Blake Richards, Eilif Muller

Abstract: One of the hallmark features of neocortical anatomy is the presence of extensive top-down projections into primary sensory areas, with many impinging on the distal apical dendrites of pyramidal neurons. While it is known that they exert a modulatory effect, altering the gain of responses, their functional role remains an active area of research. It is hypothesized that these top-down projections c… ▽ More One of the hallmark features of neocortical anatomy is the presence of extensive top-down projections into primary sensory areas, with many impinging on the distal apical dendrites of pyramidal neurons. While it is known that they exert a modulatory effect, altering the gain of responses, their functional role remains an active area of research. It is hypothesized that these top-down projections carry contextual information that can help animals to resolve ambiguities in sensory data. One proposed mechanism of contextual integration is a non-linear integration of distinct input streams at apical and basal dendrites of pyramidal neurons. Computationally, however, it is yet to be demonstrated how such an architecture could leverage distinct compartments for flexible contextual integration and sensory processing when both sensory and context signals can be unreliable. Here, we implement an augmented deep neural network with distinct apical and basal compartments that integrates a) contextual information from top-down projections to apical compartments, and b) sensory representations driven by bottom-up projections to basal compartments, via a biophysically inspired rule. In addition, we develop a new multi-scenario contextual integration task using a generative image modeling approach. In addition to generalizing previous contextual integration tasks, it better captures the diversity of scenarios where neither contextual nor sensory information are fully reliable. To solve this task, this model successfully learns to select among integration strategies. We find that our model outperforms those without the "apical prior" when contextual information contradicts sensory input. Altogether, this suggests that the apical prior and biophysically inspired integration rule could be key components necessary for handling the ambiguities that animals encounter in the diverse contexts of the real world. △ Less

Submitted 25 October, 2024; v1 submitted 9 December, 2023; originally announced December 2023.

Gradient-based methods for spiking physical systems

Authors: Julian Göltz, Sebastian Billaudelle, Laura Kriener, Luca Blessing, Christian Pehle, Eric Müller, Johannes Schemmel, Mihai A. Petrovici

Abstract: Recent efforts have fostered significant progress towards deep learning in spiking networks, both theoretical and in silico. Here, we discuss several different approaches, including a tentative comparison of the results on BrainScaleS-2, and hint towards future such comparative studies. Recent efforts have fostered significant progress towards deep learning in spiking networks, both theoretical and in silico. Here, we discuss several different approaches, including a tentative comparison of the results on BrainScaleS-2, and hint towards future such comparative studies. △ Less

Submitted 29 August, 2023; originally announced September 2023.

Comments: 2 page abstract, submitted to and accepted by the NNPC (International conference on neuromorphic, natural and physical computing)

Redundancy-aware unsupervised rankings for collections of gene sets

Authors: Chiara Balestra, Carlo Maj, Emmanuel Müller, Andreas Mayr

Abstract: The biological roles of gene sets are used to group them into collections. These collections are often characterized by being high-dimensional, overlapping, and redundant families of sets, thus precluding a straightforward interpretation and study of their content. Bioinformatics looked for solutions to reduce their dimension or increase their intepretability. One possibility lies in aggregating o… ▽ More The biological roles of gene sets are used to group them into collections. These collections are often characterized by being high-dimensional, overlapping, and redundant families of sets, thus precluding a straightforward interpretation and study of their content. Bioinformatics looked for solutions to reduce their dimension or increase their intepretability. One possibility lies in aggregating overlapping gene sets to create larger pathways, but the modified biological pathways are hardly biologically justifiable. We propose to use importance scores to rank the pathways in the collections studying the context from a set covering perspective. The proposed Shapley values-based scores consider the distribution of the singletons and the size of the sets in the families; Furthermore, a trick allows us to circumvent the usual exponential complexity of Shapley values' computation. Finally, we address the challenge of including a redundancy awareness in the obtained rankings where, in our case, sets are redundant if they show prominent intersections. The rankings can be used to reduce the dimension of collections of gene sets, such that they show lower redundancy and still a high coverage of the genes. We further investigate the impact of our selection on Gene Sets Enrichment Analysis. The proposed method shows a practical utility in bioinformatics to increase the interpretability of the collections of gene sets and a step forward to include redundancy into Shapley values computations. △ Less

Submitted 30 July, 2023; originally announced July 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2207.12184

Event-based Backpropagation for Analog Neuromorphic Hardware

Authors: Christian Pehle, Luca Blessing, Elias Arnold, Eric Müller, Johannes Schemmel

Abstract: Neuromorphic computing aims to incorporate lessons from studying biological nervous systems in the design of computer architectures. While existing approaches have successfully implemented aspects of those computational principles, such as sparse spike-based computation, event-based scalable learning has remained an elusive goal in large-scale systems. However, only then the potential energy-effic… ▽ More Neuromorphic computing aims to incorporate lessons from studying biological nervous systems in the design of computer architectures. While existing approaches have successfully implemented aspects of those computational principles, such as sparse spike-based computation, event-based scalable learning has remained an elusive goal in large-scale systems. However, only then the potential energy-efficiency advantages of neuromorphic systems relative to other hardware architectures can be realized during learning. We present our progress implementing the EventProp algorithm using the example of the BrainScaleS-2 analog neuromorphic hardware. Previous gradient-based approaches to learning used "surrogate gradients" and dense sampling of observables or were limited by assumptions on the underlying dynamics and loss functions. In contrast, our approach only needs spike time observations from the system while being able to incorporate other system observables, such as membrane voltage measurements, in a principled way. This leads to a one-order-of-magnitude improvement in the information efficiency of the gradient estimate, which would directly translate to corresponding energy efficiency improvements in an optimized hardware implementation. We present the theoretical framework for estimating gradients and results verifying the correctness of the estimation, as well as results on a low-dimensional classification task using the BrainScaleS-2 system. Building on this work has the potential to enable scalable gradient estimation in large-scale neuromorphic hardware as a continuous measurement of the system state would be prohibitive and energy-inefficient in such instances. It also suggests the feasibility of a full on-device implementation of the algorithm that would enable scalable, energy-efficient, event-based learning in large-scale analog neuromorphic hardware. △ Less

Submitted 13 February, 2023; originally announced February 2023.

Autocorrelations from emergent bistability in homeostatic spiking neural networks on neuromorphic hardware

Authors: Benjamin Cramer, Markus Kreft, Sebastian Billaudelle, Vitali Karasenko, Aron Leibfried, Eric Müller, Philipp Spilger, Johannes Weis, Johannes Schemmel, Miguel A. Muñoz, Viola Priesemann, Johannes Zierenberg

Abstract: A unique feature of neuromorphic computing is that memory is an implicit part of processing through traces of past information in the system's collective dynamics. The extent of memory about past inputs is commonly quantified by the autocorrelation time of collective dynamics. Based on past experimental evidence, a potential explanation for the underlying autocorrelations are close-to-critical flu… ▽ More A unique feature of neuromorphic computing is that memory is an implicit part of processing through traces of past information in the system's collective dynamics. The extent of memory about past inputs is commonly quantified by the autocorrelation time of collective dynamics. Based on past experimental evidence, a potential explanation for the underlying autocorrelations are close-to-critical fluctuations. Here, we show for self-organized networks of excitatory and inhibitory leaky integrate-and-fire neurons that autocorrelations can originate from emergent bistability upon reducing external input strength. We identify the bistability as a fluctuation-induced stochastic switching between metastable active and quiescent states in the vicinity of a non-equilibrium phase transition. This bistability occurs for networks with fixed heterogeneous weights as a consequence of homeostatic self-organization during development. Specifically, in our experiments on neuromorphic hardware and in computer simulations, the emergent bistability gives rise to autocorrelation times exceeding 500 ms despite single-neuron timescales of only 20 ms. Our results provide the first verification of biologically compatible autocorrelation times in networks of leaky integrate-and-fire neurons, which here are not generated by close-to-critical fluctuations but by emergent bistability in homeostatically regulated networks. Our results thereby constitute a new, complementary mechanism for emergent autocorrelations in networks of spiking neurons, with implications for biological and artificial networks, and introduces the general paradigm of fluctuation-induced bistability for driven systems with absorbing states. △ Less

Submitted 17 August, 2022; originally announced August 2022.

Redundancy-aware unsupervised ranking based on game theory -- application to gene enrichment analysis

Authors: Chiara Balestra, Carlo Maj, Emmanuel Mueller, Andreas Mayr

Abstract: Gene set collections are a common ground to study the enrichment of genes for specific phenotypic traits. Gene set enrichment analysis aims to identify genes that are over-represented in gene sets collections and might be associated with a specific phenotypic trait. However, as this involves a massive number of hypothesis testing, it is often questionable whether a pre-processing step to reduce ge… ▽ More Gene set collections are a common ground to study the enrichment of genes for specific phenotypic traits. Gene set enrichment analysis aims to identify genes that are over-represented in gene sets collections and might be associated with a specific phenotypic trait. However, as this involves a massive number of hypothesis testing, it is often questionable whether a pre-processing step to reduce gene sets collections' sizes is helpful. Moreover, the often highly overlapping gene sets and the consequent low interpretability of gene sets' collections demand for a reduction of the included gene sets. Inspired by this bioinformatics context, we propose a method to rank sets within a family of sets based on the distribution of the singletons and their size. We obtain sets' importance scores by computing Shapley values without incurring into the usual exponential number of evaluations of the value function. Moreover, we address the challenge of including a redundancy awareness in the rankings obtained where, in our case, sets are redundant if they show prominent intersections. We finally evaluate our approach for gene sets collections; the rankings obtained show low redundancy and high coverage of the genes. The unsupervised nature of the proposed ranking does not allow for an evident increase in the number of significant gene sets for specific phenotypic traits when reducing the size of the collections. However, we believe that the rankings proposed are of use in bioinformatics to increase interpretability of the gene sets collections and a step forward to include redundancy into Shapley values computations. △ Less

Submitted 22 July, 2022; originally announced July 2022.

The BrainScaleS-2 accelerated neuromorphic system with hybrid plasticity

Authors: Christian Pehle, Sebastian Billaudelle, Benjamin Cramer, Jakob Kaiser, Korbinian Schreiber, Yannik Stradmann, Johannes Weis, Aron Leibfried, Eric Müller, Johannes Schemmel

Abstract: Since the beginning of information processing by electronic components, the nervous system has served as a metaphor for the organization of computational primitives. Brain-inspired computing today encompasses a class of approaches ranging from using novel nano-devices for computation to research into large-scale neuromorphic architectures, such as TrueNorth, SpiNNaker, BrainScaleS, Tianjic, and Lo… ▽ More Since the beginning of information processing by electronic components, the nervous system has served as a metaphor for the organization of computational primitives. Brain-inspired computing today encompasses a class of approaches ranging from using novel nano-devices for computation to research into large-scale neuromorphic architectures, such as TrueNorth, SpiNNaker, BrainScaleS, Tianjic, and Loihi. While implementation details differ, spiking neural networks - sometimes referred to as the third generation of neural networks - are the common abstraction used to model computation with such systems. Here we describe the second generation of the BrainScaleS neuromorphic architecture, emphasizing applications enabled by this architecture. It combines a custom analog accelerator core supporting the accelerated physical emulation of bio-inspired spiking neural network primitives with a tightly coupled digital processor and a digital event-routing network. △ Less

Submitted 3 February, 2022; v1 submitted 26 January, 2022; originally announced January 2022.

Comments: 22 pages, 10 figures; amended funding acknowledgements, added one citation

Noradrenergic neuromodulation of nonlinear bursting neurons controls critical dynamics

Authors: Brandon R. Munn, Eli J. Müller, James M. Shine

Abstract: In order to remain adaptable to a dynamic environment, neural activity must be simultaneously both sensitive and stable. To solve this problem, the brain has been hypothesised to sit near a critical boundary. Yet, precisely how criticality and these opposing information processing modes are implemented in the brain remains elusive. A potential solution to this problem involves modulating intrinsic… ▽ More In order to remain adaptable to a dynamic environment, neural activity must be simultaneously both sensitive and stable. To solve this problem, the brain has been hypothesised to sit near a critical boundary. Yet, precisely how criticality and these opposing information processing modes are implemented in the brain remains elusive. A potential solution to this problem involves modulating intrinsically nonlinear neurons within the cerebral cortex with neuromodulatory neurotransmitters such as noradrenaline, a highly-conserved chemical released from the pontine locus coeruleus. Here we confirm that neuronal spiking in mice is poised close to the critical point of a branching process and that time-varying signatures of criticality fluctuate with neuromodulatory tone, as assessed by dynamic alterations in pupil diameter. We explore these results theoretically by creating a dual-compartment model of non-linear pyramidal neurons - capable of both regular spike and bursting modes - that replicates our main empirical findings of slightly subcritical dynamics. We then probe our model at a resolution impossible in vivo to demonstrate that noradrenaline differentially alters spiking- and bursting-criticality to facilitate sensitive and stable dynamics following an inverted-U profile that peaks at intermediate noradrenergic tone. Finally, we demonstrate that this intermediate noradrenergic regime displays burst avalanches with power-law size and duration distributions and scaling relationship belonging to the universality class of self-organized criticality. Our results confirm that the noradrenergic ascending arousal system acts as a control parameter for emergent critical dynamics in the brain. This methodology could be extended to explore other neuromodulators as control parameters of the brain. △ Less

Submitted 6 April, 2023; v1 submitted 14 June, 2021; originally announced June 2021.

Comments: 17 pages, 5 figures

Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate

Authors: Sebastian Billaudelle, Yannik Stradmann, Korbinian Schreiber, Benjamin Cramer, Andreas Baumbach, Dominik Dold, Julian Göltz, Akos F. Kungl, Timo C. Wunderlich, Andreas Hartel, Eric Müller, Oliver Breitwieser, Christian Mauch, Mitja Kleider, Andreas Grübl, David Stöckel, Christian Pehle, Arthur Heimbrecht, Philipp Spilger, Gerd Kiene, Vitali Karasenko, Walter Senn, Mihai A. Petrovici, Johannes Schemmel, Karlheinz Meier

Abstract: We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experi… ▽ More We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experiments or rapid iteration over many consecutive trials. The flexibility of our architecture is demonstrated in a suite of five distinct experiments, which emphasize different aspects of the BrainScaleS-2 system. △ Less

Submitted 9 May, 2022; v1 submitted 30 December, 2019; originally announced December 2019.

Neocortical plasticity: an unsupervised cake but no free lunch

Authors: Eilif B. Muller, Philippe Beaudoin

Abstract: The fields of artificial intelligence and neuroscience have a long history of fertile bi-directional interactions. On the one hand, important inspiration for the development of artificial intelligence systems has come from the study of natural systems of intelligence, the mammalian neocortex in particular. On the other, important inspiration for models and theories of the brain have emerged from a… ▽ More The fields of artificial intelligence and neuroscience have a long history of fertile bi-directional interactions. On the one hand, important inspiration for the development of artificial intelligence systems has come from the study of natural systems of intelligence, the mammalian neocortex in particular. On the other, important inspiration for models and theories of the brain have emerged from artificial intelligence research. A central question at the intersection of these two areas is concerned with the processes by which neocortex learns, and the extent to which they are analogous to the back-propagation training algorithm of deep networks. Matching the data efficiency, transfer and generalization properties of neocortical learning remains an area of active research in the field of deep learning. Recent advances in our understanding of neuronal, synaptic and dendritic physiology of the neocortex suggest new approaches for unsupervised representation learning, perhaps through a new class of objective functions, which could act alongside or in lieu of back-propagation. Such local learning rules have implicit rather than explicit objectives with respect to the training data, facilitating domain adaptation and generalization. Incorporating them into deep networks for representation learning could better leverage unlabelled datasets to offer significant improvements in data efficiency of downstream supervised readout learning, and reduce susceptibility to adversarial perturbations, at the cost of a more restricted domain of applicability. △ Less

Submitted 15 November, 2019; originally announced November 2019.

Pattern representation and recognition with accelerated analog neuromorphic systems

Authors: Mihai A. Petrovici, Sebastian Schmitt, Johann Klähn, David Stöckel, Anna Schroeder, Guillaume Bellec, Johannes Bill, Oliver Breitwieser, Ilja Bytschok, Andreas Grübl, Maurice Güttler, Andreas Hartel, Stephan Hartmann, Dan Husmann, Kai Husmann, Sebastian Jeltsch, Vitali Karasenko, Mitja Kleider, Christoph Koke, Alexander Kononov, Christian Mauch, Eric Müller, Paul Müller, Johannes Partzsch, Thomas Pfeil , et al. (11 additional authors not shown)

Abstract: Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since… ▽ More Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since many of these devices employ analog components, which cannot be perfectly controlled, finding ways to compensate for the resulting effects represents a key challenge. Here, we discuss three different strategies to address this problem: the addition of auxiliary network components for stabilizing activity, the utilization of inherently robust architectures and a training method for hardware-emulated networks that functions without perfect knowledge of the system's dynamics and parameters. For all three scenarios, we corroborate our theoretical considerations with experimental results on accelerated analog neuromorphic platforms. △ Less

Submitted 3 July, 2017; v1 submitted 17 March, 2017; originally announced March 2017.

Comments: accepted at ISCAS 2017

Journal ref: Circuits and Systems (ISCAS), 2017 IEEE International Symposium on

Automated point-neuron simplification of data-driven microcircuit models

Authors: Christian Rössert, Christian Pozzorini, Giuseppe Chindemi, Andrew P. Davison, Csaba Eroe, James King, Taylor H. Newton, Max Nolte, Srikanth Ramaswamy, Michael W. Reimann, Willem Wybo, Marc-Oliver Gewaltig, Wulfram Gerstner, Henry Markram, Idan Segev, Eilif Muller

Abstract: A method is presented for the reduction of morphologically detailed microcircuit models to a point-neuron representation without human intervention. The simplification occurs in a modular workflow, in the neighborhood of a user specified network activity state for the reference model, the "operating point". First, synapses are moved to the soma, correcting for dendritic filtering by low-pass filte… ▽ More A method is presented for the reduction of morphologically detailed microcircuit models to a point-neuron representation without human intervention. The simplification occurs in a modular workflow, in the neighborhood of a user specified network activity state for the reference model, the "operating point". First, synapses are moved to the soma, correcting for dendritic filtering by low-pass filtering the delivered synaptic current. Filter parameters are computed numerically and independently for inhibitory and excitatory input using a Green's function approach. Next, point-neuron models for each neuron in the microcircuit are fit to their respective morphologically detailed counterparts. Here, generalized integrate-and-fire point neuron models are used, leveraging a recently published fitting toolbox. The fits are constrained by currents and voltages computed in the morphologically detailed partner neurons with soma corrected synapses at three depolarizations about the user specified operating point. The result is a simplified circuit which is well constrained by the reference circuit, and can be continuously updated as the latter iteratively integrates new data. The modularity of the approach makes it applicable also for other point-neuron and synapse models. The approach is demonstrated on a recently reported reconstruction of a neocortical microcircuit around an in vivo-like working point. The resulting simplified network model is benchmarked to the reference morphologically detailed microcircuit model for a range of simulated network protocols. The simplified network is found to be slightly more sub-critical than the reference, with otherwise good agreement for both quantitative and qualitative validations. △ Less

Submitted 30 March, 2017; v1 submitted 31 March, 2016; originally announced April 2016.

Comments: Changes since version 1: filter fitting approach replaced by a new method to directly extract the filters using a Green's functions approach. Methods Section 2.1, Results Section 3.1 and Figures 1, 2, 4, 5 have been updated to reflect these changes. Discussion has been updated to incorporate the new findings

BluePyOpt: Leveraging open source software and cloud infrastructure to optimise model parameters in neuroscience

Authors: Werner Van Geit, Michael Gevaert, Giuseppe Chindemi, Christian Rössert, Jean-Denis Courcol, Eilif Muller, Felix Schürmann, Idan Segev, Henry Markram

Abstract: At many scales in neuroscience, appropriate mathematical models take the form of complex dynamical systems. Parametrising such models to conform to the multitude of available experimental constraints is a global nonlinear optimisation problem with a complex fitness landscape, requiring numerical techniques to find suitable approximate solutions. Stochastic optimisation approaches, such as evolutio… ▽ More At many scales in neuroscience, appropriate mathematical models take the form of complex dynamical systems. Parametrising such models to conform to the multitude of available experimental constraints is a global nonlinear optimisation problem with a complex fitness landscape, requiring numerical techniques to find suitable approximate solutions. Stochastic optimisation approaches, such as evolutionary algorithms, have been shown to be effective, but often the setting up of such optimisations and the choice of a specific search algorithm and its parameters is non-trivial, requiring domain-specific expertise. Here we describe BluePyOpt, a Python package targeted at the broad neuroscience community to simplify this task. BluePyOpt is an extensible framework for data-driven model parameter optimisation that wraps and standardises several existing open-source tools. It simplifies the task of creating and sharing these optimisations, and the associated techniques and knowledge. This is achieved by abstracting the optimisation and evaluation tasks into various reusable and flexible discrete elements according to established best-practices. Further, BluePyOpt provides methods for setting up both small- and large-scale optimisations on a variety of platforms, ranging from laptops to Linux clusters and cloud-based compute infrastructures. The versatility of the BluePyOpt framework is demonstrated by working through three representative neuroscience specific use cases. △ Less

Submitted 1 March, 2016; originally announced March 2016.

Journal ref: Front. Neuroinform., 07 June 2016

Topological analysis of the connectome of digital reconstructions of neural microcircuits

Authors: Pawe Dotko, Kathryn Hess, Ran Levi, Max Nolte, Michael Reimann, Martina Scolamiero, Katharine Turner, Eilif Muller, Henry Markram

Abstract: A recent publication provides the network graph for a neocortical microcircuit comprising 8 million connections between 31,000 neurons (H. Markram, et al., Reconstruction and simulation of neocortical microcircuitry, Cell, 163 (2015) no. 2, 456-492). Since traditional graph-theoretical methods may not be sufficient to understand the immense complexity of such a biological network, we explored whet… ▽ More A recent publication provides the network graph for a neocortical microcircuit comprising 8 million connections between 31,000 neurons (H. Markram, et al., Reconstruction and simulation of neocortical microcircuitry, Cell, 163 (2015) no. 2, 456-492). Since traditional graph-theoretical methods may not be sufficient to understand the immense complexity of such a biological network, we explored whether methods from algebraic topology could provide a new perspective on its structural and functional organization. Structural topological analysis revealed that directed graphs representing connectivity among neurons in the microcircuit deviated significantly from different varieties of randomized graph. In particular, the directed graphs contained in the order of $10^7$ simplices Ð groups of neurons with all-to-all directed connectivity. Some of these simplices contained up to 8 neurons, making them the most extreme neuronal clustering motif ever reported. Functional topological analysis of simulated neuronal activity in the microcircuit revealed novel spatio-temporal metrics that provide an effective classification of functional responses to qualitatively different stimuli. This study represents the first algebraic topological analysis of structural connectomics and connectomics-based spatio-temporal activity in a biologically realistic neural microcircuit. The methods used in the study show promise for more general applications in network science. △ Less

Submitted 7 January, 2016; originally announced January 2016.

Aspects of randomness in neural graph structures

Authors: Michelle Rudolph-Lilith, Lyle E. Muller

Abstract: In the past two decades, significant advances have been made in understanding the structural and functional properties of biological networks, via graph-theoretic analysis. In general, most graph-theoretic studies are conducted in the presence of serious uncertainties, such as major undersampling of the experimental data. In the specific case of neural systems, however, a few moderately robust exp… ▽ More In the past two decades, significant advances have been made in understanding the structural and functional properties of biological networks, via graph-theoretic analysis. In general, most graph-theoretic studies are conducted in the presence of serious uncertainties, such as major undersampling of the experimental data. In the specific case of neural systems, however, a few moderately robust experimental reconstructions do exist, and these have long served as fundamental prototypes for studying connectivity patterns in the nervous system. In this paper, we provide a comparative analysis of these "historical" graphs, both in (unmodified) directed and (often symmetrized) undirected forms, and focus on simple structural characterizations of their connectivity. We find that in most measures the networks studied are captured by simple random graph models; in a few key measures, however, we observe a marked departure from the random graph prediction. Our results suggest that the mechanism of graph formation in the networks studied is not well-captured by existing abstract graph models, such as the small-world or scale-free graph. △ Less

Submitted 18 October, 2013; originally announced October 2013.

Comments: 19 pages, 7 figures

Cellular Adaptation Accounts for the Sparse and Reliable Sensory Stimulus Representation

Authors: Farzad Farkhooi, Anja Froese, Eilif Muller, Randolf Menzel, Martin P. Nawrot

Abstract: Most neurons in peripheral sensory pathways initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. It is unclear how this phenomenon affects stimulus representation in the later stages of cortical sensory processing. Here, we show that a temporally sparse and reliable stimulus representation develops naturally in a network with adapting neurons. We… ▽ More Most neurons in peripheral sensory pathways initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. It is unclear how this phenomenon affects stimulus representation in the later stages of cortical sensory processing. Here, we show that a temporally sparse and reliable stimulus representation develops naturally in a network with adapting neurons. We find that cellular adaptation plays a critical role in the transient reduction of the trial-by-trial variability of cortical spiking, providing an explanation for a wide-spread and hitherto unexplained phenomenon by a simple mechanism. In insect olfaction, cellular adaptation is sufficient to explain the emergence of the temporally sparse and reliable stimulus representation in the mushroom body, independent of inhibitory mechanisms. Our results reveal a computational principle that relates neuronal firing rate adaptation to temporal sparse coding and variability suppression in nervous systems with a sequential processing architecture. △ Less

Submitted 26 October, 2012; originally announced October 2012.

Comments: 17 pages, 4 figures

Six networks on a universal neuromorphic computing substrate

Authors: Thomas Pfeil, Andreas Grübl, Sebastian Jeltsch, Eric Müller, Paul Müller, Mihai A. Petrovici, Michael Schmuker, Daniel Brüderle, Johannes Schemmel, Karlheinz Meier

Abstract: In this study, we present a highly configurable neuromorphic computing substrate and use it for emulating several types of neural networks. At the heart of this system lies a mixed-signal chip, with analog implementations of neurons and synapses and digital transmission of action potentials. Major advantages of this emulation device, which has been explicitly designed as a universal neural network… ▽ More In this study, we present a highly configurable neuromorphic computing substrate and use it for emulating several types of neural networks. At the heart of this system lies a mixed-signal chip, with analog implementations of neurons and synapses and digital transmission of action potentials. Major advantages of this emulation device, which has been explicitly designed as a universal neural network emulator, are its inherent parallelism and high acceleration factor compared to conventional computers. Its configurability allows the realization of almost arbitrary network topologies and the use of widely varied neuronal and synaptic parameters. Fixed-pattern noise inherent to analog circuitry is reduced by calibration routines. An integrated development environment allows neuroscientists to operate the device without any prior knowledge of neuromorphic circuit design. As a showcase for the capabilities of the system, we describe the successful emulation of six different neural networks which cover a broad spectrum of both structure and functionality. △ Less

Submitted 21 February, 2013; v1 submitted 26 October, 2012; originally announced October 2012.

Comments: 21 pages, 9 figures

Journal ref: Front. Neurosci. 7:11 (2013)

Structual Vulnerability of the Nematode Worm Neural Graph

Authors: Michelle Rudolph-Lilith, Alain Destexhe, Lyle E. Muller

Abstract: The number of connected components and the size of the largest connected component are studied under node and edge removal in the connectivity graph of the C. elegans nervous system. By studying the two subgraphs - the directed graph of chemical synapses and the undirected graph of electrical junctions - we observe that adding a small number of undirected edges dramatically reduces the number of c… ▽ More The number of connected components and the size of the largest connected component are studied under node and edge removal in the connectivity graph of the C. elegans nervous system. By studying the two subgraphs - the directed graph of chemical synapses and the undirected graph of electrical junctions - we observe that adding a small number of undirected edges dramatically reduces the number of components in the complete graph. Under random node and edge removal, the C. elegans graph displays a remarkable structural robustness. We then compare these results with the vulnerability of a number of canonical graph models. △ Less

Submitted 16 August, 2012; originally announced August 2012.

Comments: 4 pages, 4 figures

A Comprehensive Workflow for General-Purpose Neural Modeling with Highly Configurable Neuromorphic Hardware Systems

Authors: Daniel Brüderle, Mihai A. Petrovici, Bernhard Vogginger, Matthias Ehrlich, Thomas Pfeil, Sebastian Millner, Andreas Grübl, Karsten Wendt, Eric Müller, Marc-Olivier Schwartz, Dan Husmann de Oliveira, Sebastian Jeltsch, Johannes Fieres, Moritz Schilling, Paul Müller, Oliver Breitwieser, Venelin Petkov, Lyle Muller, Andrew P. Davison, Pradeep Krishnamurthy, Jens Kremkow, Mikael Lundqvist, Eilif Muller, Johannes Partzsch, Stefan Scholze , et al. (9 additional authors not shown)

Abstract: In this paper we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More spe… ▽ More In this paper we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More specifically, we aim at the establishment of this neuromorphic system as a flexible and neuroscientifically valuable modeling tool that can be used by non-hardware-experts. We consider various functional aspects to be crucial for this purpose, and we introduce a consistent workflow with detailed descriptions of all involved modules that implement the suggested steps: The integration of the hardware interface into the simulator-independent model description language PyNN; a fully automated translation between the PyNN domain and appropriate hardware configurations; an executable specification of the future neuromorphic system that can be seamlessly integrated into this biology-to-hardware mapping process as a test bench for all software layers and possible hardware design modifications; an evaluation scheme that deploys models from a dedicated benchmark library, compares the results generated by virtual or prototype hardware devices with reference software simulations and analyzes the differences. The integration of these components into one hardware-software workflow provides an ecosystem for ongoing preparative studies that support the hardware design process and represents the basis for the maturity of the model-to-hardware mapping software. The functionality and flexibility of the latter is proven with a variety of experimental results. △ Less

Submitted 21 July, 2011; v1 submitted 12 November, 2010; originally announced November 2010.

Journal ref: Biol Cybern. 2011 May;104(4-5):263-96

Adaptation Reduces Variability of the Neuronal Population Code

Authors: Farzad Farkhooi, Eilif Muller, Martin P. Nawrot

Abstract: Sequences of events in noise-driven excitable systems with slow variables often show serial correlations among their intervals of events. Here, we employ a master equation for general non-renewal processes to calculate the interval and count statistics of superimposed processes governed by a slow adaptation variable. For an ensemble of spike-frequency adapting neurons this results in the regulariz… ▽ More Sequences of events in noise-driven excitable systems with slow variables often show serial correlations among their intervals of events. Here, we employ a master equation for general non-renewal processes to calculate the interval and count statistics of superimposed processes governed by a slow adaptation variable. For an ensemble of spike-frequency adapting neurons this results in the regularization of the population activity and an enhanced post-synaptic signal decoding. We confirm our theoretical results in a population of cortical neurons. △ Less

Submitted 7 February, 2011; v1 submitted 20 July, 2010; originally announced July 2010.

Comments: 4 pages, 2 figures

MSC Class: 60G10

Journal ref: Phys. Rev. E 83, 050905 (2011)

Sequential Sparsening by Successive Adaptation in Neural Populations

Authors: Farzad Farkhooi, Eilif Muller, Martin P. Nawrot

Abstract: In the principal cells of the insect mushroom body, the Kenyon cells (KC), olfactory information is represented by a spatially and temporally sparse code. Each odor stimulus will activate only a small portion of neurons and each stimulus leads to only a short phasic response following stimulus onset irrespective of the actual duration of a constant stimulus. The mechanisms responsible for the spar… ▽ More In the principal cells of the insect mushroom body, the Kenyon cells (KC), olfactory information is represented by a spatially and temporally sparse code. Each odor stimulus will activate only a small portion of neurons and each stimulus leads to only a short phasic response following stimulus onset irrespective of the actual duration of a constant stimulus. The mechanisms responsible for the sparse code in the KCs are yet unresolved. Here, we explore the role of the neuron-intrinsic mechanism of spike-frequency adaptation (SFA) in producing temporally sparse responses to sensory stimulation in higher processing stages. Our single neuron model is defined through a conductance-based integrate-and-fire neuron with spike-frequency adaptation [1]. We study a fully connected feed-forward network architecture in coarse analogy to the insect olfactory pathway. A first layer of ten neurons represents the projection neurons (PNs) of the antenna lobe. All PNs receive a step-like input from the olfactory receptor neurons, which was realized by independent Poisson processes. The second layer represents 100 KCs which converge onto ten neurons in the output layer which represents the population of mushroom body extrinsic neurons (ENs). Our simulation result matches with the experimental observations. In particular, intracellular recordings of PNs show a clear phasic-tonic response that outlasts the stimulus [2] while extracellular recordings from KCs in the locust express sharp transient responses [3]. We conclude that the neuron-intrinsic mechanism is can explain a progressive temporal response sparsening in the insect olfactory system. Further experimental work is needed to test this hypothesis empirically. [1] Muller et. al., Neural Comput, 19(11):2958-3010, 2007. [2] Assisi et. al., Nat Neurosci, 10(9):1176-1184, 2007. [3] Krofczik et. al. Front. Comput. Neurosci., 2(9), 2009. △ Less

Submitted 14 July, 2010; originally announced July 2010.

Comments: 5 pages, 2 figures, This manuscript was submitted for review to the Eighteenth Annual Computational Neuroscience Meeting CNS*2009 in Berlin and accepted for oral presentation at the meeting

Journal ref: Supplement to Farkhooi, F., Muller, E. & Nawrot, M. Sequential sparsing by successive adapting neural populations. BMC Neuroscience 10, O10 (2009)

Simulation of networks of spiking neurons: A review of tools and strategies

Authors: R. Brette, M. Rudolph, T. Carnevale, M. Hines, D. Beeman, J. M. Bower, M. Diesmann, A. Morrison, P. H. Goodman, F. C. Harris Jr., M. Zirpe, T. Natschlager, D. Pecevski, B. Ermentrout, M. Djurfeldt, A. Lansner, O. Rochel, T. Vieville, E. Muller, A. P. Davison, S. El Boustani, A. Destexhe

Abstract: We review different aspects of the simulation of spiking neural networks. We start by reviewing the different types of simulation strategies and algorithms that are currently implemented. We next review the precision of those simulation strategies, in particular in cases where plasticity depends on the exact timing of the spikes. We overview different simulators and simulation environments prese… ▽ More We review different aspects of the simulation of spiking neural networks. We start by reviewing the different types of simulation strategies and algorithms that are currently implemented. We next review the precision of those simulation strategies, in particular in cases where plasticity depends on the exact timing of the spikes. We overview different simulators and simulation environments presently available (restricted to those freely available, open source and documented). For each simulation tool, its advantages and pitfalls are reviewed, with an aim to allow the reader to identify which simulator is appropriate for a given task. Finally, we provide a series of benchmark simulations of different types of networks of spiking neurons, including Hodgkin-Huxley type, integrate-and-fire models, interacting with current-based or conductance-based synapses, using clock-driven or event-driven integration strategies. The same set of models are implemented on the different simulators, and the codes are made available. The ultimate goal of this review is to provide a resource to facilitate identifying the appropriate integration strategy and simulation tool to use for a given modeling problem related to spiking neural networks. △ Less

Submitted 12 April, 2007; v1 submitted 28 November, 2006; originally announced November 2006.

Comments: 49 pages, 24 figures, 1 table; review article, Journal of Computational Neuroscience, in press (2007)

Journal ref: Journal of Computational Neuroscience 2007 Dec;23(3):349-98. Epub 2007 Jul 12