-
The BrainScaleS-2 accelerated neuromorphic system with hybrid plasticity
Authors:
Christian Pehle,
Sebastian Billaudelle,
Benjamin Cramer,
Jakob Kaiser,
Korbinian Schreiber,
Yannik Stradmann,
Johannes Weis,
Aron Leibfried,
Eric Müller,
Johannes Schemmel
Abstract:
Since the beginning of information processing by electronic components, the nervous system has served as a metaphor for the organization of computational primitives. Brain-inspired computing today encompasses a class of approaches ranging from using novel nano-devices for computation to research into large-scale neuromorphic architectures, such as TrueNorth, SpiNNaker, BrainScaleS, Tianjic, and Lo…
▽ More
Since the beginning of information processing by electronic components, the nervous system has served as a metaphor for the organization of computational primitives. Brain-inspired computing today encompasses a class of approaches ranging from using novel nano-devices for computation to research into large-scale neuromorphic architectures, such as TrueNorth, SpiNNaker, BrainScaleS, Tianjic, and Loihi. While implementation details differ, spiking neural networks - sometimes referred to as the third generation of neural networks - are the common abstraction used to model computation with such systems. Here we describe the second generation of the BrainScaleS neuromorphic architecture, emphasizing applications enabled by this architecture. It combines a custom analog accelerator core supporting the accelerated physical emulation of bio-inspired spiking neural network primitives with a tightly coupled digital processor and a digital event-routing network.
△ Less
Submitted 3 February, 2022; v1 submitted 26 January, 2022;
originally announced January 2022.
-
Surrogate gradients for analog neuromorphic computing
Authors:
Benjamin Cramer,
Sebastian Billaudelle,
Simeon Kanya,
Aron Leibfried,
Andreas Grübl,
Vitali Karasenko,
Christian Pehle,
Korbinian Schreiber,
Yannik Stradmann,
Johannes Weis,
Johannes Schemmel,
Friedemann Zenke
Abstract:
To rapidly process temporal information at a low metabolic cost, biological neurons integrate inputs as an analog sum but communicate with spikes, binary events in time. Analog neuromorphic hardware uses the same principles to emulate spiking neural networks with exceptional energy-efficiency. However, instantiating high-performing spiking networks on such hardware remains a significant challenge…
▽ More
To rapidly process temporal information at a low metabolic cost, biological neurons integrate inputs as an analog sum but communicate with spikes, binary events in time. Analog neuromorphic hardware uses the same principles to emulate spiking neural networks with exceptional energy-efficiency. However, instantiating high-performing spiking networks on such hardware remains a significant challenge due to device mismatch and the lack of efficient training algorithms. Here, we introduce a general in-the-loop learning framework based on surrogate gradients that resolves these issues. Using the BrainScaleS-2 neuromorphic system, we show that learning self-corrects for device mismatch resulting in competitive spiking network performance on both vision and speech benchmarks. Our networks display sparse spiking activity with, on average, far less than one spike per hidden neuron and input, perform inference at rates of up to 85 k frames/second, and consume less than 200 mW. In summary, our work sets several new benchmarks for low-energy spiking network processing on analog neuromorphic hardware and paves the way for future on-chip learning algorithms.
△ Less
Submitted 20 May, 2021; v1 submitted 12 June, 2020;
originally announced June 2020.
-
Closed-loop experiments on the BrainScaleS-2 architecture
Authors:
K. Schreiber,
T. C. Wunderlich,
C. Pehle,
M. A. Petrovici,
J. Schemmel,
K. Meier
Abstract:
The evolution of biological brains has always been contingent on their embodiment within their respective environments, in which survival required appropriate navigation and manipulation skills. Studying such interactions thus represents an important aspect of computational neuroscience and, by extension, a topic of interest for neuromorphic engineering. Here, we present three examples of embodime…
▽ More
The evolution of biological brains has always been contingent on their embodiment within their respective environments, in which survival required appropriate navigation and manipulation skills. Studying such interactions thus represents an important aspect of computational neuroscience and, by extension, a topic of interest for neuromorphic engineering. Here, we present three examples of embodiment on the BrainScaleS-2 architecture, in which dynamical timescales of both agents and environment are accelerated by several orders of magnitude with respect to their biological archetypes.
△ Less
Submitted 29 April, 2020;
originally announced April 2020.
-
Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate
Authors:
Sebastian Billaudelle,
Yannik Stradmann,
Korbinian Schreiber,
Benjamin Cramer,
Andreas Baumbach,
Dominik Dold,
Julian Göltz,
Akos F. Kungl,
Timo C. Wunderlich,
Andreas Hartel,
Eric Müller,
Oliver Breitwieser,
Christian Mauch,
Mitja Kleider,
Andreas Grübl,
David Stöckel,
Christian Pehle,
Arthur Heimbrecht,
Philipp Spilger,
Gerd Kiene,
Vitali Karasenko,
Walter Senn,
Mihai A. Petrovici,
Johannes Schemmel,
Karlheinz Meier
Abstract:
We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experi…
▽ More
We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experiments or rapid iteration over many consecutive trials. The flexibility of our architecture is demonstrated in a suite of five distinct experiments, which emphasize different aspects of the BrainScaleS-2 system.
△ Less
Submitted 9 May, 2022; v1 submitted 30 December, 2019;
originally announced December 2019.
-
Structural plasticity on an accelerated analog neuromorphic hardware system
Authors:
Sebastian Billaudelle,
Benjamin Cramer,
Mihai A. Petrovici,
Korbinian Schreiber,
David Kappel,
Johannes Schemmel,
Karlheinz Meier
Abstract:
In computational neuroscience, as well as in machine learning, neuromorphic devices promise an accelerated and scalable alternative to neural network simulations. Their neural connectivity and synaptic capacity depends on their specific design choices, but is always intrinsically limited. Here, we present a strategy to achieve structural plasticity that optimizes resource allocation under these co…
▽ More
In computational neuroscience, as well as in machine learning, neuromorphic devices promise an accelerated and scalable alternative to neural network simulations. Their neural connectivity and synaptic capacity depends on their specific design choices, but is always intrinsically limited. Here, we present a strategy to achieve structural plasticity that optimizes resource allocation under these constraints by constantly rewiring the pre- and gpostsynaptic partners while keeping the neuronal fan-in constant and the connectome sparse. In particular, we implemented this algorithm on the analog neuromorphic system BrainScaleS-2. It was executed on a custom embedded digital processor located on chip, accompanying the mixed-signal substrate of spiking neurons and synapse circuits. We evaluated our implementation in a simple supervised learning scenario, showing its ability to optimize the network topology with respect to the nature of its training data, as well as its overall computational efficiency.
△ Less
Submitted 30 September, 2020; v1 submitted 27 December, 2019;
originally announced December 2019.
