-
Lu.i -- A low-cost electronic neuron for education and outreach
Authors:
Yannik Stradmann,
Julian Göltz,
Mihai A. Petrovici,
Johannes Schemmel,
Sebastian Billaudelle
Abstract:
With an increasing presence of science throughout all parts of society, there is a rising expectation for researchers to effectively communicate their work and, equally, for teachers to discuss contemporary findings in their classrooms. While the community can resort to an established set of teaching aids for the fundamental concepts of most natural sciences, there is a need for similarly illustra…
▽ More
With an increasing presence of science throughout all parts of society, there is a rising expectation for researchers to effectively communicate their work and, equally, for teachers to discuss contemporary findings in their classrooms. While the community can resort to an established set of teaching aids for the fundamental concepts of most natural sciences, there is a need for similarly illustrative experiments and demonstrators in neuroscience. We therefore introduce Lu.i: a parametrizable electronic implementation of the leaky-integrate-and-fire neuron model in an engaging form factor. These palm-sized neurons can be used to visualize and experience the dynamics of individual cells and small spiking neural networks. When stimulated with real or simulated sensory input, Lu.i demonstrates brain-inspired information processing in the hands of a student. As such, it is actively used at workshops, in classrooms, and for science communication. As a versatile tool for teaching and outreach, Lu.i nurtures the comprehension of neuroscience research and neuromorphic engineering among future generations of scientists and in the general public.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Gradient-based methods for spiking physical systems
Authors:
Julian Göltz,
Sebastian Billaudelle,
Laura Kriener,
Luca Blessing,
Christian Pehle,
Eric Müller,
Johannes Schemmel,
Mihai A. Petrovici
Abstract:
Recent efforts have fostered significant progress towards deep learning in spiking networks, both theoretical and in silico. Here, we discuss several different approaches, including a tentative comparison of the results on BrainScaleS-2, and hint towards future such comparative studies.
Recent efforts have fostered significant progress towards deep learning in spiking networks, both theoretical and in silico. Here, we discuss several different approaches, including a tentative comparison of the results on BrainScaleS-2, and hint towards future such comparative studies.
△ Less
Submitted 29 August, 2023;
originally announced September 2023.
-
The Yin-Yang dataset
Authors:
Laura Kriener,
Julian Göltz,
Mihai A. Petrovici
Abstract:
The Yin-Yang dataset was developed for research on biologically plausible error backpropagation and deep learning in spiking neural networks. It serves as an alternative to classic deep learning datasets, especially in early-stage prototyping scenarios for both network models and hardware platforms, for which it provides several advantages. First, it is smaller and therefore faster to learn, there…
▽ More
The Yin-Yang dataset was developed for research on biologically plausible error backpropagation and deep learning in spiking neural networks. It serves as an alternative to classic deep learning datasets, especially in early-stage prototyping scenarios for both network models and hardware platforms, for which it provides several advantages. First, it is smaller and therefore faster to learn, thereby being better suited for small-scale exploratory studies in both software simulations and hardware prototypes. Second, it exhibits a very clear gap between the accuracies achievable using shallow as compared to deep neural networks. Third, it is easily transferable between spatial and temporal input domains, making it interesting for different types of classification scenarios.
△ Less
Submitted 4 January, 2022; v1 submitted 16 February, 2021;
originally announced February 2021.
-
Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate
Authors:
Sebastian Billaudelle,
Yannik Stradmann,
Korbinian Schreiber,
Benjamin Cramer,
Andreas Baumbach,
Dominik Dold,
Julian Göltz,
Akos F. Kungl,
Timo C. Wunderlich,
Andreas Hartel,
Eric Müller,
Oliver Breitwieser,
Christian Mauch,
Mitja Kleider,
Andreas Grübl,
David Stöckel,
Christian Pehle,
Arthur Heimbrecht,
Philipp Spilger,
Gerd Kiene,
Vitali Karasenko,
Walter Senn,
Mihai A. Petrovici,
Johannes Schemmel,
Karlheinz Meier
Abstract:
We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experi…
▽ More
We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experiments or rapid iteration over many consecutive trials. The flexibility of our architecture is demonstrated in a suite of five distinct experiments, which emphasize different aspects of the BrainScaleS-2 system.
△ Less
Submitted 9 May, 2022; v1 submitted 30 December, 2019;
originally announced December 2019.
-
Fast and energy-efficient neuromorphic deep learning with first-spike times
Authors:
Julian Göltz,
Laura Kriener,
Andreas Baumbach,
Sebastian Billaudelle,
Oliver Breitwieser,
Benjamin Cramer,
Dominik Dold,
Akos Ferenc Kungl,
Walter Senn,
Johannes Schemmel,
Karlheinz Meier,
Mihai Alexandru Petrovici
Abstract:
For a biological agent operating under environmental pressure, energy consumption and reaction times are of critical importance. Similarly, engineered systems are optimized for short time-to-solution and low energy-to-solution characteristics. At the level of neuronal implementation, this implies achieving the desired results with as few and as early spikes as possible. With time-to-first-spike co…
▽ More
For a biological agent operating under environmental pressure, energy consumption and reaction times are of critical importance. Similarly, engineered systems are optimized for short time-to-solution and low energy-to-solution characteristics. At the level of neuronal implementation, this implies achieving the desired results with as few and as early spikes as possible. With time-to-first-spike coding both of these goals are inherently emerging features of learning. Here, we describe a rigorous derivation of a learning rule for such first-spike times in networks of leaky integrate-and-fire neurons, relying solely on input and output spike times, and show how this mechanism can implement error backpropagation in hierarchical spiking networks. Furthermore, we emulate our framework on the BrainScaleS-2 neuromorphic system and demonstrate its capability of harnessing the system's speed and energy characteristics. Finally, we examine how our approach generalizes to other neuromorphic platforms by studying how its performance is affected by typical distortive effects induced by neuromorphic substrates.
△ Less
Submitted 17 May, 2021; v1 submitted 24 December, 2019;
originally announced December 2019.
