-
Brain inspired neuronal silencing mechanism to enable reliable sequence identification
Authors:
Shiri Hodassman,
Yuval Meir,
Karin Kisos,
Itamar Ben-Noam,
Yael Tugendhaft,
Amir Goldental,
Roni Vardi,
Ido Kanter
Abstract:
Real-time sequence identification is a core use-case of artificial neural networks (ANNs), ranging from recognizing temporal events to identifying verification codes. Existing methods apply recurrent neural networks, which suffer from training difficulties; however, performing this function without feedback loops remains a challenge. Here, we present an experimental neuronal long-term plasticity m…
▽ More
Real-time sequence identification is a core use-case of artificial neural networks (ANNs), ranging from recognizing temporal events to identifying verification codes. Existing methods apply recurrent neural networks, which suffer from training difficulties; however, performing this function without feedback loops remains a challenge. Here, we present an experimental neuronal long-term plasticity mechanism for high-precision feedforward sequence identification networks (ID-nets) without feedback loops, wherein input objects have a given order and timing. This mechanism temporarily silences neurons following their recent spiking activity. Therefore, transitory objects act on different dynamically created feedforward sub-networks. ID-nets are demonstrated to reliably identify 10 handwritten digit sequences, and are generalized to deep convolutional ANNs with continuous activation nodes trained on image sequences. Counterintuitively, their classification performance, even with a limited number of training examples, is high for sequences but low for individual objects. ID-nets are also implemented for writer-dependent recognition, and suggested as a cryptographic tool for encrypted authentication. The presented mechanism opens new horizons for advanced ANN algorithms.
△ Less
Submitted 2 October, 2022; v1 submitted 24 March, 2022;
originally announced March 2022.
-
Long anisotropic absolute refractory periods with rapid rise-times to reliable responsiveness
Authors:
Shira Sardi,
Roni Vardi,
Yael Tugendhaft,
Anton Sheinin,
Amir Goldental,
Ido Kanter
Abstract:
Refractoriness is a fundamental property of excitable elements, such as neurons, indicating the probability for re-excitation in a given time-lag, and is typically linked to the neuronal hyperpolarization following an evoked spike. Here we measured the refractory periods (RPs) in neuronal cultures and observed that an average anisotropic absolute RP could exceed 10 milliseconds and its tail 20 mil…
▽ More
Refractoriness is a fundamental property of excitable elements, such as neurons, indicating the probability for re-excitation in a given time-lag, and is typically linked to the neuronal hyperpolarization following an evoked spike. Here we measured the refractory periods (RPs) in neuronal cultures and observed that an average anisotropic absolute RP could exceed 10 milliseconds and its tail 20 milliseconds, independent of a large stimulation frequency range. It is an order of magnitude longer than anticipated and comparable with the decaying membrane potential timescale. It is followed by a sharp rise-time (relative RP) of merely ~1 millisecond to complete responsiveness. Extracellular stimulations result in longer absolute RPs than solely intracellular ones, and a pair of extracellular stimulations from two different routes exhibits distinct absolute RPs, depending on their order. Our results indicate that a neuron is an accurate excitable element, where the diverse RPs cannot be attributed solely to the soma and imply fast mutual interactions between different stimulation routes and dendrites. Further elucidation of neuronal computational capabilities and their interplay with adaptation mechanisms is warranted.
△ Less
Submitted 3 January, 2022; v1 submitted 4 November, 2021;
originally announced November 2021.
-
Significant anisotropic neuronal refractory period plasticity
Authors:
Roni Vardi,
Yael Tugendhaft,
Shira Sardi,
Ido Kanter
Abstract:
Refractory periods are an unavoidable feature of excitable elements, resulting in necessary time-lags for re-excitation. Herein, we measure neuronal absolute refractory periods (ARPs) in synaptic blocked neuronal cultures. In so doing, we show that their duration can be significantly extended by dozens of milliseconds using preceding evoked spikes generated by extracellular stimulations. The ARP i…
▽ More
Refractory periods are an unavoidable feature of excitable elements, resulting in necessary time-lags for re-excitation. Herein, we measure neuronal absolute refractory periods (ARPs) in synaptic blocked neuronal cultures. In so doing, we show that their duration can be significantly extended by dozens of milliseconds using preceding evoked spikes generated by extracellular stimulations. The ARP increases with the frequency of preceding stimulations, and saturates at the intermittent phase of the neuronal response latency, where a short relative refractory period might appear. Nevertheless, preceding stimulations via a different extracellular route does not affect the ARP. It is also found to be independent of preceding intracellular stimulations. All these features strongly suggest that the anisotropic ARPs originate in neuronal dendrites. The results demonstrate the fast and significant plasticity of the neuronal ARP, depending on the firing activity of its connecting neurons, which is expected to affect network dynamics.
△ Less
Submitted 5 September, 2021;
originally announced September 2021.
-
Brain experiments imply adaptation mechanisms which outperform common AI learning algorithms
Authors:
Shira Sardi,
Roni Vardi,
Yuval Meir,
Yael Tugendhaft,
Shiri Hodassman,
Amir Goldental,
Ido Kanter
Abstract:
Attempting to imitate the brain functionalities, researchers have bridged between neuroscience and artificial intelligence for decades; however, experimental neuroscience has not directly advanced the field of machine learning. Here, using neuronal cultures, we demonstrate that increased training frequency accelerates the neuronal adaptation processes. This mechanism was implemented on artificial…
▽ More
Attempting to imitate the brain functionalities, researchers have bridged between neuroscience and artificial intelligence for decades; however, experimental neuroscience has not directly advanced the field of machine learning. Here, using neuronal cultures, we demonstrate that increased training frequency accelerates the neuronal adaptation processes. This mechanism was implemented on artificial neural networks, where a local learning step-size increases for coherent consecutive learning steps and tested on a simple dataset of handwritten digits, MNIST. Based on our online learning results with a few handwriting examples, success rates for brain-inspired algorithms substantially outperform the commonly used machine learning algorithms. We speculate this emerging bridge from slow brain function to machine learning will promote ultrafast decision making under limited examples, which is the reality in many aspects of human activity, robotic control, and network optimization.
△ Less
Submitted 23 April, 2020;
originally announced May 2020.
