-
Predictive Coding with Spiking Neural Networks: a Survey
Authors:
Antony W. N'dri,
William Gebhardt,
Céline Teulière,
Fleur Zeldenrust,
Rajesh P. N. Rao,
Jochen Triesch,
Alexander Ororbia
Abstract:
In this article, we review a class of neuro-mimetic computational models that we place under the label of spiking predictive coding. Specifically, we review the general framework of predictive processing in the context of neurons that emit discrete action potentials, i.e., spikes. Theoretically, we structure our survey around how prediction errors are represented, which results in an organization…
▽ More
In this article, we review a class of neuro-mimetic computational models that we place under the label of spiking predictive coding. Specifically, we review the general framework of predictive processing in the context of neurons that emit discrete action potentials, i.e., spikes. Theoretically, we structure our survey around how prediction errors are represented, which results in an organization of historical neuromorphic generalizations that is centered around three broad classes of approaches: prediction errors in explicit groups of error neurons, in membrane potentials, and implicit prediction error encoding. Furthermore, we examine some applications of spiking predictive coding that utilize more energy-efficient, edge-computing hardware platforms. Finally, we highlight important future directions and challenges in this emerging line of inquiry in brain-inspired computing. Building on the prior results of work in computational cognitive neuroscience, machine intelligence, and neuromorphic engineering, we hope that this review of neuromorphic formulations and implementations of predictive coding will encourage and guide future research and development in this emerging research area.
△ Less
Submitted 9 September, 2024;
originally announced September 2024.
-
Degeneracy in epilepsy: Multiple Routes to Hyperexcitable Brain Circuits and their Repair
Authors:
Tristan Manfred Stöber,
Danylo Batulin,
Jochen Triesch,
Rishikesh Narayanan,
Peter Jedlicka
Abstract:
Developing effective therapies against epilepsy remains a challenge. The complex and multifaceted nature of this disease still fuels controversies about its origin. In this perspective article, we argue that conflicting hypotheses can be reconciled by taking into account the degeneracy of the brain, which manifests in multiple routes leading to similar function or dysfunction. We exemplify degener…
▽ More
Developing effective therapies against epilepsy remains a challenge. The complex and multifaceted nature of this disease still fuels controversies about its origin. In this perspective article, we argue that conflicting hypotheses can be reconciled by taking into account the degeneracy of the brain, which manifests in multiple routes leading to similar function or dysfunction. We exemplify degeneracy at three different levels, ranging from the cellular to the network and systems level. First, at the cellular level, we describe the relevance of ion channel degeneracy for epilepsy and discuss its interplay with dendritic morphology. Second, at the network level, we provide examples for the degeneracy of synaptic and intrinsic neuronal properties that supports the robustness of neuronal networks but also leads to diverse responses to ictogenic and epileptogenic perturbations. Third, at the system level, we provide examples for degeneracy in the intricate interactions between the immune and nervous system. Finally, we show that computational approaches including multiscale and so called population neural circuit models help disentangle the complex web of physiological and pathological adaptations. Such models may contribute to identifying the best personalized multitarget strategies for directing the system towards a physiological state.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
Staging Epileptogenesis with Deep Neural Networks
Authors:
Diyuan Lu,
Sebastian Bauer,
Valentin Neubert,
Lara Sophie Costard,
Felix Rosenow,
Jochen Triesch
Abstract:
Epilepsy is a common neurological disorder characterized by recurrent seizures accompanied by excessive synchronous brain activity. The process of structural and functional brain alterations leading to increased seizure susceptibility and eventually spontaneous seizures is called epileptogenesis (EPG) and can span months or even years. Detecting and monitoring the progression of EPG could allow fo…
▽ More
Epilepsy is a common neurological disorder characterized by recurrent seizures accompanied by excessive synchronous brain activity. The process of structural and functional brain alterations leading to increased seizure susceptibility and eventually spontaneous seizures is called epileptogenesis (EPG) and can span months or even years. Detecting and monitoring the progression of EPG could allow for targeted early interventions that could slow down disease progression or even halt its development. Here, we propose an approach for staging EPG using deep neural networks and identify potential electroencephalography (EEG) biomarkers to distinguish different phases of EPG. Specifically, continuous intracranial EEG recordings were collected from a rodent model where epilepsy is induced by electrical perforant pathway stimulation (PPS). A deep neural network (DNN) is trained to distinguish EEG signals from before stimulation (baseline), shortly after the PPS and long after the PPS but before the first spontaneous seizure (FSS). Experimental results show that our proposed method can classify EEG signals from the three phases with an average area under the curve (AUC) of 0.93, 0.89, and 0.86. To the best of our knowledge, this represents the first successful attempt to stage EPG prior to the FSS using DNNs.
△ Less
Submitted 17 June, 2020;
originally announced June 2020.
-
Non-random network connectivity comes in pairs
Authors:
Felix Z. Hoffmann,
Jochen Triesch
Abstract:
Overrepresentation of bidirectional connections in local cortical networks has been repeatedly reported and is in the focus of the ongoing discussion of non-random connectivity. Here we show in a brief mathematical analysis that in a network in which connection probabilities are symmetric in pairs, $P_{ij} = P_{ji}$, the occurrence of bidirectional connections and non-random structures are inheren…
▽ More
Overrepresentation of bidirectional connections in local cortical networks has been repeatedly reported and is in the focus of the ongoing discussion of non-random connectivity. Here we show in a brief mathematical analysis that in a network in which connection probabilities are symmetric in pairs, $P_{ij} = P_{ji}$, the occurrence of bidirectional connections and non-random structures are inherently linked; an overabundance of reciprocally connected pairs emerges necessarily when the network structure deviates from a random network in any form.
△ Less
Submitted 13 December, 2016; v1 submitted 14 September, 2016;
originally announced September 2016.
-
An active efficient coding model of the optokinetic nystagmus
Authors:
Chong Zhang,
Jochen Triesch,
Bertram E. Shi
Abstract:
Optokinetic nystagmus (OKN) is an involuntary eye movement responsible for stabilizing retinal images in the presence of relative motion between an observer and the environment. Fully understanding the development of optokinetic nystagmus requires a neurally plausible computational model that accounts for the neural development and the behavior. To date, work in this area has been limited. We prop…
▽ More
Optokinetic nystagmus (OKN) is an involuntary eye movement responsible for stabilizing retinal images in the presence of relative motion between an observer and the environment. Fully understanding the development of optokinetic nystagmus requires a neurally plausible computational model that accounts for the neural development and the behavior. To date, work in this area has been limited. We propose a neurally plausible framework for the joint development of disparity and motion tuning in the visual cortex, the optokinetic and vergence eye movements. This framework models the joint emergence of both perception and behavior, and accounts for the importance of the development of normal vergence control and binocular vision in achieving normal monocular OKN (mOKN) behaviors. Because the model includes behavior, we can simulate the same perturbations as performed in past experiments, such as artificially induced strabismus. The proposed model agrees both qualitatively and quantitatively with a number of findings from the literature on both binocular vision as well as the optokinetic reflex. Finally, our model also makes quantitative predictions about the OKN behavior using the same methods used to characterize the OKN in the experimental literature.
△ Less
Submitted 11 October, 2016; v1 submitted 21 June, 2016;
originally announced June 2016.
-
Intrinsically Motivated Learning of Visual Motion Perception and Smooth Pursuit
Authors:
Chong Zhang,
Yu Zhao,
Jochen Triesch,
Bertram E. Shi
Abstract:
We extend the framework of efficient coding, which has been used to model the development of sensory processing in isolation, to model the development of the perception/action cycle. Our extension combines sparse coding and reinforcement learning so that sensory processing and behavior co-develop to optimize a shared intrinsic motivational signal: the fidelity of the neural encoding of the sensory…
▽ More
We extend the framework of efficient coding, which has been used to model the development of sensory processing in isolation, to model the development of the perception/action cycle. Our extension combines sparse coding and reinforcement learning so that sensory processing and behavior co-develop to optimize a shared intrinsic motivational signal: the fidelity of the neural encoding of the sensory input under resource constraints. Applying this framework to a model system consisting of an active eye behaving in a time varying environment, we find that this generic principle leads to the simultaneous development of both smooth pursuit behavior and model neurons whose properties are similar to those of primary visual cortical neurons selective for different directions of visual motion. We suggest that this general principle may form the basis for a unified and integrated explanation of many perception/action loops.
△ Less
Submitted 24 February, 2014; v1 submitted 13 February, 2014;
originally announced February 2014.
