-
Entropy-statistical approach to phase-locking detection of pulse oscillations: application for the analysis of biosignal synchronization
Authors:
Petr Boriskov,
Vadim Putrolaynen,
Andrei Velichko,
Kristina Peltonen
Abstract:
In this study a new method for analyzing synchronization in oscillator systems is proposed using the example of modeling the dynamics of a circuit of two resistively coupled pulse oscillators. The dynamic characteristic of synchronization is fuzzy entropy (FuzzyEn) calculated a time series composed of the ratios of the number of pulse periods (subharmonic ratio, SHR) during phase-locking intervals…
▽ More
In this study a new method for analyzing synchronization in oscillator systems is proposed using the example of modeling the dynamics of a circuit of two resistively coupled pulse oscillators. The dynamic characteristic of synchronization is fuzzy entropy (FuzzyEn) calculated a time series composed of the ratios of the number of pulse periods (subharmonic ratio, SHR) during phase-locking intervals. Low entropy values indicate strong synchronization, whereas high entropy values suggest weak synchronization between the two oscillators. This method effectively visualizes synchronized modes of the circuit using entropy maps of synchronization states. Additionally, a classification of synchronization states is proposed based on the dependencies of FuzzyEn on the length of embedding vectors of SHR time series. An extension of this method for analyzing non-relaxation (non-spike) type signals is illustrated using the example of phase-phase coupling rhythms of local field potential of rat hippocampus. The entropy-statistical approach using rational fractions and pulse signal forms makes this method promising for analyzing biosignal synchronization and implementing the algorithm in mobile digital platforms.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
A Bio-Inspired Chaos Sensor Model Based on the Perceptron Neural Network: Machine Learning Concept and Application for Computational Neuro-Science
Authors:
Andrei Velichko,
Petr Boriskov,
Maksim Belyaev,
Vadim Putrolaynen
Abstract:
The study presents a bio-inspired chaos sensor model based on the perceptron neural network for the estimation of entropy of spike train in neurodynamic systems. After training, the sensor on perceptron, having 50 neurons in the hidden layer and 1 neuron at the output, approximates the fuzzy entropy of a short time series with high accuracy, with a determination coefficient of R2 ~ 0.9. The Hindma…
▽ More
The study presents a bio-inspired chaos sensor model based on the perceptron neural network for the estimation of entropy of spike train in neurodynamic systems. After training, the sensor on perceptron, having 50 neurons in the hidden layer and 1 neuron at the output, approximates the fuzzy entropy of a short time series with high accuracy, with a determination coefficient of R2 ~ 0.9. The Hindmarsh-Rose spike model was used to generate time series of spike intervals, and datasets for training and testing the perceptron. The selection of the hyperparameters of the perceptron model and the estimation of the sensor accuracy were performed using the K-block cross-validation method. Even for a hidden layer with one neuron, the model approximates the fuzzy entropy with good results and the metric R2 ~ 0.5-0.8. In a simplified model with one neuron and equal weights in the first layer, the principle of approximation is based on the linear transformation of the average value of the time series into the entropy value. An example of using the chaos sensor on spike train of action potential recordings from the L5 dorsal rootlet of rat is provided. The bio-inspired chaos sensor model based on an ensemble of neurons is able to dynamically track the chaotic behavior of a spike signal and transmit this information to other parts of the neurodynamic model for further processing. The study will be useful for specialists in the field of computational neuroscience, and also to create humanoid and animal robots, and bio-robots with limited resources.
△ Less
Submitted 15 August, 2023; v1 submitted 2 June, 2023;
originally announced June 2023.
-
Electrical conductivity of vanadium dioxide switching channel
Authors:
Alexander Pergament,
Petr Boriskov,
Nikolai Kuldin,
Andrei Velichko
Abstract:
The electrical conductivity of the switching channel of vanadium dioxide thin-film sandwich structures is studied over a wide temperature range (15-300 K). It is shown that the electrical resistance of the channel varies with temperature as R~exp(aT-b/T) in the high-temperature region (above 70 K). The experimental results are discussed from the viewpoint of the small polaron hopping conduction th…
▽ More
The electrical conductivity of the switching channel of vanadium dioxide thin-film sandwich structures is studied over a wide temperature range (15-300 K). It is shown that the electrical resistance of the channel varies with temperature as R~exp(aT-b/T) in the high-temperature region (above 70 K). The experimental results are discussed from the viewpoint of the small polaron hopping conduction theory which takes into account the influence of thermal lattice vibrations onto the resonance integral.
△ Less
Submitted 8 January, 2020;
originally announced January 2020.
-
Oscillator Circuit for Spike Neural Network with Sigmoid Like Activation Function and Firing Rate Coding
Authors:
Andrei Velichko,
Petr Boriskov
Abstract:
The study presents an oscillator circuit for a spike neural network with the possibility of firing rate coding and sigmoid-like activation function. The circuit contains a switching element with an S-shaped current-voltage characteristic and two capacitors; one of the capacitors is shunted by a control resistor. The circuit is characterised by a strong dependence of the frequency of relaxation osc…
▽ More
The study presents an oscillator circuit for a spike neural network with the possibility of firing rate coding and sigmoid-like activation function. The circuit contains a switching element with an S-shaped current-voltage characteristic and two capacitors; one of the capacitors is shunted by a control resistor. The circuit is characterised by a strong dependence of the frequency of relaxation oscillations on the magnitude of the control resistor. The dependence has a sigmoid-like form and we present an analytical method for dependence calculation. Finally, we describe the concept of the spike neural network architecture with firing rate coding based on the presented circuit for creating neuromorphic devices and artificial intelligence.
△ Less
Submitted 23 November, 2019;
originally announced November 2019.
-
Switch Elements with S-Shaped Current-Voltage Characteristic in Models of Neural Oscillators
Authors:
Petr Boriskov,
Andrei Velichko
Abstract:
In this paper, we present circuit solutions based on a switch element with the S-type I-V characteristic implemented using the classic FitzHugh-Nagumo and FitzHugh-Rinzel models. Using the proposed simplified electrical circuits allows the modeling of the integrate-and-fire neuron and burst oscillation modes with the emulation of the mammalian cold receptor patterns. The circuits were studied usin…
▽ More
In this paper, we present circuit solutions based on a switch element with the S-type I-V characteristic implemented using the classic FitzHugh-Nagumo and FitzHugh-Rinzel models. Using the proposed simplified electrical circuits allows the modeling of the integrate-and-fire neuron and burst oscillation modes with the emulation of the mammalian cold receptor patterns. The circuits were studied using the experimental I-V characteristic of an NbO2 switch with a stable section of negative differential resistance (NDR) and a VO2 switch with an unstable NDR, considering the temperature dependences of the threshold characteristics. The results are relevant for modern neuroelectronics and have practical significance for the introduction of the neurodynamic models in circuit design and the brain-machine interface. The proposed systems of differential equations with the piecewise linear approximation of the S-type I-V characteristic may be of scientific interest for further analytical and numerical research and development of neural networks with artificial intelligence.
△ Less
Submitted 23 August, 2019; v1 submitted 8 July, 2019;
originally announced August 2019.
-
A Model of an Oscillatory Neural Network with Multilevel Neurons for Pattern Recognition and Computing
Authors:
Andrei Velichko,
Maksim Belyaev,
Petr Boriskov
Abstract:
The current study uses a novel method of multilevel neurons and high order synchronization effects described by a family of special metrics, for pattern recognition in an oscillatory neural network (ONN). The output oscillator (neuron) of the network has multilevel variations in its synchronization value with the reference oscillator, and allows classification of an input pattern into a set of cla…
▽ More
The current study uses a novel method of multilevel neurons and high order synchronization effects described by a family of special metrics, for pattern recognition in an oscillatory neural network (ONN). The output oscillator (neuron) of the network has multilevel variations in its synchronization value with the reference oscillator, and allows classification of an input pattern into a set of classes. The ONN model is implemented on thermally-coupled vanadium dioxide oscillators. The ONN is trained by the simulated annealing algorithm for selection of the network parameters. The results demonstrate that ONN is capable of classifying 512 visual patterns (as a cell array 3 * 3, distributed by symmetry into 102 classes) into a set of classes with a maximum number of elements up to fourteen. The classification capability of the network depends on the interior noise level and synchronization effectiveness parameter. The model allows for designing multilevel output cascades of neural networks with high net data throughput. The presented method can be applied in ONNs with various coupling mechanisms and oscillator topology.
△ Less
Submitted 23 August, 2019; v1 submitted 8 June, 2018;
originally announced June 2018.
-
Method of increasing the information capacity of associative memory of oscillator neural networks using high-order synchronization effect
Authors:
Andrei Velichko,
Maksim Belyaev,
Vadim Putrolaynen,
Petr Boriskov
Abstract:
Computational modelling of two- and three-oscillator schemes with thermally coupled $VO_2$-switches is used to demonstrate a novel method of pattern storage and recognition in an impulse oscillator neural network (ONN) based on the high-order synchronization effect. The method ensures high information capacity of associative memory, i.e. a large number of synchronous states $N_s$. Each state in th…
▽ More
Computational modelling of two- and three-oscillator schemes with thermally coupled $VO_2$-switches is used to demonstrate a novel method of pattern storage and recognition in an impulse oscillator neural network (ONN) based on the high-order synchronization effect. The method ensures high information capacity of associative memory, i.e. a large number of synchronous states $N_s$. Each state in the system is characterized by the synchronization order determined as the ratio of harmonics number at the common synchronization frequency. The modelling demonstrates attainment of $N_s$ of several orders both for a three-oscillator scheme $N_s$~650 and for a two-oscillator scheme $N_s$~260. A number of regularities are obtained, in particular, an optimal strength of oscillator coupling is revealed when $N_s$ has a maximum. A general tendency toward information capacity decrease is shown when the coupling strength and switch inner noise amplitude increase. An algorithm of pattern storage and test vector recognition is suggested. It is also shown that the coordinate number in each vector should be one less than the switch number to reduce recognition ambiguity. The demonstrated method of associative memory realization is a general one and it may be applied in ONNs with various mechanisms and oscillator coupling topology.
△ Less
Submitted 14 May, 2018;
originally announced May 2018.
-
Metal-insulator transition in electric field: A viewpoint from the switching effect
Authors:
P. P. Boriskov,
A. L. Pergament,
A. A. Velichko,
G. B. Stefanovich,
N. A. Kuldin
Abstract:
The proposed switching mechanism is based on an electronically-induced metal-insulator transition occurring in conditions of the excess non-equilibrium carrier density under the applied electric field. First, this mechanism is developed on the basis of a phenomenological approach. This model not only allows the qualitative description of the switching mechanism, but it is in quantitative agreeme…
▽ More
The proposed switching mechanism is based on an electronically-induced metal-insulator transition occurring in conditions of the excess non-equilibrium carrier density under the applied electric field. First, this mechanism is developed on the basis of a phenomenological approach. This model not only allows the qualitative description of the switching mechanism, but it is in quantitative agreement with the experimental results, in particular, with those concerning the critical concentration and threshold field. The mechanism takes into account the dependence of the carrier density on electric field, as well as the scaling of the critical field. Next, we show that such a 'macroscopic' approach can be supported by some microscopic model. The quintessence of this approach consists in the fact that an electronically induced metal-insulator transition may be described in terms of Bardeen-Cooper-Schrieffer (BCS) formalism developed earlier for the charge density wave concept. It is shown that for the combination of both the types of interaction (electron-electron and electron-phonon), the formation of a collective excitation - an electron crystal of charge density wave - in the model of exciton insulator is possible, which, in a general case, can also be accompanied by a structural transition. The results for vanadium dioxide are examined within the frameworks of the developed approach.
△ Less
Submitted 6 March, 2006;
originally announced March 2006.
