-
Memcapacitive neural networks
Authors:
Y. V. Pershin,
M. Di Ventra
Abstract:
We show that memcapacitive (memory capacitive) systems can be used as synapses in artificial neural networks. As an example of our approach, we discuss the architecture of an integrate-and-fire neural network based on memcapacitive synapses. Moreover, we demonstrate that the spike-timing-dependent plasticity can be simply realized with some of these devices. Memcapacitive synapses are a low-energy…
▽ More
We show that memcapacitive (memory capacitive) systems can be used as synapses in artificial neural networks. As an example of our approach, we discuss the architecture of an integrate-and-fire neural network based on memcapacitive synapses. Moreover, we demonstrate that the spike-timing-dependent plasticity can be simply realized with some of these devices. Memcapacitive synapses are a low-energy alternative to memristive synapses for neuromorphic computation.
△ Less
Submitted 26 July, 2013;
originally announced July 2013.
-
Memory models of adaptive behaviour
Authors:
Fabio Lorenzo Traversa,
Yuriy V. Pershin,
Massimiliano Di Ventra
Abstract:
Adaptive response to a varying environment is a common feature of biological organisms. Reproducing such features in electronic systems and circuits is of great importance for a variety of applications. Here, we consider memory models inspired by an intriguing ability of slime molds to both memorize the period of temperature and humidity variations, and anticipate the next variations to come, when…
▽ More
Adaptive response to a varying environment is a common feature of biological organisms. Reproducing such features in electronic systems and circuits is of great importance for a variety of applications. Here, we consider memory models inspired by an intriguing ability of slime molds to both memorize the period of temperature and humidity variations, and anticipate the next variations to come, when appropriately trained. Effective circuit models of such behavior are designed using i) a set of LC-contours with memristive damping, and ii) a single memcapacitive system-based adaptive contour with memristive damping. We consider these two approaches in detail by comparing their results and predictions. Finally, possible biological experiments that would discriminate between the models are discussed. In this work, we also introduce an effective description of certain memory circuit elements.
△ Less
Submitted 1 May, 2013; v1 submitted 2 January, 2013;
originally announced January 2013.
-
Memcomputing: a computing paradigm to store and process information on the same physical platform
Authors:
M. Di Ventra,
Y. V. Pershin
Abstract:
In present day technology, storing and processing of information occur on physically distinct regions of space. Not only does this result in space limitations; it also translates into unwanted delays in retrieving and processing of relevant information. There is, however, a class of two-terminal passive circuit elements with memory, memristive, memcapacitive and meminductive systems -- collectivel…
▽ More
In present day technology, storing and processing of information occur on physically distinct regions of space. Not only does this result in space limitations; it also translates into unwanted delays in retrieving and processing of relevant information. There is, however, a class of two-terminal passive circuit elements with memory, memristive, memcapacitive and meminductive systems -- collectively called memelements -- that perform both information processing and storing of the initial, intermediate and final computational data on the same physical platform. Importantly, the states of these memelements adjust to input signals and provide analog capabilities unavailable in standard circuit elements, resulting in adaptive circuitry, and providing analog massively-parallel computation. All these features are tantalizingly similar to those encountered in the biological realm, thus offering new opportunities for biologically-inspired computation. Of particular importance is the fact that these memelements emerge naturally in nanoscale systems, and are therefore a consequence and a natural by-product of the continued miniaturization of electronic devices. We will discuss the various possibilities offered by memcomputing, discuss the criteria that need to be satisfied to realize this paradigm, and provide an example showing the solution of the shortest-path problem and demonstrate the healing property of the solution path.
△ Less
Submitted 7 April, 2013; v1 submitted 19 November, 2012;
originally announced November 2012.
-
Biologically-Inspired Electronics with Memory Circuit Elements
Authors:
M. Di Ventra,
Y. V. Pershin
Abstract:
Several abilities of biological systems, such as adaptation to natural environment, or of animals to learn patterns when appropriately trained, are features that are extremely useful, if emulated by electronic circuits, in applications ranging from robotics to solution of complex optimization problems, traffic control, etc. In this chapter, we discuss several examples of biologically-inspired circ…
▽ More
Several abilities of biological systems, such as adaptation to natural environment, or of animals to learn patterns when appropriately trained, are features that are extremely useful, if emulated by electronic circuits, in applications ranging from robotics to solution of complex optimization problems, traffic control, etc. In this chapter, we discuss several examples of biologically-inspired circuits that take advantage of memory circuit elements, namely, electronic elements whose resistive, capacitive or inductive characteristics depend on their past dynamics. We provide several illustrations of what can be accomplished with these elements including learning circuits and related adaptive filters, neuromorphic and cellular computing circuits, analog massively-parallel computation architectures, etc. We also give examples of experimental realizations of memory circuit elements and discuss opportunities and challenges in this new field.
△ Less
Submitted 21 December, 2011;
originally announced December 2011.
-
Neuromorphic, Digital and Quantum Computation with Memory Circuit Elements
Authors:
Yuriy V. Pershin,
Massimiliano Di Ventra
Abstract:
Memory effects are ubiquitous in nature and the class of memory circuit elements - which includes memristors, memcapacitors and meminductors - shows great potential to understand and simulate the associated fundamental physical processes. Here, we show that such elements can also be used in electronic schemes mimicking biologically-inspired computer architectures, performing digital logic and arit…
▽ More
Memory effects are ubiquitous in nature and the class of memory circuit elements - which includes memristors, memcapacitors and meminductors - shows great potential to understand and simulate the associated fundamental physical processes. Here, we show that such elements can also be used in electronic schemes mimicking biologically-inspired computer architectures, performing digital logic and arithmetic operations, and can expand the capabilities of certain quantum computation schemes. In particular, we will discuss few examples where the concept of memory elements is relevant to the realization of associative memory in neuronal circuits, spike-timing-dependent plasticity of synapses, digital and field-programmable quantum computing.
△ Less
Submitted 28 September, 2011; v1 submitted 29 September, 2010;
originally announced September 2010.
-
Experimental demonstration of associative memory with memristive neural networks
Authors:
Yuriy V. Pershin,
Massimiliano Di Ventra
Abstract:
When someone mentions the name of a known person we immediately recall her face and possibly many other traits. This is because we possess the so-called associative memory, that is the ability to correlate different memories to the same fact or event. Associative memory is such a fundamental and encompassing human ability (and not just human) that the network of neurons in our brain must perform…
▽ More
When someone mentions the name of a known person we immediately recall her face and possibly many other traits. This is because we possess the so-called associative memory, that is the ability to correlate different memories to the same fact or event. Associative memory is such a fundamental and encompassing human ability (and not just human) that the network of neurons in our brain must perform it quite easily. The question is then whether electronic neural networks (electronic schemes that act somewhat similarly to human brains) can be built to perform this type of function. Although the field of neural networks has developed for many years, a key element, namely the synapses between adjacent neurons, has been lacking a satisfactory electronic representation. The reason for this is that a passive circuit element able to reproduce the synapse behaviour needs to remember its past dynamical history, store a continuous set of states, and be "plastic" according to the pre-synaptic and post-synaptic neuronal activity. Here we show that all this can be accomplished by a memory-resistor (memristor for short). In particular, by using simple and inexpensive off-the-shelf components we have built a memristor emulator which realizes all required synaptic properties. Most importantly, we have demonstrated experimentally the formation of associative memory in a simple neural network consisting of three electronic neurons connected by two memristor-emulator synapses. This experimental demonstration opens up new possibilities in the understanding of neural processes using memory devices, an important step forward to reproduce complex learning, adaptive and spontaneous behaviour with electronic neural networks.
△ Less
Submitted 17 January, 2010; v1 submitted 18 May, 2009;
originally announced May 2009.
-
Memristive model of amoeba's learning
Authors:
Yuriy V. Pershin,
Steven La Fontaine,
Massimiliano Di Ventra
Abstract:
Recently, it was shown that the amoeba-like cell {\it Physarum polycephalum} when exposed to a pattern of periodic environmental changes learns and adapts its behavior in anticipation of the next stimulus to come. Here we show that such behavior can be mapped into the response of a simple electronic circuit consisting of an $LC$ contour and a memory-resistor (a memristor) to a train of voltage p…
▽ More
Recently, it was shown that the amoeba-like cell {\it Physarum polycephalum} when exposed to a pattern of periodic environmental changes learns and adapts its behavior in anticipation of the next stimulus to come. Here we show that such behavior can be mapped into the response of a simple electronic circuit consisting of an $LC$ contour and a memory-resistor (a memristor) to a train of voltage pulses that mimic environment changes. We also identify a possible biological origin of the memristive behavior in the cell. These biological memory features are likely to occur in other unicellular as well as multicellular organisms, albeit in different forms. Therefore, the above memristive circuit model, which has learning properties, is useful to better understand the origins of primitive intelligence.
△ Less
Submitted 26 July, 2009; v1 submitted 22 October, 2008;
originally announced October 2008.
