-
Compensation of anisotropy in spin-Hall devices for neuromorphic applications
Authors:
Pankaj Sethi,
Dédalo Sanz-Hernández,
Florian Godel,
Sachin Krishnia,
Fernando Ajejas,
Alice Mizrahi,
Vincent Cros,
Danijela Marković,
Julie Grollier
Abstract:
Spintronic nano-oscillators with reduced non-linearity could offer key benefits for realizing neuromorphic applications such as spike-based neurons and frequency multiplexing in neural networks. Here, we experimentally demonstrate the reduction in non-linearity of a spin-Hall nano-oscillator (SHNO) by compensation of its effective magnetic anisotropy. The study involves optimization of Co/Ni multi…
▽ More
Spintronic nano-oscillators with reduced non-linearity could offer key benefits for realizing neuromorphic applications such as spike-based neurons and frequency multiplexing in neural networks. Here, we experimentally demonstrate the reduction in non-linearity of a spin-Hall nano-oscillator (SHNO) by compensation of its effective magnetic anisotropy. The study involves optimization of Co/Ni multilayer growth to achieve the compensation, followed by spin diode measurements on patterned microstrips to quantify their anisotropy. The relation between the second ($H_{k2}$ = 0.47 mT) and the first order ($H_{k1}^{eff}$ = $-$0.8 mT) anisotropy fields reveals the existence of an easy cone, thereby validating the presence of compensation. Furthermore, we demonstrate a synapse based on the compensated spin diode which has a fixed frequency when the input power is varied. We then study the current-induced auto-oscillation properties of SHNOs on compensated films by patterning nano-constrictions of widths 200 and 100 nm. The invariance of the resonance frequency and linewidth of the compensated SHNO with applied dc current indicates the absence of non-linearity. This independence is maintained irrespective of the applied external fields and its orientations. The compensated SHNO obtained has a linewidth of 1.1 MHz and a peak output power of up to 1 pW/MHz emulating a nano-neuron with a low linewidth and a fixed frequency.
△ Less
Submitted 10 January, 2023;
originally announced January 2023.
-
Classification of multi-frequency RF signals by extreme learning, using magnetic tunnel junctions as neurons and synapses
Authors:
Nathan Leroux,
Danijela Marković,
Dédalo Sanz-Hernández,
Juan Trastoy,
Paolo Bortolotti,
Alejandro Schulman,
Luana Benetti,
Alex Jenkins,
Ricardo Ferreira,
Julie Grollier,
Alice Mizrahi
Abstract:
Extracting information from radiofrequency (RF) signals using artificial neural networks at low energy cost is a critical need for a wide range of applications from radars to health. These RF inputs are composed of multiples frequencies. Here we show that magnetic tunnel junctions can process analogue RF inputs with multiple frequencies in parallel and perform synaptic operations. Using a backprop…
▽ More
Extracting information from radiofrequency (RF) signals using artificial neural networks at low energy cost is a critical need for a wide range of applications from radars to health. These RF inputs are composed of multiples frequencies. Here we show that magnetic tunnel junctions can process analogue RF inputs with multiple frequencies in parallel and perform synaptic operations. Using a backpropagation-free method called extreme learning, we classify noisy images encoded by RF signals, using experimental data from magnetic tunnel junctions functioning as both synapses and neurons. We achieve the same accuracy as an equivalent software neural network. These results are a key step for embedded radiofrequency artificial intelligence.
△ Less
Submitted 20 April, 2023; v1 submitted 2 November, 2022;
originally announced November 2022.
-
Quantum reservoir neural network implementation on coherently coupled quantum oscillators
Authors:
Julien Dudas,
Baptiste Carles,
Erwan Plouet,
Alice Mizrahi,
Julie Grollier,
Danijela Marković
Abstract:
Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators inst…
▽ More
Quantum reservoir computing is a promising approach for quantum neural networks, capable of solving hard learning tasks on both classical and quantum input data. However, current approaches with qubits suffer from limited connectivity. We propose an implementation for quantum reservoir that obtains a large number of densely connected neurons by using parametrically coupled quantum oscillators instead of physically coupled qubits. We analyse a specific hardware implementation based on superconducting circuits: with just two coupled quantum oscillators, we create a quantum reservoir comprising up to 81 neurons. We obtain state-of-the-art accuracy of 99 % on benchmark tasks that otherwise require at least 24 classical oscillators to be solved. Our results give the coupling and dissipation requirements in the system and show how they affect the performance of the quantum reservoir. Beyond quantum reservoir computing, the use of parametrically coupled bosonic modes holds promise for realizing large quantum neural network architectures, with billions of neurons implemented with only 10 coupled quantum oscillators.
△ Less
Submitted 2 May, 2023; v1 submitted 7 September, 2022;
originally announced September 2022.
-
Convolutional Neural Networks with Radio-Frequency Spintronic Nano-Devices
Authors:
Nathan Leroux,
Arnaud De Riz,
Dédalo Sanz-Hernández,
Danijela Marković,
Alice Mizrahi,
Julie Grollier
Abstract:
Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/O…
▽ More
Convolutional neural networks are state-of-the-art and ubiquitous in modern signal processing and machine vision. Nowadays, hardware solutions based on emerging nanodevices are designed to reduce the power consumption of these networks. Spintronics devices are promising for information processing because of the various neural and synaptic functionalities they offer. However, due to their low OFF/ON ratio, performing all the multiplications required for convolutions in a single step with a crossbar array of spintronic memories would cause sneak-path currents. Here we present an architecture where synaptic communications have a frequency selectivity that prevents crosstalk caused by sneak-path currents. We first demonstrate how a chain of spintronic resonators can function as synapses and make convolutions by sequentially rectifying radio-frequency signals encoding consecutive sets of inputs. We show that a parallel implementation is possible with multiple chains of spintronic resonators to avoid storing intermediate computational steps in memory. We propose two different spatial arrangements for these chains. For each of them, we explain how to tune many artificial synapses simultaneously, exploiting the synaptic weight sharing specific to convolutions. We show how information can be transmitted between convolutional layers by using spintronic oscillators as artificial microwave neurons. Finally, we simulate a network of these radio-frequency resonators and spintronic oscillators to solve the MNIST handwritten digits dataset, and obtain results comparable to software convolutional neural networks. Since it can run convolutional neural networks fully in parallel in a single step with nano devices, the architecture proposed in this paper is promising for embedded applications requiring machine vision, such as autonomous driving.
△ Less
Submitted 9 November, 2021;
originally announced November 2021.
-
2022 Roadmap on Neuromorphic Computing and Engineering
Authors:
Dennis V. Christensen,
Regina Dittmann,
Bernabé Linares-Barranco,
Abu Sebastian,
Manuel Le Gallo,
Andrea Redaelli,
Stefan Slesazeck,
Thomas Mikolajick,
Sabina Spiga,
Stephan Menzel,
Ilia Valov,
Gianluca Milano,
Carlo Ricciardi,
Shi-Jun Liang,
Feng Miao,
Mario Lanza,
Tyler J. Quill,
Scott T. Keene,
Alberto Salleo,
Julie Grollier,
Danijela Marković,
Alice Mizrahi,
Peng Yao,
J. Joshua Yang,
Giacomo Indiveri
, et al. (34 additional authors not shown)
Abstract:
Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exas…
▽ More
Modern computation based on the von Neumann architecture is today a mature cutting-edge science. In the Von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exascale with 1018 calculations each second. Even though these future computers will be incredibly powerful, if they are based on von Neumann type architectures, they will consume between 20 and 30 megawatts of power and will not have intrinsic physically built-in capabilities to learn or deal with complex data as our brain does. These needs can be addressed by neuromorphic computing systems which are inspired by the biological concepts of the human brain. This new generation of computers has the potential to be used for the storage and processing of large amounts of digital information with much lower power consumption than conventional processors. Among their potential future applications, an important niche is moving the control from data centers to edge devices.
The aim of this Roadmap is to present a snapshot of the present state of neuromorphic technology and provide an opinion on the challenges and opportunities that the future holds in the major areas of neuromorphic technology, namely materials, devices, neuromorphic circuits, neuromorphic algorithms, applications, and ethics. The Roadmap is a collection of perspectives where leading researchers in the neuromorphic community provide their own view about the current state and the future challenges. We hope that this Roadmap will be a useful resource to readers outside this field, for those who are just entering the field, and for those who are well established in the neuromorphic community.
https://doi.org/10.1088/2634-4386/ac4a83
△ Less
Submitted 13 January, 2022; v1 submitted 12 May, 2021;
originally announced May 2021.
-
Hardware realization of the multiply and accumulate operation on radio-frequency signals with magnetic tunnel junctions
Authors:
Nathan Leroux,
Alice Mizrahi,
Danijela Markovic,
Dedalo Sanz-Hernandez,
Juan Trastoy,
Paolo Bortolotti,
Leandro Martins,
Alex Jenkins,
Ricardo Ferreira,
Julie Grollier
Abstract:
Artificial neural networks are a valuable tool for radio-frequency (RF) signal classification in many applications, but digitization of analog signals and the use of general purpose hardware non-optimized for training make the process slow and energetically costly. Recent theoretical work has proposed to use nano-devices called magnetic tunnel junctions, which exhibit intrinsic RF dynamics, to imp…
▽ More
Artificial neural networks are a valuable tool for radio-frequency (RF) signal classification in many applications, but digitization of analog signals and the use of general purpose hardware non-optimized for training make the process slow and energetically costly. Recent theoretical work has proposed to use nano-devices called magnetic tunnel junctions, which exhibit intrinsic RF dynamics, to implement in hardware the Multiply and Accumulate (MAC) operation, a key building block of neural networks, directly using analogue RF signals. In this article, we experimentally demonstrate that a magnetic tunnel junction can perform multiplication of RF powers, with tunable positive and negative synaptic weights. Using two magnetic tunnel junctions connected in series we demonstrate the MAC operation and use it for classification of RF signals. These results open the path to embedded systems capable of analyzing RF signals with neural networks directly after the antenna, at low power cost and high speed.
△ Less
Submitted 14 April, 2021; v1 submitted 22 March, 2021;
originally announced March 2021.
-
Radio-Frequency Multiply-And-Accumulate Operations with Spintronic Synapses
Authors:
N. Leroux,
D. Marković,
E. Martin,
T. Petrisor,
D. Querlioz,
A. Mizrahi,
J. Grollier
Abstract:
Exploiting the physics of nanoelectronic devices is a major lead for implementing compact, fast, and energy efficient artificial intelligence. In this work, we propose an original road in this direction, where assemblies of spintronic resonators used as artificial synapses can classify an-alogue radio-frequency signals directly without digitalization. The resonators convert the ra-dio-frequency in…
▽ More
Exploiting the physics of nanoelectronic devices is a major lead for implementing compact, fast, and energy efficient artificial intelligence. In this work, we propose an original road in this direction, where assemblies of spintronic resonators used as artificial synapses can classify an-alogue radio-frequency signals directly without digitalization. The resonators convert the ra-dio-frequency input signals into direct voltages through the spin-diode effect. In the process, they multiply the input signals by a synaptic weight, which depends on their resonance fre-quency. We demonstrate through physical simulations with parameters extracted from exper-imental devices that frequency-multiplexed assemblies of resonators implement the corner-stone operation of artificial neural networks, the Multiply-And-Accumulate (MAC), directly on microwave inputs. The results show that even with a non-ideal realistic model, the outputs obtained with our architecture remain comparable to that of a traditional MAC operation. Us-ing a conventional machine learning framework augmented with equations describing the physics of spintronic resonators, we train a single layer neural network to classify radio-fre-quency signals encoding 8x8 pixel handwritten digits pictures. The spintronic neural network recognizes the digits with an accuracy of 99.96 %, equivalent to purely software neural net-works. This MAC implementation offers a promising solution for fast, low-power radio-fre-quency classification applications, and a new building block for spintronic deep neural net-works.
△ Less
Submitted 5 April, 2021; v1 submitted 16 November, 2020;
originally announced November 2020.
-
Wireless communication between two magnetic tunnel junctions acting as oscillator and diode
Authors:
Danijela Marković,
Nathan Leroux,
Alice Mizrahi,
Juan Trastoy,
Vincent Cros,
Paolo Bortolotti,
Leandro Martins,
Alex Jenkins,
Ricardo Ferreira,
Julie Grollier
Abstract:
Magnetic tunnel junctions are nanoscale spintronic devices with microwave generation and detection capabilities. Here we use the rectification effect called "spin-diode" in a magnetic tunnel junction to wirelessly detect the microwave emission of another junction in the auto-oscillatory regime. We show that the rectified spin-diode voltage measured at the receiving junction end can be reconstructe…
▽ More
Magnetic tunnel junctions are nanoscale spintronic devices with microwave generation and detection capabilities. Here we use the rectification effect called "spin-diode" in a magnetic tunnel junction to wirelessly detect the microwave emission of another junction in the auto-oscillatory regime. We show that the rectified spin-diode voltage measured at the receiving junction end can be reconstructed from the independently measured auto-oscillation and spin diode spectra in each junction. Finally we adapt the auto-oscillator model to the case of spin-torque oscillator and spin-torque diode and we show that accurately reproduces the experimentally observed features. These results will be useful to design circuits and chips based on spintronic nanodevices communicating through microwaves.
△ Less
Submitted 19 February, 2020; v1 submitted 2 January, 2020;
originally announced January 2020.
-
Energy-efficient stochastic computing with superparamagnetic tunnel junctions
Authors:
Matthew W. Daniels,
Advait Madhavan,
Philippe Talatchian,
Alice Mizrahi,
Mark D. Stiles
Abstract:
Superparamagnetic tunnel junctions (SMTJs) have emerged as a competitive, realistic nanotechnology to support novel forms of stochastic computation in CMOS-compatible platforms. One of their applications is to generate random bitstreams suitable for use in stochastic computing implementations. We describe a method for digitally programmable bitstream generation based on pre-charge sense amplifiers…
▽ More
Superparamagnetic tunnel junctions (SMTJs) have emerged as a competitive, realistic nanotechnology to support novel forms of stochastic computation in CMOS-compatible platforms. One of their applications is to generate random bitstreams suitable for use in stochastic computing implementations. We describe a method for digitally programmable bitstream generation based on pre-charge sense amplifiers. This generator is significantly more energy efficient than SMTJ-based bitstream generators that tune probabilities with spin currents and a factor of two more efficient than related CMOS-based implementations. The true randomness of this bitstream generator allows us to use them as the fundamental units of a novel neural network architecture. To take advantage of the potential savings, we codesign the algorithm with the circuit, rather than directly transcribing a classical neural network into hardware. The flexibility of the neural network mathematics allows us to adapt the network to the explicitly energy efficient choices we make at the device level. The result is a convolutional neural network design operating at $\approx$ 150 nJ per inference with 97 % performance on MNIST -- a factor of 1.4 to 7.7 improvement in energy efficiency over comparable proposals in the recent literature.
△ Less
Submitted 6 March, 2020; v1 submitted 25 November, 2019;
originally announced November 2019.
-
Low-Energy Truly Random Number Generation with Superparamagnetic Tunnel Junctions for Unconventional Computing
Authors:
Damir Vodenicarevic,
Nicolas Locatelli,
Alice Mizrahi,
Joseph S. Friedman,
Adrien F. Vincent,
Miguel Romera,
Akio Fukushima,
Kay Yakushiji,
Hitoshi Kubota,
Shinji Yuasa,
Sandip Tiwari,
Julie Grollier,
Damien Querlioz
Abstract:
Low-energy random number generation is critical for many emerging computing schemes proposed to complement or replace von Neumann architectures. However, current random number generators are always associated with an energy cost that is prohibitive for these computing schemes. In this paper, we introduce random number bit generation based on specific nanodevices: superparamagnetic tunnel junctions…
▽ More
Low-energy random number generation is critical for many emerging computing schemes proposed to complement or replace von Neumann architectures. However, current random number generators are always associated with an energy cost that is prohibitive for these computing schemes. In this paper, we introduce random number bit generation based on specific nanodevices: superparamagnetic tunnel junctions. We experimentally demonstrate high quality random bit generation that represents orders-of-magnitude improvements in energy efficiency compared to current solutions. We show that the random generation speed improves with nanodevice scaling, and investigate the impact of temperature, magnetic field and crosstalk. Finally, we show how alternative computing schemes can be implemented using superparamagentic tunnel junctions as random number generators. These results open the way for fabricating efficient hardware computing devices leveraging stochasticity, and highlight a novel use for emerging nanodevices.
△ Less
Submitted 24 November, 2017; v1 submitted 16 June, 2017;
originally announced June 2017.
-
Neural-like computing with populations of superparamagnetic basis functions
Authors:
Alice Mizrahi,
Tifenn Hirtzlin,
Akio Fukushima,
Hitoshi Kubota,
Shinji Yuasa,
Julie Grollier,
Damien Querlioz
Abstract:
In neuroscience, population coding theory demonstrates that neural assemblies can achieve fault-tolerant information processing. Mapped to nanoelectronics, this strategy could allow for reliable computing with scaled-down, noisy, imperfect devices. Doing so requires that the population components form a set of basis functions in terms of their response functions to inputs, offering a physical subs…
▽ More
In neuroscience, population coding theory demonstrates that neural assemblies can achieve fault-tolerant information processing. Mapped to nanoelectronics, this strategy could allow for reliable computing with scaled-down, noisy, imperfect devices. Doing so requires that the population components form a set of basis functions in terms of their response functions to inputs, offering a physical substrate for calculating. For this purpose, the responses of the nanodevices should be non-linear, and each tuned to different values of the input. These strong requirements have prevented a demonstration of population coding with nanodevices. Here, we show that nanoscale magnetic tunnel junctions can be assembled to meet these requirements. We demonstrate experimentally that a population of nine junctions can implement a basis set of functions, providing the data to achieve, for example, the generation of cursive letters. We design hybrid magnetic-CMOS systems based on interlinked populations of junctions and show that they can learn to realize non-linear variability-resilient transformations with a low imprint area and low power.
△ Less
Submitted 15 March, 2018; v1 submitted 27 October, 2016;
originally announced October 2016.
-
Role of spin-transfer torques on synchronization and resonance phenomena in stochastic magnetic oscillators
Authors:
Artur Accioly,
Nicolas Locatelli,
Alice Mizrahi,
Damien Querlioz,
Luis G. Pereira,
Julie Grollier,
Joo-Von Kim
Abstract:
A theoretical study on how synchronization and resonance-like phenomena in superparamagnetic tunnel junctions can be driven by spin-transfer torques is presented. We examine the magnetization of a superparamagnetic free layer that reverses randomly between two well-defined orientations due to thermal fluctuations, acting as a stochastic oscillator. When subject to an external ac forcing this syste…
▽ More
A theoretical study on how synchronization and resonance-like phenomena in superparamagnetic tunnel junctions can be driven by spin-transfer torques is presented. We examine the magnetization of a superparamagnetic free layer that reverses randomly between two well-defined orientations due to thermal fluctuations, acting as a stochastic oscillator. When subject to an external ac forcing this system can present stochastic resonance and noise-enhanced synchronization. We focus on the roles of the mutually perpendicular damping-like and field-like torques, showing that the response of the system is very different at low and high-frequencies. We also demonstrate that the field-like torque can increase the efficiency of the current-driven forcing, specially at sub-threshold electric currents. These results can be useful for possible low-power, more energy efficient, applications.
△ Less
Submitted 1 September, 2016; v1 submitted 1 July, 2016;
originally announced July 2016.
-
Synchronization of electrically coupled stochastic magnetic oscillators induced by thermal and electrical noise
Authors:
A. Mizrahi,
N. Locatelli,
J. Grollier,
D. Querlioz
Abstract:
Superparamagnetic tunnel junctions are nanostructures that auto-oscillate stochastically under the effect of thermal noise. Recent works showed that despite their stochasticity, such junctions possess a capability to synchronize to subthreshold voltage drives, in a way that can be enhanced or controlled by adding noise. In this work, we investigate a system composed of two electrically coupled jun…
▽ More
Superparamagnetic tunnel junctions are nanostructures that auto-oscillate stochastically under the effect of thermal noise. Recent works showed that despite their stochasticity, such junctions possess a capability to synchronize to subthreshold voltage drives, in a way that can be enhanced or controlled by adding noise. In this work, we investigate a system composed of two electrically coupled junctions, connected in series to a periodic voltage source. We make use of numerical simulations and of an analytical model to demonstrate that both junctions can be phase-locked to the drive, in phase or in anti-phase. This synchronization phenomenon can be controlled by both thermal and electrical noises, although the two types of noises induce qualitatively different behaviors. Namely, thermal noise can stabilize a regime where one junction is phase-locked to the drive voltage while the other is blocked in one state. On the contrary, electrical noise causes the junctions to have highly correlated behaviors and thus cannot induce the latter. These results open the way for the design of superparamagnetic tunnel junctions that can perform computation through synchronization, and which harvest the largest part of their energy consumption from thermal noise.
△ Less
Submitted 29 June, 2016;
originally announced June 2016.
-
Controlling the phase locking of unstable magnetic bits for ultra-low power computation
Authors:
A. Mizrahi,
N. Locatelli,
R. Lebrun,
V. Cros,
A. Fukushima,
H. Kubota,
S. Yuasa,
D. Querlioz,
J. Grollier
Abstract:
When fabricating magnetic memories, one of the main challenges is to maintain the bit stability while downscaling. Indeed, for magnetic volumes of a few thousand nm3, the energy barrier between magnetic configurations becomes comparable to the thermal energy at room temperature. Then, switches of the magnetization spontaneously occur. These volatile, superparamagnetic nanomagnets are generally con…
▽ More
When fabricating magnetic memories, one of the main challenges is to maintain the bit stability while downscaling. Indeed, for magnetic volumes of a few thousand nm3, the energy barrier between magnetic configurations becomes comparable to the thermal energy at room temperature. Then, switches of the magnetization spontaneously occur. These volatile, superparamagnetic nanomagnets are generally considered useless. But what if we could use them as low power computational building blocks? Remarkably, they can oscillate without the need of any external dc drive, and despite their stochastic nature, they can beat in unison with an external periodic signal. Here we show that the phase locking of superparamagnetic tunnel junctions can be induced and suppressed by electrical noise injection. We develop a comprehensive model giving the conditions for synchronization, and predict that it can be achieved with a total energy cost lower than 10-^13 J. Our results open the path to ultra-low power computation based on the controlled synchronization of oscillators.
△ Less
Submitted 23 May, 2016;
originally announced May 2016.
-
Noise-enhanced synchronization of stochastic magnetic oscillators
Authors:
Nicolas Locatelli,
Alice Mizrahi,
Artur Accioloy,
Rie Matsumoto,
Akio Fukushima,
Hitoshi Kubota,
Shinji Yuasa,
Vincent Cros,
Luis Gustavo Pereira,
Damien Querlioz,
Joo-Von Kim,
Julie Grollier
Abstract:
We present an experimental study of phase-locking in a stochastic magnetic oscillator. The system comprises a magnetic tunnel junction with a superparamagnetic free layer, whose magnetization dynamics is driven with spin torques through an external periodic driving current. We show that synchronization of this stochastic oscillator to the input current is possible for current densities below…
▽ More
We present an experimental study of phase-locking in a stochastic magnetic oscillator. The system comprises a magnetic tunnel junction with a superparamagnetic free layer, whose magnetization dynamics is driven with spin torques through an external periodic driving current. We show that synchronization of this stochastic oscillator to the input current is possible for current densities below $3 \times 10^6$ A/cm$^2$, and occurs for input frequencies lower than the natural mean frequency of the stochastic oscillator. We show that such injection-locking is robust and leads to a drastic reduction in the phase diffusion of the stochastic oscillator, despite the presence of a frequency mismatch between the oscillator and the excitation.
△ Less
Submitted 17 May, 2014;
originally announced May 2014.