Showing 1–9 of 9 results for author: Akashi, N

Incorporating Coupling Knowledge into Echo State Networks for Learning Spatiotemporally Chaotic Dynamics

Authors: Kuei-Jan Chu, Nozomi Akashi, Akihiro Yamamoto

Abstract: Machine learning methods have shown promise in learning chaotic dynamical systems, enabling model-free short-term prediction and attractor reconstruction. However, when applied to large-scale, spatiotemporally chaotic systems, purely data-driven machine learning methods often suffer from inefficiencies, as they require a large learning model size and a massive amount of training data to achieve ac… ▽ More Machine learning methods have shown promise in learning chaotic dynamical systems, enabling model-free short-term prediction and attractor reconstruction. However, when applied to large-scale, spatiotemporally chaotic systems, purely data-driven machine learning methods often suffer from inefficiencies, as they require a large learning model size and a massive amount of training data to achieve acceptable performance. To address this challenge, we incorporate the spatial coupling structure of the target system as an inductive bias in the network design. Specifically, we introduce physics-guided clustered echo state networks, leveraging the efficiency of the echo state networks as a base model. Experimental results on benchmark chaotic systems demonstrate that our physics-informed method outperforms existing echo state network models in learning the target chaotic systems. Additionally, our models exhibit robustness to noise in training data and remain effective even when prior coupling knowledge is imperfect. This approach has the potential to enhance other machine learning methods. △ Less

Submitted 2 April, 2025; originally announced April 2025.

Comments: 16 pages, 12 figures

Gradient-based optimization of spintronic devices

Authors: Yusuke Imai, Shuhong Liu, Nozomi Akashi, Kohei Nakajima

Abstract: The optimization of physical parameters serves various purposes, such as system identification and efficiency in developing devices. Spin-torque oscillators have been applied to neuromorphic computing experimentally and theoretically, but the optimization of their physical parameters has usually been done by grid search. In this paper, we propose a scheme to optimize the parameters of the dynamics… ▽ More The optimization of physical parameters serves various purposes, such as system identification and efficiency in developing devices. Spin-torque oscillators have been applied to neuromorphic computing experimentally and theoretically, but the optimization of their physical parameters has usually been done by grid search. In this paper, we propose a scheme to optimize the parameters of the dynamics of macrospin-type spin-torque oscillators using the gradient descent method with automatic differentiation. First, we prepared numerically created dynamics as teacher data and successfully tuned the parameters to reproduce the dynamics. This can be applied to obtain the correspondence between the simulation and experiment of the spin-torque oscillators. Next, we successfully solved the image recognition task with high accuracy by connecting the coupled system of spin-torque oscillators to the input and output layers and training all of them through gradient descent. This approach allowed us to estimate how to control the experimental setup and design the physical systems so that the task could be solved with a high accuracy using spin-torque oscillators. △ Less

Submitted 13 September, 2024; originally announced September 2024.

Exploiting Chaotic Dynamics as Deep Neural Networks

Authors: Shuhong Liu, Nozomi Akashi, Qingyao Huang, Yasuo Kuniyoshi, Kohei Nakajima

Abstract: Chaos presents complex dynamics arising from nonlinearity and a sensitivity to initial states. These characteristics suggest a depth of expressivity that underscores their potential for advanced computational applications. However, strategies to effectively exploit chaotic dynamics for information processing have largely remained elusive. In this study, we reveal that the essence of chaos can be f… ▽ More Chaos presents complex dynamics arising from nonlinearity and a sensitivity to initial states. These characteristics suggest a depth of expressivity that underscores their potential for advanced computational applications. However, strategies to effectively exploit chaotic dynamics for information processing have largely remained elusive. In this study, we reveal that the essence of chaos can be found in various state-of-the-art deep neural networks. Drawing inspiration from this revelation, we propose a novel method that directly leverages chaotic dynamics for deep learning architectures. Our approach is systematically evaluated across distinct chaotic systems. In all instances, our framework presents superior results to conventional deep neural networks in terms of accuracy, convergence speed, and efficiency. Furthermore, we found an active role of transient chaos formation in our scheme. Collectively, this study offers a new path for the integration of chaos, which has long been overlooked in information processing, and provides insights into the prospective fusion of chaotic dynamics within the domains of machine learning and neuromorphic computation. △ Less

Submitted 29 May, 2024; originally announced June 2024.

Virtual reservoir acceleration for CPU and GPU: Case study for coupled spin-torque oscillator reservoir

Authors: Thomas Geert de Jong, Nozomi Akashi, Tomohiro Taniguchi, Hirofumi Notsu, Kohei Nakajima

Abstract: We provide high-speed implementations for simulating reservoirs described by $N$-coupled spin-torque oscillators. Here $N$ also corresponds to the number of reservoir nodes. We benchmark a variety of implementations based on CPU and GPU. Our new methods are at least 2.6 times quicker than the baseline for $N$ in range $1$ to $10^4$. More specifically, over all implementations the best factor is 78… ▽ More We provide high-speed implementations for simulating reservoirs described by $N$-coupled spin-torque oscillators. Here $N$ also corresponds to the number of reservoir nodes. We benchmark a variety of implementations based on CPU and GPU. Our new methods are at least 2.6 times quicker than the baseline for $N$ in range $1$ to $10^4$. More specifically, over all implementations the best factor is 78.9 for $N=1$ which decreases to 2.6 for $N=10^3$ and finally increases to 23.8 for $N=10^4$. GPU outperforms CPU significantly at $N=2500$. Our results show that GPU implementations should be tested for reservoir simulations. The implementations considered here can be used for any reservoir with evolution that can be approximated using an explicit method. △ Less

Submitted 2 December, 2023; originally announced December 2023.

Embedding bifurcations into pneumatic artificial muscle

Authors: Nozomi Akashi, Yasuo Kuniyoshi, Taketomo Jo, Mitsuhiro Nishida, Ryo Sakurai, Yasumichi Wakao, Kohei Nakajima

Abstract: Harnessing complex body dynamics has been a long-standing challenge in robotics. Soft body dynamics is a typical example of high complexity in interacting with the environment. An increasing number of studies have reported that these dynamics can be used as a computational resource. This includes the McKibben pneumatic artificial muscle, which is a typical soft actuator. This study demonstrated th… ▽ More Harnessing complex body dynamics has been a long-standing challenge in robotics. Soft body dynamics is a typical example of high complexity in interacting with the environment. An increasing number of studies have reported that these dynamics can be used as a computational resource. This includes the McKibben pneumatic artificial muscle, which is a typical soft actuator. This study demonstrated that various dynamics, including periodic and chaotic dynamics, could be embedded into the pneumatic artificial muscle, with the entire bifurcation structure using the framework of physical reservoir computing. These results suggest that dynamics that are not presented in training data could be embedded by using this capability of bifurcation embeddment. This implies that it is possible to embed various qualitatively different patterns into pneumatic artificial muscle by learning specific patterns, without the need to design and learn all patterns required for the purpose. Thus, this study sheds new light on a novel pathway to simplify the robotic devices and training of the control by reducing the external pattern generators and the amount and types of training data for the control. △ Less

Submitted 10 May, 2023; v1 submitted 6 May, 2023; originally announced May 2023.

ACM Class: I.2.9

Step-like dependence of memory function on pulse width in spintronics reservoir computing

Authors: Terufumi Yamaguchi, Nozomi Akashi, Kohei Nakajima, Hitoshi Kubota, Sumito Tsunegi, Tomohiro Taniguchi

Abstract: Physical reservoir computing is a type of recurrent neural network that applies the dynamical response from physical systems to information processing. However, the relation between computation performance and physical parameters/phenomena still remains unclear. This study reports our progress regarding the role of current-dependent magnetic damping in the computational performance of reservoir co… ▽ More Physical reservoir computing is a type of recurrent neural network that applies the dynamical response from physical systems to information processing. However, the relation between computation performance and physical parameters/phenomena still remains unclear. This study reports our progress regarding the role of current-dependent magnetic damping in the computational performance of reservoir computing. The current-dependent relaxation dynamics of a magnetic vortex core results in an asymmetric memory function with respect to binary inputs. A fast relaxation caused by a large input leads to a fast fading of the input memory, whereas a slow relaxation by a small input enables the reservoir to keep the input memory for a relatively long time. As a result, a step-like dependence is found for the short-term memory and parity-check capacities on the pulse width of input data, where the capacities remain at 1.5 for a certain range of the pulse width, and drop to 1.0 for a long pulse-width limit. Both analytical and numerical analyses clarify that the step-like behavior can be attributed to the current-dependent relaxation time of the vortex core to a limit-cycle state. } △ Less

Submitted 11 November, 2020; originally announced November 2020.

Comments: 9 pages, 5 figures

Journal ref: Scientific Reports 10, 19536 (2020)

Periodic structure of memory function in spintronics reservoir with feedback current

Authors: Terufumi Yamaguchi, Nozomi Akashi, Sumito Tsunegi, Hitoshi Kubota, Kohei Nakajima, Tomohiro Taniguchi

Abstract: The role of the feedback effect on physical reservoir computing is studied theoretically by solving the vortex-core dynamics in a nanostructured ferromagnet. Although the spin-transfer torque due to the feedback current makes the vortex dynamics complex, it is clarified that the feedback effect does not always contribute to the enhancement of the memory function in a physical reservoir. The memory… ▽ More The role of the feedback effect on physical reservoir computing is studied theoretically by solving the vortex-core dynamics in a nanostructured ferromagnet. Although the spin-transfer torque due to the feedback current makes the vortex dynamics complex, it is clarified that the feedback effect does not always contribute to the enhancement of the memory function in a physical reservoir. The memory function, characterized by the correlation coefficient between the input data and the dynamical response of the vortex core, becomes large when the delay time of the feedback current is not an integral multiple of the pulse width. On the other hand, the memory function remains small when the delay time is an integral multiple of the pulse width. As a result, a periodic behavior for the short-term memory capacity is observed with respect to the delay time, the phenomenon of which can be attributed to correlations between the virtual neurons via the feedback current. △ Less

Submitted 23 June, 2020; originally announced June 2020.

Comments: 10 pages, 9 figures

Journal ref: Phys. Rev. Research 2, 023389 (2020)

Synchronization and chaos in a spin-torque oscillator with a perpendicularly magnetized free layer

Authors: Terufumi Yamaguchi, Nozomi Akashi, Kohei Naka jima, Sumito Tsunegi, Hitoshi Kubota, Tomohiro Taniguchi

Abstract: Synchronization and chaos caused by alternating current and microwave field in a spin torque oscillator consisting of a perpendicularly magnetized free layer and an in-plane magnetized reference layer is comprehensively studied theoretically. A forced synchronization by the alternating current is observed in numerical simulation over wide ranges of its amplitude and frequency. An analytical theory… ▽ More Synchronization and chaos caused by alternating current and microwave field in a spin torque oscillator consisting of a perpendicularly magnetized free layer and an in-plane magnetized reference layer is comprehensively studied theoretically. A forced synchronization by the alternating current is observed in numerical simulation over wide ranges of its amplitude and frequency. An analytical theory clarifies that the nonlinear frequency shift, as well as the spin-transfer torque asymmetry, plays a key role in determining locking range and phase difference between the oscillator and current. Chaos caused by the alternating current is identified for a region of large alternating current by evaluating the Lyapunov exponent. Similar results are also obtained for microwave field, although the parameter regions causing chaos are narrower than those by the alternating current. △ Less

Submitted 23 December, 2019; originally announced December 2019.

Journal ref: Phys. Rev. B 100, 224422 (2019)

Chaos in nanomagnet via feedback current

Authors: Tomohiro Taniguchi, Nozomi Akashi, Hirofumi Notsu, Masato Kimura, Hiroshi Tsukahara, Kohei Nakajima

Abstract: Nonlinear magnetization dynamics excited by spin-transfer effect with feedback current is studied both numerically and analytically. The numerical simulation of the Landau-Lifshitz-Gilbert equation indicates the positive Lyapunov exponent for a certain range of the feedback rate, which identifies the existence of chaos in a nanostructured ferromagnet. Transient behavior from chaotic to steady osci… ▽ More Nonlinear magnetization dynamics excited by spin-transfer effect with feedback current is studied both numerically and analytically. The numerical simulation of the Landau-Lifshitz-Gilbert equation indicates the positive Lyapunov exponent for a certain range of the feedback rate, which identifies the existence of chaos in a nanostructured ferromagnet. Transient behavior from chaotic to steady oscillation is also observed in another range of the feedback parameter. An analytical theory is also developed, which indicates the appearance of multiple attractors in a phase space due to the feedback current. An instantaneous imbalance between the spin-transfer torque and damping torque causes a transition between the attractors, and results in the complex dynamics. △ Less

Submitted 22 November, 2019; v1 submitted 11 September, 2019; originally announced September 2019.

Journal ref: Phys. Rev. B 100, 174425 (2019)