Skip to main content

Showing 1–9 of 9 results for author: Sakemi, Y

Searching in archive cs. Search in all archives.
.
  1. arXiv:2505.02019  [pdf, ps, other

    stat.ML cs.LG math.DS

    Learning the Simplest Neural ODE

    Authors: Yuji Okamoto, Tomoya Takeuchi, Yusuke Sakemi

    Abstract: Since the advent of the ``Neural Ordinary Differential Equation (Neural ODE)'' paper, learning ODEs with deep learning has been applied to system identification, time-series forecasting, and related areas. Exploiting the diffeomorphic nature of ODE solution maps, neural ODEs has also enabled their use in generative modeling. Despite the rich potential to incorporate various kinds of physical infor… ▽ More

    Submitted 4 May, 2025; originally announced May 2025.

    Comments: Under review

  2. arXiv:2412.09010  [pdf, other

    cs.LG

    Harnessing Nonidealities in Analog In-Memory Computing Circuits: A Physical Modeling Approach for Neuromorphic Systems

    Authors: Yusuke Sakemi, Yuji Okamoto, Takashi Morie, Sou Nobukawa, Takeo Hosomi, Kazuyuki Aihara

    Abstract: Large-scale deep learning models are increasingly constrained by their immense energy consumption, limiting their scalability and applicability for edge intelligence. In-memory computing (IMC) offers a promising solution by addressing the von Neumann bottleneck inherent in traditional deep learning accelerators, significantly reducing energy consumption. However, the analog nature of IMC introduce… ▽ More

    Submitted 20 March, 2025; v1 submitted 12 December, 2024; originally announced December 2024.

    Comments: Title changed

  3. arXiv:2405.09086  [pdf, other

    cs.LG cs.AI cs.NE

    Chaos-based reinforcement learning with TD3

    Authors: Toshitaka Matsuki, Yusuke Sakemi, Kazuyuki Aihara

    Abstract: Chaos-based reinforcement learning (CBRL) is a method in which the agent's internal chaotic dynamics drives exploration. This approach offers a model for considering how the biological brain can create variability in its behavior and learn in an exploratory manner. At the same time, it is a learning model that has the ability to automatically switch between exploration and exploitation modes and t… ▽ More

    Submitted 15 May, 2024; originally announced May 2024.

  4. arXiv:2307.13007  [pdf, other

    cs.NE cs.LG

    Sparse-firing regularization methods for spiking neural networks with time-to-first spike coding

    Authors: Yusuke Sakemi, Kakei Yamamoto, Takeo Hosomi, Kazuyuki Aihara

    Abstract: The training of multilayer spiking neural networks (SNNs) using the error backpropagation algorithm has made significant progress in recent years. Among the various training schemes, the error backpropagation method that directly uses the firing time of neurons has attracted considerable attention because it can realize ideal temporal coding. This method uses time-to-first spike (TTFS) coding, in… ▽ More

    Submitted 24 July, 2023; originally announced July 2023.

  5. arXiv:2301.09235  [pdf, other

    cs.LG cs.NE

    Learning Reservoir Dynamics with Temporal Self-Modulation

    Authors: Yusuke Sakemi, Sou Nobukawa, Toshitaka Matsuki, Takashi Morie, Kazuyuki Aihara

    Abstract: Reservoir computing (RC) can efficiently process time-series data by transferring the input signal to randomly connected recurrent neural networks (RNNs), which are referred to as a reservoir. The high-dimensional representation of time-series data in the reservoir significantly simplifies subsequent learning tasks. Although this simple architecture allows fast learning and facile physical impleme… ▽ More

    Submitted 22 January, 2023; originally announced January 2023.

  6. arXiv:2211.16113  [pdf, other

    cs.NE cs.LG

    Timing-Based Backpropagation in Spiking Neural Networks Without Single-Spike Restrictions

    Authors: Kakei Yamamoto, Yusuke Sakemi, Kazuyuki Aihara

    Abstract: We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits the advantages of conventional timing-based methods in that it computes accurate gradients with respect to spike timing, which promotes ideal temporal coding.… ▽ More

    Submitted 29 November, 2022; originally announced November 2022.

    Comments: 10 pages, 5 figures

    ACM Class: I.5.1

  7. arXiv:2106.10382  [pdf, ps, other

    cs.AR cs.NE

    Effects of VLSI Circuit Constraints on Temporal-Coding Multilayer Spiking Neural Networks

    Authors: Yusuke Sakemi, Takashi Morie, Takeo Hosomi, Kazuyuki Aihara

    Abstract: The spiking neural network (SNN) has been attracting considerable attention not only as a mathematical model for the brain, but also as an energy-efficient information processing model for real-world applications. In particular, SNNs based on temporal coding are expected to be much more efficient than those based on rate coding, because the former requires substantially fewer spikes to carry out t… ▽ More

    Submitted 24 June, 2021; v1 submitted 18 June, 2021; originally announced June 2021.

    Comments: corrected typos

  8. Model-Size Reduction for Reservoir Computing by Concatenating Internal States Through Time

    Authors: Yusuke Sakemi, Kai Morino, Timothée Leleu, Kazuyuki Aihara

    Abstract: Reservoir computing (RC) is a machine learning algorithm that can learn complex time series from data very rapidly based on the use of high-dimensional dynamical systems, such as random networks of neurons, called "reservoirs." To implement RC in edge computing, it is highly important to reduce the amount of computational resources that RC requires. In this study, we propose methods that reduce th… ▽ More

    Submitted 11 June, 2020; originally announced June 2020.

    Journal ref: Sci Rep 10, 21794 (2020)

  9. arXiv:2001.05348  [pdf, other

    cs.NE cs.LG stat.ML

    A Supervised Learning Algorithm for Multilayer Spiking Neural Networks Based on Temporal Coding Toward Energy-Efficient VLSI Processor Design

    Authors: Yusuke Sakemi, Kai Morino, Takashi Morie, Kazuyuki Aihara

    Abstract: Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient computational models when implemented in VLSI circuits. In this paper, we propose a novel supervised learning algorithm for SNNs based on temporal coding. A spiking neuro… ▽ More

    Submitted 7 January, 2020; originally announced January 2020.