-
Extended dynamic mode decomposition with dictionary learning using neural ordinary differential equations
Authors:
Hiroaki Terao,
Sho Shirasaka,
Hideyuki Suzuki
Abstract:
Nonlinear phenomena can be analyzed via linear techniques using operator-theoretic approaches. Data-driven method called the extended dynamic mode decomposition (EDMD) and its variants, which approximate the Koopman operator associated with the nonlinear phenomena, have been rapidly developing by incorporating machine learning methods. Neural ordinary differential equations (NODEs), which are a ne…
▽ More
Nonlinear phenomena can be analyzed via linear techniques using operator-theoretic approaches. Data-driven method called the extended dynamic mode decomposition (EDMD) and its variants, which approximate the Koopman operator associated with the nonlinear phenomena, have been rapidly developing by incorporating machine learning methods. Neural ordinary differential equations (NODEs), which are a neural network equipped with a continuum of layers, and have high parameter and memory efficiencies, have been proposed. In this paper, we propose an algorithm to perform EDMD using NODEs. NODEs are used to find a parameter-efficient dictionary which provides a good finite-dimensional approximation of the Koopman operator. We show the superiority of the parameter efficiency of the proposed method through numerical experiments.
△ Less
Submitted 17 May, 2022; v1 submitted 1 October, 2021;
originally announced October 2021.
-
Nonlinear phase-amplitude reduction of delay-induced oscillations
Authors:
Kiyoshi Kotani,
Yutaro Ogawa,
Sho Shirasaka,
Akihiko Akao,
Yasuhiko Jimbo,
Hiroya Nakao
Abstract:
Spontaneous oscillations induced by time delays are observed in many real-world systems. Phase reduction theory for limit-cycle oscillators described by delay-differential equations (DDEs) has been developed to analyze their synchronization properties, but it is applicable only when the perturbation applied to the oscillator is sufficiently weak. In this study, we formulate a nonlinear phase-ampli…
▽ More
Spontaneous oscillations induced by time delays are observed in many real-world systems. Phase reduction theory for limit-cycle oscillators described by delay-differential equations (DDEs) has been developed to analyze their synchronization properties, but it is applicable only when the perturbation applied to the oscillator is sufficiently weak. In this study, we formulate a nonlinear phase-amplitude reduction theory for limit-cycle oscillators described by DDEs on the basis of the Floquet theorem, which is applicable when the oscillator is subjected to perturbations of moderate intensity. We propose a numerical method to evaluate the leading Floquet eigenvalues, eigenfunctions, and adjoint eigenfunctions necessary for the reduction and derive a set of low-dimensional nonlinear phase-amplitude equations approximately describing the oscillator dynamics. By analyzing an analytically tractable oscillator model with a cubic nonlinearity, we show that the asymptotic phase of the oscillator state in an infinite-dimensional state space can be approximately evaluated and non-trivial bistability of the oscillation amplitude caused by moderately strong periodic perturbations can be predicted on the basis of the derived phase-amplitude equations. We further analyze a model of gene-regulatory oscillator and illustrate that the reduced equations can elucidate the mechanism of its complex dynamics under non-weak perturbations, which may be relevant to real physiological phenomena such as circadian rhythm sleep disorders.
△ Less
Submitted 21 July, 2020;
originally announced July 2020.
-
Theta-gamma cross-frequency coupling enables covariance between distant brain regions
Authors:
Akihiko Akao,
Sho Shirasaka,
Yasuhiko Jimbo,
Bard Ermentrout,
Kiyoshi Kotani
Abstract:
Cross-frequency coupling (CFC) is thought to play an important role in communication across distant brain regions. However, neither the mechanism of its generation nor the influence on the underlying spiking dynamics is well understood. Here, we investigate the dynamics of two interacting distant neuronal modules coupled by inter-regional long-range connections. Each neuronal module comprises an e…
▽ More
Cross-frequency coupling (CFC) is thought to play an important role in communication across distant brain regions. However, neither the mechanism of its generation nor the influence on the underlying spiking dynamics is well understood. Here, we investigate the dynamics of two interacting distant neuronal modules coupled by inter-regional long-range connections. Each neuronal module comprises an excitatory and inhibitory population of quadratic integrate-and-fire neurons connected locally with conductance-based synapses. The two modules are coupled reciprocally with delays that represent the long-range conduction time. We applied the Ott-Antonsen ansatz to reduce the spiking dynamics to the corresponding mean field equations as a small set of delay differential equations. Bifurcation analysis on these mean field equations shows inter-regional conduction delay is sufficient to produce CFC via a torus bifurcation. Spike correlation analysis during the CFC revealed that several local clusters exhibit synchronized firing in gamma-band frequencies. These clusters exhibit locally decorrelated firings between the cluster pairs within the same population. In contrast, the clusters exhibit long-range gamma-band cross-covariance between the distant clusters that have similar firing frequency. The interactions of the different gamma frequencies produce a beat leading to population-level CFC. We analyzed spike counts in relation to the phases of the macroscopic fast and slow oscillations and found population spike counts vary with respect to macroscopic phases. Such firing phase preference accompanies a phase window with high spike count and low Fano factor, which is suitable for a population rate code. Our work suggests the inter-regional conduction delay plays a significant role in the emergence of CFC and the underlying spiking dynamics may support long-range communication and neural coding.
△ Less
Submitted 28 March, 2019;
originally announced March 2019.
-
Optimization of linear and nonlinear interaction schemes for stable synchronization of weakly coupled limit-cycle oscillators
Authors:
Nobuhiro Watanabe,
Yuzuru Kato,
Sho Shirasaka,
Hiroya Nakao
Abstract:
Optimization of mutual synchronization between a pair of limit-cycle oscillators with weak symmetric coupling is considered in the framework of the phase reduction theory. By generalizing a previous study on the optimization of cross-diffusion coupling matrices between the oscillators, we consider optimization of mutual coupling signals to maximize the linear stability of the synchronized state, w…
▽ More
Optimization of mutual synchronization between a pair of limit-cycle oscillators with weak symmetric coupling is considered in the framework of the phase reduction theory. By generalizing a previous study on the optimization of cross-diffusion coupling matrices between the oscillators, we consider optimization of mutual coupling signals to maximize the linear stability of the synchronized state, which are functionals of the past time sequences of the oscillator states. For the case of linear coupling, optimization of the delay time and linear filitering of coupling signals are considered. For the case of nonlinear coupling, general drive-response coupling is considered, and the optimal response and driving functions are derived. The theoretical results are exemplified by numerical simulations.
△ Less
Submitted 9 January, 2019;
originally announced January 2019.
-
Optimizing mutual synchronization of rhythmic spatiotemporal patterns in reaction-diffusion systems
Authors:
Yoji Kawamura,
Sho Shirasaka,
Tatsuo Yanagita,
Hiroya Nakao
Abstract:
Optimization of the stability of synchronized states between a pair of symmetrically coupled reaction-diffusion systems exhibiting rhythmic spatiotemporal patterns is studied in the framework of the phase reduction theory. The optimal linear filter that maximizes the linear stability of the in-phase synchronized state is derived for the case where the two systems are linearly coupled. The nonlinea…
▽ More
Optimization of the stability of synchronized states between a pair of symmetrically coupled reaction-diffusion systems exhibiting rhythmic spatiotemporal patterns is studied in the framework of the phase reduction theory. The optimal linear filter that maximizes the linear stability of the in-phase synchronized state is derived for the case where the two systems are linearly coupled. The nonlinear optimal interaction function that theoretically gives the largest linear stability of the in-phase synchronized state is also derived. The theory is illustrated by using typical rhythmic patterns in FitzHugh-Nagumo systems as examples.
△ Less
Submitted 22 July, 2017; v1 submitted 12 April, 2017;
originally announced April 2017.
-
Optimizing stability of mutual synchronization between a pair of limit-cycle oscillators with weak cross coupling
Authors:
Sho Shirasaka,
Nobuhiro Watanabe,
Yoji Kawamura,
Hiroya Nakao
Abstract:
We consider optimization of linear stability of synchronized states between a pair of weakly coupled limit-cycle oscillators with cross coupling, where different components of state variables of the oscillators are allowed to interact. On the basis of the phase reduction theory, the coupling matrix between different components of the oscillator states that maximizes the linear stability of the syn…
▽ More
We consider optimization of linear stability of synchronized states between a pair of weakly coupled limit-cycle oscillators with cross coupling, where different components of state variables of the oscillators are allowed to interact. On the basis of the phase reduction theory, the coupling matrix between different components of the oscillator states that maximizes the linear stability of the synchronized state under given constraints on overall coupling intensity and on stationary phase difference is derived. The improvement in the linear stability is illustrated by using several types of limit-cycle oscillators as examples.
△ Less
Submitted 22 July, 2017; v1 submitted 12 April, 2017;
originally announced April 2017.
-
Phase-amplitude reduction of transient dynamics far from attractors for limit-cycling systems
Authors:
Sho Shirasaka,
Wataru Kurebayashi,
Hiroya Nakao
Abstract:
Phase reduction framework for limit-cycling systems based on isochrons has been used as a powerful tool for analyzing rhythmic phenomena. Recently, the notion of isostables, which complements the isochrons by characterizing amplitudes of the system state, i.e., deviations from the limit-cycle attractor, has been introduced to describe transient dynamics around the limit cycle [Wilson and Moehlis,…
▽ More
Phase reduction framework for limit-cycling systems based on isochrons has been used as a powerful tool for analyzing rhythmic phenomena. Recently, the notion of isostables, which complements the isochrons by characterizing amplitudes of the system state, i.e., deviations from the limit-cycle attractor, has been introduced to describe transient dynamics around the limit cycle [Wilson and Moehlis, Phys. Rev. E 94, 052213 (2016)]. In this study, we introduce a framework for a reduced phase-amplitude description of transient dynamics of stable limit-cycling systems. In contrast to the preceding study, the isostables are treated in a fully consistent way with the Koopman operator analysis, which enables us to avoid discontinuities of the isostables and to apply the framework to system states far from the limit cycle. We also propose a new, convenient bi-orthogonalization method to obtain the response functions of the amplitudes, which can be interpreted as an extension of the adjoint covariant Lyapunov vector to transient dynamics in limit-cycling systems. We illustrate the utility of the proposed reduction framework by estimating optimal injection timing of external input that efficiently suppresses deviations of the system state from the limit cycle in a model of a biochemical oscillator.
△ Less
Submitted 1 March, 2017; v1 submitted 19 January, 2017;
originally announced January 2017.
-
Phase reduction theory for hybrid nonlinear oscillators
Authors:
Sho Shirasaka,
Wataru Kurebayashi,
Hiroya Nakao
Abstract:
Hybrid dynamical systems characterized by discrete switching of smooth dynamics have been used to model various rhythmic phenomena. However, the phase reduction theory, a fundamental framework for analyzing the synchronization of limit-cycle oscillations in rhythmic systems, has mostly been restricted to smooth dynamical systems. Here we develop a general phase reduction theory for weakly perturbe…
▽ More
Hybrid dynamical systems characterized by discrete switching of smooth dynamics have been used to model various rhythmic phenomena. However, the phase reduction theory, a fundamental framework for analyzing the synchronization of limit-cycle oscillations in rhythmic systems, has mostly been restricted to smooth dynamical systems. Here we develop a general phase reduction theory for weakly perturbed limit cycles in hybrid dynamical systems that facilitates analysis, control, and optimization of nonlinear oscillators whose smooth models are unavailable or intractable. On the basis of the generalized theory, we analyze injection locking of hybrid limit-cycle oscillators by periodic forcing and reveal their characteristic synchronization properties, such as ultrafast and robust entrainment to the periodic forcing and logarithmic scaling at the synchronization transition. We also illustrate the theory by analyzing the synchronization dynamics of a simple physical model of biped locomotion.
△ Less
Submitted 24 January, 2017; v1 submitted 22 April, 2016;
originally announced April 2016.
-
A criterion for timescale decomposition of external inputs for generalized phase reduction of limit-cycle oscillators
Authors:
Wataru Kurebayashi,
Sho Shirasaka,
Hiroya Nakao
Abstract:
The phase reduction method is a dimension reduction method for weakly driven limit-cycle oscillators, which has played an important role in the theoretical analysis of synchro- nization phenomena. Recently, we proposed a generalization of the phase reduction method [W. Kurebayashi et al., Phys. Rev. Lett. 111, 2013]. This generalized phase reduction method can robustly predict the dynamics of stro…
▽ More
The phase reduction method is a dimension reduction method for weakly driven limit-cycle oscillators, which has played an important role in the theoretical analysis of synchro- nization phenomena. Recently, we proposed a generalization of the phase reduction method [W. Kurebayashi et al., Phys. Rev. Lett. 111, 2013]. This generalized phase reduction method can robustly predict the dynamics of strongly driven oscillators, for which the conventional phase reduction method fails. In this generalized method, the external input to the oscillator should be properly decomposed into a slowly varying component and remaining weak fluctua- tions. In this paper, we propose a simple criterion for timescale decomposition of the external input, which gives accurate prediction of the phase dynamics and enables us to systematically apply the generalized phase reduction method to a general class of limit-cycle oscillators. The validity of the criterion is confirmed by numerical simulations.
△ Less
Submitted 6 September, 2015;
originally announced September 2015.
-
Phase Reduction Method for Strongly Perturbed Limit Cycle Oscillators
Authors:
Wataru Kurebayashi,
Sho Shirasaka,
Hiroya Nakao
Abstract:
The phase reduction method for limit cycle oscillators subjected to weak perturbations has significantly contributed to theoretical investigations of rhythmic phenomena. We here propose a generalized phase reduction method that is also applicable to strongly perturbed limit cycle oscillators. The fundamental assumption of our method is that the perturbations can be decomposed into a slowly varying…
▽ More
The phase reduction method for limit cycle oscillators subjected to weak perturbations has significantly contributed to theoretical investigations of rhythmic phenomena. We here propose a generalized phase reduction method that is also applicable to strongly perturbed limit cycle oscillators. The fundamental assumption of our method is that the perturbations can be decomposed into a slowly varying component as compared to the amplitude relaxation time and remaining weak fluctuations. Under this assumption, we introduce a generalized phase parameterized by the slowly varying component and derive a closed equation for the generalized phase describing the oscillator dynamics. The proposed method enables us to explore a broader class of rhythmic phenomena, in which the shape and frequency of the oscillation may vary largely because of the perturbations. We illustrate our method by analyzing the synchronization dynamics of limit cycle oscillators driven by strong periodic signals. It is shown that the proposed method accurately predicts the synchronization properties of the oscillators, while the conventional method does not.
△ Less
Submitted 13 January, 2014;
originally announced January 2014.