-
Reinforcement Learning Optimizes Power Dispatch in Decentralized Power Grid
Authors:
Yongsun Lee,
Hoyun Choi,
Laurent Pagnier,
Cook Hyun Kim,
Jongshin Lee,
Bukyoung Jhun,
Heetae Kim,
Juergen Kurths,
B. Kahng
Abstract:
Effective frequency control in power grids has become increasingly important with the increasing demand for renewable energy sources. Here, we propose a novel strategy for resolving this challenge using graph convolutional proximal policy optimization (GC-PPO). The GC-PPO method can optimally determine how much power individual buses dispatch to reduce frequency fluctuations across a power grid. W…
▽ More
Effective frequency control in power grids has become increasingly important with the increasing demand for renewable energy sources. Here, we propose a novel strategy for resolving this challenge using graph convolutional proximal policy optimization (GC-PPO). The GC-PPO method can optimally determine how much power individual buses dispatch to reduce frequency fluctuations across a power grid. We demonstrate its efficacy in controlling disturbances by applying the GC-PPO to the power grid of the UK. The performance of GC-PPO is outstanding compared to the classical methods. This result highlights the promising role of GC-PPO in enhancing the stability and reliability of power systems by switching lines or decentralizing grid topology.
△ Less
Submitted 21 July, 2024;
originally announced July 2024.
-
Machine learning approaches for Kuramoto coupled oscillator systems
Authors:
Je Ung Song,
K. Choi,
B. Kahng
Abstract:
Recently, there has been significant advancement in the machine learning (ML) approach and its application to diverse systems ranging from complex to quantum systems. As one of such systems, a coupled-oscillators system exhibits intriguing collective behaviors, synchronization phase transitions, chaotic behaviors and so on. Even though traditional approaches such as analytical and numerical method…
▽ More
Recently, there has been significant advancement in the machine learning (ML) approach and its application to diverse systems ranging from complex to quantum systems. As one of such systems, a coupled-oscillators system exhibits intriguing collective behaviors, synchronization phase transitions, chaotic behaviors and so on. Even though traditional approaches such as analytical and numerical methods enable to understand diverse properties of such systems, some properties still remain unclear. Here, we applied the ML approach to such systems particularly described by the Kuramoto model, with the aim of resolving the following intriguing problems, namely determination of the transition point and criticality of a hybrid synchronization transition; understanding network structures from chaotic patterns; and comparison of ML algorithms for the prediction of future chaotic behaviors. The proposed method is expected to be useful for further problems such as understanding a neural network structure from electroencephalogram signals.
△ Less
Submitted 18 September, 2021;
originally announced September 2021.
-
Synchronization in leader-follower switching dynamics
Authors:
Jinha Park,
B. Kahng
Abstract:
The features of animal population dynamics, for instance, flocking and migration, are often synchronized for survival under large-scale climate change or perceived threats. These coherent phenomena have been explained using synchronization models. However, such models do not take into account asynchronous and adaptive updating of an individual's status at each time. Here, we modify the Kuramoto mo…
▽ More
The features of animal population dynamics, for instance, flocking and migration, are often synchronized for survival under large-scale climate change or perceived threats. These coherent phenomena have been explained using synchronization models. However, such models do not take into account asynchronous and adaptive updating of an individual's status at each time. Here, we modify the Kuramoto model slightly by classifying oscillators as leaders or followers, according to their angular velocity at each time, where individuals interact asymmetrically according to their leader/follower status. As the angular velocities of the oscillators are updated, the leader and follower status may also be reassigned. Owing to this adaptive dynamics, oscillators may cooperate by taking turns acting as a leader or follower. This may result in intriguing patterns of synchronization transitions, including hybrid phase transitions, and produce the leader-follower switching pattern observed in bird migration patterns.
△ Less
Submitted 18 February, 2020;
originally announced February 2020.
-
Competing synchronization on random networks
Authors:
Jinha Park,
B. Kahng
Abstract:
The synchronization pattern of a fully connected competing Kuramoto model with a uniform intrinsic frequency distribution $g(ω)$ was recently considered. This competing Kuramoto model assigns two coupling constants with opposite signs, $K_1 < 0$ and $K_2 > 0$, to the $1-p$ and $p$ fractions of nodes, respectively. This model has a rich phase diagram that includes incoherent, $π$, and traveling wav…
▽ More
The synchronization pattern of a fully connected competing Kuramoto model with a uniform intrinsic frequency distribution $g(ω)$ was recently considered. This competing Kuramoto model assigns two coupling constants with opposite signs, $K_1 < 0$ and $K_2 > 0$, to the $1-p$ and $p$ fractions of nodes, respectively. This model has a rich phase diagram that includes incoherent, $π$, and traveling wave (TW) phases and a hybrid phase transition with abnormal properties that occurs through an intermediate metastable $π$ state. Here, we consider the competing Kuramoto model on Erdős--Rényi (ER) random networks. Numerical simulations and the mean-field solution based on the annealed network approximation reveal that in this case, when the mean degree of the random networks is large, the features of the phase diagram and transition types are consistent overall with those on completely connected networks. However, when the mean degree is small, the mean-field solution is not consistent with the numerical simulation results; specifically, the TW state does not occur, and thus the phase diagram is changed, owing to the strong heterogeneity of the local environment. By contrast, for the original Kuramoto oscillators, the annealed mean-field solution is consistent with the numerical simulation result for ER networks.
△ Less
Submitted 30 March, 2020; v1 submitted 7 January, 2019;
originally announced January 2019.
-
Metastable state en route to traveling-wave synchronization state
Authors:
Jinha Park,
B. Kahng
Abstract:
The Kuramoto model with mixed signs of couplings is known to produce a traveling-wave synchronized state. Here, we consider an abrupt synchronization transition from the incoherent state to the traveling-wave state through a long-lasting metastable state with large fluctuations. Our explanation of the metastability is that the dynamic flow remains within a limited region of phase space and circula…
▽ More
The Kuramoto model with mixed signs of couplings is known to produce a traveling-wave synchronized state. Here, we consider an abrupt synchronization transition from the incoherent state to the traveling-wave state through a long-lasting metastable state with large fluctuations. Our explanation of the metastability is that the dynamic flow remains within a limited region of phase space and circulates through a few active states bounded by saddle and stable fixed points. This complex flow generates a long-lasting critical behavior, a signature of a hybrid phase transition. We show that the long-lasting period can be controlled by varying the density of inhibitory/excitatory interactions. We discuss a potential application of this transition behavior to the recovery process of human consciousness.
△ Less
Submitted 20 February, 2018;
originally announced February 2018.
-
Extended finite-size scaling of synchronized coupled oscillators
Authors:
Chulho Choi,
Meesoon Ha,
Byungnam Kahng
Abstract:
We present a systematic analysis of dynamic scaling in the time evolution of the phase order parameter for coupled oscillators with non-identical natural frequencies in terms of the Kuramoto model. This provides a comprehensive view of phase synchronization. In particular, we extend finite-size scaling (FSS) in the steady state to dynamics, determine critical exponents, and find the critical coupl…
▽ More
We present a systematic analysis of dynamic scaling in the time evolution of the phase order parameter for coupled oscillators with non-identical natural frequencies in terms of the Kuramoto model. This provides a comprehensive view of phase synchronization. In particular, we extend finite-size scaling (FSS) in the steady state to dynamics, determine critical exponents, and find the critical coupling strength. The dynamic scaling approach enables us to measure not only the FSS exponent associated with the correlation volume in finite systems but also thermodynamic critical exponents. Based on the extended FSS theory, we also discuss how the sampling of natural frequencies and thermal noise affect dynamic scaling, which is numerically confirmed.
△ Less
Submitted 20 September, 2013; v1 submitted 9 July, 2013;
originally announced July 2013.
-
Harmonic forcing of an extended oscillatory system: Homogeneous and periodic solutions
Authors:
Jeenu Kim,
Jysoo Lee,
Byungnam Kahng
Abstract:
In this paper we study the effect of external harmonic forcing on a one-dimensional oscillatory system described by the complex Ginzburg-Landau equation (CGLE). For a sufficiently large forcing amplitude, a homogeneous state with no spatial structure is observed. The state becomes unstable to a spatially periodic ``stripe'' state via a supercritical bifurcation as the forcing amplitude decreases…
▽ More
In this paper we study the effect of external harmonic forcing on a one-dimensional oscillatory system described by the complex Ginzburg-Landau equation (CGLE). For a sufficiently large forcing amplitude, a homogeneous state with no spatial structure is observed. The state becomes unstable to a spatially periodic ``stripe'' state via a supercritical bifurcation as the forcing amplitude decreases. An approximate phase equation is derived, and an analytic solution for the stripe state is obtained, through which the asymmetric behavior of the stability border of the state is explained. The phase equation, in particular the analytic solution, is found to be very useful in understanding the stability borders of the homogeneous and stripe states of the forced CGLE.
△ Less
Submitted 9 March, 2002;
originally announced March 2002.