-
On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control
Authors:
Ruisheng Diao,
Di Shi,
Bei Zhang,
Siqi Wang,
Haifeng Li,
Chunlei Xu,
Tu Lan,
Desong Bian,
Jiajun Duan
Abstract:
Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to achieve multi-objective real-time power grid control for real-world implementation. State-of-the-art off-policy reinforcement learning (RL) algorithm, soft act…
▽ More
Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to achieve multi-objective real-time power grid control for real-world implementation. State-of-the-art off-policy reinforcement learning (RL) algorithm, soft actor-critic (SAC) is adopted to train AI agents with multi-thread offline training and periodic online training for regulating voltages and transmission losses without violating thermal constraints of lines. A software prototype was developed and deployed in the control center of SGCC Jiangsu Electric Power Company that interacts with their Energy Management System (EMS) every 5 minutes. Massive numerical studies using actual power grid snapshots in the real-time environment verify the effectiveness of the proposed approach. Well-trained SAC agents can learn to provide effective and subsecond control actions in regulating voltage profiles and reducing transmission losses.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Line Outage Detection and Localization via Synchrophasor Measurement
Authors:
Xianda Deng,
Desong Bian,
Di Shi,
Wenxuan Yao,
Zhihao Jiang,
Yilu Liu
Abstract:
Since transmission lines are crucial links in the power system, one line outage event may bring about interruption or even cascading failure of the power system. If a quick and accurate line outage detection and localization can be achieved, the system operator can take necessary actions in time to mitigate the negative impact. Therefore, the objective of this paper is to study a method for line o…
▽ More
Since transmission lines are crucial links in the power system, one line outage event may bring about interruption or even cascading failure of the power system. If a quick and accurate line outage detection and localization can be achieved, the system operator can take necessary actions in time to mitigate the negative impact. Therefore, the objective of this paper is to study a method for line outage detection and localization via synchrophasor measurements. The density of deployed phasor measurement units (PMUs) is increasing recently, which greatly improves the visibility of the power grid. Taking advantage of the high-resolution synchrophasor data, the proposed method utilizes frequency measurement for line outage detection and power change for localization. The procedure of the proposed method is given. Compared with conventional methods, it does not require the pre-knowledge on the system. Simulation study validates the effectiveness of the proposed method.
△ Less
Submitted 2 April, 2019; v1 submitted 21 March, 2019;
originally announced March 2019.
-
Online Low Frequency Oscillation Detection and Analysis System with an Ensemble Filter
Authors:
Desong Bian,
Zhe Yu,
Di Shi,
Ruisheng Diao,
Zhiwei Wang
Abstract:
The widespread deployment of phasor measurement unit (PMU) overpower systems makes it possible to monitor and analyze grid dynamics in real-time. Low-frequency oscillation is harmful to power system equipment and operation, and in the worst-case scenario may lead to cascading failures. Therefore, it is critical to detect and identify them as soon as they appear. This paper presents an online low-f…
▽ More
The widespread deployment of phasor measurement unit (PMU) overpower systems makes it possible to monitor and analyze grid dynamics in real-time. Low-frequency oscillation is harmful to power system equipment and operation, and in the worst-case scenario may lead to cascading failures. Therefore, it is critical to detect and identify them as soon as they appear. This paper presents an online low-frequency oscillation detection and analysis (LFODA) system, which has the merit of significantly reducing the chance of false alarm via a voting schema and a time-serial filter. A novel algorithm based on density-based spatial clustering of applications with noise (DBSCAN) is proposed to classify oscillation modes as well as to group their corresponding buses/monitoring sites. Performance of the LFODA system is evaluated through experiments using both simulated and real-world PMU data.
△ Less
Submitted 13 January, 2020; v1 submitted 28 December, 2018;
originally announced December 2018.
-
Small-signal Stability Analysis and Performance Evaluation of Microgrids under Distributed Control
Authors:
Yimajian Yan,
Di Shi,
Desong Bian,
Bibin Huang,
Zhehan Yi,
Zhiwei Wang
Abstract:
Distributed control, as a potential solution to decreasing communication demands in microgrids, has drawn much attention in recent years. Advantages of distributed control have been extensively discussed, while its impacts on microgrid performance and stability, especially in the case of communication latency, have not been explicitly studied or fully understood yet. This paper addresses this gap…
▽ More
Distributed control, as a potential solution to decreasing communication demands in microgrids, has drawn much attention in recent years. Advantages of distributed control have been extensively discussed, while its impacts on microgrid performance and stability, especially in the case of communication latency, have not been explicitly studied or fully understood yet. This paper addresses this gap by proposing a generalized theoretical framework for small-signal stability analysis and performance evaluation for microgrids using distributed control. The proposed framework synthesizes generator and load frequency-domain characteristics, primary and secondary control loops, as well as the communication latency into a frequency-domain representation which is further evaluated by the generalized Nyquist theorem. In addition, various parameters and their impacts on microgrid dynamic performance are investigated and summarized into guidelines to help better design the system. Case studies demonstrate the effectiveness of the proposed approach.
△ Less
Submitted 7 September, 2018; v1 submitted 4 September, 2018;
originally announced September 2018.
-
Forced Oscillation Source Location via Multivariate Time Series Classification
Authors:
Yao Meng,
Zhe Yu,
Di Shi,
Desong Bian,
Zhiwei Wang
Abstract:
Precisely locating low-frequency oscillation sources is the prerequisite of suppressing sustained oscillation, which is an essential guarantee for the secure and stable operation of power grids. Using synchrophasor measurements, a machine learning method is proposed to locate the source of forced oscillation in power systems. Rotor angle and active power of each power plant are utilized to constru…
▽ More
Precisely locating low-frequency oscillation sources is the prerequisite of suppressing sustained oscillation, which is an essential guarantee for the secure and stable operation of power grids. Using synchrophasor measurements, a machine learning method is proposed to locate the source of forced oscillation in power systems. Rotor angle and active power of each power plant are utilized to construct multivariate time series (MTS). Applying Mahalanobis distance metric and dynamic time warping, the distance between MTS with different phases or lengths can be appropriately measured. The obtained distance metric, representing characteristics during the transient phase of forced oscillation under different disturbance sources, is used for offline classifier training and online matching to locate the disturbance source. Simulation results using the four-machine two-area system and IEEE 39-bus system indicate that the proposed location method can identify the power system forced oscillation source online with high accuracy.
△ Less
Submitted 8 November, 2017;
originally announced November 2017.
-
A Distributed Cooperative Control Framework for Synchronized Reconnection of a Multi-Bus Microgrid
Authors:
Di Shi,
Xi Chen,
Zhiwei Wang,
Xiaohu Zhang,
Zhe Yu,
Xinan Wang,
Desong Bian
Abstract:
One critical value microgrids bring to power systems is resilience, the capability of being able to island from the main grid under certain conditions and connect back when necessary. Once islanded, a microgrid must be synchronized to the main grid before reconnection to prevent severe consequences. In general, synchronization of a single machine with the grid can be easily achieved using a synchr…
▽ More
One critical value microgrids bring to power systems is resilience, the capability of being able to island from the main grid under certain conditions and connect back when necessary. Once islanded, a microgrid must be synchronized to the main grid before reconnection to prevent severe consequences. In general, synchronization of a single machine with the grid can be easily achieved using a synchronizer. The problem becomes more challenging when it comes to a multi-bus microgrid with multiple distributed generators (DGs) and dispersed loads. All distributed generators need to be properly controlled in a coordinated way to achieve synchronization. This paper presents a novel bi-level distributed cooperative control framework for a multi-bus microgrid. In this framework, DGs work collaboratively in a distributed manner using the minimum and sparse communication. The topology of the communication network can be flexible which supports the plug-and-play feature of microgrids. Fast and deterministic synchronization can be achieved with tolerance to communication latency. Experimental results obtained from Hardware-in-the-Loop (HIL) simulation demonstrate the effectiveness of the proposed approach.
△ Less
Submitted 16 June, 2017;
originally announced June 2017.
