-
Robust Deep Reinforcement Learning for Volt-VAR Optimization in Active Distribution System under Uncertainty
Authors:
Zhengrong Chen,
Siyao Cai,
A. P. Sakis Meliopoulos
Abstract:
The deep reinforcement learning (DRL) based Volt-VAR optimization (VVO) methods have been widely studied for active distribution networks (ADNs). However, most of them lack safety guarantees in terms of power injection uncertainties due to the increase in distributed energy resources (DERs) and load demand, such as electric vehicles. This article proposes a robust deep reinforcement learning (RDRL…
▽ More
The deep reinforcement learning (DRL) based Volt-VAR optimization (VVO) methods have been widely studied for active distribution networks (ADNs). However, most of them lack safety guarantees in terms of power injection uncertainties due to the increase in distributed energy resources (DERs) and load demand, such as electric vehicles. This article proposes a robust deep reinforcement learning (RDRL) framework for VVO via a robust deep deterministic policy gradient (DDPG) algorithm. This algorithm can effectively manage hybrid action spaces, considering control devices like capacitors, voltage regulators, and smart inverters. Additionally, it is designed to handle uncertainties by quantifying uncertainty sets with conformal prediction and modeling uncertainties as adversarial attacks to guarantee safe exploration across action spaces. Numerical results on three IEEE test cases demonstrate the sample efficiency and safety of the proposed robust DDPG against uncertainties compared to the benchmark algorithms.
△ Less
Submitted 27 September, 2024;
originally announced September 2024.
-
An Online Approach to Cyberattack Detection and Localization in Smart Grid
Authors:
Dan Li,
Nagi Gebraeel,
Kamran Paynabar,
A. P. Sakis Meliopoulos
Abstract:
Complex interconnections between information technology and digital control systems have significantly increased cybersecurity vulnerabilities in smart grids. Cyberattacks involving data integrity can be very disruptive because of their potential to compromise physical control by manipulating measurement data. This is especially true in large and complex electric networks that often rely on tradit…
▽ More
Complex interconnections between information technology and digital control systems have significantly increased cybersecurity vulnerabilities in smart grids. Cyberattacks involving data integrity can be very disruptive because of their potential to compromise physical control by manipulating measurement data. This is especially true in large and complex electric networks that often rely on traditional intrusion detection systems focused on monitoring network traffic. In this paper, we develop an online detection algorithm to detect and localize covert attacks on smart grids. Using a network system model, we develop a theoretical framework by characterizing a covert attack on a generator bus in the network as sparse features in the state-estimation residuals. We leverage such sparsity via a regularized linear regression method to detect and localize covert attacks based on the regression coefficients. We conduct a comprehensive numerical study on both linear and nonlinear system models to validate our proposed method. The results show that our method outperforms conventional methods in both detection delay and localization accuracy.
△ Less
Submitted 22 February, 2021;
originally announced February 2021.
-
Roles of Dynamic State Estimation in Power System Modeling, Monitoring and Operation
Authors:
Junbo Zhao,
Marcos Netto,
Zhenyu Huang,
Samson Shenglong Yu,
Antonio Gomez-Exposito,
Shaobu Wang,
Innocent Kamwa,
Shahrokh Akhlaghi,
Lamine Mili,
Vladimir Terzija,
A. P. Sakis Meliopoulos,
Bikash Pal,
Abhinav Kumar Singh,
Ali Abur,
Tianshu Bi,
Alireza Rouhani
Abstract:
Power system dynamic state estimation (DSE) remains an active research area. This is driven by the absence of accurate models, the increasing availability of fast-sampled, time-synchronized measurements, and the advances in the capability, scalability, and affordability of computing and communications. This paper discusses the advantages of DSE as compared to static state estimation, and the imple…
▽ More
Power system dynamic state estimation (DSE) remains an active research area. This is driven by the absence of accurate models, the increasing availability of fast-sampled, time-synchronized measurements, and the advances in the capability, scalability, and affordability of computing and communications. This paper discusses the advantages of DSE as compared to static state estimation, and the implementation differences between the two, including the measurement configuration, modeling framework and support software features. The important roles of DSE are discussed from modeling, monitoring and operation aspects for today's synchronous machine dominated systems and the future power electronics-interfaced generation systems. Several examples are presented to demonstrate the benefits of DSE on enhancing the operational robustness and resilience of 21st century power system through time critical applications. Future research directions are identified and discussed, paving the way for developing the next generation of energy management systems.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
-
Nuclear Magnetohydrodynamic EMP, Solar Storms, and Substorms
Authors:
Mario Rabinowitz,
A. P. Sakis Meliopoulos,
Elias N. Glytsis,
George J. Cokkinides
Abstract:
In addition to a fast electromagnetic pulse (EMP), a high altitude nuclear burst produces a relatively slow magnetohydrodynarnic EMP (MHD EMP), whose effects are like those from solar storm geomagnetically induced currents (SS GIC). The MHD EMP electric field E < 10^-1 V/m and lasts < 10^2 sec, whereas for solar storms E > 10^-2 V/m and lasts >10^3 sec. Although the solar storm electric field is…
▽ More
In addition to a fast electromagnetic pulse (EMP), a high altitude nuclear burst produces a relatively slow magnetohydrodynarnic EMP (MHD EMP), whose effects are like those from solar storm geomagnetically induced currents (SS GIC). The MHD EMP electric field E < 10^-1 V/m and lasts < 10^2 sec, whereas for solar storms E > 10^-2 V/m and lasts >10^3 sec. Although the solar storm electric field is lower than MHD EMP, the solar storm effects are generally greater due to their much longer duration. Substorms produce much smaller effects than SS GIC, but occur much more frequently. This paper describes the physics of such geomagnetic disturbances and analyzes their effects.
△ Less
Submitted 12 July, 2003;
originally announced July 2003.
