-
Gaussian Processes in Power Systems: Techniques, Applications, and Future Works
Authors:
Bendong Tan,
Tong Su,
Yu Weng,
Ketian Ye,
Parikshit Pareek,
Petr Vorobev,
Hung Nguyen,
Junbo Zhao,
Deepjyoti Deka
Abstract:
The increasing integration of renewable energy sources (RESs) and distributed energy resources (DERs) has significantly heightened operational complexity and uncertainty in modern power systems. Concurrently, the widespread deployment of smart meters, phasor measurement units (PMUs) and other sensors has generated vast spatiotemporal data streams, enabling advanced data-driven analytics and decisi…
▽ More
The increasing integration of renewable energy sources (RESs) and distributed energy resources (DERs) has significantly heightened operational complexity and uncertainty in modern power systems. Concurrently, the widespread deployment of smart meters, phasor measurement units (PMUs) and other sensors has generated vast spatiotemporal data streams, enabling advanced data-driven analytics and decision-making in grid operations. In this context, Gaussian processes (GPs) have emerged as a powerful probabilistic framework, offering uncertainty quantification, non-parametric modeling, and predictive capabilities to enhance power system analysis and control. This paper presents a comprehensive review of GP techniques and their applications in power system operation and control. GP applications are reviewed across three key domains: GP-based modeling, risk assessment, and optimization and control. These areas serve as representative examples of how GP can be utilized in power systems. Furthermore, critical challenges in GP applications are discussed, and potential research directions are outlined to facilitate future power system operations.
△ Less
Submitted 22 May, 2025; v1 submitted 21 May, 2025;
originally announced May 2025.
-
Power Flow Approximations for Multiphase Distribution Networks using Gaussian Processes
Authors:
Daniel Glover,
Parikshit Pareek,
Deepjyoti Deka,
Anamika Dubey
Abstract:
Learning-based approaches are increasingly leveraged to manage and coordinate the operation of grid-edge resources in active power distribution networks. Among these, model-based techniques stand out for their superior data efficiency and robustness compared to model-free methods. However, effective model learning requires a learning-based approximator for the underlying power flow model. This stu…
▽ More
Learning-based approaches are increasingly leveraged to manage and coordinate the operation of grid-edge resources in active power distribution networks. Among these, model-based techniques stand out for their superior data efficiency and robustness compared to model-free methods. However, effective model learning requires a learning-based approximator for the underlying power flow model. This study extends existing work by introducing a data-driven power flow method based on Gaussian Processes (GPs) to approximate the multiphase power flow model, by mapping net load injections to nodal voltages. Simulation results using the IEEE 123-bus and 8500-node distribution test feeders demonstrate that the trained GP model can reliably predict the nonlinear power flow solutions with minimal training data. We also conduct a comparative analysis of the training efficiency and testing performance of the proposed GP-based power flow approximator against a deep neural network-based approximator, highlighting the advantages of our data-efficient approach. Results over realistic operating conditions show that despite an 85% reduction in the training sample size (corresponding to a 92.8% improvement in training time), GP models produce a 99.9% relative reduction in mean absolute error compared to the baselines of deep neural networks.
△ Less
Submitted 29 April, 2025;
originally announced April 2025.
-
Degradation-Infused Energy Portfolio Allocation Framework: Risk-Averse Fair Storage Participation
Authors:
Parikshit Pareek,
L. P. Mohasha Isuru Sampath,
Anshuman Singh,
Lalit Goel,
Hoay Beng Gooi,
Hung Dinh Nguyen
Abstract:
This work proposes a novel degradation-infused energy portfolio allocation (DI-EPA) framework for enabling the participation of battery energy storage systems in multi-service electricity markets. The proposed framework attempts to address the challenge of including the rainflow algorithm for cycle counting by directly developing a closed-form of marginal degradation as a function of dispatch deci…
▽ More
This work proposes a novel degradation-infused energy portfolio allocation (DI-EPA) framework for enabling the participation of battery energy storage systems in multi-service electricity markets. The proposed framework attempts to address the challenge of including the rainflow algorithm for cycle counting by directly developing a closed-form of marginal degradation as a function of dispatch decisions. Further, this closed-form degradation profile is embedded into an energy portfolio allocation (EPA) problem designed for making the optimal dispatch decisions for all the batteries together, in a shared economy manner. We term the entity taking these decisions as `facilitator' which works as a link between storage units and market operators. The proposed EPA formulation is quipped with a conditional-value-at-risk (CVaR)-based mechanism to bring risk-averseness against uncertainty in market prices. The proposed DI-EPA problem introduces fairness by dividing the profits into various units using the idea of marginal contribution. Simulation results regarding the accuracy of the closed-form of degradation, effectiveness of CVaR in handling uncertainty within the EPA problem, and fairness in the context of degradation awareness are discussed. Numerical results indicate that the DI-EPA framework improves the net profit of the storage units by considering the effect of degradation in optimal market participation.
△ Less
Submitted 4 November, 2024; v1 submitted 3 November, 2024;
originally announced November 2024.
-
Optimization Proxies using Limited Labeled Data and Training Time -- A Semi-Supervised Bayesian Neural Network Approach
Authors:
Parikshit Pareek,
Abhijith Jayakumar,
Kaarthik Sundar,
Deepjyoti Deka,
Sidhant Misra
Abstract:
Constrained optimization problems arise in various engineering systems such as inventory management and power grids. Standard deep neural network (DNN) based machine learning proxies are ineffective in practical settings where labeled data is scarce and training times are limited. We propose a semi-supervised Bayesian Neural Networks (BNNs) based optimization proxy for this complex regime, wherein…
▽ More
Constrained optimization problems arise in various engineering systems such as inventory management and power grids. Standard deep neural network (DNN) based machine learning proxies are ineffective in practical settings where labeled data is scarce and training times are limited. We propose a semi-supervised Bayesian Neural Networks (BNNs) based optimization proxy for this complex regime, wherein training commences in a sandwiched fashion, alternating between a supervised learning step for minimizing cost, and an unsupervised learning step for enforcing constraint feasibility. We show that the proposed semi-supervised BNN outperforms DNN architectures on important non-convex constrained optimization problems from energy network operations, achieving up to a tenfold reduction in expected maximum equality gap and halving the inequality gaps. Further, the BNN's ability to provide posterior samples is leveraged to construct practically meaningful probabilistic confidence bounds on performance using a limited validation data, unlike prior methods. The implementation code for this study is available at: https://github.com/kaarthiksundar/BNN-OPF/.
△ Less
Submitted 5 June, 2025; v1 submitted 3 October, 2024;
originally announced October 2024.
-
Demystifying Quantum Power Flow: Unveiling the Limits of Practical Quantum Advantage
Authors:
Parikshit Pareek,
Abhijith Jayakumar,
Carleton Coffrin,
Sidhant Misra
Abstract:
Quantum computers hold promise for solving problems intractable for classical computers, especially those with high time and/or space complexity. The reduction of the power flow (PF) problem into a linear system of equations, allows formulation of quantum power flow (QPF) algorithms, based on quantum linear system solving methods such as the Harrow-Hassidim-Lloyd (HHL) algorithm. The speedup due t…
▽ More
Quantum computers hold promise for solving problems intractable for classical computers, especially those with high time and/or space complexity. The reduction of the power flow (PF) problem into a linear system of equations, allows formulation of quantum power flow (QPF) algorithms, based on quantum linear system solving methods such as the Harrow-Hassidim-Lloyd (HHL) algorithm. The speedup due to QPF algorithms is claimed to be exponential when compared to classical PF solved by state-of-the-art algorithms. We investigate the potential for practical quantum advantage (PQA) in solving QPF compared to classical methods on gate-based quantum computers. We meticulously scrutinize the end-to-end complexity of QPF, providing a nuanced evaluation of the purported quantum speedup in this problem. Our analysis establishes a best-case bound for the HHL-QPF complexity, conclusively demonstrating the absence of any PQA in the direct current power flow (DCPF) and fast decoupled load flow (FDLF) problem. Additionally, we establish that for potential PQA to exist it is necessary to consider DCPF-type problems with a very narrow range of condition number values and readout requirements.
△ Less
Submitted 20 February, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
Data-Efficient Strategies for Probabilistic Voltage Envelopes under Network Contingencies
Authors:
Parikshit Pareek,
Deepjyoti Deka,
Sidhant Misra
Abstract:
This work presents an efficient data-driven method to construct probabilistic voltage envelopes (PVE) using power flow learning in grids with network contingencies. First, a network-aware Gaussian process (GP) termed Vertex-Degree Kernel (VDK-GP), developed in prior work, is used to estimate voltage-power functions for a few network configurations. The paper introduces a novel multi-task vertex de…
▽ More
This work presents an efficient data-driven method to construct probabilistic voltage envelopes (PVE) using power flow learning in grids with network contingencies. First, a network-aware Gaussian process (GP) termed Vertex-Degree Kernel (VDK-GP), developed in prior work, is used to estimate voltage-power functions for a few network configurations. The paper introduces a novel multi-task vertex degree kernel (MT-VDK) that amalgamates the learned VDK-GPs to determine power flows for unseen networks, with a significant reduction in the computational complexity and hyperparameter requirements compared to alternate approaches. Simulations on the IEEE 30-Bus network demonstrate the retention and transfer of power flow knowledge in both N-1 and N-2 contingency scenarios. The MT-VDK-GP approach achieves over 50% reduction in mean prediction error for novel N-1 contingency network configurations in low training data regimes (50-250 samples) over VDK-GP. Additionally, MT-VDK-GP outperforms a hyper-parameter based transfer learning approach in over 75% of N-2 contingency network structures, even without historical N-2 outage data. The proposed method demonstrates the ability to achieve PVEs using sixteen times fewer power flow solutions compared to Monte-Carlo sampling-based methods.
△ Less
Submitted 3 April, 2024; v1 submitted 1 October, 2023;
originally announced October 2023.
-
A Convergence Predictor Model for Consensus-based Decentralised Energy Markets
Authors:
Parikshit Pareek,
L. P. Mohasha Isuru Sampath,
Hung D. Nguyen,
Eddy Y. S. Foo
Abstract:
This letter introduces a convergence prediction model (CPM) for decentralized market clearing mechanisms. The CPM serves as a tool to detect potential cyber-attacks that affect the convergence of the consensus mechanism during ongoing market clearing operations. In this study, we propose a successively elongating Bayesian logistic regression approach to model the probability of convergence of real…
▽ More
This letter introduces a convergence prediction model (CPM) for decentralized market clearing mechanisms. The CPM serves as a tool to detect potential cyber-attacks that affect the convergence of the consensus mechanism during ongoing market clearing operations. In this study, we propose a successively elongating Bayesian logistic regression approach to model the probability of convergence of real-time market mechanisms. The CPM utilizes net-power balance among all the prosumers/market participants as a feature for convergence prediction, enabling a low-dimensional model to operate efficiently for all the prosumers concurrently. The results highlight that the proposed CPM has achieved a net false rate of less than 0.01% for a stressed dataset.
△ Less
Submitted 18 August, 2023;
originally announced August 2023.
-
Fast Risk Assessment in Power Grids through Novel Gaussian Process and Active Learning
Authors:
Parikshit Pareek,
Deepjyoti Deka,
Sidhant Misra
Abstract:
This paper presents a graph-structured Gaussian process (GP) model for data-driven risk assessment of critical voltage constraints. The proposed GP is based on a novel kernel, named the vertex-degree kernel (VDK), that decomposes the voltage-load relationship based on the network graph. To estimate the GP efficiently, we propose a novel active learning scheme that leverages the additive structure…
▽ More
This paper presents a graph-structured Gaussian process (GP) model for data-driven risk assessment of critical voltage constraints. The proposed GP is based on a novel kernel, named the vertex-degree kernel (VDK), that decomposes the voltage-load relationship based on the network graph. To estimate the GP efficiently, we propose a novel active learning scheme that leverages the additive structure of VDK. Further, we prove a probabilistic bound on the error in risk estimation using VDK-GP model that demonstrates that it is statistically comparable to using standard AC power flow (AC-PF), but does not require computing a large number of ACPF solutions. Simulations demonstrate that the proposed VDK-GP achieves more than two fold sample complexity reduction, compared to a generic GP on medium scale 500-Bus and large scale 1354-Bus power systems. Moreover, active learning achieves an impressive reduction of over 15 times in comparison to the time complexity of Monte-Carlo simulations (MCS), and have risk estimation error of order 1E-4 for both 500-Bus and 1354-Bus system, demonstrating its superior efficiency in risk estimation.
△ Less
Submitted 21 July, 2024; v1 submitted 15 August, 2023;
originally announced August 2023.
-
Health-Focused Optimal Power Flow
Authors:
Logesh Kumar,
Parikshit Pareek,
Sivakumar Nadarajan,
Souvik Dasgupta,
Amit Gupta,
Hung D. Nguyen
Abstract:
In this paper, we propose a novel Health-Focused Optimal Power Flow (HF-OPF) to take into account the equipment health in operational and physical constraints. The health condition index is estimated based on the possible fault characteristics for generators and batteries. The paper addresses the need for understanding the relationship between health condition index and the operational constraints…
▽ More
In this paper, we propose a novel Health-Focused Optimal Power Flow (HF-OPF) to take into account the equipment health in operational and physical constraints. The health condition index is estimated based on the possible fault characteristics for generators and batteries. The paper addresses the need for understanding the relationship between health condition index and the operational constraints in OPF problems. Such a relationship is established through Finite Element Method (FEM)-based simulations. The simulations for generator and battery faults indicate the presence of an inflection point after which effect of fault becomes severe. A microgrid system is used to illustrate the performance of the proposed HF-OPF. The results show that health condition inflicts high cost of generation and can lead to infeasibility even with less critical faults.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
-
Gaussian Process Learning-based Probabilistic Optimal Power Flow
Authors:
Parikshit Pareek,
Hung D. Nguyen
Abstract:
In this letter, we present a novel Gaussian Process Learning-based Probabilistic Optimal Power Flow (GP-POPF) for solving POPF under renewable and load uncertainties of arbitrary distribution. The proposed method relies on a non-parametric Bayesian inference-based uncertainty propagation approach, called Gaussian Process (GP). We also suggest a new type of sensitivity called Subspace-wise Sensitiv…
▽ More
In this letter, we present a novel Gaussian Process Learning-based Probabilistic Optimal Power Flow (GP-POPF) for solving POPF under renewable and load uncertainties of arbitrary distribution. The proposed method relies on a non-parametric Bayesian inference-based uncertainty propagation approach, called Gaussian Process (GP). We also suggest a new type of sensitivity called Subspace-wise Sensitivity, using observations on the interpretability of GP-POPF hyperparameters. The simulation results on 14-bus and 30-bus systems show that the proposed method provides reasonably accurate solutions when compared with Monte-Carlo Simulations (MCS) solutions at different levels of uncertain renewable penetration as well as load uncertainties, while requiring much less number of samples and elapsed time.
△ Less
Submitted 16 April, 2020;
originally announced April 2020.
-
A Convexification Approach for Small-Signal Stability Constrained Optimal Power Flow
Authors:
Parikshit Pareek,
Hung D. Nguyen
Abstract:
In this paper, a novel convexification approach for Small-Signal Stability Constraint Optimal Power Flow (SSSC-OPF) has been presented that does not rely on eigenvalue analysis. The proposed methodology is based on the sufficient condition for the small-signal stability, developed as a Bilinear Matrix Inequality (BMI), and uses network structure-preserving Differential Algebraic Equation (DAE) mod…
▽ More
In this paper, a novel convexification approach for Small-Signal Stability Constraint Optimal Power Flow (SSSC-OPF) has been presented that does not rely on eigenvalue analysis. The proposed methodology is based on the sufficient condition for the small-signal stability, developed as a Bilinear Matrix Inequality (BMI), and uses network structure-preserving Differential Algebraic Equation (DAE) modeling of the power system. The proposed formulation is based on Semi-definite Programming (SDP) and objective penalization that has been proposed for feasible solution recovery, making the method computationally efficient for large-scale systems. A vector-norm based objective penalty function has also been proposed for feasible solution recovery while working over large and dense BMIs with matrix variables. An effectiveness study carried out on WECC 9-bus, New England 39-bus, and IEEE 118-bus test systems show that the proposed method is capable of achieving a stable equilibrium point without inflicting a high stability-induced additional cost.
△ Less
Submitted 16 September, 2021; v1 submitted 27 November, 2019;
originally announced November 2019.
-
Non-parametric Probabilistic Load Flow using Gaussian Process Learning
Authors:
Parikshit Pareek,
Chuan Wang,
Hung D. Nguyen
Abstract:
In this work, we propose a non-parametric probabilistic load flow (NP-PLF) technique based on the Gaussian Process (GP) learning to understand the power system behavior under uncertainty for better operational decisions. The technique can provide "semi-explicit" power flow solutions by implementing the learning and testing steps which map control variables to inputs. The proposed NP-PLF leverages…
▽ More
In this work, we propose a non-parametric probabilistic load flow (NP-PLF) technique based on the Gaussian Process (GP) learning to understand the power system behavior under uncertainty for better operational decisions. The technique can provide "semi-explicit" power flow solutions by implementing the learning and testing steps which map control variables to inputs. The proposed NP-PLF leverages upon GP upper confidence bound (GP-UCB) sampling algorithm. The salient features of this NP-PLF method are: i) applicable for power flow problem having power injection uncertainty with an unknown class of distribution; ii) providing probabilistic learning bound (PLB) which further provides control over the error and convergence; iii) capable of handling intermittent distributed generation as well as load uncertainties, and iv) applicable to both balanced and unbalanced power flow with different type and size of power systems. The simulation results performed on the IEEE 30-bus and IEEE 118-bus system show that the proposed method can learn the voltage function over the power injection subspace using a small number of training samples. Further, the testing with different input uncertainty distributions indicates that complete statistical information can be obtained for the probabilistic load flow problem with average percentage relative error of order $10^{-3}$\% on 50000 test points.
△ Less
Submitted 18 March, 2020; v1 submitted 8 November, 2019;
originally announced November 2019.
-
Probabilistic Robust Small-Signal Stability Framework using Gaussian Process Learning
Authors:
Parikshit Pareek,
Hung D. Nguyen
Abstract:
While most power system small-signal stability assessments rely on the reduced Jacobian, which depends non-linearly on the states, uncertain operating points introduce nontrivial hurdles in certifying the system's stability. In this paper, a novel probabilistic robust small-signal stability (PRS) framework is developed for a power system based on Gaussian process (GP) learning. The proposed PRS as…
▽ More
While most power system small-signal stability assessments rely on the reduced Jacobian, which depends non-linearly on the states, uncertain operating points introduce nontrivial hurdles in certifying the system's stability. In this paper, a novel probabilistic robust small-signal stability (PRS) framework is developed for a power system based on Gaussian process (GP) learning. The proposed PRS assessment provides a robust stability certificate for a state subspace, such as that specified by the error bounds of the state estimation, with a given probability. With such a PRS certificate, all inner points of the concerned subspace will be stable with at least the corresponding confidence level. To this end, the behavior of the critical eigenvalue of the reduced Jacobian with state points in a state subspace is learned using GP. The proposed PRS certificate along with the Subspace-based Search and Confidence-based Search mechanisms constitute a holistic framework catering to all scenarios. The proposed framework is a powerful approach to assess the stability under uncertainty because it does not require input uncertainty distributions and other state-specific input-to-output approximations. Further, the critical eigenvalue behavior in a state subspace is analyzed using an upper bound of the eigenvalue variations and their inferences are discussed in detail. The results on three-machine nine-bus WSCC system show that the proposed certificate can find the robust stable state subspace with a given probability.
△ Less
Submitted 3 October, 2019;
originally announced October 2019.