-
Ancillary Services in Power System Transition Toward a 100% Non-Fossil Future: Market Design Challenges in the United States and Europe
Authors:
Luigi Viola,
Saeed Nordin,
Daniel Dotta,
Mohammad Reza Hesamzadeh,
Ross Baldick,
Damian Flynn
Abstract:
The expansion of variable generation has driven a transition toward a 100\% non-fossil power system. New system needs are challenging system stability and suggesting the need for a redesign of the ancillary service (AS) markets. This paper presents a comprehensive and broad review for industrial practitioners and academic researchers regarding the challenges and potential solutions to accommodate…
▽ More
The expansion of variable generation has driven a transition toward a 100\% non-fossil power system. New system needs are challenging system stability and suggesting the need for a redesign of the ancillary service (AS) markets. This paper presents a comprehensive and broad review for industrial practitioners and academic researchers regarding the challenges and potential solutions to accommodate high shares of variable renewable energy (VRE) generation levels. We detail the main drivers enabling the energy transition and facilitating the provision of ASs. A systematic review of the United States and European AS markets is conducted. We clearly organize the main ASs in a standard taxonomy, identifying current practices and initiatives to support the increasing VRE share. Furthermore, we envision the future of modern AS markets, proposing potential solutions for some remaining fundamental technical and market design challenges.
△ Less
Submitted 26 October, 2023;
originally announced November 2023.
-
Enhanced Modeling of Contingency Response in Security-constrained Optimal Power Flow
Authors:
Tuncay Altun,
Ramtin Madani,
Alper Atamturk,
Ross Baldick,
Ali Davoudi
Abstract:
This paper provides an enhanced modeling of the contingency response that collectively reflects high-fidelity physical and operational characteristics of power grids. Integrating active and reactive power contingency responses into the security-constrained optimal power flow (SCOPF) problem is challenging, due to the nonsmoothness and nonconvexity of feasible sets in consequence of piece-wise curv…
▽ More
This paper provides an enhanced modeling of the contingency response that collectively reflects high-fidelity physical and operational characteristics of power grids. Integrating active and reactive power contingency responses into the security-constrained optimal power flow (SCOPF) problem is challenging, due to the nonsmoothness and nonconvexity of feasible sets in consequence of piece-wise curves representing generator characteristics. We introduce a continuously-differentiable model using functions that closely resemble PV/PQ switching and the generator contingency response. These models enforce physical and operational limits by optimally allocating active power imbalances among available generators and deciding the bus type to switch from the PV type to the PQ type. The efficacy of this method is numerically validated on the IEEE 30-bus, 300-bus, and 118-bus systems with 12, 10, and 100 contingencies, respectively.
△ Less
Submitted 17 February, 2021;
originally announced February 2021.
-
Requirements for Interdependent Reserve Types
Authors:
Manuel Garcia,
Ross Baldick
Abstract:
As renewable energy penetration increases and system inertia levels drop, primary frequency control is becoming a critical concern in relatively small interconnections such as the Electric Reliability Council of Texas (ERCOT). To address this problem ERCOT is implementing a number of market rule changes including the introduction of a new Fast Frequency Response (FFR) reserve type to the electrici…
▽ More
As renewable energy penetration increases and system inertia levels drop, primary frequency control is becoming a critical concern in relatively small interconnections such as the Electric Reliability Council of Texas (ERCOT). To address this problem ERCOT is implementing a number of market rule changes including the introduction of a new Fast Frequency Response (FFR) reserve type to the electricity market. This FFR reserve type aims to help the traditional Primary Frequency Response (PFR) reserve type in arresting frequency decline in the event of a large generator outage. This paper derives reserve requirements to ensure sufficient reserve to arrest frequency decline before reaching the critical frequency threshold while coupling PFR reserve, FFR reserve, and system inertia. The general reserve requirement places limits on the amount of PFR reserve that can be provided by each unit based on its ramping capabilities. Two such limits are derived from first principles and another is proposed that is capable of accommodating the equivalency ratio introduced in previous work. These PFR reserve limits also provide first principles insight into equivalency ratios, which have only been studied empirically in the past. High-level insights are provided on a large Texas test case.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
Enhanced Ramping Product Design to Improve Power System Reliability
Authors:
Hyeongon Park,
Bing Huang,
Ross Baldick
Abstract:
The roll-out of a flexible ramping product provides Independent System Operators (ISOs) with the ability to address ramping capacity shortages. ISOs procure flexible ramping capability by committing more generating units or reserving a certain amount of head room of committed units. In this paper, we raise the concern of the possibility that the procured ramping capability cannot be deployed in re…
▽ More
The roll-out of a flexible ramping product provides Independent System Operators (ISOs) with the ability to address ramping capacity shortages. ISOs procure flexible ramping capability by committing more generating units or reserving a certain amount of head room of committed units. In this paper, we raise the concern of the possibility that the procured ramping capability cannot be deployed in real-time operations. As a solution to the non-delivery issue, we provide a new ramping product designed to improve reliability and reduce the expected operating cost. The trajectory of start-up and shutdown processes is also considered in determining the ramping capability. A new optimization problem is formulated using mixed integer linear programming to be readily applied to practical power system operation. The performance of this proposed method is verified through simulations using a small-scale system and IEEE 118-bus systems. The simulation results demonstrate that the proposed formulation can realize improved generation scheduling alleviating capacity shortages.
△ Less
Submitted 5 May, 2019;
originally announced May 2019.
-
A General Economic Dispatch Problem with Marginal Losses
Authors:
Manuel Garcia,
Ross Baldick,
Shams Siddiqi
Abstract:
Standard economic dispatch problems that consider line losses are linear approximations of a non-convex economic dispatch problem formulated by fixing voltage magnitudes and assuming the decoupling of real and reactive power. This paper formulates and analyzes the general non-convex economic dispatch problem, incorporating and generalizing the Fictitious Nodal Demand (FND) model, resulting in a sl…
▽ More
Standard economic dispatch problems that consider line losses are linear approximations of a non-convex economic dispatch problem formulated by fixing voltage magnitudes and assuming the decoupling of real and reactive power. This paper formulates and analyzes the general non-convex economic dispatch problem, incorporating and generalizing the Fictitious Nodal Demand (FND) model, resulting in a slack bus independent formulation that provides insight into standard formulations by pointing out commonly used but unnecessary assumptions and by deriving proper choices of "tuning parameters." The proper choice of loss allocation is derived to assign half of the losses of each transmission line to adjacent buses, justifying approaches in the literature. Line constraints are proposed in the form of voltage angle difference limits and are proven equivalent to various other line limits including current magnitude limits and mid-line power flow limits. The formulated general economic dispatch problem with marginal losses consistently models flows and loss approximation, results in approximately correct outcomes and is proven to be reference bus independent. Various approximations of this problem are compared using realistically large transmission network test cases.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Integrated PV Charging of EV Fleet Based on Dynamic Energy Prices and Offer of Reserves
Authors:
Gautham Ram Chandra Mouli,
Mahdi Kefayati,
Ross Baldick,
Pavol Bauer
Abstract:
Workplace charging of electric vehicles (EV) from photovoltaic (PV) panels installed on an office building can provide several benefits. This includes the local production and use of PV energy for charging the EV and making use of dynamic tariffs from the grid to schedule the energy exchange with the grid. The long parking time of EV at the workplace provide the chance for the EV to support the gr…
▽ More
Workplace charging of electric vehicles (EV) from photovoltaic (PV) panels installed on an office building can provide several benefits. This includes the local production and use of PV energy for charging the EV and making use of dynamic tariffs from the grid to schedule the energy exchange with the grid. The long parking time of EV at the workplace provide the chance for the EV to support the grid via vehicle-to-grid technology, the use of a single EV charger for charging several EV by multiplexing and the offer of ancillary services to the grid for up and down regulation. Further, distribution network constraints can be considered to limit the power and prevent the overloading of the grid. A single MILP formulation that considers all the above applications has been proposed in this paper for a charging a fleet of EVs from PV. The MILP is implemented as a receding-horizon model predictive energy management system. Numerical simulation based on market and PV data in Austin, Texas have shown 31% to 650% reduction in the cost of EV charging when compared to immediate and average rate charging policies.
△ Less
Submitted 7 May, 2017;
originally announced May 2017.
-
A Convex Primal Formulation for Convex Hull Pricing
Authors:
Bowen Hua,
Ross Baldick
Abstract:
In certain electricity markets, because of non-convexities that arise from their operating characteristics, generators that follow the independent system operator's (ISO's) decisions may fail to recover their cost through sales of energy at locational marginal prices. Discriminatory side payments are made by the ISO to incentivize the compliance of generators. Convex hull pricing is a uniform pric…
▽ More
In certain electricity markets, because of non-convexities that arise from their operating characteristics, generators that follow the independent system operator's (ISO's) decisions may fail to recover their cost through sales of energy at locational marginal prices. Discriminatory side payments are made by the ISO to incentivize the compliance of generators. Convex hull pricing is a uniform pricing scheme that minimizes these side payments. The Lagrangian dual problem of the unit commitment problem has been used to determine convex hull prices. However, this approach is computationally expensive. In this paper, we propose a polynomially-solvable primal formulation for the Lagrangian dual problem. This formulation explicitly describes for each generating unit the convex hull of its feasible set and the convex envelope of its cost function. We cast our formulation as a second-order cone program when the cost functions are quadratic, and a linear program when the cost functions are piecewise linear. A 96-period 76-unit transmission-constrained example is solved in less than fifteen seconds on a personal computer.
△ Less
Submitted 15 June, 2020; v1 submitted 16 May, 2016;
originally announced May 2016.
-
Jamming aided Generalized Data Attacks: Exposing Vulnerabilities in Secure Estimation
Authors:
Deepjyoti Deka,
Ross Baldick,
Sriram Vishwanath
Abstract:
Jamming refers to the deletion, corruption or damage of meter measurements that prevents their further usage. This is distinct from adversarial data injection that changes meter readings while preserving their utility in state estimation. This paper presents a generalized attack regime that uses jamming of secure and insecure measurements to greatly expand the scope of common 'hidden' and 'detecta…
▽ More
Jamming refers to the deletion, corruption or damage of meter measurements that prevents their further usage. This is distinct from adversarial data injection that changes meter readings while preserving their utility in state estimation. This paper presents a generalized attack regime that uses jamming of secure and insecure measurements to greatly expand the scope of common 'hidden' and 'detectable' data injection attacks in literature. For 'hidden' attacks, it is shown that with jamming, the optimal attack is given by the minimum feasible cut in a specific weighted graph. More importantly, for 'detectable' data attacks, this paper shows that the entire range of relative costs for adversarial jamming and data injection can be divided into three separate regions, with distinct graph-cut based constructions for the optimal attack. Approximate algorithms for attack design are developed and their performances are demonstrated by simulations on IEEE test cases. Further, it is proved that prevention of such attacks require security of all grid measurements. This work comprehensively quantifies the dual adversarial benefits of jamming: (a) reduced attack cost and (b) increased resilience to secure measurements, that strengthen the potency of data attacks.
△ Less
Submitted 15 September, 2015;
originally announced September 2015.
-
Voltage Regulation Algorithms for Multiphase Power Distribution Grids
Authors:
Vassilis Kekatos,
Liang Zhang,
Georgios B. Giannakis,
Ross Baldick
Abstract:
Time-varying renewable energy generation can result in serious under-/over-voltage conditions in future distribution grids. Augmenting conventional utility-owned voltage regulating equipment with the reactive power capabilities of distributed generation units is a viable solution. Local control options attaining global voltage regulation optimality at fast convergence rates is the goal here. In th…
▽ More
Time-varying renewable energy generation can result in serious under-/over-voltage conditions in future distribution grids. Augmenting conventional utility-owned voltage regulating equipment with the reactive power capabilities of distributed generation units is a viable solution. Local control options attaining global voltage regulation optimality at fast convergence rates is the goal here. In this context, novel reactive power control rules are analyzed under a unifying linearized grid model. For single-phase grids, our proximal gradient scheme has computational complexity comparable to that of the rule suggested by the IEEE 1547.8 standard, but it enjoys well-characterized convergence guarantees. Adding memory to the scheme results in accelerated convergence. For three-phase grids, it is shown that reactive injections have a counter-intuitive effect on bus voltage magnitudes across phases. Nevertheless, when our control scheme is applied to unbalanced conditions, it is shown to reach an equilibrium point. Yet this point may not correspond to the minimizer of a voltage regulation problem. Numerical tests using the IEEE 13-bus, the IEEE 123-bus, and a Southern California Edison 47-bus feeder with increased renewable penetration verify the convergence properties of the schemes and their resiliency to grid topology reconfigurations.
△ Less
Submitted 26 August, 2015;
originally announced August 2015.
-
Reducing the Candidate Line List for Practical Integration of Switching into Power System Operation
Authors:
Mohammad Majidi-Qadikolai,
Ross Baldick
Abstract:
Optimized operation of the transmission network is one solution to supply extra demand by more efficient use of transmission facilities, and line switching is one main tool to achieve this goal. In this paper, we add extra constraints to OPF formulation to limit the maximum number of switching operations in every hour based on network conditions, and add switching cost in the objective function to…
▽ More
Optimized operation of the transmission network is one solution to supply extra demand by more efficient use of transmission facilities, and line switching is one main tool to achieve this goal. In this paper, we add extra constraints to OPF formulation to limit the maximum number of switching operations in every hour based on network conditions, and add switching cost in the objective function to represent extra maintenance cost as a result of frequent switching. We also propose an algorithm to remove less important lines for switching in different loading conditions, so OPF with transmission switching will be solved faster for real-time operation. It is applied to a case study with several operation hours.
△ Less
Submitted 26 July, 2015; v1 submitted 14 July, 2015;
originally announced July 2015.
-
Optimal Data Attacks on Power Grids: Leveraging Detection & Measurement Jamming
Authors:
Deepjyoti Deka,
Ross Baldick,
Sriram Vishwanath
Abstract:
Meter measurements in the power grid are susceptible to manipulation by adversaries, that can lead to errors in state estimation. This paper presents a general framework to study attacks on state estimation by adversaries capable of injecting bad-data into measurements and further, of jamming their reception. Through these two techniques, a novel `detectable jamming' attack is designed that change…
▽ More
Meter measurements in the power grid are susceptible to manipulation by adversaries, that can lead to errors in state estimation. This paper presents a general framework to study attacks on state estimation by adversaries capable of injecting bad-data into measurements and further, of jamming their reception. Through these two techniques, a novel `detectable jamming' attack is designed that changes the state estimation despite failing bad-data detection checks. Compared to commonly studied `hidden' data attacks, these attacks have lower costs and a wider feasible operating region. It is shown that the entire domain of jamming costs can be divided into two regions, with distinct graph-cut based formulations for the design of the optimal attack. The most significant insight arising from this result is that the adversarial capability to jam measurements changes the optimal 'detectable jamming' attack design only if the jamming cost is less than half the cost of bad-data injection. A polynomial time approximate algorithm for attack vector construction is developed and its efficacy in attack design is demonstrated through simulations on IEEE test systems.
△ Less
Submitted 15 June, 2015;
originally announced June 2015.
-
One Breaker is Enough: Hidden Topology Attacks on Power Grids
Authors:
Deepjyoti Deka,
Ross Baldick,
Sriram Vishwanath
Abstract:
A coordinated cyber-attack on grid meter readings and breaker statuses can lead to incorrect state estimation that can subsequently destabilize the grid. This paper studies cyber-attacks by an adversary that changes breaker statuses on transmission lines to affect the estimation of the grid topology. The adversary, however, is incapable of changing the value of any meter data and can only block re…
▽ More
A coordinated cyber-attack on grid meter readings and breaker statuses can lead to incorrect state estimation that can subsequently destabilize the grid. This paper studies cyber-attacks by an adversary that changes breaker statuses on transmission lines to affect the estimation of the grid topology. The adversary, however, is incapable of changing the value of any meter data and can only block recorded measurements on certain lines from being transmitted to the control center. The proposed framework, with limited resource requirements as compared to standard data attacks, thus extends the scope of cyber-attacks to grids secure from meter corruption. We discuss necessary and sufficient conditions for feasible attacks using a novel graph-coloring based analysis and show that an optimal attack requires breaker status change at only ONE transmission line. The potency of our attack regime is demonstrated through simulations on IEEE test cases.
△ Less
Submitted 13 June, 2015;
originally announced June 2015.
-
Online Energy Price Matrix Factorization for Power Grid Topology Tracking
Authors:
Vassilis Kekatos,
Georgios B. Giannakis,
Ross Baldick
Abstract:
Grid security and open markets are two major smart grid goals. Transparency of market data facilitates a competitive and efficient energy environment, yet it may also reveal critical physical system information. Recovering the grid topology based solely on publicly available market data is explored here. Real-time energy prices are calculated as the Lagrange multipliers of network-constrained econ…
▽ More
Grid security and open markets are two major smart grid goals. Transparency of market data facilitates a competitive and efficient energy environment, yet it may also reveal critical physical system information. Recovering the grid topology based solely on publicly available market data is explored here. Real-time energy prices are calculated as the Lagrange multipliers of network-constrained economic dispatch; that is, via a linear program (LP) typically solved every 5 minutes. Granted the grid Laplacian is a parameter of this LP, one could infer such a topology-revealing matrix upon observing successive LP dual outcomes. The matrix of spatio-temporal prices is first shown to factor as the product of the inverse Laplacian times a sparse matrix. Leveraging results from sparse matrix decompositions, topology recovery schemes with complementary strengths are subsequently formulated. Solvers scalable to high-dimensional and streaming market data are devised. Numerical validation using real load data on the IEEE 30-bus grid provide useful input for current and future market designs.
△ Less
Submitted 22 October, 2014;
originally announced October 2014.
-
Optimal Policies for Simultaneous Energy Consumption and Ancillary Service Provision for Flexible Loads under Stochastic Prices and No Capacity Reservation Constraint
Authors:
Mahdi Kefayati,
Ross Baldick
Abstract:
Flexible loads, i.e. the loads whose power trajectory is not bound to a specific one, constitute a sizable portion of current and future electric demand. This flexibility can be used to improve the performance of the grid, should the right incentives be in place.
In this paper, we consider the optimal decision making problem faced by a flexible load, demanding a certain amount of energy over its…
▽ More
Flexible loads, i.e. the loads whose power trajectory is not bound to a specific one, constitute a sizable portion of current and future electric demand. This flexibility can be used to improve the performance of the grid, should the right incentives be in place.
In this paper, we consider the optimal decision making problem faced by a flexible load, demanding a certain amount of energy over its availability period, subject to rate constraints. The load is also capable of providing Ancillary Services (AS) by decreasing or increasing its consumption in response to signals from the Independent System Operator. Under arbitrarily distributed and correlated Markovian energy and AS prices, we obtain the optimal policy for minimizing expected total cost, which includes cost of energy and benefits from AS provision, assuming no capacity reservation requirement for AS provision. We also prove that the optimal policy has a multi-threshold form and can be computed, stored and operated efficiently. We further study the effectiveness of our proposed optimal policy and its impact on the grid.
We show that, while optimal simultaneous consumption and AS provision under real-time stochastic prices is achievable with acceptable computational burden, the impact of adopting such real-time pricing schemes on the network might not be as good as suggested by the majority of the existing literature. In fact, we show that such price responsive loads are likely to induce peak-to-average ratios much more than what is observed in the current distribution networks and adversely affect the grid.
△ Less
Submitted 6 July, 2014;
originally announced July 2014.
-
Exact and Efficient Algorithm to Discover Extreme Stochastic Events in Wind Generation over Transmission Power Grids
Authors:
Michael Chertkov,
Mikhail Stepanov,
Feng Pan,
Ross Baldick
Abstract:
In this manuscript we continue the thread of [M. Chertkov, F. Pan, M. Stepanov, Predicting Failures in Power Grids: The Case of Static Overloads, IEEE Smart Grid 2011] and suggest a new algorithm discovering most probable extreme stochastic events in static power grids associated with intermittent generation of wind turbines. The algorithm becomes EXACT and EFFICIENT (polynomial) in the case of th…
▽ More
In this manuscript we continue the thread of [M. Chertkov, F. Pan, M. Stepanov, Predicting Failures in Power Grids: The Case of Static Overloads, IEEE Smart Grid 2011] and suggest a new algorithm discovering most probable extreme stochastic events in static power grids associated with intermittent generation of wind turbines. The algorithm becomes EXACT and EFFICIENT (polynomial) in the case of the proportional (or other low parametric) control of standard generation, and log-concave probability distribution of the renewable generation, assumed known from the wind forecast. We illustrate the algorithm's ability to discover problematic extreme events on the example of the IEEE RTS-96 model of transmission with additions of 10%, 20% and 30% of renewable generation. We observe that the probability of failure may grow but it may also decrease with increase in renewable penetration, if the latter is sufficiently diversified and distributed.
△ Less
Submitted 6 September, 2011; v1 submitted 1 April, 2011;
originally announced April 2011.
