Showing 1–5 of 5 results for author: Callaway, D S

Predicting Electricity Infrastructure Induced Wildfire Risk in California

Authors: Mengqi Yao, Meghana Bharadwaj, Zheng Zhang, Baihong Jin, Duncan S. Callaway

Abstract: This paper examines the use of risk models to predict the timing and location of wildfires caused by electricity infrastructure. Our data include historical ignition and wire-down points triggered by grid infrastructure collected between 2015 to 2019 in Pacific Gas & Electricity territory along with various weather, vegetation, and very high resolution data on grid infrastructure including locatio… ▽ More This paper examines the use of risk models to predict the timing and location of wildfires caused by electricity infrastructure. Our data include historical ignition and wire-down points triggered by grid infrastructure collected between 2015 to 2019 in Pacific Gas & Electricity territory along with various weather, vegetation, and very high resolution data on grid infrastructure including location, age, materials. With these data we explore a range of machine learning methods and strategies to manage training data imbalance. The best area under the receiver operating characteristic we obtain is 0.776 for distribution feeder ignitions and 0.824 for transmission line wire-down events, both using the histogram-based gradient boosting tree algorithm (HGB) with under-sampling. We then use these models to identify which information provides the most predictive value. After line length, we find that weather and vegetation features dominate the list of top important features for ignition or wire-down risk. Distribution ignition models show more dependence on slow-varying vegetation variables such as burn index, energy release content, and tree height, whereas transmission wire-down models rely more on primary weather variables such as wind speed and precipitation. These results point to the importance of improved vegetation modeling for feeder ignition risk models, and improved weather forecasting for transmission wire-down models. We observe that infrastructure features make small but meaningful improvements to risk model predictive power. △ Less

Submitted 11 August, 2022; v1 submitted 6 June, 2022; originally announced June 2022.

Approximated Multi-Agent Fitted Q Iteration

Authors: Antoine Lesage-Landry, Duncan S. Callaway

Abstract: We formulate an efficient approximation for multi-agent batch reinforcement learning, the approximated multi-agent fitted Q iteration (AMAFQI). We present a detailed derivation of our approach. We propose an iterative policy search and show that it yields a greedy policy with respect to multiple approximations of the centralized, learned Q-function. In each iteration and policy evaluation, AMAFQI… ▽ More We formulate an efficient approximation for multi-agent batch reinforcement learning, the approximated multi-agent fitted Q iteration (AMAFQI). We present a detailed derivation of our approach. We propose an iterative policy search and show that it yields a greedy policy with respect to multiple approximations of the centralized, learned Q-function. In each iteration and policy evaluation, AMAFQI requires a number of computations that scales linearly with the number of agents whereas the analogous number of computations increase exponentially for the fitted Q iteration (FQI), a commonly used approaches in batch reinforcement learning. This property of AMAFQI is fundamental for the design of a tractable multi-agent approach. We evaluate the performance of AMAFQI and compare it to FQI in numerical simulations. The simulations illustrate the significant computation time reduction when using AMAFQI instead of FQI in multi-agent problems and corroborate the similar performance of both approaches. △ Less

Submitted 4 April, 2023; v1 submitted 19 April, 2021; originally announced April 2021.

Online Convex Optimization with Binary Constraints

Authors: Antoine Lesage-Landry, Joshua A. Taylor, Duncan S. Callaway

Abstract: We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any time horizon and a specialized bound for finite time horizons. First, we present the regret as the sum of the relaxed, continuous round optimum tracking error an… ▽ More We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any time horizon and a specialized bound for finite time horizons. First, we present the regret as the sum of the relaxed, continuous round optimum tracking error and the rounding error of our update in which the former asymptomatically decreases with time under certain conditions. Then, we derive a finite-time bound that is sublinear in time and linear in the cumulative variation of the relaxed, continuous round optima. We apply bOGD to demand response with thermostatically controlled loads, in which binary constraints model discrete on/off settings. We also model uncertainty and varying load availability, which depend on temperature deadbands, lockout of cooling units and manual overrides. We test the performance of bOGD in several simulations based on demand response. The simulations corroborate that the use of randomization in bOGD does not significantly degrade performance while making the problem more tractable. △ Less

Submitted 19 February, 2021; v1 submitted 5 May, 2020; originally announced May 2020.

Journal ref: IEEE Transactions on Automatic Control 66 (12): 6164 - 6170. December 2021

Dynamic and Distributed Online Convex Optimization for Demand Response of Commercial Buildings

Authors: Antoine Lesage-Landry, Duncan S. Callaway

Abstract: We extend the regret analysis of the online distributed weighted dual averaging (DWDA) algorithm [1] to the dynamic setting and provide the tightest dynamic regret bound known to date with respect to the time horizon for a distributed online convex optimization (OCO) algorithm. Our bound is linear in the cumulative difference between consecutive optima and does not depend explicitly on the time ho… ▽ More We extend the regret analysis of the online distributed weighted dual averaging (DWDA) algorithm [1] to the dynamic setting and provide the tightest dynamic regret bound known to date with respect to the time horizon for a distributed online convex optimization (OCO) algorithm. Our bound is linear in the cumulative difference between consecutive optima and does not depend explicitly on the time horizon. We use dynamic-online DWDA (D-ODWDA) and formulate a performance-guaranteed distributed online demand response approach for heating, ventilation, and air-conditioning (HVAC) systems of commercial buildings. We show the performance of our approach for fast timescale demand response in numerical simulations and obtain demand response decisions that closely reproduce the centralized optimal ones. △ Less

Submitted 17 April, 2020; v1 submitted 31 January, 2020; originally announced February 2020.

Journal ref: IEEE Control Systems Letters, 4 (3): 632-637. July 2020

Price and capacity competition in balancing markets with energy storage

Authors: Josh A. Taylor, Johanna L. Mathieu, Duncan S. Callaway, Kameshwar Poolla

Abstract: Energy storage can absorb variability from the rising number of wind and solar power producers. Storage is different from the conventional generators that have traditionally balanced supply and demand on fast time scales due to its hard energy capacity constraints, dynamic coupling, and low marginal costs. These differences are leading system operators to propose new mechanisms for enabling storag… ▽ More Energy storage can absorb variability from the rising number of wind and solar power producers. Storage is different from the conventional generators that have traditionally balanced supply and demand on fast time scales due to its hard energy capacity constraints, dynamic coupling, and low marginal costs. These differences are leading system operators to propose new mechanisms for enabling storage to participate in reserve and real-time energy markets. The persistence of market power and gaming in electricity markets suggests that these changes will expose new vulnerabilities. We develop a new model of strategic behavior among storages in energy balancing markets. Our model is a two-stage game that generalizes a classic model of capacity followed by Bertrand-Edgeworth price competition by explicitly modeling storage dynamics and uncertainty in the pricing stage. By applying the model to balancing markets with storage, we are able to compare capacity and energy-based pricing schemes, and to analyze the dynamic effects of the market horizon and energy losses due to leakage. Our first key finding is that capacity pricing leads to higher prices and higher capacity commitments, and that energy pricing leads to lower, randomized prices and lower capacity commitments. Second, we find that a longer market horizon and higher physical efficiencies lead to lower prices by inducing the storage to compete to have their states of charge cycled more frequently. △ Less

Submitted 1 July, 2015; v1 submitted 23 March, 2015; originally announced March 2015.