-
Risk-Sensitive Security-Constrained Economic Dispatch: Pricing and Algorithm Design
Authors:
Avinash N. Madavan,
Nathan Dahlin,
Subhonmesh Bose,
Lang Tong
Abstract:
We propose a risk-sensitive security-constrained economic dispatch (R-SCED) formulation capturing the tradeoff between dispatch cost and resilience against potential line failures, where risk is modeled via the conditional value at risk (CVaR). In the context of our formulation, we analyze revenue adequacy and side payments of two pricing models, one based on nominal generation costs, and another…
▽ More
We propose a risk-sensitive security-constrained economic dispatch (R-SCED) formulation capturing the tradeoff between dispatch cost and resilience against potential line failures, where risk is modeled via the conditional value at risk (CVaR). In the context of our formulation, we analyze revenue adequacy and side payments of two pricing models, one based on nominal generation costs, and another based on total marginal cost including contingencies. In particular, we prove that the system operator's (SO) merchandising surplus (MS) and total revenue are nonnegative under the latter, while under the former the same does not hold in general. We demonstrate that the proposed R-SCED formulation is amenable to decomposition and describe a Benders' decomposition algorithm to solve it. In numerical examples, we illustrate the differences in MS and total revenue under the considered pricing schemes, and the computational efficiency of our decomposition approach.
△ Less
Submitted 19 February, 2025;
originally announced February 2025.
-
Nonparametric Sparse Online Learning of the Koopman Operator
Authors:
Boya Hou,
Sina Sanjari,
Nathan Dahlin,
Alec Koppel,
Subhonmesh Bose
Abstract:
The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. Data-driven techniques to learn the Koopman operator typically assume that the chosen function space is closed under system dynamics. In this paper, we study the Koopman operator via its action on the reproducing kernel Hilbert space (RKHS), and explore the mis-specified scenari…
▽ More
The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. Data-driven techniques to learn the Koopman operator typically assume that the chosen function space is closed under system dynamics. In this paper, we study the Koopman operator via its action on the reproducing kernel Hilbert space (RKHS), and explore the mis-specified scenario where the dynamics may escape the chosen function space. We relate the Koopman operator to the conditional mean embeddings (CME) operator and then present an operator stochastic approximation algorithm to learn the Koopman operator iteratively with control over the complexity of the representation. We provide both asymptotic and finite-time last-iterate guarantees of the online sparse learning algorithm with trajectory-based sampling with an analysis that is substantially more involved than that for finite-dimensional stochastic approximation. Numerical examples confirm the effectiveness of the proposed algorithm.
△ Less
Submitted 4 February, 2025; v1 submitted 27 January, 2025;
originally announced January 2025.
-
Nonparametric Sparse Online Learning of the Koopman Operator
Authors:
Boya Hou,
Sina Sanjari,
Nathan Dahlin,
Alec Koppel,
Subhonmesh Bose
Abstract:
The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. Data-driven techniques to learn the Koopman operator typically assume that the chosen function space is closed under system dynamics. In this paper, we study the Koopman operator via its action on the reproducing kernel Hilbert space (RKHS), and explore the mis-specified scenari…
▽ More
The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. Data-driven techniques to learn the Koopman operator typically assume that the chosen function space is closed under system dynamics. In this paper, we study the Koopman operator via its action on the reproducing kernel Hilbert space (RKHS), and explore the mis-specified scenario where the dynamics may escape the chosen function space. We relate the Koopman operator to the conditional mean embeddings (CME) operator and then present an operator stochastic approximation algorithm to learn the Koopman operator iteratively with control over the complexity of the representation. We provide both asymptotic and finite-time last-iterate guarantees of the online sparse learning algorithm with trajectory-based sampling with an analysis that is substantially more involved than that for finite-dimensional stochastic approximation. Numerical examples confirm the effectiveness of the proposed algorithm.
△ Less
Submitted 4 February, 2025; v1 submitted 12 May, 2024;
originally announced May 2024.
-
Exact and Cost-Effective Automated Transformation of Neural Network Controllers to Decision Tree Controllers
Authors:
Kevin Chang,
Nathan Dahlin,
Rahul Jain,
Pierluigi Nuzzo
Abstract:
Over the past decade, neural network (NN)-based controllers have demonstrated remarkable efficacy in a variety of decision-making tasks. However, their black-box nature and the risk of unexpected behaviors and surprising results pose a challenge to their deployment in real-world systems with strong guarantees of correctness and safety. We address these limitations by investigating the transformati…
▽ More
Over the past decade, neural network (NN)-based controllers have demonstrated remarkable efficacy in a variety of decision-making tasks. However, their black-box nature and the risk of unexpected behaviors and surprising results pose a challenge to their deployment in real-world systems with strong guarantees of correctness and safety. We address these limitations by investigating the transformation of NN-based controllers into equivalent soft decision tree (SDT)-based controllers and its impact on verifiability. Differently from previous approaches, we focus on discrete-output NN controllers including rectified linear unit (ReLU) activation functions as well as argmax operations. We then devise an exact but cost-effective transformation algorithm, in that it can automatically prune redundant branches. We evaluate our approach using two benchmarks from the OpenAI Gym environment. Our results indicate that the SDT transformation can benefit formal verification, showing runtime improvements of up to 21x and 2x for MountainCar-v0 and CartPole-v0, respectively.
△ Less
Submitted 15 September, 2023; v1 submitted 11 April, 2023;
originally announced April 2023.
-
Controlling a Markov Decision Process with an Abrupt Change in the Transition Kernel
Authors:
Nathan Dahlin,
Subhonmesh Bose,
Venugopal V. Veeravalli
Abstract:
We consider the control of a Markov decision process (MDP) that undergoes an abrupt change in its transition kernel (mode). We formulate the problem of minimizing regret under control-switching based on mode change detection, compared to a mode-observing controller, as an optimal stopping problem. Using a sequence of approximations, we reduce it to a quickest change detection (QCD) problem with Ma…
▽ More
We consider the control of a Markov decision process (MDP) that undergoes an abrupt change in its transition kernel (mode). We formulate the problem of minimizing regret under control-switching based on mode change detection, compared to a mode-observing controller, as an optimal stopping problem. Using a sequence of approximations, we reduce it to a quickest change detection (QCD) problem with Markovian data, for which we characterize a state-dependent threshold-type optimal change detection policy. Numerical experiments illustrate various properties of our control-switching policy.
△ Less
Submitted 8 October, 2022;
originally announced October 2022.
-
Conditional Value at Risk-Sensitive Solar Hosting Capacity Analysis in Distribution Networks
Authors:
Avinash N. Madavan,
Nathan Dahlin,
Subhonmesh Bose,
Lang Tong
Abstract:
Solar hosting capacity analysis (HCA) assesses the ability of a distribution network to host distributed solar generation without seriously violating distribution network constraints. In this paper, we consider risk-sensitive HCA that limits the risk of network constraint violations with a collection of scenarios of solar irradiance and nodal power demands, where risk is modeled via the conditiona…
▽ More
Solar hosting capacity analysis (HCA) assesses the ability of a distribution network to host distributed solar generation without seriously violating distribution network constraints. In this paper, we consider risk-sensitive HCA that limits the risk of network constraint violations with a collection of scenarios of solar irradiance and nodal power demands, where risk is modeled via the conditional value at risk (CVaR) measure. First, we consider the question of maximizing aggregate installed solar capacities, subject to risk constraints and solve it as a second-order cone program (SOCP) with a standard conic relaxation of the feasible set with power flow equations. Second, we design an incremental algorithm to decide whether a configuration of solar installations has acceptable risk of constraint violations, modeled via CVaR. The algorithm circumvents explicit risk computation by incrementally constructing inner and outer polyhedral approximations of the set of acceptable solar installation configurations from prior such tests conducted. Our numerical examples study the impact of risk parameters, the number of scenarios and the scalability of our framework.
△ Less
Submitted 19 April, 2022;
originally announced April 2022.
-
Scheduling Flexible Non-Preemptive Loads in Smart-Grid Networks
Authors:
Nathan Dahlin,
Rahul Jain
Abstract:
A market consisting of a generator with thermal and renewable generation capability, a set of non-preemptive loads (i.e., loads which cannot be interrupted once started), and an independent system operator (ISO) is considered. Loads are characterized by durations, power demand rates and utility for receiving service, as well as disutility functions giving preferences for time slots in which servic…
▽ More
A market consisting of a generator with thermal and renewable generation capability, a set of non-preemptive loads (i.e., loads which cannot be interrupted once started), and an independent system operator (ISO) is considered. Loads are characterized by durations, power demand rates and utility for receiving service, as well as disutility functions giving preferences for time slots in which service is preferred. Given this information, along with the generator's thermal generation cost function and forecast renewable generation, the social planner solves a mixed integer program to determine a load activation schedule which maximizes social welfare. Assuming price taking behavior, we develop a competitive equilibrium concept based on a relaxed version of the social planner's problem which includes prices for consumption and incentives for flexibility, and allows for probabilistic allocation of power to loads. Considering each load as representative of a population of identical loads with scaled characteristics, we demonstrate that the relaxed social planner's problem gives an exact solution to the original mixed integer problem in the large population limit, and give a market mechanism for implementing the competitive equilibrium. Finally, we evaluate via case study the benefit of incorporating load flexibility information into power consumption and generation scheduling in terms of proportion of loads served and overall social welfare.
△ Less
Submitted 12 December, 2021; v1 submitted 30 March, 2020;
originally announced March 2020.
-
A Risk Aware Two-Stage Market Mechanism for Electricity with Renewable Generation
Authors:
Nathan Dahlin,
Rahul Jain
Abstract:
Over the last few decades, electricity markets around the world have adopted multi-settlement structures, allowing for balancing of supply and demand as more accurate forecast information becomes available. Given increasing uncertainty due to adoption of renewables, more recent market design work has focused on optimization of expectation of some quantity, e.g. social welfare. However, social plan…
▽ More
Over the last few decades, electricity markets around the world have adopted multi-settlement structures, allowing for balancing of supply and demand as more accurate forecast information becomes available. Given increasing uncertainty due to adoption of renewables, more recent market design work has focused on optimization of expectation of some quantity, e.g. social welfare. However, social planners and policy makers are often risk averse, so that such risk neutral formulations do not adequately reflect prevailing attitudes towards risk, nor explain the decisions that follow. Hence we incorporate the commonly used risk measure conditional value at risk (CVaR) into the central planning objective, and study how a two-stage market operates when the individual generators are risk neutral. Our primary result is to show existence (by construction) of a sequential competitive equilibrium (SCEq) in this risk-aware two-stage market. Given equilibrium prices, we design a market mechanism which achieves social cost minimization assuming that agents are non strategic.
△ Less
Submitted 13 March, 2020;
originally announced March 2020.
-
Two-Stage Electricity Markets with Renewable Energy Integration: Market Mechanisms and Equilibrium Analysis
Authors:
Nathan Dahlin,
Rahul Jain
Abstract:
We consider a two-stage market mechanism for trading electricity including renewable generation as an alternative to the widely used multi-settlement market structure. The two-stage market structure allows for recourse decisions by the market operator, which are not possible in today's markets. We allow for different conventional generation cost curves in the forward and the real-time stages. We h…
▽ More
We consider a two-stage market mechanism for trading electricity including renewable generation as an alternative to the widely used multi-settlement market structure. The two-stage market structure allows for recourse decisions by the market operator, which are not possible in today's markets. We allow for different conventional generation cost curves in the forward and the real-time stages. We have considered costs of demand response programs and black outs, and adopt a DC power flow model to account for network constraints. Our first result is to show existence (by construction) of a sequential competitive equilibrium (SCEq) in such a two-stage market. We argue social welfare properties of such an SCEq, and then design a market mechanism that achieves social welfare maximization when the market participants are non-strategic. We also show that under either a congestion-free or a monopoly-free condition, an efficient Nash equilibrium exists.
△ Less
Submitted 14 June, 2021; v1 submitted 1 September, 2019;
originally announced September 2019.
