-
A Nationwide Multi-Location Multi-Resource Stochastic Programming Based Energy Planning Framework
Authors:
Razan A. H. Al-Lawati,
Tasnim Ibn Faiz,
Md. Noor-E-Alam
Abstract:
The global increase in energy consumption and demand has forced many countries to transition into including more diverse energy sources in their electricity market. To efficiently utilize the available fuel resources, all energy sources must be optimized simultaneously. However, the inherent variability in variable renewable energy generators makes deterministic models ineffective. On the other ha…
▽ More
The global increase in energy consumption and demand has forced many countries to transition into including more diverse energy sources in their electricity market. To efficiently utilize the available fuel resources, all energy sources must be optimized simultaneously. However, the inherent variability in variable renewable energy generators makes deterministic models ineffective. On the other hand, comprehensive stochastic models, including all sources of generation across a nation, can become computationally intractable. This work proposes a comprehensive national energy planning framework from a policymaker's perspective, which is generalizable to any country, region, or any group of countries in energy trade agreements. Given its relative land area and energy consumption globally, the United States is selected as a case study. A two-stage stochastic programming approach is adopted, and a scenario-based Benders decomposition modeling approach is employed to achieve computational efficiency for the large-scale model. Data is obtained from the U.S. Energy Information Administration's online data collection. Scenarios for the uncertain parameters are developed using a k-means clustering algorithm. Various cases are compared from a financial perspective to inform policymaking by identifying implementable cost-reduction strategies. The findings underscore the importance of promoting resource coordination and demonstrate the impact of increasing interchange and renewable energy capacity on overall gains. Moreover, the study highlights the value of stochastic optimization modeling compared to deterministic modeling to make energy planning decisions.
△ Less
Submitted 4 March, 2024; v1 submitted 1 October, 2023;
originally announced October 2023.
-
Two-Stage Stochastic Optimization Frameworks to Aid in Decision-Making Under Uncertainty for Variable Resource Generators Participating in a Sequential Energy Market
Authors:
Razan A. H. Al-Lawati,
Jose L. Crespo-Vazquez,
Tasnim Ibn Faiz,
Xin Fang,
Md. Noor-E-Alam
Abstract:
Decisions for a variable renewable resource generators commitment in the energy market are typically made in advance when little information is obtainable about wind availability and market prices. Much research has been published recommending various frameworks for addressing this issue. However, these frameworks are limited as they do not consider all markets a producer can participate in. Moreo…
▽ More
Decisions for a variable renewable resource generators commitment in the energy market are typically made in advance when little information is obtainable about wind availability and market prices. Much research has been published recommending various frameworks for addressing this issue. However, these frameworks are limited as they do not consider all markets a producer can participate in. Moreover, current stochastic programming models do not allow for uncertainty data to be updated as more accurate information becomes available. This work proposes two decision-making frameworks for a wind energy generator participating in day-ahead, intraday, reserve, and balancing markets. The first framework is a two-stage stochastic convex optimization approach, where both scenario-independent and scenario-dependent decisions are made concurrently. The second framework is a series of four two-stage stochastic optimization models wherein the results from each model feed into each subsequent model allowing for scenarios to be updated as more information becomes available to the decision-maker. In the simulation experiments, the multi-phase framework performs better than the single-phase in every run, and results in an average profit increase of 7%. The proposed optimization frameworks aid in better decision-making while addressing uncertainty related to variable resource generators and maximize the return on investment.
△ Less
Submitted 6 March, 2021; v1 submitted 24 December, 2020;
originally announced December 2020.
-
Anytime Minibatch with Delayed Gradients
Authors:
Haider Al-Lawati,
Stark C. Draper
Abstract:
Distributed optimization is widely deployed in practice to solve a broad range of problems. In a typical asynchronous scheme, workers calculate gradients with respect to out-of-date optimization parameters while the master uses stale (i.e., delayed) gradients to update the parameters. While using stale gradients can slow the convergence, asynchronous methods speed up the overall optimization with…
▽ More
Distributed optimization is widely deployed in practice to solve a broad range of problems. In a typical asynchronous scheme, workers calculate gradients with respect to out-of-date optimization parameters while the master uses stale (i.e., delayed) gradients to update the parameters. While using stale gradients can slow the convergence, asynchronous methods speed up the overall optimization with respect to wall clock time by allowing more frequent updates and reducing idling times. In this paper, we present a variable per-epoch minibatch scheme called Anytime Minibatch with Delayed Gradients (AMB-DG). In AMB-DG, workers compute gradients in epochs of a fixed time while the master uses stale gradients to update the optimization parameters. We analyze AMB-DG in terms of its regret bound and convergence rate. We prove that for convex smooth objective functions, AMB-DG achieves the optimal regret bound and convergence rate. We compare the performance of AMB-DG with that of Anytime Minibatch (AMB) which is similar to AMB-DG but does not use stale gradients. In AMB, workers stay idle after each gradient transmission to the master until they receive the updated parameters from the master while in AMB-DG workers never idle. We also extend AMB-DG to the fully distributed setting. We compare AMB-DG with AMB when the communication delay is long and observe that AMB-DG converges faster than AMB in wall clock time. We also compare the performance of AMB-DG with the state-of-the-art fixed minibatch approach that uses delayed gradients. We run our experiments on a real distributed system and observe that AMB-DG converges more than two times.
△ Less
Submitted 15 December, 2020;
originally announced December 2020.
-
Anytime MiniBatch: Exploiting Stragglers in Online Distributed Optimization
Authors:
Nuwan Ferdinand,
Haider Al-Lawati,
Stark C. Draper,
Matthew Nokleby
Abstract:
Distributed optimization is vital in solving large-scale machine learning problems. A widely-shared feature of distributed optimization techniques is the requirement that all nodes complete their assigned tasks in each computational epoch before the system can proceed to the next epoch. In such settings, slow nodes, called stragglers, can greatly slow progress. To mitigate the impact of stragglers…
▽ More
Distributed optimization is vital in solving large-scale machine learning problems. A widely-shared feature of distributed optimization techniques is the requirement that all nodes complete their assigned tasks in each computational epoch before the system can proceed to the next epoch. In such settings, slow nodes, called stragglers, can greatly slow progress. To mitigate the impact of stragglers, we propose an online distributed optimization method called Anytime Minibatch. In this approach, all nodes are given a fixed time to compute the gradients of as many data samples as possible. The result is a variable per-node minibatch size. Workers then get a fixed communication time to average their minibatch gradients via several rounds of consensus, which are then used to update primal variables via dual averaging. Anytime Minibatch prevents stragglers from holding up the system without wasting the work that stragglers can complete. We present a convergence analysis and analyze the wall time performance. Our numerical results show that our approach is up to 1.5 times faster in Amazon EC2 and it is up to five times faster when there is greater variability in compute node performance.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.