-
Learning Data-Driven Uncertainty Set Partitions for Robust and Adaptive Energy Forecasting with Missing Data
Authors:
Akylas Stratigakos,
Panagiotis Andrianesis
Abstract:
Short-term forecasting models typically assume the availability of input data (features) when they are deployed and in use. However, equipment failures, disruptions, cyberattacks, may lead to missing features when such models are used operationally, which could negatively affect forecast accuracy, and result in suboptimal operational decisions. In this paper, we use adaptive robust optimization an…
▽ More
Short-term forecasting models typically assume the availability of input data (features) when they are deployed and in use. However, equipment failures, disruptions, cyberattacks, may lead to missing features when such models are used operationally, which could negatively affect forecast accuracy, and result in suboptimal operational decisions. In this paper, we use adaptive robust optimization and adversarial machine learning to develop forecasting models that seamlessly handle missing data operationally. We propose linear- and neural network-based forecasting models with parameters that adapt to available features, combining linear adaptation with a novel algorithm for learning data-driven uncertainty set partitions. The proposed adaptive models do not rely on identifying historical missing data patterns and are suitable for real-time operations under stringent time constraints. Extensive numerical experiments on short-term wind power forecasting considering horizons from 15 minutes to 4 hours ahead illustrate that our proposed adaptive models are on par with imputation when data are missing for very short periods (e.g., when only the latest measurement is missing) whereas they significantly outperform imputation when data are missing for longer periods. We further provide insights by showcasing how linear adaptation and data-driven partitions (even with a few subsets) approach the performance of the optimal, yet impractical, method of retraining for every possible realization of missing data.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
-
Predict+Optimize Problem in Renewable Energy Scheduling
Authors:
Christoph Bergmeir,
Frits de Nijs,
Evgenii Genov,
Abishek Sriramulu,
Mahdi Abolghasemi,
Richard Bean,
John Betts,
Quang Bui,
Nam Trong Dinh,
Nils Einecke,
Rasul Esmaeilbeigi,
Scott Ferraro,
Priya Galketiya,
Robert Glasgow,
Rakshitha Godahewa,
Yanfei Kang,
Steffen Limmer,
Luis Magdalena,
Pablo Montero-Manso,
Daniel Peralta,
Yogesh Pipada Sunil Kumar,
Alejandro Rosales-Pérez,
Julian Ruddick,
Akylas Stratigakos,
Peter Stuckey
, et al. (3 additional authors not shown)
Abstract:
Predict+Optimize frameworks integrate forecasting and optimization to address real-world challenges such as renewable energy scheduling, where variability and uncertainty are critical factors. This paper benchmarks solutions from the IEEE-CIS Technical Challenge on Predict+Optimize for Renewable Energy Scheduling, focusing on forecasting renewable production and demand and optimizing energy cost.…
▽ More
Predict+Optimize frameworks integrate forecasting and optimization to address real-world challenges such as renewable energy scheduling, where variability and uncertainty are critical factors. This paper benchmarks solutions from the IEEE-CIS Technical Challenge on Predict+Optimize for Renewable Energy Scheduling, focusing on forecasting renewable production and demand and optimizing energy cost. The competition attracted 49 participants in total. The top-ranked method employed stochastic optimization using LightGBM ensembles, and achieved at least a 2% reduction in energy costs compared to deterministic approaches, demonstrating that the most accurate point forecast does not necessarily guarantee the best performance in downstream optimization. The published data and problem setting establish a benchmark for further research into integrated forecasting-optimization methods for energy systems, highlighting the importance of considering forecast uncertainty in optimization models to achieve cost-effective and reliable energy management. The novelty of this work lies in its comprehensive evaluation of Predict+Optimize methodologies applied to a real-world renewable energy scheduling problem, providing insights into the scalability, generalizability, and effectiveness of the proposed solutions. Potential applications extend beyond energy systems to any domain requiring integrated forecasting and optimization, such as supply chain management, transportation planning, and financial portfolio optimization.
△ Less
Submitted 14 April, 2025; v1 submitted 20 December, 2022;
originally announced December 2022.
-
Dynamic Conditional Correlation between Electricity and Stock markets during the Financial Crisis in Greece
Authors:
Panagiotis G. Papaioannou,
George P. Papaioannou,
Kostas Siettos,
Akylas Stratigakos,
Christos Dikaiakos
Abstract:
Liberalization of electricity markets has increasingly created the need for understanding the volatility and correlation structure between electricity and financial markets. This work reveals the existence of structural changes in correlation patterns among these two markets and links the changes to both fundamentals and regulatory conditions prevailing in the markets, as well as the current Europ…
▽ More
Liberalization of electricity markets has increasingly created the need for understanding the volatility and correlation structure between electricity and financial markets. This work reveals the existence of structural changes in correlation patterns among these two markets and links the changes to both fundamentals and regulatory conditions prevailing in the markets, as well as the current European financial crisis. We apply a Dynamic Conditional Correlation (DCC) GARCH model to a set of market s fundamental variables and Greece s financial market and microeconomic indexes to study their interaction. Emphasis is given on the period of severe financial crisis of the Country to understand contagion and volatility spillover between these two markets.
△ Less
Submitted 11 August, 2017;
originally announced August 2017.
