-
Probabilistic intraday electricity price forecasting using generative machine learning
Authors:
Jieyu Chen,
Sebastian Lerch,
Melanie Schienle,
Tomasz Serafin,
Rafał Weron
Abstract:
The growing importance of intraday electricity trading in Europe calls for improved price forecasting and tailored decision-support tools. In this paper, we propose a novel generative neural network model to generate probabilistic path forecasts for intraday electricity prices and use them to construct effective trading strategies for Germany's continuous-time intraday market. Our method demonstra…
▽ More
The growing importance of intraday electricity trading in Europe calls for improved price forecasting and tailored decision-support tools. In this paper, we propose a novel generative neural network model to generate probabilistic path forecasts for intraday electricity prices and use them to construct effective trading strategies for Germany's continuous-time intraday market. Our method demonstrates competitive performance in terms of statistical evaluation metrics compared to two state-of-the-art statistical benchmark approaches. To further assess its economic value, we consider a realistic fixed-volume trading scenario and propose various strategies for placing market sell orders based on the path forecasts. Among the different trading strategies, the price paths generated by our generative model lead to higher profit gains than the benchmark methods. Our findings highlight the potential of generative machine learning tools in electricity price forecasting and underscore the importance of economic evaluation.
△ Less
Submitted 28 May, 2025;
originally announced June 2025.
-
Model Determination for High-Dimensional Longitudinal Data with Missing Observations: An Application to Microfinance Data
Authors:
Lotta Rüter,
Melanie Schienle
Abstract:
We propose an adaption of the multiple imputation random lasso procedure tailored to longitudinal data with unobserved fixed effects which provides robust variable selection in the presence of complex missingness, high dimensionality and multicollinearity. We apply it to identify social and financial success factors of microfinance institutions (MFIs) in a data-driven way from a comprehensive, bal…
▽ More
We propose an adaption of the multiple imputation random lasso procedure tailored to longitudinal data with unobserved fixed effects which provides robust variable selection in the presence of complex missingness, high dimensionality and multicollinearity. We apply it to identify social and financial success factors of microfinance institutions (MFIs) in a data-driven way from a comprehensive, balanced, and global panel with 136 characteristics for 213 MFIs over a six-year period. We discover the importance of staff structure for MFI success and find that profitability is the most important determinant of financial success. Our results indicate that financial sustainability and breadth of outreach can be increased simultaneously while the relationship with depth of outreach is more mixed.
△ Less
Submitted 3 December, 2024;
originally announced December 2024.
-
Simple Macroeconomic Forecast Distributions for the G7 Economies
Authors:
Friederike Becker,
Fabian Krüger,
Melanie Schienle
Abstract:
We present a simple method for predicting the distribution of output growth and inflation in the G7 economies. The method is based on point forecasts published by the International Monetary Fund (IMF), as well as robust statistics from the empirical distribution of the IMF's past forecast errors while imposing coherence of prediction intervals across horizons. We show that the technique yields cal…
▽ More
We present a simple method for predicting the distribution of output growth and inflation in the G7 economies. The method is based on point forecasts published by the International Monetary Fund (IMF), as well as robust statistics from the empirical distribution of the IMF's past forecast errors while imposing coherence of prediction intervals across horizons. We show that the technique yields calibrated prediction intervals and performs similar to, or better than, more complex time series models in terms of statistical loss functions. We provide a simple website with graphical illustrations of our forecasts, as well as time-stamped data files that document their real time character.
△ Less
Submitted 18 April, 2025; v1 submitted 15 August, 2024;
originally announced August 2024.
-
Estimation of spatio-temporal extremes via generative neural networks
Authors:
Christopher Bülte,
Lisa Leimenstoll,
Melanie Schienle
Abstract:
Recent methods in modeling spatial extreme events have focused on utilizing parametric max-stable processes and their underlying dependence structure. In this work, we provide a unified approach for analyzing spatial extremes with little available data by estimating the distribution of model parameters or the spatial dependence directly. By employing recent developments in generative neural networ…
▽ More
Recent methods in modeling spatial extreme events have focused on utilizing parametric max-stable processes and their underlying dependence structure. In this work, we provide a unified approach for analyzing spatial extremes with little available data by estimating the distribution of model parameters or the spatial dependence directly. By employing recent developments in generative neural networks we predict a full sample-based distribution, allowing for direct assessment of uncertainty regarding model parameters or other parameter dependent functionals. We validate our method by fitting several simulated max-stable processes, showing a high accuracy of the approach, regarding parameter estimation, as well as uncertainty quantification. Additional robustness checks highlight the generalization and extrapolation capabilities of the model, while an application to precipitation extremes across Western Germany demonstrates the usability of our approach in real-world scenarios.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Direction Augmentation in the Evaluation of Armed Conflict Predictions
Authors:
Johannes Bracher,
Lotta Rüter,
Fabian Krüger,
Sebastian Lerch,
Melanie Schienle
Abstract:
In many forecasting settings, there is a specific interest in predicting the sign of an outcome variable correctly in addition to its magnitude. For instance, when forecasting armed conflicts, positive and negative log-changes in monthly fatalities represent escalation and de-escalation, respectively, and have very different implications. In the ViEWS forecasting challenge, a prediction competitio…
▽ More
In many forecasting settings, there is a specific interest in predicting the sign of an outcome variable correctly in addition to its magnitude. For instance, when forecasting armed conflicts, positive and negative log-changes in monthly fatalities represent escalation and de-escalation, respectively, and have very different implications. In the ViEWS forecasting challenge, a prediction competition on state-based violence, a novel evaluation score called targeted absolute deviation with direction augmentation (TADDA) has therefore been suggested, which accounts for both for the sign and magnitude of log-changes. While it has a straightforward intuitive motivation, the empirical results of the challenge show that a no-change model always predicting a log-change of zero outperforms all submitted forecasting models under the TADDA score. We provide a statistical explanation for this phenomenon. Analyzing the properties of TADDA, we find that in order to achieve good scores, forecasters often have an incentive to predict no or only modest log-changes. In particular, there is often an incentive to report conservative point predictions considerably closer to zero than the forecaster's actual predictive median or mean. In an empirical application, we demonstrate that a no-change model can be improved upon by tailoring predictions to the particularities of the TADDA score. We conclude by outlining some alternative scoring concepts.
△ Less
Submitted 24 April, 2023;
originally announced April 2023.
-
Predicting Value at Risk for Cryptocurrencies With Generalized Random Forests
Authors:
Rebekka Buse,
Konstantin Görgen,
Melanie Schienle
Abstract:
We study the prediction of Value at Risk (VaR) for cryptocurrencies. In contrast to classic assets, returns of cryptocurrencies are often highly volatile and characterized by large fluctuations around single events. Analyzing a comprehensive set of 105 major cryptocurrencies, we show that Generalized Random Forests (GRF) (Athey, Tibshirani & Wager, 2019) adapted to quantile prediction have superio…
▽ More
We study the prediction of Value at Risk (VaR) for cryptocurrencies. In contrast to classic assets, returns of cryptocurrencies are often highly volatile and characterized by large fluctuations around single events. Analyzing a comprehensive set of 105 major cryptocurrencies, we show that Generalized Random Forests (GRF) (Athey, Tibshirani & Wager, 2019) adapted to quantile prediction have superior performance over other established methods such as quantile regression, GARCH-type and CAViaR models. This advantage is especially pronounced in unstable times and for classes of highly-volatile cryptocurrencies. Furthermore, we identify important predictors during such times and show their influence on forecasting over time. Moreover, a comprehensive simulation study also indicates that the GRF methodology is at least on par with existing methods in VaR predictions for standard types of financial returns and clearly superior in the cryptocurrency setup.
△ Less
Submitted 19 December, 2024; v1 submitted 24 February, 2022;
originally announced March 2022.
-
How have German University Tuition Fees Affected Enrollment Rates: Robust Model Selection and Design-based Inference in High-Dimensions
Authors:
Konstantin Görgen,
Melanie Schienle
Abstract:
We use official data for all 16 federal German states to study the causal effect of a flat 1000 Euro state-dependent university tuition fee on the enrollment behavior of students during the years 2006-2014. In particular, we show how the variation in the introduction scheme across states and times can be exploited to identify the federal average causal effect of tuition fees by controlling for a l…
▽ More
We use official data for all 16 federal German states to study the causal effect of a flat 1000 Euro state-dependent university tuition fee on the enrollment behavior of students during the years 2006-2014. In particular, we show how the variation in the introduction scheme across states and times can be exploited to identify the federal average causal effect of tuition fees by controlling for a large amount of potentially influencing attributes for state heterogeneity. We suggest a stability post-double selection methodology to robustly determine the causal effect across types in the transparently modeled unknown response components. The proposed stability resampling scheme in the two LASSO selection steps efficiently mitigates the risk of model underspecification and thus biased effects when the tuition fee policy decision also depends on relevant variables for the state enrollment rates. Correct inference for the full cross-section state population in the sample requires adequate design -- rather than sampling-based standard errors. With the data-driven model selection and explicit control for spatial cross-effects we detect that tuition fees induce substantial migration effects where the mobility occurs both from fee but also from non-fee states suggesting also a general movement for quality. Overall, we find a significant negative impact of up to 4.5 percentage points of fees on student enrollment. This is in contrast to plain one-step LASSO or previous empirical studies with full fixed effects linear panel regressions which generally underestimate the size and get an only insignificant effect.
△ Less
Submitted 4 January, 2021; v1 submitted 18 September, 2019;
originally announced September 2019.
