-
Adaptive probabilistic forecasting of French electricity spot prices
Authors:
Grégoire Dutot,
Margaux Zaffran,
Olivier Féron,
Yannig Goude
Abstract:
Electricity price forecasting (EPF) plays a major role for electricity companies as a fundamental entry for trading decisions or energy management operations. As electricity can not be stored, electricity prices are highly volatile which make EPF a particularly difficult task. This is all the more true when dramatic fortuitous events disrupt the markets. Trading and more generally energy managemen…
▽ More
Electricity price forecasting (EPF) plays a major role for electricity companies as a fundamental entry for trading decisions or energy management operations. As electricity can not be stored, electricity prices are highly volatile which make EPF a particularly difficult task. This is all the more true when dramatic fortuitous events disrupt the markets. Trading and more generally energy management decisions require risk management tools which are based on probabilistic EPF (PEPF). In this challenging context, we argue in favor of the deployment of highly adaptive black-boxes strategies allowing to turn any forecasts into a robust adaptive predictive interval, such as conformal prediction and online aggregation, as a fundamental last layer of any operational pipeline.
We propose to investigate a novel data set containing the French electricity spot prices during the turbulent 2020-2021 years, and build a new explanatory feature revealing high predictive power, namely the nuclear availability. Benchmarking state-of-the-art PEPF on this data set highlights the difficulty of choosing a given model, as they all behave very differently in practice, and none of them is reliable. However, we propose an adequate conformalisation, OSSCP-horizon, that improves the performances of PEPF methods, even in the most hazardous period of late 2021. Finally, we emphasize that combining it with online aggregation significantly outperforms any other approaches, and should be the preferred pipeline, as it provides trustworthy probabilistic forecasts.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Adaptive Conformal Predictions for Time Series
Authors:
Margaux Zaffran,
Aymeric Dieuleveut,
Olivier Féron,
Yannig Goude,
Julie Josse
Abstract:
Uncertainty quantification of predictive models is crucial in decision-making problems. Conformal prediction is a general and theoretically sound answer. However, it requires exchangeable data, excluding time series. While recent works tackled this issue, we argue that Adaptive Conformal Inference (ACI, Gibbs and Cand{è}s, 2021), developed for distribution-shift time series, is a good procedure fo…
▽ More
Uncertainty quantification of predictive models is crucial in decision-making problems. Conformal prediction is a general and theoretically sound answer. However, it requires exchangeable data, excluding time series. While recent works tackled this issue, we argue that Adaptive Conformal Inference (ACI, Gibbs and Cand{è}s, 2021), developed for distribution-shift time series, is a good procedure for time series with general dependency. We theoretically analyse the impact of the learning rate on its efficiency in the exchangeable and auto-regressive case. We propose a parameter-free method, AgACI, that adaptively builds upon ACI based on online expert aggregation. We lead extensive fair simulations against competing methods that advocate for ACI's use in time series. We conduct a real case study: electricity price forecasting. The proposed aggregation algorithm provides efficient prediction intervals for day-ahead forecasting. All the code and data to reproduce the experiments is made available.
△ Less
Submitted 15 February, 2022;
originally announced February 2022.
-
A survey of electricity spot and futures price models for risk management applications
Authors:
Thomas Deschatre,
Olivier Féron,
Pierre Gruet
Abstract:
This review presents the set of electricity price models proposed in the literature since the opening of power markets. We focus on price models applied to financial pricing and risk management. We classify these models according to their ability to represent the random behavior of prices and some of their characteristics. In particular, this classification helps users to choose among the most sui…
▽ More
This review presents the set of electricity price models proposed in the literature since the opening of power markets. We focus on price models applied to financial pricing and risk management. We classify these models according to their ability to represent the random behavior of prices and some of their characteristics. In particular, this classification helps users to choose among the most suitable models for their risk management problems.
△ Less
Submitted 29 July, 2021; v1 submitted 31 March, 2021;
originally announced March 2021.
-
Price formation and optimal trading in intraday electricity markets with a major player
Authors:
Olivier Féron,
Peter Tankov,
Laura Tinsi
Abstract:
We study price formation in intraday electricity markets in the presence of intermittent renewable generation. We consider the setting where a major producer may interact strategically with a large number of small producers. Using stochastic control theory we identify the optimal strategies of agents with market impact and exhibit the Nash equilibrium in closed form in the asymptotic framework of…
▽ More
We study price formation in intraday electricity markets in the presence of intermittent renewable generation. We consider the setting where a major producer may interact strategically with a large number of small producers. Using stochastic control theory we identify the optimal strategies of agents with market impact and exhibit the Nash equilibrium in closed form in the asymptotic framework of mean field games with a major player. This is a companion paper to [Féron, Tankov, and Tinsi, Price formation and optimal trading in intraday electricity markets, arXiv:2009.04786, 2020], where a similar model is developed in the setting of identical agents.
△ Less
Submitted 15 November, 2020;
originally announced November 2020.
-
Price formation and optimal trading in intraday electricity markets
Authors:
Olivier Féron,
Peter Tankov,
Laura Tinsi
Abstract:
We develop a tractable equilibrium model for price formation in intraday electricity markets in the presence of intermittent renewable generation. Using stochastic control theory, we identify the optimal strategies of agents with market impact and exhibit the Nash equilibrium in closed form for a finite number of agents as well as in the asymptotic framework of mean field games. Our model reproduc…
▽ More
We develop a tractable equilibrium model for price formation in intraday electricity markets in the presence of intermittent renewable generation. Using stochastic control theory, we identify the optimal strategies of agents with market impact and exhibit the Nash equilibrium in closed form for a finite number of agents as well as in the asymptotic framework of mean field games. Our model reproduces the empirical features of intraday market prices, such as increasing price volatility at the approach of the delivery date and the correlation between price and renewable infeed forecasts, and relates these features with market characteristics like liquidity, number of agents, and imbalance penalty.
△ Less
Submitted 30 June, 2021; v1 submitted 10 September, 2020;
originally announced September 2020.
-
Efficient volatility estimation in a two-factor model
Authors:
Olivier Féron,
Pierre Gruet,
Marc Hoffmann
Abstract:
We statistically analyse a multivariate HJM diffusion model with stochastic volatility. The volatility process of the first factor is left totally unspecified while the volatility of the second factor is the product of an unknown process and an exponential function of time to maturity. This exponential term includes some real parameter measuring the rate of increase of the second factor as time go…
▽ More
We statistically analyse a multivariate HJM diffusion model with stochastic volatility. The volatility process of the first factor is left totally unspecified while the volatility of the second factor is the product of an unknown process and an exponential function of time to maturity. This exponential term includes some real parameter measuring the rate of increase of the second factor as time goes to maturity. From historical data, we efficiently estimate the time to maturity parameter in the sense of constructing an estimator that achieves an optimal information bound in a semiparametric setting. We also identify nonparametrically the paths of the volatility processes and achieve minimax bounds. We address the problem of degeneracy that occurs when the dimension of the process is greater than two, and give in particular optimal limit theorems under suitable regularity assumptions on the drift process. We consistently analyse the numerical behaviour of our estimators on simulated and real datasets of prices of forward contracts on electricity markets.
△ Less
Submitted 6 June, 2019; v1 submitted 26 November, 2018;
originally announced November 2018.
-
Structural price model for electricity coupled markets
Authors:
Clemence Alasseur,
Olivier Feron
Abstract:
We propose a new structural model that can compute the electricity spot and forward prices in two coupled markets with limited interconnection and multiple fuels. We choose a structural approach in order to represent some key characteristics of electricity spot prices such as their link to fuel prices, consumption level and production fleet. With this model, explicit formulas are also available fo…
▽ More
We propose a new structural model that can compute the electricity spot and forward prices in two coupled markets with limited interconnection and multiple fuels. We choose a structural approach in order to represent some key characteristics of electricity spot prices such as their link to fuel prices, consumption level and production fleet. With this model, explicit formulas are also available for forward prices and other derivatives. We give some illustrative results of the behaviour of spot and forward prices, and of the values of transmission rights.
△ Less
Submitted 20 April, 2017;
originally announced April 2017.
-
Gradient Scan Gibbs Sampler: an efficient algorithm for high-dimensional Gaussian distributions
Authors:
Olivier Féron,
François Orieux,
Jean-François Giovannelli
Abstract:
This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set of directions. The algorithm is proved to converge, i.e. the drawn samples are asymptotically distributed according to the target distribution. Our main motivat…
▽ More
This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set of directions. The algorithm is proved to converge, i.e. the drawn samples are asymptotically distributed according to the target distribution. Our main motivation is in inverse problems related to general linear observation models and their solution in a hierarchical Bayesian framework implemented through sampling algorithms. It finds direct applications in semi-blind/unsupervised methods as well as in some non-Gaussian methods. The paper provides an illustration focused on the unsupervised estimation for super-resolution methods.
△ Less
Submitted 11 September, 2015;
originally announced September 2015.
-
Estimation of covariance matrices based on hierarchical inverse-Wishart priors
Authors:
Mathilde Bouriga,
Olivier Féron
Abstract:
This paper focuses on Bayesian shrinkage for covariance matrix estimation. We examine posterior properties and frequentist risks of Bayesian estimators based on new hierarchical inverse-Wishart priors. More precisely, we give the existence conditions of the posterior distributions. Advantages in terms of numerical simulations of posteriors are shown. A simulation study illustrates the performance…
▽ More
This paper focuses on Bayesian shrinkage for covariance matrix estimation. We examine posterior properties and frequentist risks of Bayesian estimators based on new hierarchical inverse-Wishart priors. More precisely, we give the existence conditions of the posterior distributions. Advantages in terms of numerical simulations of posteriors are shown. A simulation study illustrates the performance of the estimation procedures under three loss functions for relevant sample sizes and various covariance structures.
△ Less
Submitted 16 June, 2011;
originally announced June 2011.
-
Efficient sampling of high-dimensional Gaussian fields: the non-stationary / non-sparse case
Authors:
F. Orieux,
O. Féron,
J. -F. Giovannelli
Abstract:
This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and especially as it emerges in inverse problems. It relies on a perturbation-optimization principle: adequate stochastic perturbation of a criterion and optimization of th…
▽ More
This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and especially as it emerges in inverse problems. It relies on a perturbation-optimization principle: adequate stochastic perturbation of a criterion and optimization of the perturbed criterion. It is shown that the criterion minimizer is a sample of the target density. The motivation in inverse problems is related to general (non-convolutive) linear observation models and their resolution in a Bayesian framework implemented through sampling algorithms when existing samplers are not feasible. It finds a direct application in myopic and/or unsupervised inversion as well as in some non-Gaussian inversion. An illustration focused on hyperparameter estimation for super-resolution problems assesses the effectiveness of the proposed approach.
△ Less
Submitted 30 May, 2011;
originally announced May 2011.
-
Bayesian segmentation of hyperspectral images
Authors:
Adel Mohammadpour,
Olivier Féron,
Ali Mohammad-Djafari
Abstract:
In this paper we consider the problem of joint segmentation of hyperspectral images in the Bayesian framework. The proposed approach is based on a Hidden Markov Modeling (HMM) of the images with common segmentation, or equivalently with common hidden classification label variables which is modeled by a Potts Markov Random Field. We introduce an appropriate Markov Chain Monte Carlo (MCMC) algorit…
▽ More
In this paper we consider the problem of joint segmentation of hyperspectral images in the Bayesian framework. The proposed approach is based on a Hidden Markov Modeling (HMM) of the images with common segmentation, or equivalently with common hidden classification label variables which is modeled by a Potts Markov Random Field. We introduce an appropriate Markov Chain Monte Carlo (MCMC) algorithm to implement the method and show some simulation results.
△ Less
Submitted 22 August, 2007;
originally announced August 2007.
-
A hidden Markov Model for image fusion and their joint segmentation in medical image computing
Authors:
Olivier Feron,
Ali Mohammad-Djafari
Abstract:
In this work we propose a Bayesian framework for fully automated image fusion and their joint segmentation. More specifically, we consider the case where we have observed images of the same object through different image processes or through different spectral bands. The objective of this work is then to propose a coherent approach to combine these data sets and obtain a segmented image which ca…
▽ More
In this work we propose a Bayesian framework for fully automated image fusion and their joint segmentation. More specifically, we consider the case where we have observed images of the same object through different image processes or through different spectral bands. The objective of this work is then to propose a coherent approach to combine these data sets and obtain a segmented image which can be considered as the fusion result of these observations. The proposed approach is based on a Hidden Markov Modeling (HMM) of the images with common segmentation, or equivalently, with common hidden classification label variables which are modeled by the Potts Markov Random Field. We propose an appropriate Markov Chain Monte Carlo (MCMC) algorithm to implement the method and show some simulation results and applications.
△ Less
Submitted 31 March, 2004;
originally announced March 2004.
-
A Hidden Markov model for Bayesian data fusion of multivariate signals
Authors:
Olivier Feron,
Ali Mohammad-Djafari
Abstract:
In this work we propose a Bayesian framework for data fusion of multivariate signals which arises in imaging systems. More specifically, we consider the case where we have observed two images of the same object through two different imaging processes. The objective of this work is then to propose a coherent approach to combine these data sets to obtain a segmented image which can be considered a…
▽ More
In this work we propose a Bayesian framework for data fusion of multivariate signals which arises in imaging systems. More specifically, we consider the case where we have observed two images of the same object through two different imaging processes. The objective of this work is then to propose a coherent approach to combine these data sets to obtain a segmented image which can be considered as the fusion result of these two images. The proposed approach is based on a Hidden Markov Modeling (HMM) of the images with common segmentation, or equivalently, with common hidden classification label variables which is modeled by the Potts Markov Random Field. We propose then an appropriate Markov Chain Monte Carlo (MCMC) algorithm to implement the method and show some simulation results and applications.
△ Less
Submitted 31 March, 2004;
originally announced March 2004.
-
A Bayesian approach to change point analysis of discrete time series
Authors:
Ali Mohammad-Djafari,
Olivier Feron
Abstract:
In this work we consider time series with a finite number of discrete point changes. We assume that the data in each segment follows a different probability density functions (pdf). We focus on the case where the data in all segments are modeled by Gaussian probability density functions with different means, variances and correlation lengths. We put a prior law on the change point instances (Poi…
▽ More
In this work we consider time series with a finite number of discrete point changes. We assume that the data in each segment follows a different probability density functions (pdf). We focus on the case where the data in all segments are modeled by Gaussian probability density functions with different means, variances and correlation lengths. We put a prior law on the change point instances (Poisson process) as well as on these different parameters(conjugate priors) and give the expression of the posterior probality distributions of these change points. The computations are done by using an appropriate Markov Chain Monte Carlo (MCMC) technique.
The problem as we stated can also be considered as an unsupervised classification and/or segmentation of the time serie. This analogy gives us the possibility to propose alternative modeling and computation of change points, which are more appropriate for multivariate signals, for example in image processing.
△ Less
Submitted 31 March, 2004;
originally announced March 2004.