Showing 1–6 of 6 results for author: Hauser, R A

A fundamental Game Theoretic model and approximate global Nash Equilibria computation for European Spot Power Markets

Authors: Ioan Alexandru Puiu, Raphael Andreas Hauser

Abstract: Spot electricity markets are considered under a Game-Theoretic framework, where risk averse players submit orders to the market clearing mechanism to maximise their own utility. Consistent with the current practice in Europe, the market clearing mechanism is modelled as a Social Welfare Maximisation problem, with zonal pricing, and we consider inflexible demand, physical constraints of the electri… ▽ More Spot electricity markets are considered under a Game-Theoretic framework, where risk averse players submit orders to the market clearing mechanism to maximise their own utility. Consistent with the current practice in Europe, the market clearing mechanism is modelled as a Social Welfare Maximisation problem, with zonal pricing, and we consider inflexible demand, physical constraints of the electricity grid, and capacity-constrained producers. A novel type of non-parametric risk aversion based on a defined worst case scenario is introduced, and this reduces the dimensionality of the strategy variables and ensures boundedness of prices. By leveraging these properties we devise Jacobi and Gauss-Seidel iterative schemes for computation of approximate global Nash Equilibria, which are in contrast to derivative based local equilibria. Our methodology is applied to the real world data of Central Western European (CWE) Spot Market during the 2019-2020 period, and offers a good representation of the historical time series of prices. By also solving for the assumption of truthful bidding, we devise a simple method based on hypothesis testing to infer if and when producers are bidding strategically (instead of truthfully), and we find evidence suggesting that strategic bidding may be fairly pronounced in the CWE region. △ Less

Submitted 30 August, 2022; originally announced August 2022.

On Market Clearing of Day Ahead Auctions for European Power Markets: Cost Minimisation versus Social Welfare Maximisation

Authors: Ioan Alexandru Puiu, Raphael Andreas Hauser

Abstract: For the case of inflexible demand and considering network constraints, we introduce a Cost Minimisation (CM) based market clearing mechanism, and a model representing the standard Social Welfare Maximisation mechanism used in European Day Ahead Electricity Markets. Since the CM model corresponds to a more challenging optimisation problem, we propose four numerical algorithms that leverage the prob… ▽ More For the case of inflexible demand and considering network constraints, we introduce a Cost Minimisation (CM) based market clearing mechanism, and a model representing the standard Social Welfare Maximisation mechanism used in European Day Ahead Electricity Markets. Since the CM model corresponds to a more challenging optimisation problem, we propose four numerical algorithms that leverage the problem structure, each with different trade-offs between computational cost and convergence guarantees. These algorithms are evaluated on synthetic data to provide some intuition of their performance. We also provide strong (but partial) analytical results to facilitate efficient solution of the CM problem, which call for the introduction of a new concept: optimal zonal stack curves, and these results are used to devise one of the four solution algorithms. An evaluation of the CM and SWM models and their comparison is performed, under the assumption of truthful bidding, on the real world data of Central Western European Day Ahead Power Market during the period of 2019-2020. We show that the SWM model we introduce gives a good representation of the historical time series of the real prices. Further, the CM reduces the market power of producers, as generally this results in decreased zonal prices and always decreases the total cost of electricity procurement when compared to the currently employed SWM. △ Less

Submitted 5 November, 2022; v1 submitted 13 July, 2022; originally announced July 2022.

Comments: Corrected minor typos, 25 pages, 8 figures

Binary Matrix Factorisation and Completion via Integer Programming

Authors: Reka A. Kovacs, Oktay Gunluk, Raphael A. Hauser

Abstract: Binary matrix factorisation is an essential tool for identifying discrete patterns in binary data. In this paper we consider the rank-k binary matrix factorisation problem (k-BMF) under Boolean arithmetic: we are given an n x m binary matrix X with possibly missing entries and need to find two binary matrices A and B of dimension n x k and k x m respectively, which minimise the distance between X… ▽ More Binary matrix factorisation is an essential tool for identifying discrete patterns in binary data. In this paper we consider the rank-k binary matrix factorisation problem (k-BMF) under Boolean arithmetic: we are given an n x m binary matrix X with possibly missing entries and need to find two binary matrices A and B of dimension n x k and k x m respectively, which minimise the distance between X and the Boolean product of A and B in the squared Frobenius distance. We present a compact and two exponential size integer programs (IPs) for k-BMF and show that the compact IP has a weak LP relaxation, while the exponential size IPs have a stronger equivalent LP relaxation. We introduce a new objective function, which differs from the traditional squared Frobenius objective in attributing a weight to zero entries of the input matrix that is proportional to the number of times the zero is erroneously covered in a rank-k factorisation. For one of the exponential size IPs we describe a computational approach based on column generation. Experimental results on synthetic and real word datasets suggest that our integer programming approach is competitive against available methods for k-BMF and provides accurate low-error factorisations. △ Less

Submitted 3 August, 2021; v1 submitted 25 June, 2021; originally announced June 2021.

Principled Data Completion of Network Constraints for Day Ahead Auctions in Power Markets

Authors: Ioan Alexandru Puiu, Raphael Andreas Hauser

Abstract: Network constraints play a key role in the price finding mechanism for European Power Markets, but historical data is very sparse and usually insufficient for many quantitative applications. We reconstruct the constraints data, known as the Power Transmission Distribution Factors (PTDFs) and Remaining Available Margins (RAMs), by first recovering the underlying time dependent signals known as the… ▽ More Network constraints play a key role in the price finding mechanism for European Power Markets, but historical data is very sparse and usually insufficient for many quantitative applications. We reconstruct the constraints data, known as the Power Transmission Distribution Factors (PTDFs) and Remaining Available Margins (RAMs), by first recovering the underlying time dependent signals known as the Generation Shift Keys (GSKs) and Phase Angles (PAs), and the electricity grid characteristics, via a mathematical optimisation problem. This is solved by exploiting marginal convexity in certain subspaces via alternating minimisation. The GSKs and PAs are then mapped to the PTDFs and RAMs, using the grid structure. Our reconstruction achieves good in-sample and out-of-sample relative errors for the PTDFs and RAMs. We further show that our model outperforms the naive approach, and that the reconstructed GSKs and PAs recover specific structure. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Binary Matrix Factorisation via Column Generation

Authors: Reka A. Kovacs, Oktay Gunluk, Raphael A. Hauser

Abstract: Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic. Due to the hardness of this problem, most previous attempts rely on heuristic techniques. We formulate the problem as a mixed integer linear program and use a la… ▽ More Identifying discrete patterns in binary data is an important dimensionality reduction tool in machine learning and data mining. In this paper, we consider the problem of low-rank binary matrix factorisation (BMF) under Boolean arithmetic. Due to the hardness of this problem, most previous attempts rely on heuristic techniques. We formulate the problem as a mixed integer linear program and use a large scale optimisation technique of column generation to solve it without the need of heuristic pattern mining. Our approach focuses on accuracy and on the provision of optimality guarantees. Experimental results on real world datasets demonstrate that our proposed method is effective at producing highly accurate factorisations and improves on the previously available best known results for 15 out of 24 problem instances. △ Less

Submitted 3 August, 2021; v1 submitted 9 November, 2020; originally announced November 2020.

Comments: final version as published by AAAI2021, plus including Appendix

MOSES: A Streaming Algorithm for Linear Dimensionality Reduction

Authors: Armin Eftekhari, Raphael A. Hauser, Andreas Grammenos

Abstract: This paper introduces Memory-limited Online Subspace Estimation Scheme (MOSES) for both estimating the principal components of streaming data and reducing its dimension. More specifically, in various applications such as sensor networks, the data vectors are presented sequentially to a user who has limited storage and processing time available. Applied to such problems, MOSES can provide a running… ▽ More This paper introduces Memory-limited Online Subspace Estimation Scheme (MOSES) for both estimating the principal components of streaming data and reducing its dimension. More specifically, in various applications such as sensor networks, the data vectors are presented sequentially to a user who has limited storage and processing time available. Applied to such problems, MOSES can provide a running estimate of leading principal components of the data that has arrived so far and also reduce its dimension. MOSES generalises the popular incremental Singular Vale Decomposition (iSVD) to handle thin blocks of data, rather than just vectors. This minor generalisation in part allows us to complement MOSES with a comprehensive statistical analysis, thus providing the first theoretically-sound variant of iSVD, which has been lacking despite the empirical success of this method. This generalisation also enables us to concretely interpret MOSES as an approximate solver for the underlying non-convex optimisation program. We find that MOSES consistently surpasses the state of the art in our numerical experiments with both synthetic and real-world datasets, while being computationally inexpensive. △ Less

Submitted 23 February, 2020; v1 submitted 4 June, 2018; originally announced June 2018.