Showing 1–9 of 9 results for author: de Weerdt, M

Tight MIP Formulations for Optimal Operation and Investment of Storage Including Reserves

Authors: Maaike B. Elgersma, Germán Morales-España, Karen I. Aardal, Niina Helistö, Juha Kiviluoma, Mathijs M. de Weerdt

Abstract: Fast and accurate large-scale energy system models are needed to investigate the potential of storage to complement the fluctuating energy production of renewable energy systems. However, standard Mixed-Integer Programming (MIP) models that describe optimal investment and operation of these storage units, including the optional capacity to provide up/down reserves, do not scale well. To improve sc… ▽ More Fast and accurate large-scale energy system models are needed to investigate the potential of storage to complement the fluctuating energy production of renewable energy systems. However, standard Mixed-Integer Programming (MIP) models that describe optimal investment and operation of these storage units, including the optional capacity to provide up/down reserves, do not scale well. To improve scalability, the integrality constraints are often relaxed, resulting in Linear Programming (LP) relaxations that allow simultaneous charging and discharging, while this is not feasible in practice. To address this, we derive the convex hull of the solutions for the optimal operation of storage for one time period, as well as for problems including investments and reserves, guaranteeing that no tighter MIP formulation or better LP approximation exists for one time period. When incorporating this convex hull into a multi-period formulation and including it in large-scale energy system models, the improved LP relaxations can better prevent simultaneous charging and discharging, and the tighter MIP can speed up the solving time. We demonstrate this with illustrative case studies of a unit commitment problem and a transmission expansion planning problem. △ Less

Submitted 6 May, 2025; v1 submitted 26 November, 2024; originally announced November 2024.

Comments: Revised preprint submitted to IEEE Transactions on Power Systems

A Penalty-Based Guardrail Algorithm for Non-Decreasing Optimization with Inequality Constraints

Authors: Ksenija Stepanovic, Wendelin Böhmer, Mathijs de Weerdt

Abstract: Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones, and solved with computationally efficient optimization approaches based on first-order information, such as the gradient descent method. However, for unconstrain… ▽ More Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones, and solved with computationally efficient optimization approaches based on first-order information, such as the gradient descent method. However, for unconstrained problems, balancing the minimization of the objective function with the reduction of constraint violations is challenging. We consider the class of time-dependent minimization problems with increasing (possibly) nonlinear and non-convex objective function and non-decreasing (possibly) nonlinear and non-convex inequality constraints. To efficiently solve them, we propose a penalty-based guardrail algorithm (PGA). This algorithm adapts a standard penalty-based method by dynamically updating the right-hand side of the constraints with a guardrail variable which adds a margin to prevent violations. We evaluate PGA on two novel application domains: a simplified model of a district heating system and an optimization model derived from learned deep neural networks. Our method significantly outperforms mathematical programming solvers and the standard penalty-based method, and achieves better performance and faster convergence than a state-of-the-art algorithm (IPDD) within a specified time limit. △ Less

Submitted 3 May, 2024; originally announced May 2024.

When Effort May Fail: Equilibria of Shared Effort with a Threshold

Authors: Gleb Polevoy, Stojan Trajanovski, Mathijs de Weerdt

Abstract: People, robots, and companies mostly divide time and effort between projects, and \defined{shared effort games} model people investing resources in public endeavors and sharing the generated values. In linear $θ$ sharing (effort) games, a project's value is linear in the total contribution, thus modelling predictable, uniform, and scalable activities. The threshold $θ$ for effort defines which con… ▽ More People, robots, and companies mostly divide time and effort between projects, and \defined{shared effort games} model people investing resources in public endeavors and sharing the generated values. In linear $θ$ sharing (effort) games, a project's value is linear in the total contribution, thus modelling predictable, uniform, and scalable activities. The threshold $θ$ for effort defines which contributors win and receive their share, equal share modelling standard salaries, equity-minded projects, etc. Thresholds between 0 and 1 model games such as paper co-authorship and shared assignments, where a minimum positive contribution is required for sharing in the value. We constructively characterise the conditions for the existence of a pure equilibrium for $θ\in\{0,1\}$, and for two-player games with a general threshold, and find the prices of anarchy and stability. We also provide existence and efficiency results for more than two players, and use generalised fictitious play simulations to show when a pure equilibrium exists and what its efficiency is. We propose a novel method for studying solution concepts by defining a new concept and proving its equivalence to a previously known on a large subclass of games. This means that the original concept narrows down to a more demanding concepts on certain games, providing new insights and opening a path to study both concepts conveniently. We also prove mixed equilibria always exist and bound their efficiency. △ Less

Submitted 23 March, 2025; v1 submitted 3 December, 2023; originally announced December 2023.

MSC Class: 91A10; 91A80; ACM Class: J.4

You Shall Pass: Dealing with the Zero-Gradient Problem in Predict and Optimize for Convex Optimization

Authors: Grigorii Veviurko, Wendelin Böhmer, Mathijs de Weerdt

Abstract: Predict and optimize is an increasingly popular decision-making paradigm that employs machine learning to predict unknown parameters of optimization problems. Instead of minimizing the prediction error of the parameters, it trains predictive models using task performance as a loss function. The key challenge to train such models is the computation of the Jacobian of the solution of the optimizatio… ▽ More Predict and optimize is an increasingly popular decision-making paradigm that employs machine learning to predict unknown parameters of optimization problems. Instead of minimizing the prediction error of the parameters, it trains predictive models using task performance as a loss function. The key challenge to train such models is the computation of the Jacobian of the solution of the optimization problem with respect to its parameters. For linear problems, this Jacobian is known to be zero or undefined; hence, approximations are usually employed. For non-linear convex problems, however, it is common to use the exact Jacobian. This paper demonstrates that the zero-gradient problem appears in the non-linear case as well -- the Jacobian can have a sizeable null space, thereby causing the training process to get stuck in suboptimal points. Through formal proofs, this paper shows that smoothing the feasible set resolves this problem. Combining this insight with known techniques from the literature, such as quadratic programming approximation and projection distance regularization, a novel method to approximate the Jacobian is derived. In simulation experiments, the proposed method increases the performance in the non-linear case and at least matches the existing state-of-the-art methods for linear problems. △ Less

Submitted 2 February, 2024; v1 submitted 30 July, 2023; originally announced July 2023.

EXPObench: Benchmarking Surrogate-based Optimisation Algorithms on Expensive Black-box Functions

Authors: Laurens Bliek, Arthur Guijt, Rickard Karlsson, Sicco Verwer, Mathijs de Weerdt

Abstract: Surrogate algorithms such as Bayesian optimisation are especially designed for black-box optimisation problems with expensive objectives, such as hyperparameter tuning or simulation-based optimisation. In the literature, these algorithms are usually evaluated with synthetic benchmarks which are well established but have no expensive objective, and only on one or two real-life applications which va… ▽ More Surrogate algorithms such as Bayesian optimisation are especially designed for black-box optimisation problems with expensive objectives, such as hyperparameter tuning or simulation-based optimisation. In the literature, these algorithms are usually evaluated with synthetic benchmarks which are well established but have no expensive objective, and only on one or two real-life applications which vary wildly between papers. There is a clear lack of standardisation when it comes to benchmarking surrogate algorithms on real-life, expensive, black-box objective functions. This makes it very difficult to draw conclusions on the effect of algorithmic contributions and to give substantial advice on which method to use when. A new benchmark library, EXPObench, provides first steps towards such a standardisation. The library is used to provide an extensive comparison of six different surrogate algorithms on four expensive optimisation problems from different real-life applications. This has led to new insights regarding the relative importance of exploration, the evaluation time of the objective, and the used model. We also provide rules of thumb for which surrogate algorithm to use in which situation. A further contribution is that we make the algorithms and benchmark problem instances publicly available, contributing to more uniform analysis of surrogate algorithms. Most importantly, we include the performance of the six algorithms on all evaluated problem instances. This results in a unique new dataset that lowers the bar for researching new methods as the number of expensive evaluations required for comparison is significantly reduced. △ Less

Submitted 1 December, 2022; v1 submitted 8 June, 2021; originally announced June 2021.

Comments: 33 pages

The Maintenance Scheduling and Location Choice Problem for Railway Rolling Stock

Authors: Jordi Zomer, Nikola Bešinović, Mathijs M. de Weerdt, Rob M. P. Goverde

Abstract: Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting. Therefore, the scheduling of rolling stock maintenance and the choice regarding optimal locations to perform maintenance is increasingly complicated. This research introduces a Maintenance Scheduling and Location Choice Problem (MSLCP). It simultaneously determines maintenance locations and… ▽ More Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting. Therefore, the scheduling of rolling stock maintenance and the choice regarding optimal locations to perform maintenance is increasingly complicated. This research introduces a Maintenance Scheduling and Location Choice Problem (MSLCP). It simultaneously determines maintenance locations and maintenance schedules of rolling stock, while it also considers the available capacity of maintenance locations, measured in the number of available teams. To solve the MSLCP, an optimization framework based on Logic-Based Benders' Decomposition (LBBD) is proposed by combining two models, the Maintenance Location Choice Problem (MLCP) and the Activity Planning Problem (APP), to assess the capacity of a MLCP solution. Within the LBBD, four cut generation procedures are introduced to improve the computational performance: a naive procedure, two heuristic procedures and the so-called min-cut procedure that aims to exploit the specific characteristics of the problem at hand. The framework is demonstrated on a realistic scenarios from the Dutch railways. It is shown that the best choice for cut generation procedure depends on the objective: when aiming to find a good but not necessarily optimal solution, the min-cut procedure performs best, whereas when aiming for the optimal solution, one of the heuristic procedures is the preferred option. The techniques used in the current research are new to the current field and offer interesting next research opportunities. △ Less

Submitted 28 February, 2021; originally announced March 2021.

Comments: 27 pages, 10 figures, MSCLP code available at github

The Maintenance Location Choice Problem for Railway Rolling Stock

Authors: Jordi Zomer, Nikola Bešinović, Mathijs M. de Weerdt, Rob M. P. Goverde

Abstract: Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting to accommodate existing rolling stock. To reduce capacity issues at maintenance locations during nighttime, railway undertakings consider performing more daytime maintenance, but the choice at which locations personnel needs to be stationed for daytime maintenance is not straightforward. Amo… ▽ More Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting to accommodate existing rolling stock. To reduce capacity issues at maintenance locations during nighttime, railway undertakings consider performing more daytime maintenance, but the choice at which locations personnel needs to be stationed for daytime maintenance is not straightforward. Among other things, it depends on the planned rolling stock circulation and the maintenance activities that need to be performed. This paper presents the Maintenance Location Choice Problem (MLCP) and provides a Mixed Integer Linear Programming model for this problem. The model demonstrates that for a representative rolling stock circulation from the Dutch railways a substantial amount of maintenance activities can be performed during daytime. Also, it is shown that the location choice delivered by the model is robust under various time horizons and rolling stock circulations. Moreover, the running time for optimizing the model is considered acceptable for planning purposes. △ Less

Submitted 8 December, 2020; originally announced December 2020.

Comments: 16 pages, 5 figures

MSC Class: 90-10

Continuous surrogate-based optimization algorithms are well-suited for expensive discrete problems

Authors: Rickard Karlsson, Laurens Bliek, Sicco Verwer, Mathijs de Weerdt

Abstract: One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an approximate solution to the original problem. In the case of discrete problems, recent research has revolved around surrogate models that are specifically constr… ▽ More One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an approximate solution to the original problem. In the case of discrete problems, recent research has revolved around surrogate models that are specifically constructed to deal with discrete structures. A main motivation is that literature considers continuous methods, such as Bayesian optimization with Gaussian processes as the surrogate, to be sub-optimal (especially in higher dimensions) because they ignore the discrete structure by, e.g., rounding off real-valued solutions to integers. However, we claim that this is not true. In fact, we present empirical evidence showing that the use of continuous surrogate models displays competitive performance on a set of high-dimensional discrete benchmark problems, including a real-life application, against state-of-the-art discrete surrogate-based methods. Our experiments on different discrete structures and time constraints also give more insight into which algorithms work well on which type of problem. △ Less

Submitted 30 November, 2020; v1 submitted 6 November, 2020; originally announced November 2020.

Comments: 16 pages, 3 figures; added keywords, typos corrected, additional information in Figure 3 but results unchanged

Journal ref: Proceedings of BNAIC/BeneLearn (2020), 88-102

Black-box Mixed-Variable Optimisation using a Surrogate Model that Satisfies Integer Constraints

Authors: Laurens Bliek, Arthur Guijt, Sicco Verwer, Mathijs de Weerdt

Abstract: A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for example in automatic algorithm configuration. Surrogate-based algorithms are very suitable for this type of problem, but most existing techniques are designed w… ▽ More A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for example in automatic algorithm configuration. Surrogate-based algorithms are very suitable for this type of problem, but most existing techniques are designed with only continuous or only discrete variables in mind. Mixed-Variable ReLU-based Surrogate Modelling (MVRSM) is a surrogate-based algorithm that uses a linear combination of rectified linear units, defined in such a way that (local) optima satisfy the integer constraints. This method outperforms the state of the art on several synthetic benchmarks with up to 238 continuous and integer variables, and achieves competitive performance on two real-life benchmarks: XGBoost hyperparameter tuning and Electrostatic Precipitator optimisation. △ Less

Submitted 15 September, 2020; v1 submitted 8 June, 2020; originally announced June 2020.

Comments: Ann Math Artif Intell (2020)

Journal ref: Proceedings of the Genetic and Evolutionary Computation Conference Companion 2021