-
PyJobShop: Solving scheduling problems with constraint programming in Python
Authors:
Leon Lan,
Joost Berkhout
Abstract:
This paper presents PyJobShop, an open-source Python library for solving scheduling problems with constraint programming. PyJobShop provides an easy-to-use modeling interface that supports a wide variety of scheduling problems, including well-known variants such as the flexible job shop problem and the resource-constrained project scheduling problem. PyJobShop integrates two state-of-the-art const…
▽ More
This paper presents PyJobShop, an open-source Python library for solving scheduling problems with constraint programming. PyJobShop provides an easy-to-use modeling interface that supports a wide variety of scheduling problems, including well-known variants such as the flexible job shop problem and the resource-constrained project scheduling problem. PyJobShop integrates two state-of-the-art constraint programming solvers: Google's OR-Tools CP-SAT and IBM ILOG's CP Optimizer. We leverage PyJobShop to conduct large-scale numerical experiments on more than 9,000 benchmark instances from the machine scheduling and project scheduling literature, comparing the performance of OR-Tools and CP Optimizer. While CP Optimizer performs better on permutation scheduling and large-scale problems, OR-Tools is highly competitive on job shop scheduling and project scheduling problems--while also being fully open-source. By providing an accessible and tested implementation of constraint programming for scheduling, we hope that PyJobShop will enable researchers and practitioners to use constraint programming for real-world scheduling problems.
△ Less
Submitted 19 February, 2025;
originally announced February 2025.
-
A Two-Step Warm Start Method Used for Solving Large-Scale Stochastic Mixed-Integer Problems
Authors:
Berend Markhorst,
Markus Leitner,
Joost Berkhout,
Alessandro Zocca,
Rob van der Mei
Abstract:
Two-stage stochastic programs become computationally challenging when the number of scenarios representing parameter uncertainties grows. Motivated by this, we propose the TULIP-algorithm ("Two-step warm start method Used for solving Large-scale stochastic mixed-Integer Problems"), a two-step approach for solving two-stage stochastic (mixed) integer linear programs with an exponential number of co…
▽ More
Two-stage stochastic programs become computationally challenging when the number of scenarios representing parameter uncertainties grows. Motivated by this, we propose the TULIP-algorithm ("Two-step warm start method Used for solving Large-scale stochastic mixed-Integer Problems"), a two-step approach for solving two-stage stochastic (mixed) integer linear programs with an exponential number of constraints. In this approach, we first generate a reduced set of representative scenarios and solve the root node of the corresponding integer linear program using a cutting-plane method. The generated constraints are then used to accelerate solving the original problem with the full scenario set in the second phase. We demonstrate the generic effectiveness of TULIP on two benchmark problems: the Stochastic Capacitated Vehicle Routing Problem and the Two-Stage Stochastic Steiner Forest Problem. The results of our extensive numerical experiments show that TULIP yields significant computational gains compared to solving the problem directly with branch-and-cut.
△ Less
Submitted 13 December, 2024;
originally announced December 2024.
-
A new Simheuristics procedure for stochastic combinatorial optimization
Authors:
Joost Berkhout
Abstract:
Ignoring uncertainty in combinatorial optimization leads to suboptimal decisions in practice. Nevertheless, the focus is often on deterministic combinatorial optimization problems, mainly because they are already challenging enough without stochasticity. To make it easier to address stochasticity in combinatorial optimization, Simheuristics have been developed that allow solving stochastic combina…
▽ More
Ignoring uncertainty in combinatorial optimization leads to suboptimal decisions in practice. Nevertheless, the focus is often on deterministic combinatorial optimization problems, mainly because they are already challenging enough without stochasticity. To make it easier to address stochasticity in combinatorial optimization, Simheuristics have been developed that allow solving stochastic combinatorial optimization problems. We propose a new Simheuristic procedure that dynamically changes the optimization focus between a deterministic and stochastic perspective based upon a statistical model. By doing so, an adequate trade-off is made between exploration and exploitation of the solution space during the optimization. We numerically show that the new Simheuristic procedure solves real-life stochastic scheduling problems more efficiently than standard Simheuristics strategies.
△ Less
Submitted 18 July, 2024;
originally announced August 2024.
-
A Pseudo-Gradient Approach for Model-free Markov Chain Optimization
Authors:
Nanne A. Dieleman,
Joost Berkhout,
Bernd Heidergott
Abstract:
We develop a first-order (pseudo-)gradient approach for optimizing functions over the stationary distribution of discrete-time Markov chains (DTMC). We give insights into why solving this optimization problem is challenging and show how transformations can be used to circumvent the hard constraints inherent in the optimization problem. The optimization framework is model-free since no explicit mod…
▽ More
We develop a first-order (pseudo-)gradient approach for optimizing functions over the stationary distribution of discrete-time Markov chains (DTMC). We give insights into why solving this optimization problem is challenging and show how transformations can be used to circumvent the hard constraints inherent in the optimization problem. The optimization framework is model-free since no explicit model of the interdependence of the row elements of the Markov chain transition matrix is required. Upon the transformation we build an extension of Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm, called stochastic matrix SPSA (SM-SPSA) to solve the optimization problem. The performance of the SM-SPSA gradient search is compared with a benchmark commercial solver. Numerical examples show that SM-SPSA scales better which makes it the preferred solution method for large problem instances. We also apply the algorithm to the maximization of web-page rankings in web-graphs based on a real-life data set. As we explain in the paper, when applying a first-order gradient search one typically encounters a phenomenon which we call ``infliction points," that is, jumps in the optimization trajectories between periods of almost stationary behavior that slow down the optimization. We propose a heuristic for avoiding such infliction points and present a metastudy on a wide range of networks showing the positive effect of our heuristic on the convergence properties of SM-SPSA gradient search.
△ Less
Submitted 20 July, 2024;
originally announced July 2024.
-
Future-proof ship pipe routing: navigating the energy transition
Authors:
Berend Markhorst,
Joost Berkhout,
Alessandro Zocca,
Jeroen Pruyn,
Rob van der Mei
Abstract:
The maritime industry must prepare for the energy transition from fossil fuels to sustainable alternatives. Making ships future-proof is necessary given their long lifetime, but it is also complex because the future fuel type is uncertain. Within this uncertainty, one typically overlooks pipe routing, although it is a crucial driver for design time and costs. Therefore, we propose a mathematical a…
▽ More
The maritime industry must prepare for the energy transition from fossil fuels to sustainable alternatives. Making ships future-proof is necessary given their long lifetime, but it is also complex because the future fuel type is uncertain. Within this uncertainty, one typically overlooks pipe routing, although it is a crucial driver for design time and costs. Therefore, we propose a mathematical approach for modeling uncertainty in pipe routing with deterministic, stochastic, and robust optimization. All three models are based on state-of-the-art integer linear optimization models for the Stochastic Steiner Forest Problem and adjusted to the maritime domain using specific constraints for pipe routing. We compare the models using both artificial and realistic instances and show that considering uncertainty using stochastic optimization and robust optimization leads to cost reductions of up to 22% in our experiments.
△ Less
Submitted 28 June, 2024; v1 submitted 14 December, 2023;
originally announced December 2023.
-
A Critical Account of Perturbation Analysis of Markov Chains
Authors:
Karim Abbas,
Joost Berkhout,
Bernd Heidergott
Abstract:
Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite and denumerable Markov chains and introduces new bounds based on series expansions. We discuss a series of examples to illustrate the applicability and numerical…
▽ More
Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite and denumerable Markov chains and introduces new bounds based on series expansions. We discuss a series of examples to illustrate the applicability and numerical efficiency of the various bounds. Specifically, we address the question on how the bounds developed for finite Markov chains behave as the size of the system grows. In addition, we provide for the first time an analysis of the relative error of these bounds. For the case of a scaled perturbation we show that perturbation bounds can be used to analyze stability of a stable Markov chain with respect to perturbation with an unstable chain.
△ Less
Submitted 14 September, 2016;
originally announced September 2016.