-
Investigating the Monte-Carlo Tree Search Approach for the Job Shop Scheduling Problem
Authors:
Laurie Boveroux,
Damien Ernst,
Quentin Louveaux
Abstract:
The Job Shop Scheduling Problem (JSSP) is a well-known optimization problem in manufacturing, where the goal is to determine the optimal sequence of jobs across different machines to minimize a given objective. In this work, we focus on minimising the weighted sum of job completion times. We explore the potential of Monte Carlo Tree Search (MCTS), a heuristic-based reinforcement learning technique…
▽ More
The Job Shop Scheduling Problem (JSSP) is a well-known optimization problem in manufacturing, where the goal is to determine the optimal sequence of jobs across different machines to minimize a given objective. In this work, we focus on minimising the weighted sum of job completion times. We explore the potential of Monte Carlo Tree Search (MCTS), a heuristic-based reinforcement learning technique, to solve large-scale JSSPs, especially those with recirculation. We propose several Markov Decision Process (MDP) formulations to model the JSSP for the MCTS algorithm. In addition, we introduce a new synthetic benchmark derived from real manufacturing data, which captures the complexity of large, non-rectangular instances often encountered in practice. Our experimental results show that MCTS effectively produces good-quality solutions for large-scale JSSP instances, outperforming our constraint programming approach.
△ Less
Submitted 29 January, 2025;
originally announced January 2025.
-
Efficient LP warmstarting for linear modifications of the constraint matrix
Authors:
Guillaume Derval,
Bardhyl Miftari,
Damien Ernst,
Quentin Louveaux
Abstract:
We consider the problem of computing the optimal solution and objective of a linear program under linearly changing linear constraints. More specifically, we want to compute the optimal solution of a linear optimization where the constraint matrix linearly depends on a paramater that can take p different values. Based on the information given by a precomputed basis, we present three efficient LP w…
▽ More
We consider the problem of computing the optimal solution and objective of a linear program under linearly changing linear constraints. More specifically, we want to compute the optimal solution of a linear optimization where the constraint matrix linearly depends on a paramater that can take p different values. Based on the information given by a precomputed basis, we present three efficient LP warm-starting algorithms. Each algorithm is either based on the eigenvalue decomposition, the Schur decomposition, or a tweaked eigenvalue decomposition to evaluate the optimal solution and optimal objective of these problems. The three algorithms have an overall complexity O(m^3 + pm^2) where m is the number of constraints of the original problem and p the number of values of the parameter that we want to evaluate. We also provide theorems related to the optimality conditions to verify when a basis is still optimal and a local bound on the objective.
△ Less
Submitted 7 January, 2025;
originally announced January 2025.
-
Sensitivity analysis for linear changes of the constraint matrix of a linear program
Authors:
Bardhyl Miftari,
Quentin Louveaux,
Damien Ernst,
Guillaume Derval
Abstract:
Understanding the variation of the optimal value with respect to change in the data is an old problem of mathematical optimisation. This paper focuses on the linear problem $f(λ) = \min c^t x$ such that $(A+λD)x \leq b$, where $λ$ is an unknown parameter that varies within an interval and $D$ is a matrix modifying the coefficients of the constraint matrix $A$. This problem is used to analyse the i…
▽ More
Understanding the variation of the optimal value with respect to change in the data is an old problem of mathematical optimisation. This paper focuses on the linear problem $f(λ) = \min c^t x$ such that $(A+λD)x \leq b$, where $λ$ is an unknown parameter that varies within an interval and $D$ is a matrix modifying the coefficients of the constraint matrix $A$. This problem is used to analyse the impact of multiple affine changes in the constraint matrix on the objective function. The function $f(λ)$ can have an erratic behaviour and computing it for a large number of points is computationally heavy while not providing any guarantees in between the computed points. As a new approach to the problem, we derive several bounding methods that provide guarantees on the objective function's behaviour. Those guarantees can be exploited to avoid recomputing the problem for numerous $λ$. The bounding methods are based on approaches from robust optimisation or Lagrangian relaxations. For each approach, we derive three methods of increasing complexity and precision, one that provides constant bounds, one that provides $λ$-dependant bounds and envelope bounds. We assess each bounding method in terms of precision, availability and timing. We show that for a large number of problems, the bound approach outperforms the naive sampling approach considered with 100 points while still providing a good precision and stronger guarantees on a large dataset of problems. We also introduce an iterative algorithm that uses these bounds to compute an approximation of the original function within a given error threshold and discuss its performances.
△ Less
Submitted 13 November, 2024; v1 submitted 18 October, 2024;
originally announced October 2024.
-
On the Length of Monotone Paths in Polyhedra
Authors:
Moïse Blanchard,
Jesùs A. De Loera,
Quentin Louveaux
Abstract:
Motivated by the problem of bounding the number of iterations of the Simplex algorithm we investigate the possible lengths of monotone paths followed by the Simplex method inside the oriented graphs of polyhedra (oriented by the objective function). We consider both the shortest and the longest monotone paths and estimate the monotone diameter and height of polyhedra. Our analysis applies to trans…
▽ More
Motivated by the problem of bounding the number of iterations of the Simplex algorithm we investigate the possible lengths of monotone paths followed by the Simplex method inside the oriented graphs of polyhedra (oriented by the objective function). We consider both the shortest and the longest monotone paths and estimate the monotone diameter and height of polyhedra. Our analysis applies to transportation polytopes, matroid polytopes, matching polytopes, shortest-path polytopes, and the TSP, among others. We begin by showing that combinatorial cubes have monotone and Bland pivot height bounded by their dimension and that in fact all monotone paths of zonotopes are no larger than the number of edge directions of the zonotope. We later use this to show that several polytopes have polynomial-size pivot height, for all pivot rules. In contrast, we show that many well-known combinatorial polytopes have exponentially-long monotone paths. Surprisingly, for some famous pivot rules, e.g., greatest improvement and steepest edge, these same polytopes have polynomial-size simplex paths.
△ Less
Submitted 26 January, 2020;
originally announced January 2020.
-
Comparison Between Robust and Stochastic Optimisation for Long-term Reservoir Operations Under Uncertainty
Authors:
Thibaut Cuvelier,
Pierre Archambeau,
Benjamin Dewals,
Quentin Louveaux
Abstract:
Long-term reservoir management often uses bounds on the reservoir level, between which the operator can work. However, these bounds are not always kept up-to-date with the latest knowledge about the reservoir drainage area, and thus become obsolete. The main difficulty with bounds computation is to correctly take into account the high uncertainty about the inflows to the reservoir. In this article…
▽ More
Long-term reservoir management often uses bounds on the reservoir level, between which the operator can work. However, these bounds are not always kept up-to-date with the latest knowledge about the reservoir drainage area, and thus become obsolete. The main difficulty with bounds computation is to correctly take into account the high uncertainty about the inflows to the reservoir. In this article, we propose a methodology to derive minimum bounds while providing formal guarantees about the quality of the obtained solutions. The uncertainty is embedded using either stochastic or robust programming in a model-predictive-control framework. We compare the two paradigms to the existing solution for a case study and find that the obtained solutions vary substantially. By combining the stochastic and the robust approaches, we also assign a confidence level to the solutions obtained by stochastic programming. The proposed methodology is found to be both efficient and easy to implement. It relies on sound mathematical principles, ensuring that a global optimum is reached in all cases.
△ Less
Submitted 26 January, 2018;
originally announced January 2018.
-
Parametric Polyhedra with at least $k$ Lattice Points: Their Semigroup Structure and the k-Frobenius Problem
Authors:
Iskander Aliev,
Jesus A. De Loera,
Quentin Louveaux
Abstract:
Given an integral $d \times n$ matrix $A$, the well-studied affine semigroup $\mbox{ Sg} (A)=\{ b : Ax=b, \ x \in {\mathbb Z}^n, x \geq 0\}$ can be stratified by the number of lattice points inside the parametric polyhedra $P_A(b)=\{x: Ax=b, x\geq0\}$. Such families of parametric polyhedra appear in many areas of combinatorics, convex geometry, algebra and number theory. The key themes of this pap…
▽ More
Given an integral $d \times n$ matrix $A$, the well-studied affine semigroup $\mbox{ Sg} (A)=\{ b : Ax=b, \ x \in {\mathbb Z}^n, x \geq 0\}$ can be stratified by the number of lattice points inside the parametric polyhedra $P_A(b)=\{x: Ax=b, x\geq0\}$. Such families of parametric polyhedra appear in many areas of combinatorics, convex geometry, algebra and number theory. The key themes of this paper are: (1) A structure theory that characterizes precisely the subset $\mbox{ Sg}_{\geq k}(A)$ of all vectors $b \in \mbox{ Sg}(A)$ such that $P_A(b) \cap {\mathbb Z}^n $ has at least $k$ solutions. We demonstrate that this set is finitely generated, it is a union of translated copies of a semigroup which can be computed explicitly via Hilbert bases computations. Related results can be derived for those right-hand-side vectors $b$ for which $P_A(b) \cap {\mathbb Z}^n$ has exactly $k$ solutions or fewer than $k$ solutions. (2) A computational complexity theory. We show that, when $n$, $k$ are fixed natural numbers, one can compute in polynomial time an encoding of $\mbox{ Sg}_{\geq k}(A)$ as a multivariate generating function, using a short sum of rational functions. As a consequence, one can identify all right-hand-side vectors of bounded norm that have at least $k$ solutions. (3) Applications and computation for the $k$-Frobenius numbers. Using Generating functions we prove that for fixed $n,k$ the $k$-Frobenius number can be computed in polynomial time. This generalizes a well-known result for $k=1$ by R. Kannan. Using some adaptation of dynamic programming we show some practical computations of $k$-Frobenius numbers and their relatives.
△ Less
Submitted 24 July, 2015; v1 submitted 18 September, 2014;
originally announced September 2014.
-
A Quantitative Doignon-Bell-Scarf Theorem
Authors:
Iskander Aliev,
Robert Bassett,
Jesus A. De Loera,
Quentin Louveaux
Abstract:
The famous Doignon-Bell-Scarf Theorem is a Helly-type result about the existence of integer solutions on systems of linear inequalities. The purpose of this paper is to present the following quantitative generalization: Given an integer $k$, we prove that there exists a constant $c(n,k)$, depending only on the dimension $n$ and $k$, such that if a polyhedron ${x: Ax \leq b}$ contains exactly k int…
▽ More
The famous Doignon-Bell-Scarf Theorem is a Helly-type result about the existence of integer solutions on systems of linear inequalities. The purpose of this paper is to present the following quantitative generalization: Given an integer $k$, we prove that there exists a constant $c(n,k)$, depending only on the dimension $n$ and $k$, such that if a polyhedron ${x: Ax \leq b}$ contains exactly k integer solutions, then there exists a subset of the rows, of cardinality no more than $c(n,k)$, defining a polyhedron that contains exactly the same $k$ integer points. In this case $c(n,0) = 2^n$ is the original case of Doignon-Bell-Scarf for infeasible systems of inequalities. We work on both upper and lower bounds for the constant $c(n,k)$ and discuss some consequences, including a Clarkson-style algorithm to find the $l$-th best solution of an integer program with respect to the ordering induced by the objective function.
△ Less
Submitted 7 September, 2015; v1 submitted 10 May, 2014;
originally announced May 2014.
-
Relaxations for multi-period optimal power flow problems with discrete decision variables
Authors:
Quentin Gemine,
Damien Ernst,
Quentin Louveaux,
Bertrand Cornélusse
Abstract:
We consider a class of optimal power flow (OPF) applications where some loads offer a modulation service in exchange for an activation fee. These applications can be modeled as multi-period formulations of the OPF with discrete variables that define mixed-integer non-convex mathematical programs. We propose two types of relaxations to tackle these problems. One is based on a Lagrangian relaxation…
▽ More
We consider a class of optimal power flow (OPF) applications where some loads offer a modulation service in exchange for an activation fee. These applications can be modeled as multi-period formulations of the OPF with discrete variables that define mixed-integer non-convex mathematical programs. We propose two types of relaxations to tackle these problems. One is based on a Lagrangian relaxation and the other is based on a network flow relaxation. Both relaxations are tested on several benchmarks and, although they provide a comparable dual bound, it appears that the constraints in the solutions derived from the network flow relaxation are significantly less violated.
△ Less
Submitted 6 January, 2014;
originally announced January 2014.
-
An analysis of mixed integer linear sets based on lattice point free convex sets
Authors:
Kent Andersen,
Quentin Louveaux,
Robert Weismantel
Abstract:
Split cuts are cutting planes for mixed integer programs whose validity is derived from maximal lattice point free polyhedra of the form $S:=\{x : π_0 \leq π^T x \leq π_0+1 \}$ called split sets. The set obtained by adding all split cuts is called the split closure, and the split closure is known to be a polyhedron. A split set $S$ has max-facet-width equal to one in the sense that…
▽ More
Split cuts are cutting planes for mixed integer programs whose validity is derived from maximal lattice point free polyhedra of the form $S:=\{x : π_0 \leq π^T x \leq π_0+1 \}$ called split sets. The set obtained by adding all split cuts is called the split closure, and the split closure is known to be a polyhedron. A split set $S$ has max-facet-width equal to one in the sense that $\max\{π^T x : x \in S \}-\min\{π^T x : x \in S \} \leq 1$. In this paper we consider using general lattice point free rational polyhedra to derive valid cuts for mixed integer linear sets. We say that lattice point free polyhedra with max-facet-width equal to $w$ have width size $w$. A split cut of width size $w$ is then a valid inequality whose validity follows from a lattice point free rational polyhedron of width size $w$. The $w$-th split closure is the set obtained by adding all valid inequalities of width size at most $w$. Our main result is a sufficient condition for the addition of a family of rational inequalities to result in a polyhedral relaxation. We then show that a corollary is that the $w$-th split closure is a polyhedron. Given this result, a natural question is which width size $w^*$ is required to design a finite cutting plane proof for the validity of an inequality. Specifically, for this value $w^*$, a finite cutting plane proof exists that uses lattice point free rational polyhedra of width size at most $w^*$, but no finite cutting plane proof that only uses lattice point free rational polyhedra of width size smaller than $w^*$. We characterize $w^*$ based on the faces of the linear relaxation.
△ Less
Submitted 29 June, 2009;
originally announced June 2009.
-
Split rank of triangle and quadrilateral inequalities
Authors:
Santanu Dey,
Quentin Louveaux
Abstract:
A simple relaxation of two rows of a simplex tableau is a mixed integer set consisting of two equations with two free integer variables and non-negative continuous variables. Recently Andersen, Louveaux, Weismantel and Wolsey (2007) and Cornuejols and Margot (2008) showed that the facet-defining inequalities of this set are either split cuts or intersection cuts obtained from lattice-free triang…
▽ More
A simple relaxation of two rows of a simplex tableau is a mixed integer set consisting of two equations with two free integer variables and non-negative continuous variables. Recently Andersen, Louveaux, Weismantel and Wolsey (2007) and Cornuejols and Margot (2008) showed that the facet-defining inequalities of this set are either split cuts or intersection cuts obtained from lattice-free triangles and quadrilaterals. Through a result by Cook, Kannan and Schrijver (1990), it is known that one particular class of facet-defining triangle inequality does not have a finite split rank. In this paper, we show that all other facet-defining triangle and quadrilateral inequalities have a finite split-rank. The proof is constructive and given a facet-defining triangle or quadrilateral inequality we present an explicit sequence of split inequalities that can be used to generate it.
△ Less
Submitted 4 June, 2009;
originally announced June 2009.
-
Intermediate integer programming representations using value disjunctions
Authors:
Matthias Köppe,
Quentin Louveaux,
Robert Weismantel
Abstract:
We introduce a general technique to create an extended formulation of a mixed-integer program. We classify the integer variables into blocks, each of which generates a finite set of vector values. The extended formulation is constructed by creating a new binary variable for each generated value. Initial experiments show that the extended formulation can have a more compact complete description t…
▽ More
We introduce a general technique to create an extended formulation of a mixed-integer program. We classify the integer variables into blocks, each of which generates a finite set of vector values. The extended formulation is constructed by creating a new binary variable for each generated value. Initial experiments show that the extended formulation can have a more compact complete description than the original formulation.
We prove that, using this reformulation technique, the facet description decomposes into one ``linking polyhedron'' per block and the ``aggregated polyhedron''. Each of these polyhedra can be analyzed separately. For the case of identical coefficients in a block, we provide a complete description of the linking polyhedron and a polynomial-time separation algorithm. Applied to the knapsack with a fixed number of distinct coefficients, this theorem provides a complete description in an extended space with a polynomial number of variables.
△ Less
Submitted 13 March, 2006;
originally announced March 2006.
