-
Sparse Approximation in Lattices and Semigroups
Authors:
Stefan Kuhlmann,
Timm Oertel,
Robert Weismantel
Abstract:
Given an integer or a non-negative integer solution $x$ to a system $Ax = b$, where the number of non-zero components of $x$ is at most $n$. This paper addresses the following question: How closely can we approximate $b$ with $Ay$, where $y$ is an integer or non-negative integer solution constrained to have at most $k$ non-zero components with $k<n$? We establish upper and lower bounds for this qu…
▽ More
Given an integer or a non-negative integer solution $x$ to a system $Ax = b$, where the number of non-zero components of $x$ is at most $n$. This paper addresses the following question: How closely can we approximate $b$ with $Ay$, where $y$ is an integer or non-negative integer solution constrained to have at most $k$ non-zero components with $k<n$? We establish upper and lower bounds for this question in general. In specific cases, these bounds match. The key finding is that the quality of the approximation increases exponentially as $k$ goes to $n$.
△ Less
Submitted 31 October, 2024;
originally announced October 2024.
-
On Matrices over a Polynomial Ring with Restricted Subdeterminants
Authors:
Marcel Celaya,
Stefan Kuhlmann,
Robert Weismantel
Abstract:
This paper introduces a framework to study discrete optimization problems which are parametric in the following sense: their constraint matrices correspond to matrices over the ring $\mathbb{Z}[x]$ of polynomials in one variable. We investigate in particular matrices whose subdeterminants all lie in a fixed set $S\subseteq\mathbb{Z}[x]$. Such matrices, which we call totally $S$-modular matrices, a…
▽ More
This paper introduces a framework to study discrete optimization problems which are parametric in the following sense: their constraint matrices correspond to matrices over the ring $\mathbb{Z}[x]$ of polynomials in one variable. We investigate in particular matrices whose subdeterminants all lie in a fixed set $S\subseteq\mathbb{Z}[x]$. Such matrices, which we call totally $S$-modular matrices, are closed with respect to taking submatrices, so it is natural to look at minimally non-totally $S$-modular matrices which we call forbidden minors for $S$. Among other results, we prove that if $S$ is finite, then the set of all determinants attained by a forbidden minor for $S$ is also finite. Specializing to the integers, we subsequently obtain the following positive complexity result: the recognition problem for totally $\pm\{0,1,a,a+1,2a+1\}$-modular matrices with $a\in\mathbb{Z}\backslash\{-3,-2,1,2\}$ and the integer linear optimization problem for totally $\pm\{ 0,a,a+1,2a+1\}$-modular matrices with $a\in\mathbb{Z}\backslash\{ -2,1\}$ can be solved in polynomial time.
△ Less
Submitted 7 March, 2024; v1 submitted 7 November, 2023;
originally announced November 2023.
-
Sparse Approximation Over the Cube
Authors:
Sabrina Bruckmeier,
Christoph Hunkenschröder,
Robert Weismantel
Abstract:
This paper presents an anlysis of the NP-hard minimization problem $\min \{\|b - Ax\|_2: \ x \in [0,1]^n, | \text{supp}(x) | \leq σ\}$, where $\text{supp}(x) = \{i \in [n]: x_i \neq 0\}$ and $σ$ is a positive integer. The object of investigation is a natural relaxation where we replace $| \text{supp}(x) | \leq σ$ by $\sum_i x_i \leq σ$. Our analysis includes a probabilistic view on when the relaxa…
▽ More
This paper presents an anlysis of the NP-hard minimization problem $\min \{\|b - Ax\|_2: \ x \in [0,1]^n, | \text{supp}(x) | \leq σ\}$, where $\text{supp}(x) = \{i \in [n]: x_i \neq 0\}$ and $σ$ is a positive integer. The object of investigation is a natural relaxation where we replace $| \text{supp}(x) | \leq σ$ by $\sum_i x_i \leq σ$. Our analysis includes a probabilistic view on when the relaxation is exact. We also consider the problem from a deterministic point of view and provide a bound on the distance between the images of optimal solutions of the original problem and its relaxation under $A$. This leads to an algorithm for generic matrices $A \in \mathbb{Z}^{m \times n}$ and achieves a polynomial running time provided that $m$ and $\|A\|_{\infty}$ are fixed.
△ Less
Submitted 6 October, 2022;
originally announced October 2022.
-
Minimum-Cost Flows Over Time
Authors:
Miriam Schlöter,
Robert Weismantel
Abstract:
In this paper we show that every maximum minimum-cost flow over time problem has an optimal solution with a repeated structure if the given time horizon is large enough.
In this paper we show that every maximum minimum-cost flow over time problem has an optimal solution with a repeated structure if the given time horizon is large enough.
△ Less
Submitted 1 June, 2022;
originally announced June 2022.
-
Minimizing a low-dimensional convex function over a high-dimensional cube
Authors:
Christoph Hunkenschröder,
Sebastian Pokutta,
Robert Weismantel
Abstract:
For a matrix $W \in \mathbb{Z}^{m \times n}$, $m \leq n$, and a convex function $g: \mathbb{R}^m \rightarrow \mathbb{R}$, we are interested in minimizing $f(x) = g(Wx)$ over the set $\{0,1\}^n$. We will study separable convex functions and sharp convex functions $g$. Moreover, the matrix $W$ is unknown to us. Only the number of rows $m \leq n$ and $\|W\|_{\infty}$ is revealed. The composite functi…
▽ More
For a matrix $W \in \mathbb{Z}^{m \times n}$, $m \leq n$, and a convex function $g: \mathbb{R}^m \rightarrow \mathbb{R}$, we are interested in minimizing $f(x) = g(Wx)$ over the set $\{0,1\}^n$. We will study separable convex functions and sharp convex functions $g$. Moreover, the matrix $W$ is unknown to us. Only the number of rows $m \leq n$ and $\|W\|_{\infty}$ is revealed. The composite function $f(x)$ is presented by a zeroth and first order oracle only. Our main result is a proximity theorem that ensures that an integral minimum and a continuous minimum for separable convex and sharp convex functions are always "close" by. This will be a key ingredient to develop an algorithm for detecting an integer minimum that achieves a running time of roughly $(m \| W \|_{\infty})^{\mathcal{O}(m^3)} \cdot \text{poly}(n)$. In the special case when $(i)$ $W$ is given explicitly and $(ii)$ $g$ is separable convex one can also adapt an algorithm of Hochbaum and Shanthikumar. The running time of this adapted algorithm matches with the running time of our general algorithm.
△ Less
Submitted 16 August, 2022; v1 submitted 11 April, 2022;
originally announced April 2022.
-
Notes on $\{a,b,c\}$-Modular Matrices
Authors:
Christoph Glanzer,
Ingo Stallknecht,
Robert Weismantel
Abstract:
Let $A \in \mathbb{Z}^{m \times n}$ be an integral matrix and $a$, $b$, $c \in \mathbb{Z}$ satisfy $a \geq b \geq c \geq 0$. The question is to recognize whether $A$ is $\{a,b,c\}$-modular, i.e., whether the set of $n \times n$ subdeterminants of $A$ in absolute value is $\{a,b,c\}$. We will succeed in solving this problem in polynomial time unless $A$ possesses a duplicative relation, that is,…
▽ More
Let $A \in \mathbb{Z}^{m \times n}$ be an integral matrix and $a$, $b$, $c \in \mathbb{Z}$ satisfy $a \geq b \geq c \geq 0$. The question is to recognize whether $A$ is $\{a,b,c\}$-modular, i.e., whether the set of $n \times n$ subdeterminants of $A$ in absolute value is $\{a,b,c\}$. We will succeed in solving this problem in polynomial time unless $A$ possesses a duplicative relation, that is, $A$ has nonzero $n \times n$ subdeterminants $k_1$ and $k_2$ satisfying $2 \cdot |k_1| = |k_2|$. This is an extension of the well-known recognition algorithm for totally unimodular matrices. As a consequence of our analysis, we present a polynomial time algorithm to solve integer programs in standard form over $\{a,b,c\}$-modular constraint matrices for any constants $a$, $b$ and $c$.
△ Less
Submitted 28 September, 2021; v1 submitted 28 June, 2021;
originally announced June 2021.
-
Efficient sequential and parallel algorithms for multistage stochastic integer programming using proximity
Authors:
Jana Cslovjecsek,
Friedrich Eisenbrand,
Michał Pilipczuk,
Moritz Venzin,
Robert Weismantel
Abstract:
We consider the problem of solving integer programs of the form $\min \{\,c^\intercal x\ \colon\ Ax=b, x\geq 0\}$, where $A$ is a multistage stochastic matrix in the following sense: the primal treedepth of $A$ is bounded by a parameter $d$, which means that the columns of $A$ can be organized into a rooted forest of depth at most $d$ so that columns not bound by the ancestor/descendant relation i…
▽ More
We consider the problem of solving integer programs of the form $\min \{\,c^\intercal x\ \colon\ Ax=b, x\geq 0\}$, where $A$ is a multistage stochastic matrix in the following sense: the primal treedepth of $A$ is bounded by a parameter $d$, which means that the columns of $A$ can be organized into a rooted forest of depth at most $d$ so that columns not bound by the ancestor/descendant relation in the forest do not have non-zero entries in the same row. We give an algorithm that solves this problem in fixed-parameter time $f(d,\|A\|_{\infty})\cdot n\log^{O(2^d)} n$, where $f$ is a computable function and $n$ is the number of rows of $A$. The algorithm works in the strong model, where the running time only measures unit arithmetic operations on the input numbers and does not depend on their bitlength. This is the first fpt algorithm for multistage stochastic integer programming to achieve almost linear running time in the strong sense. For the case of two-stage stochastic integer programs, our algorithm works in time $2^{(2\|A\|_\infty)^{O(r(r+s))}}\cdot n\log^{O(rs)} n$. The algorithm can be also parallelized: we give an implementation in the PRAM model that achieves running time $f(d,\|A\|_{\infty})\cdot \log^{O(2^d)} n$ using $n$ processors.
The main conceptual ingredient in our algorithms is a new proximity result for multistage stochastic integer programs. We prove that if we consider an integer program $P$, say with a constraint matrix $A$, then for every optimum solution to the linear relaxation of $P$ there exists an optimum (integral) solution to $P$ that lies, in the $\ell_{\infty}$-norm, within distance bounded by a function of $\|A\|_{\infty}$ and the primal treedepth of $A$. On the way to achieve this result, we prove a generalization and considerable improvement of a structural result of Klein for multistage stochastic integer programs.
△ Less
Submitted 21 December, 2020;
originally announced December 2020.
-
Block-Structured Integer and Linear Programming in Strongly Polynomial and Near Linear Time
Authors:
Jana Cslovjecsek,
Friedrich Eisenbrand,
Christoph Hunkenschröder,
Lars Rohwedder,
Robert Weismantel
Abstract:
We consider integer and linear programming problems for which the linear constraints exhibit a (recursive) block-structure: The problem decomposes into independent and efficiently solvable sub-problems if a small number of constraints is deleted. A prominent example are $n$-fold integer programming problems and their generalizations which have received considerable attention in the recent literatu…
▽ More
We consider integer and linear programming problems for which the linear constraints exhibit a (recursive) block-structure: The problem decomposes into independent and efficiently solvable sub-problems if a small number of constraints is deleted. A prominent example are $n$-fold integer programming problems and their generalizations which have received considerable attention in the recent literature. The previously known algorithms for these problems are based on the augmentation framework, a tailored integer programming variant of local search. In this paper we propose a different approach. Our algorithm relies on parametric search and a new proximity bound. We show that block-structured linear programming can be solved efficiently via an adaptation of a parametric search framework by Norton, Plotkin, and Tardos in combination with Megiddo's multidimensional search technique. This also forms a subroutine of our algorithm for the integer programming case by solving a strong relaxation of it. Then we show that, for any given optimal vertex solution of this relaxation, there is an optimal integer solution within $\ell_1$-distance independent of the dimension of the problem. This in turn allows us to find an optimal integer solution efficiently. We apply our techniques to integer and linear programming with $n$-fold structure or bounded dual treedepth, two benchmark problems in this field. We obtain the first algorithms for these cases that are both near-linear in the dimension of the problem and strongly polynomial. Moreover, unlike the augmentation algorithms, our approach is highly parallelizable.
△ Less
Submitted 3 August, 2020; v1 submitted 18 February, 2020;
originally announced February 2020.
-
The Integrality Number of an Integer Program
Authors:
Joseph Paat,
Miriam Schlöter,
Robert Weismantel
Abstract:
We introduce the integrality number of an integer program (IP) in inequality form. Roughly speaking, the integrality number is the smallest number of integer constraints needed to solve an IP via a mixed integer (MIP) relaxation. One notable property of this number is its invariance under unimodular transformations of the constraint matrix. Considering the largest minor $Δ$ of the constraint matri…
▽ More
We introduce the integrality number of an integer program (IP) in inequality form. Roughly speaking, the integrality number is the smallest number of integer constraints needed to solve an IP via a mixed integer (MIP) relaxation. One notable property of this number is its invariance under unimodular transformations of the constraint matrix. Considering the largest minor $Δ$ of the constraint matrix, our analysis allows us to make statements of the following form: there exist numbers $τ(Δ)$ and $κ(Δ)$ such that an IP with $n\geq τ(Δ)$ many variables and $n + κ(Δ)\cdot \sqrt{n}$ many inequality constraints can be solved via a MIP relaxation with fewer than $n$ integer constraints. From our results it follows that IPs defined by only $n$ constraints can be solved via a MIP relaxation with $O(\sqrtΔ)$ many integer constraints.
△ Less
Submitted 7 April, 2021; v1 submitted 15 April, 2019;
originally announced April 2019.
-
Subset selection in sparse matrices
Authors:
Alberto Del Pia,
Santanu S. Dey,
Robert Weismantel
Abstract:
In subset selection we search for the best linear predictor that involves a small subset of variables. From a computational complexity viewpoint, subset selection is NP-hard and few classes are known to be solvable in polynomial time. Using mainly tools from discrete geometry, we show that some sparsity conditions on the original data matrix allow us to solve the problem in polynomial time.
In subset selection we search for the best linear predictor that involves a small subset of variables. From a computational complexity viewpoint, subset selection is NP-hard and few classes are known to be solvable in polynomial time. Using mainly tools from discrete geometry, we show that some sparsity conditions on the original data matrix allow us to solve the problem in polynomial time.
△ Less
Submitted 6 February, 2020; v1 submitted 5 October, 2018;
originally announced October 2018.
-
Proximity results and faster algorithms for Integer Programming using the Steinitz Lemma
Authors:
Friedrich Eisenbrand,
Robert Weismantel
Abstract:
We consider integer programming problems in standard form $\max \{c^Tx : Ax = b, \, x\geq 0, \, x \in Z^n\}$ where $A \in Z^{m \times n}$, $b \in Z^m$ and $c \in Z^n$. We show that such an integer program can be solved in time $(m Δ)^{O(m)} \cdot \|b\|_\infty^2$, where $Δ$ is an upper bound on each absolute value of an entry in $A$. This improves upon the longstanding best bound of Papadimitriou (…
▽ More
We consider integer programming problems in standard form $\max \{c^Tx : Ax = b, \, x\geq 0, \, x \in Z^n\}$ where $A \in Z^{m \times n}$, $b \in Z^m$ and $c \in Z^n$. We show that such an integer program can be solved in time $(m Δ)^{O(m)} \cdot \|b\|_\infty^2$, where $Δ$ is an upper bound on each absolute value of an entry in $A$. This improves upon the longstanding best bound of Papadimitriou (1981) of $(m\cdot Δ)^{O(m^2)}$, where in addition, the absolute values of the entries of $b$ also need to be bounded by $Δ$. Our result relies on a lemma of Steinitz that states that a set of vectors in $R^m$ that is contained in the unit ball of a norm and that sum up to zero can be ordered such that all partial sums are of norm bounded by $m$. We also use the Steinitz lemma to show that the $\ell_1$-distance of an optimal integer and fractional solution, also under the presence of upper bounds on the variables, is bounded by $m \cdot (2\,m \cdot Δ+1)^m$. Here $Δ$ is again an upper bound on the absolute values of the entries of $A$. The novel strength of our bound is that it is independent of $n$. We provide evidence for the significance of our bound by applying it to general knapsack problems where we obtain structural and algorithmic results that improve upon the recent literature.
△ Less
Submitted 7 June, 2019; v1 submitted 3 July, 2017;
originally announced July 2017.
-
The Quadratic Graver Cone, Quadratic Integer Minimization, and Extensions
Authors:
Jon Lee,
Shmuel Onn,
Lyubov Romanchuk,
Robert Weismantel
Abstract:
We consider the nonlinear integer programming problem of minimizing a quadratic function over the integer points in variable dimension satisfying a system of linear inequalities. We show that when the Graver basis of the matrix defining the system is given, and the quadratic function lies in a suitable {\em dual Graver cone}, the problem can be solved in polynomial time. We discuss the relation be…
▽ More
We consider the nonlinear integer programming problem of minimizing a quadratic function over the integer points in variable dimension satisfying a system of linear inequalities. We show that when the Graver basis of the matrix defining the system is given, and the quadratic function lies in a suitable {\em dual Graver cone}, the problem can be solved in polynomial time. We discuss the relation between this cone and the cone of positive semidefinite matrices, and show that none contains the other. So we can minimize in polynomial time some non-convex and some (including all separable) convex quadrics.
We conclude by extending our results to efficient integer minimization of multivariate polynomial functions of arbitrary degree lying in suitable cones.
△ Less
Submitted 3 June, 2010;
originally announced June 2010.
-
Intractability of approximate multi-dimensional nonlinear optimization on independence systems
Authors:
Jon Lee,
Shmuel Onn,
Robert Weismantel
Abstract:
We consider optimization of nonlinear objective functions that balance $d$ linear criteria over $n$-element independence systems presented by linear-optimization oracles. For $d=1$, we have previously shown that an $r$-best approximate solution can be found in polynomial time. Here, using an extended Erdős-Ko-Rado theorem of Frankl, we show that for $d=2$, finding a $ρn$-best solution requires e…
▽ More
We consider optimization of nonlinear objective functions that balance $d$ linear criteria over $n$-element independence systems presented by linear-optimization oracles. For $d=1$, we have previously shown that an $r$-best approximate solution can be found in polynomial time. Here, using an extended Erdős-Ko-Rado theorem of Frankl, we show that for $d=2$, finding a $ρn$-best solution requires exponential time.
△ Less
Submitted 28 January, 2010;
originally announced January 2010.
-
Multicommodity Flow in Polynomial Time
Authors:
Raymond Hemmecke,
Shmuel Onn,
Robert Weismantel
Abstract:
The multicommodity flow problem is NP-hard already for two commodities over bipartite graphs. Nonetheless, using our recent theory of n-fold integer programming and extensions developed herein, we are able to establish the surprising polynomial time solvability of the problem in two broad situations.
The multicommodity flow problem is NP-hard already for two commodities over bipartite graphs. Nonetheless, using our recent theory of n-fold integer programming and extensions developed herein, we are able to establish the surprising polynomial time solvability of the problem in two broad situations.
△ Less
Submitted 13 July, 2009; v1 submitted 28 June, 2009;
originally announced June 2009.
-
Nonlinear Optimization over a Weighted Independence System
Authors:
Jon Lee,
Shmuel Onn,
Robert Weismantel
Abstract:
We consider the problem of optimizing a nonlinear objective function over a weighted independence system presented by a linear-optimization oracle. We provide a polynomial-time algorithm that determines an r-best solution for nonlinear functions of the total weight of an independent set, where r is a constant that depends on certain Frobenius numbers of the individual weights and is independent…
▽ More
We consider the problem of optimizing a nonlinear objective function over a weighted independence system presented by a linear-optimization oracle. We provide a polynomial-time algorithm that determines an r-best solution for nonlinear functions of the total weight of an independent set, where r is a constant that depends on certain Frobenius numbers of the individual weights and is independent of the size of the ground set. In contrast, we show that finding an optimal (0-best) solution requires exponential time even in a very special case of the problem.
△ Less
Submitted 7 May, 2008;
originally announced May 2008.
-
Nonlinear Matroid Optimization and Experimental Design
Authors:
Yael Berstein,
Jon Lee,
Hugo Maruri-Aguilar,
Shmuel Onn,
Eva Riccomagno,
Robert Weismantel,
Henry Wynn
Abstract:
We study the problem of optimizing nonlinear objective functions over matroids presented by oracles or explicitly. Such functions can be interpreted as the balancing of multi-criteria optimization. We provide a combinatorial polynomial time algorithm for arbitrary oracle-presented matroids, that makes repeated use of matroid intersection, and an algebraic algorithm for vectorial matroids.
Our…
▽ More
We study the problem of optimizing nonlinear objective functions over matroids presented by oracles or explicitly. Such functions can be interpreted as the balancing of multi-criteria optimization. We provide a combinatorial polynomial time algorithm for arbitrary oracle-presented matroids, that makes repeated use of matroid intersection, and an algebraic algorithm for vectorial matroids.
Our work is partly motivated by applications to minimum-aberration model-fitting in experimental design in statistics, which we discuss and demonstrate in detail.
△ Less
Submitted 31 July, 2007;
originally announced July 2007.
-
N-Fold Integer Programming
Authors:
Jesús A. De Loera,
Raymond Hemmecke,
Shmuel Onn,
Robert Weismantel
Abstract:
In this article we study a broad class of integer programming problems in variable dimension. We show that these so-termed {\em n-fold integer programming problems} are polynomial time solvable. Our proof involves two heavy ingredients discovered recently: the equivalence of linear optimization and so-called directed augmentation, and the stabilization of certain Graver bases.
We discuss sever…
▽ More
In this article we study a broad class of integer programming problems in variable dimension. We show that these so-termed {\em n-fold integer programming problems} are polynomial time solvable. Our proof involves two heavy ingredients discovered recently: the equivalence of linear optimization and so-called directed augmentation, and the stabilization of certain Graver bases.
We discuss several applications of our algorithm to multiway transportation problems and to packing problems. One important consequence of our results is a polynomial time algorithm for the $d$-dimensional integer transportation problem for long multiway tables. Another interesting application is a new algorithm for the classical cutting stock problem.
△ Less
Submitted 9 May, 2006;
originally announced May 2006.
