-
A Polynomial-Time Inner Approximation Algorithm for Multi-Objective Optimization
Authors:
Levin Nemesch,
Stefan Ruzika,
Clemens Thielen,
Alina Wittmann
Abstract:
In multi-objective optimization, the problem of finding all non-dominated images is often intractable. However, for any multiplicative factor greater than one, an approximation set can be constructed in polynomial time for many problems. In this paper, we use the concept of convex approximation sets: Each non-dominated image is approximated by a convex combination of images of solutions in such a…
▽ More
In multi-objective optimization, the problem of finding all non-dominated images is often intractable. However, for any multiplicative factor greater than one, an approximation set can be constructed in polynomial time for many problems. In this paper, we use the concept of convex approximation sets: Each non-dominated image is approximated by a convex combination of images of solutions in such a set. Recently, Helfrich et al. (2024) presented a convex approximation algorithm that works in an adaptive fashion and outperforms all previously existing algorithms. We use a different approach for constructing an even more efficient adaptive algorithm for computing convex approximation sets. Our algorithm is based on the skeleton algorithm for polyhedral inner approximation by Csirmaz (2021). If the weighted sum scalarization can be solved exactly or approximately in polynomial time, our algorithm can find a convex approximation set for an approximation factor arbitrarily close to this solution quality. We demonstrate that our new algorithm significantly outperforms the current state-of-the-art algorithm from Helfrich et al. (2024) on instances of the multi-objective variants of the assignment problem, the knapsack problem, and the symmetric metric travelling salesman problem.
△ Less
Submitted 28 April, 2025;
originally announced April 2025.
-
Multi-parametric matroids -- Applications to interdiction and weight set decomposition
Authors:
Nils Hausbrandt,
Stefan Ruzika
Abstract:
In this article, we investigate the multi-parametric matroid problem. The weights of the elements of the matroid's ground set depend linearly on an arbitrary but fixed number of parameters, each of which is taken from a real interval. The goal is to compute a minimum weight basis for each possible combination of the parameters. For this problem, we propose an algorithm that requires a polynomial n…
▽ More
In this article, we investigate the multi-parametric matroid problem. The weights of the elements of the matroid's ground set depend linearly on an arbitrary but fixed number of parameters, each of which is taken from a real interval. The goal is to compute a minimum weight basis for each possible combination of the parameters. For this problem, we propose an algorithm that requires a polynomial number of independence tests and discuss two useful applications. First, the algorithm can be applied to solve a multi-parametric version of a special matroid interdiction problem, and second, it can be utilized to compute the weight set decomposition of the multi-objective (graphic) matroid problem. For the latter, we asymptotically improve the current state-of-the-art algorithm by a factor that is almost proportional to the number of edges of the graphic matroid.
△ Less
Submitted 12 March, 2025; v1 submitted 11 March, 2025;
originally announced March 2025.
-
A Survey of Exact and Approximation Algorithms for Linear-Parametric Optimization Problems
Authors:
Levin Nemesch,
Stefan Ruzika,
Clemens Thielen,
Alina Wittmann
Abstract:
Linear-parametric optimization, where multiple objectives are combined into a single objective using linear combinations with parameters as coefficients, has numerous links to other fields in optimization and a wide range of application areas. In this survey, we provide a comprehensive overview of structural results and algorithmic strategies for solving linear-parametric optimization problems exa…
▽ More
Linear-parametric optimization, where multiple objectives are combined into a single objective using linear combinations with parameters as coefficients, has numerous links to other fields in optimization and a wide range of application areas. In this survey, we provide a comprehensive overview of structural results and algorithmic strategies for solving linear-parametric optimization problems exactly and approximately. Transferring concepts from related areas such as multi-objective optimization provides further relevant results. The survey consists of two parts: First, we list strategies that work in a general fashion and do not rely on specific problem structures. Second, we look at well-studied parametric optimization problems and cover both important theoretical results and specialized algorithmic approaches for these problems. Among these problems are parametric variants of shortest path problems, minimum cost flow and maximum flow problems, spanning tree problems, the knapsack problem, and matching problems. Overall, we cover the results from 128 publications (and refer to 33 supplemental works) published between 1963 and 2024.
△ Less
Submitted 20 January, 2025;
originally announced January 2025.
-
The Parametric Matroid $\ell$-Interdiction Problem
Authors:
Nils Hausbrandt,
Stefan Ruzika
Abstract:
In this article, we introduce the parametric matroid $\ell$-interdiction problem, where $\ell\in\mathbb{N}_{>0}$ is a fixed number of elements allowed to be interdicted. Each element of the matroid's ground set is assigned a weight that depends linearly on a real parameter from a given interval. The goal is to compute, for each possible parameter value, a set of $\ell$-most vital elements with cor…
▽ More
In this article, we introduce the parametric matroid $\ell$-interdiction problem, where $\ell\in\mathbb{N}_{>0}$ is a fixed number of elements allowed to be interdicted. Each element of the matroid's ground set is assigned a weight that depends linearly on a real parameter from a given interval. The goal is to compute, for each possible parameter value, a set of $\ell$-most vital elements with corresponding objective value the deletion of which causes a maximum increase of the weight of a minimal basis. We show that such a set, which of course depends on the parameter, can only change polynomially often if the parameter varies. We develop several exact algorithms to solve the problem that have polynomial running times if an independence test can be performed in polynomial time.
△ Less
Submitted 14 August, 2024;
originally announced August 2024.
-
Lessons Learned from Designing an Open-Source Automated Feedback System for STEM Education
Authors:
Steffen Steinert,
Lars Krupp,
Karina E. Avila,
Anke S. Janssen,
Verena Ruf,
David Dzsotjan,
Christian De Schryver,
Jakob Karolus,
Stefan Ruzika,
Karen Joisten,
Paul Lukowicz,
Jochen Kuhn,
Norbert Wehn,
Stefan Küchemann
Abstract:
As distance learning becomes increasingly important and artificial intelligence tools continue to advance, automated systems for individual learning have attracted significant attention. However, the scarcity of open-source online tools that are capable of providing personalized feedback has restricted the widespread implementation of research-based feedback systems. In this work, we present RATsA…
▽ More
As distance learning becomes increasingly important and artificial intelligence tools continue to advance, automated systems for individual learning have attracted significant attention. However, the scarcity of open-source online tools that are capable of providing personalized feedback has restricted the widespread implementation of research-based feedback systems. In this work, we present RATsApp, an open-source automated feedback system (AFS) that incorporates research-based features such as formative feedback. The system focuses on core STEM competencies such as mathematical competence, representational competence, and data literacy. It also allows lecturers to monitor students' progress. We conducted a survey based on the technology acceptance model (TAM2) among a set of students (N=64). Our findings confirm the applicability of the TAM2 framework, revealing that factors such as the relevance of the studies, output quality, and ease of use significantly influence the perceived usefulness. We also found a linear relation between the perceived usefulness and the intention to use, which in turn is a significant predictor of the frequency of use. Moreover, the formative feedback feature of RATsApp received positive feedback, indicating its potential as an educational tool. Furthermore, as an open-source platform, RATsApp encourages public contributions to its ongoing development, fostering a collaborative approach to improve educational tools.
△ Less
Submitted 19 January, 2024;
originally announced January 2024.
-
Harnessing Large Language Models to Enhance Self-Regulated Learning via Formative Feedback
Authors:
Steffen Steinert,
Karina E. Avila,
Stefan Ruzika,
Jochen Kuhn,
Stefan Küchemann
Abstract:
Effectively supporting students in mastering all facets of self-regulated learning is a central aim of teachers and educational researchers. Prior research could demonstrate that formative feedback is an effective way to support students during self-regulated learning (SRL). However, for formative feedback to be effective, it needs to be tailored to the learners, requiring information about their…
▽ More
Effectively supporting students in mastering all facets of self-regulated learning is a central aim of teachers and educational researchers. Prior research could demonstrate that formative feedback is an effective way to support students during self-regulated learning (SRL). However, for formative feedback to be effective, it needs to be tailored to the learners, requiring information about their learning progress. In this work, we introduce LEAP, a novel platform that utilizes advanced large language models (LLMs), such as ChatGPT, to provide formative feedback to students. LEAP empowers teachers with the ability to effectively pre-prompt and assign tasks to the LLM, thereby stimulating students' cognitive and metacognitive processes and promoting self-regulated learning. We demonstrate that a systematic prompt design based on theoretical principles can provide a wide range of types of scaffolds to students, including sense-making, elaboration, self-explanation, partial task-solution scaffolds, as well as metacognitive and motivational scaffolds. In this way, we emphasize the critical importance of synchronizing educational technological advances with empirical research and theoretical frameworks.
△ Less
Submitted 30 November, 2023; v1 submitted 23 November, 2023;
originally announced November 2023.
-
Parametric Matroid Interdiction
Authors:
Nils Hausbrandt,
Oliver Bachtler,
Stefan Ruzika,
Luca E. Schäfer
Abstract:
We introduce the parametric matroid one-interdiction problem. Given a matroid, each element of its ground set is associated with a weight that depends linearly on a real parameter from a given parameter interval. The goal is to find, for each parameter value, one element that, when being removed, maximizes the weight of a minimum weight basis. The complexity of this problem can be measured by the…
▽ More
We introduce the parametric matroid one-interdiction problem. Given a matroid, each element of its ground set is associated with a weight that depends linearly on a real parameter from a given parameter interval. The goal is to find, for each parameter value, one element that, when being removed, maximizes the weight of a minimum weight basis. The complexity of this problem can be measured by the number of slope changes of the piecewise linear function mapping the parameter to the weight of the optimal solution of the parametric matroid one-interdiction problem. We provide two polynomial upper bounds as well as a lower bound on the number of these slope changes. Using these, we develop algorithms that require a polynomial number of independence tests and analyse their running time in the special case of graphical matroids.
△ Less
Submitted 8 October, 2023;
originally announced October 2023.
-
Using Scalarizations for the Approximation of Multiobjective Optimization Problems: Towards a General Theory
Authors:
Stephan Helfrich,
Arne Herzel,
Stefan Ruzika,
Clemens Thielen
Abstract:
We study the approximation of general multiobjective optimization problems with the help of scalarizations. Existing results state that multiobjective minimization problems can be approximated well by norm-based scalarizations. However, for multiobjective maximization problems, only impossibility results are known so far. Countering this, we show that all multiobjective optimization problems can,…
▽ More
We study the approximation of general multiobjective optimization problems with the help of scalarizations. Existing results state that multiobjective minimization problems can be approximated well by norm-based scalarizations. However, for multiobjective maximization problems, only impossibility results are known so far. Countering this, we show that all multiobjective optimization problems can, in principle, be approximated equally well by scalarizations. In this context, we introduce a transformation theory for scalarizations that establishes the following: Suppose there exists a scalarization that yields an approximation of a certain quality for arbitrary instances of multiobjective optimization problems with a given decomposition specifying which objective functions are to be minimized / maximized. Then, for each other decomposition, our transformation yields another scalarization that yields the same approximation quality for arbitrary instances of problems with this other decomposition. In this sense, the existing results about the approximation via scalarizations for minimization problems carry over to any other objective decomposition -- in particular, to maximization problems -- when suitably adapting the employed scalarization.
We further provide necessary and sufficient conditions on a scalarization such that its optimal solutions achieve a constant approximation quality. We give an upper bound on the best achievable approximation quality that applies to general scalarizations and is tight for the majority of norm-based scalarizations applied in the context of multiobjective optimization. As a consequence, none of these norm-based scalarizations can induce approximation sets for optimization problems with maximization objectives, which unifies and generalizes the existing impossibility results concerning the approximation of maximization problems.
△ Less
Submitted 24 May, 2023;
originally announced May 2023.
-
Efficiently Constructing Convex Approximation Sets in Multiobjective Optimization Problems
Authors:
Stephan Helfrich,
Stefan Ruzika,
Clemens Thielen
Abstract:
Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the approximation set up to a multiplicative factor in each component, a convex approximation set only requires this multiplicative approximation to be achieved by som…
▽ More
Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the approximation set up to a multiplicative factor in each component, a convex approximation set only requires this multiplicative approximation to be achieved by some convex combination of finitely many images of solutions in the set. This makes convex approximation sets efficiently computable for a wide range of multiobjective problems - even for many problems for which (classic) approximations sets are hard to compute.
In this article, we propose a polynomial-time algorithm to compute convex approximation sets that builds upon an exact or approximate algorithm for the weighted sum scalarization and is, therefore, applicable to a large variety of multiobjective optimization problems. The provided convex approximation quality is arbitrarily close to the approximation quality of the underlying algorithm for the weighted sum scalarization. In essence, our algorithm can be interpreted as an approximate variant of the dual variant of Benson's Outer Approximation Algorithm. Thus, in contrast to existing convex approximation algorithms from the literature, information on solutions obtained during the approximation process is utilized to significantly reduce both the practical running time and the cardinality of the returned solution sets while still guaranteeing the same worst-case approximation quality. We underpin these advantages by the first comparison of all existing convex approximation algorithms on several instances of the triobjective knapsack problem and the triobjective symmetric metric traveling salesman problem.
△ Less
Submitted 10 June, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
Approximating Multiobjective Optimization Problems: How exact can you be?
Authors:
Cristina Bazgan,
Arne Herzel,
Stefan Ruzika,
Clemens Thielen,
Daniel Vanderpooten
Abstract:
It is well known that, under very weak assumptions, multiobjective optimization problems admit $(1+\varepsilon,\dots,1+\varepsilon)$-approximation sets (also called $\varepsilon$-Pareto sets) of polynomial cardinality (in the size of the instance and in $\frac{1}{\varepsilon}$). While an approximation guarantee of $1+\varepsilon$ for any $\varepsilon>0$ is the best one can expect for singleobjecti…
▽ More
It is well known that, under very weak assumptions, multiobjective optimization problems admit $(1+\varepsilon,\dots,1+\varepsilon)$-approximation sets (also called $\varepsilon$-Pareto sets) of polynomial cardinality (in the size of the instance and in $\frac{1}{\varepsilon}$). While an approximation guarantee of $1+\varepsilon$ for any $\varepsilon>0$ is the best one can expect for singleobjective problems (apart from solving the problem to optimality), even better approximation guarantees than $(1+\varepsilon,\dots,1+\varepsilon)$ can be considered in the multiobjective case since the approximation might be exact in some of the objectives.
Hence, in this paper, we consider partially exact approximation sets that require to approximate each feasible solution exactly, i.e., with an approximation guarantee of $1$, in some of the objectives while still obtaining a guarantee of $1+\varepsilon$ in all others. We characterize the types of polynomial-cardinality, partially exact approximation sets that are guaranteed to exist for general multiobjective optimization problems. Moreover, we study minimum-cardinality partially exact approximation sets concerning (weak) efficiency of the contained solutions and relate their cardinalities to the minimum cardinality of a $(1+\varepsilon,\dots,1+\varepsilon)$-approximation set.
△ Less
Submitted 24 May, 2023;
originally announced May 2023.
-
p-median location interdiction on trees
Authors:
Lena Leiß,
Till Heller,
Luca E. Schäfer,
Manuel Streicher,
Stefan Ruzika
Abstract:
In p-median location interdiction the aim is to find a subset of edges in a graph, such that the objective value of the p-median problem in the same graph without the selected edges is as large as possible.
We prove that this problem is NP-hard even on acyclic graphs. Restricting the problem to trees with unit lengths on the edges, unit interdiction costs, and a single edge interdiction, we prov…
▽ More
In p-median location interdiction the aim is to find a subset of edges in a graph, such that the objective value of the p-median problem in the same graph without the selected edges is as large as possible.
We prove that this problem is NP-hard even on acyclic graphs. Restricting the problem to trees with unit lengths on the edges, unit interdiction costs, and a single edge interdiction, we provide an algorithm which solves the problem in polynomial time. Furthermore, we investigate path graphs with unit and arbitrary lengths. For the former case, we present an algorithm, where multiple edges can get interdicted. Furthermore, for the latter case, we present a method to compute an optimal solution for one interdiction step which can also be extended to multiple interdicted edges.
△ Less
Submitted 31 January, 2023;
originally announced January 2023.
-
A machine learning based algorithm selection method to solve the minimum cost flow problem
Authors:
Philipp Herrmann,
Anna Meyer,
Stefan Ruzika,
Luca E. Schäfer,
Fabian von der Warth
Abstract:
The minimum cost flow problem is one of the most studied network optimization problems and appears in numerous applications. Some efficient algorithms exist for this problem, which are freely available in the form of libraries or software packages. It is noticeable that none of these solvers is better than the other solution methods on all instances. Thus, the question arises whether the fastest a…
▽ More
The minimum cost flow problem is one of the most studied network optimization problems and appears in numerous applications. Some efficient algorithms exist for this problem, which are freely available in the form of libraries or software packages. It is noticeable that none of these solvers is better than the other solution methods on all instances. Thus, the question arises whether the fastest algorithm can be selected for a given instance based on the characteristics of the instance. To this end, we train several machine learning classifiers to predict the fastest among a given set of solvers. We accomplish this by creating a representative data set of 81,000 instances and characterizing each of these instances by a vector of relevant features. To achieve better performance, we conduct a grid search to optimize the hyperparameters of the classifiers. Finally, we evaluate the different classifiers by means of accuracy. It is shown that tree-based models appear to adapt and exploit the relevant structures of the minimum-cost flow problem particularly well on a large number of instances, predicting the fastest solver with an accuracy of more than 90%.
△ Less
Submitted 3 October, 2022;
originally announced October 2022.
-
An Approximation Algorithm for a General Class of Multi-Parametric Optimization Problems
Authors:
Stephan Helfrich,
Arne Herzel,
Stefan Ruzika,
Clemens Thielen
Abstract:
In a widely-studied class of multi-parametric optimization problems, the objective value of each solution is an affine function of real-valued parameters. Then, the goal is to provide an optimal solution set, i.e., a set containing an optimal solution for each non-parametric problem obtained by fixing a parameter vector. For many multi-parametric optimization problems, however, an optimal solution…
▽ More
In a widely-studied class of multi-parametric optimization problems, the objective value of each solution is an affine function of real-valued parameters. Then, the goal is to provide an optimal solution set, i.e., a set containing an optimal solution for each non-parametric problem obtained by fixing a parameter vector. For many multi-parametric optimization problems, however, an optimal solution set of minimum cardinality can contain super-polynomially many solutions. Consequently, no polynomial-time exact algorithms can exist for these problems even if $\textsf{P}=\textsf{NP}$.
We propose an approximation method that is applicable to a general class of multi-parametric optimization problems and outputs a set of solutions with cardinality polynomial in the instance size and the inverse of the approximation guarantee. This method lifts approximation algorithms for non-parametric optimization problems to their parametric version and provides an approximation guarantee that is arbitrarily close to the approximation guarantee of the approximation algorithm for the non-parametric problem. If the non-parametric problem can be solved exactly in polynomial time or if an FPTAS is available, our algorithm is an FPTAS. Further, we show that, for any given approximation guarantee, the minimum cardinality of an approximation set is, in general, not $\ell$-approximable for any natural number $\ell$ less or equal to the number of parameters, and we discuss applications of our results to classical multi-parametric combinatorial optimizations problems. In particular, we obtain an FPTAS for the multi-parametric minimum $s$-$t$-cut problem, an FPTAS for the multi-parametric knapsack problem, as well as an approximation algorithm for the multi-parametric maximization of independence systems problem.
△ Less
Submitted 13 December, 2021; v1 submitted 21 September, 2021;
originally announced September 2021.
-
Approximating Biobjective Minimization Problems Using General Ordering Cones
Authors:
Arne Herzel,
Stephan Helfrich,
Stefan Ruzika,
Clemens Thielen
Abstract:
This article investigates the approximation quality achievable for biobjective minimization problems with respect to the Pareto cone by solutions that are (approximately) optimal with respect to larger ordering cones. When simultaneously considering $α$-approximations for all closed convex ordering cones of a fixed inner angle $γ\in [\frac π2, π]$, an approximation guarantee between $α$ and $2 α$…
▽ More
This article investigates the approximation quality achievable for biobjective minimization problems with respect to the Pareto cone by solutions that are (approximately) optimal with respect to larger ordering cones. When simultaneously considering $α$-approximations for all closed convex ordering cones of a fixed inner angle $γ\in [\frac π2, π]$, an approximation guarantee between $α$ and $2 α$ is achieved, which depends continuously on $γ$. The analysis is best-possible for any inner angle and it generalizes and unifies the known results that the set of supported solutions is a 2-approximation and that the efficient set itself is a 1-approximation. Moreover, it is shown that, for maximization problems, no approximation guarantee is achievable by considering larger ordering cones in the described fashion, which again generalizes a known result about the set of supported solutions.
△ Less
Submitted 21 September, 2021;
originally announced September 2021.
-
On the Bicriterion Maximum Flow Network Interdiction Problem
Authors:
Luca E. Schäfer,
Stefan Ruzika,
Sven O. Krumke,
Carlos M. Fonseca
Abstract:
This article focuses on a biobjective extension of the maximum flow network interdiction problem, where each arc in the network is associated with two capacity values. Two maximum flows from a source to a sink are to be computed independently of each other with respect to the first and second capacity function, respectively, while an interdictor aims to minimize the value of both maximum flows by…
▽ More
This article focuses on a biobjective extension of the maximum flow network interdiction problem, where each arc in the network is associated with two capacity values. Two maximum flows from a source to a sink are to be computed independently of each other with respect to the first and second capacity function, respectively, while an interdictor aims to minimize the value of both maximum flows by interdicting arcs. We show that this problem is intractable and that the decision problem, which asks whether or not a feasible interdiction strategy is efficient, is NP-complete. We propose a pseudopolynomial time algorithm in the case of two-terminal series-parallel graphs and positive integer-valued interdiction costs. We extend this algorithm to a fully polynomial-time approximation scheme for the case of unit interdiction costs by appropriately partitioning the objective space.
△ Less
Submitted 8 October, 2020; v1 submitted 6 October, 2020;
originally announced October 2020.
-
Sparsifying Parity-Check Matrices
Authors:
Luís M. S. Russo,
Tobias Dietz,
José Rui Figueira,
Alexandre P. Francisco,
Stefan Ruzika
Abstract:
Parity check matrices (PCMs) are used to define linear error correcting codes and ensure reliable information transmission over noisy channels. The set of codewords of such a code is the null space of this binary matrix.
We consider the problem of minimizing the number of one-entries in parity-check matrices. In the maximum-likelihood (ML) decoding method, the number of ones in PCMs is directly…
▽ More
Parity check matrices (PCMs) are used to define linear error correcting codes and ensure reliable information transmission over noisy channels. The set of codewords of such a code is the null space of this binary matrix.
We consider the problem of minimizing the number of one-entries in parity-check matrices. In the maximum-likelihood (ML) decoding method, the number of ones in PCMs is directly related to the time required to decode messages. We propose a simple matrix row manipulation heuristic which alters the PCM, but not the code itself. We apply simulated annealing and greedy local searches to obtain PCMs with a small number of one entries quickly, i.e. in a couple of minutes or hours when using mainstream hardware. The resulting matrices provide faster ML decoding procedures, especially for large codes.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.
-
The two player shortest path network interdiction problem
Authors:
Simon Busam,
Luca E. Schäfer,
Stefan Ruzika
Abstract:
In this article, we study a biobjective extension of the shortest path network interdiction problem. Each arc in the network is associated with two integer length values and two players compute their respective shortest paths from source to sink independently from each other while an interdictor tries to lengthen both shortest paths by removing arcs. We show that this problem is intractable and th…
▽ More
In this article, we study a biobjective extension of the shortest path network interdiction problem. Each arc in the network is associated with two integer length values and two players compute their respective shortest paths from source to sink independently from each other while an interdictor tries to lengthen both shortest paths by removing arcs. We show that this problem is intractable and that deciding whether a feasible interdiction strategy is efficient, is NP- complete. We provide a solution procedure to solve the problem on two-terminal series-parallel graphs in pseudopolynomial time.
△ Less
Submitted 23 August, 2020; v1 submitted 17 April, 2020;
originally announced April 2020.
-
The {0,1}-knapsack problem with qualitative levels
Authors:
Luca E. Schäfer,
Tobias Dietz,
Maria Barbati,
José Rui Figueira,
Salvatore Greco,
Stefan Ruzika
Abstract:
A variant of the classical knapsack problem is considered in which each item is associated with an integer weight and a qualitative level. We define a dominance relation over the feasible subsets of the given item set and show that this relation defines a preorder. We propose a dynamic programming algorithm to compute the entire set of non-dominated rank cardinality vectors and we state two greedy…
▽ More
A variant of the classical knapsack problem is considered in which each item is associated with an integer weight and a qualitative level. We define a dominance relation over the feasible subsets of the given item set and show that this relation defines a preorder. We propose a dynamic programming algorithm to compute the entire set of non-dominated rank cardinality vectors and we state two greedy algorithms, which efficiently compute a single efficient solution.
△ Less
Submitted 12 February, 2020;
originally announced February 2020.
-
One-Exact Approximate Pareto Sets
Authors:
Arne Herzel,
Cristina Bazgan,
Stefan Ruzika,
Clemens Thielen,
Daniel Vanderpooten
Abstract:
Papadimitriou and Yannakakis show that the polynomial-time solvability of a certain singleobjective problem determines the class of multiobjective optimization problems that admit a polynomial-time computable $(1+\varepsilon, \dots , 1+\varepsilon)$-approximate Pareto set (also called an $\varepsilon$-Pareto set). Similarly, in this article, we characterize the class of problems having a polynomia…
▽ More
Papadimitriou and Yannakakis show that the polynomial-time solvability of a certain singleobjective problem determines the class of multiobjective optimization problems that admit a polynomial-time computable $(1+\varepsilon, \dots , 1+\varepsilon)$-approximate Pareto set (also called an $\varepsilon$-Pareto set). Similarly, in this article, we characterize the class of problems having a polynomial-time computable approximate $\varepsilon$-Pareto set that is exact in one objective by the efficient solvability of an appropriate singleobjective problem. This class includes important problems such as multiobjective shortest path and spanning tree, and the approximation guarantee we provide is, in general, best possible. Furthermore, for biobjective problems from this class, we provide an algorithm that computes a one-exact $\varepsilon$-Pareto set of cardinality at most twice the cardinality of a smallest such set and show that this factor of 2 is best possible. For three or more objective functions, however, we prove that no constant-factor approximation on the size of the set can be obtained efficiently.
△ Less
Submitted 28 August, 2019;
originally announced August 2019.
-
The Power of the Weighted Sum Scalarization for Approximating Multiobjective Optimization Problems
Authors:
Cristina Bazgan,
Stefan Ruzika,
Clemens Thielen,
Daniel Vanderpooten
Abstract:
We determine the power of the weighted sum scalarization with respect to the computation of approximations for general multiobjective minimization and maximization problems. Additionally, we introduce a new multi-factor notion of approximation that is specifically tailored to the multiobjective case and its inherent trade-offs between different objectives.
For minimization problems, we provide a…
▽ More
We determine the power of the weighted sum scalarization with respect to the computation of approximations for general multiobjective minimization and maximization problems. Additionally, we introduce a new multi-factor notion of approximation that is specifically tailored to the multiobjective case and its inherent trade-offs between different objectives.
For minimization problems, we provide an efficient algorithm that computes an approximation of a multiobjective problem by using an exact or approximate algorithm for its weighted sum scalarization. In case that an exact algorithm for the weighted sum scalarization is used, this algorithm comes arbitrarily close to the best approximation quality that is obtainable by supported solutions - both with respect to the common notion of approximation and with respect to the new multi-factor notion. Moreover, the algorithm yields the currently best approximation results for several well-known multiobjective minimization problems. For maximization problems, however, we show that a polynomial approximation guarantee can, in general, not be obtained in more than one of the objective functions simultaneously by supported solutions.
△ Less
Submitted 8 November, 2020; v1 submitted 3 August, 2019;
originally announced August 2019.
-
On the Universal Near Shortest Simple Paths Problem
Authors:
Luca E. Schäfer,
Andrea Maier,
Stefan Ruzika
Abstract:
This article generalizes the Near Shortest Paths Problem introduced by Byers and Waterman in 1984 using concepts of the Universal Shortest Path Problem established by Turner and Hamacher in 2011. The generalization covers a variety of shortest path problems by introducing a universal weight vector. We apply this concept to the Near Shortest Paths Problem in a way that we are able to enumerate all…
▽ More
This article generalizes the Near Shortest Paths Problem introduced by Byers and Waterman in 1984 using concepts of the Universal Shortest Path Problem established by Turner and Hamacher in 2011. The generalization covers a variety of shortest path problems by introducing a universal weight vector. We apply this concept to the Near Shortest Paths Problem in a way that we are able to enumerate all universal near shortest simple paths. We present two recursive algorithms to compute the set of universal near shortest simple paths between two prespecified vertices and evaluate the running time complexity per path enumerated with respect to different values of the universal weight vector. Further, we study the cardinality of a minimal complete set with respect to different values of the universal weight vector.
△ Less
Submitted 23 August, 2019; v1 submitted 12 June, 2019;
originally announced June 2019.
-
A Reduced-Complexity Projection Algorithm for ADMM-based LP Decoding
Authors:
Florian Gensheimer,
Tobias Dietz,
Kira Kraft,
Stefan Ruzika,
Norbert Wehn
Abstract:
The Alternating Direction Method of Multipliers has recently been adapted for Linear Programming Decoding of Low-Density Parity-Check codes. The computation of the projection onto the parity polytope is the core of this algorithm and usually involves a sorting operation, which is the main effort of the projection.
In this paper, we present an algorithm with low complexity to compute this project…
▽ More
The Alternating Direction Method of Multipliers has recently been adapted for Linear Programming Decoding of Low-Density Parity-Check codes. The computation of the projection onto the parity polytope is the core of this algorithm and usually involves a sorting operation, which is the main effort of the projection.
In this paper, we present an algorithm with low complexity to compute this projection. The algorithm relies on new findings in the recursive structure of the parity polytope and iteratively fixes selected components. It requires up to 37% less arithmetical operations compared to state-of-the-art projections. Additionally, it does not involve a sorting operation, which is needed in all exact state-of-the-art projection algorithms. These two benefits make it appealing for efficient hard- and software implementations.
△ Less
Submitted 10 January, 2019;
originally announced January 2019.
-
Introducing Multiobjective Complex Systems
Authors:
Tobias Dietz,
Kathrin Klamroth,
Konstantin Kraus,
Stefan Ruzika,
Luca E. Schäfer,
Britta Schulze,
Michael Stiglmayr,
Margaret M. Wiecek
Abstract:
This article focuses on the optimization of a complex system which is composed of several subsystems. On the one hand, these subsystems are subject to multiple objectives, local constraints as well as local variables, and they are associated with an own, subsystem-dependent decision maker. On the other hand, these subsystems are interconnected to each other by global variables or linking constrain…
▽ More
This article focuses on the optimization of a complex system which is composed of several subsystems. On the one hand, these subsystems are subject to multiple objectives, local constraints as well as local variables, and they are associated with an own, subsystem-dependent decision maker. On the other hand, these subsystems are interconnected to each other by global variables or linking constraints. Due to these interdependencies, it is in general not possible to simply optimize each subsystem individually to improve the performance of the overall system. This article introduces a formal graph-based representation of such complex systems and generalizes the classical notions of feasibility and optimality to match this complex situation. Moreover, several algorithmic approaches are suggested and analyzed.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Shortest Paths with Ordinal Weights
Authors:
Luca E. Schäfer,
Tobias Dietz,
Nicolas Fröhlich,
Stefan Ruzika,
José Rui Figueira
Abstract:
We investigate the single-source-single-destination "shortest" paths problem in acyclic graphs with ordinal weighted arc costs. We define the concepts of ordinal dominance and efficiency for paths and their associated ordinal levels, respectively. Further, we show that the number of ordinally non-dominated paths vectors from the source node to every other node in the graph is polynomially bounded…
▽ More
We investigate the single-source-single-destination "shortest" paths problem in acyclic graphs with ordinal weighted arc costs. We define the concepts of ordinal dominance and efficiency for paths and their associated ordinal levels, respectively. Further, we show that the number of ordinally non-dominated paths vectors from the source node to every other node in the graph is polynomially bounded and we propose a polynomial time labeling algorithm for solving the problem of finding the set of ordinally non-dominated paths vectors from source to sink.
△ Less
Submitted 6 September, 2018; v1 submitted 28 August, 2018;
originally announced August 2018.
-
A General Approximation Method for Bicriteria Minimization Problems
Authors:
Pascal Halffmann,
Stefan Ruzika,
Clemens Thielen,
David Willems
Abstract:
We present a general technique for approximating bicriteria minimization problems with positive-valued, polynomially computable objective functions. Given $0<ε\leq1$ and a polynomial-time $α$-approximation algorithm for the corresponding weighted sum problem, we show how to obtain a bicriteria $(α\cdot(1+2ε),α\cdot(1+\frac{2}ε))$-approximation algorithm for the budget-constrained problem whose run…
▽ More
We present a general technique for approximating bicriteria minimization problems with positive-valued, polynomially computable objective functions. Given $0<ε\leq1$ and a polynomial-time $α$-approximation algorithm for the corresponding weighted sum problem, we show how to obtain a bicriteria $(α\cdot(1+2ε),α\cdot(1+\frac{2}ε))$-approximation algorithm for the budget-constrained problem whose running time is polynomial in the encoding length of the input and linear in $\frac{1}ε$.
Moreover, we show that our method can be extended to compute an $(α\cdot(1+2ε),α\cdot(1+\frac{2}ε))$-approximate Pareto curve under the same assumptions. Our technique applies to many minimization problems to which most previous algorithms for computing approximate Pareto curves cannot be applied because the corresponding gap problem is $\textsf{NP}$-hard to solve. For maximization problems, however, we show that approximation results similar to the ones presented here for minimization problems are impossible to obtain in polynomial time unless $\textsf{P}=\textsf{NP}$.
△ Less
Submitted 11 January, 2017;
originally announced January 2017.
-
Efficient Maximum-Likelihood Decoding of Linear Block Codes on Binary Memoryless Channels
Authors:
Michael Helmling,
Eirik Rosnes,
Stefan Ruzika,
Stefan Scholl
Abstract:
In this work, we consider efficient maximum-likelihood decoding of linear block codes for small-to-moderate block lengths. The presented approach is a branch-and-bound algorithm using the cutting-plane approach of Zhang and Siegel (IEEE Trans. Inf. Theory, 2012) for obtaining lower bounds. We have compared our proposed algorithm to the state-of-the-art commercial integer program solver CPLEX, and…
▽ More
In this work, we consider efficient maximum-likelihood decoding of linear block codes for small-to-moderate block lengths. The presented approach is a branch-and-bound algorithm using the cutting-plane approach of Zhang and Siegel (IEEE Trans. Inf. Theory, 2012) for obtaining lower bounds. We have compared our proposed algorithm to the state-of-the-art commercial integer program solver CPLEX, and for all considered codes our approach is faster for both low and high signal-to-noise ratios. For instance, for the benchmark (155,64) Tanner code our algorithm is more than 11 times as fast as CPLEX for an SNR of 1.0 dB on the additive white Gaussian noise channel. By a small modification, our algorithm can be used to calculate the minimum distance, which we have again verified to be much faster than using the CPLEX solver.
△ Less
Submitted 28 April, 2014; v1 submitted 17 March, 2014;
originally announced March 2014.
-
Towards An Exact Combinatorial Algorithm for LP Decoding of Turbo Codes
Authors:
Michael Helmling,
Stefan Ruzika
Abstract:
We present a novel algorithm that solves the turbo code LP decoding problem in a fininte number of steps by Euclidean distance minimizations, which in turn rely on repeated shortest path computations in the trellis graph representing the turbo code. Previous attempts to exploit the combinatorial graph structure only led to algorithms which are either of heuristic nature or do not guarantee finite…
▽ More
We present a novel algorithm that solves the turbo code LP decoding problem in a fininte number of steps by Euclidean distance minimizations, which in turn rely on repeated shortest path computations in the trellis graph representing the turbo code. Previous attempts to exploit the combinatorial graph structure only led to algorithms which are either of heuristic nature or do not guarantee finite convergence. A numerical study shows that our algorithm clearly beats the running time, up to a factor of 100, of generic commercial LP solvers for medium-sized codes, especially for high SNR values.
△ Less
Submitted 27 January, 2013;
originally announced January 2013.
-
Mathematical Programming Decoding of Binary Linear Codes: Theory and Algorithms
Authors:
Michael Helmling,
Stefan Ruzika,
Akin Tanatmis
Abstract:
Mathematical programming is a branch of applied mathematics and has recently been used to derive new decoding approaches, challenging established but often heuristic algorithms based on iterative message passing. Concepts from mathematical programming used in the context of decoding include linear, integer, and nonlinear programming, network flows, notions of duality as well as matroid and polyhed…
▽ More
Mathematical programming is a branch of applied mathematics and has recently been used to derive new decoding approaches, challenging established but often heuristic algorithms based on iterative message passing. Concepts from mathematical programming used in the context of decoding include linear, integer, and nonlinear programming, network flows, notions of duality as well as matroid and polyhedral theory. This survey article reviews and categorizes decoding methods based on mathematical programming approaches for binary linear codes over binary-input memoryless symmetric channels.
△ Less
Submitted 28 April, 2014; v1 submitted 19 July, 2011;
originally announced July 2011.
-
A Separation Algorithm for Improved LP-Decoding of Linear Block Codes
Authors:
Akin Tanatmis,
Stefan Ruzika,
Horst W. Hamacher,
Mayur Punekar,
Frank Kienle,
Norbert Wehn
Abstract:
Maximum Likelihood (ML) decoding is the optimal decoding algorithm for arbitrary linear block codes and can be written as an Integer Programming (IP) problem. Feldman et al. relaxed this IP problem and presented Linear Programming (LP) based decoding algorithm for linear block codes. In this paper, we propose a new IP formulation of the ML decoding problem and solve the IP with generic methods.…
▽ More
Maximum Likelihood (ML) decoding is the optimal decoding algorithm for arbitrary linear block codes and can be written as an Integer Programming (IP) problem. Feldman et al. relaxed this IP problem and presented Linear Programming (LP) based decoding algorithm for linear block codes. In this paper, we propose a new IP formulation of the ML decoding problem and solve the IP with generic methods. The formulation uses indicator variables to detect violated parity checks. We derive Gomory cuts from our formulation and use them in a separation algorithm to find ML codewords. We further propose an efficient method of finding cuts induced by redundant parity checks (RPC). Under certain circumstances we can guarantee that these RPC cuts are valid and cut off the fractional optimal solutions of LP decoding. We demonstrate on two LDPC codes and one BCH code that our separation algorithm performs significantly better than LP decoding.
△ Less
Submitted 13 December, 2008;
originally announced December 2008.
