-
Kernel-Free Universum Quadratic Surface Twin Support Vector Machines for Imbalanced Data
Authors:
Hossein Moosaei,
Milan Hladík,
Ahmad Mousavi,
Zheming Gao,
Haojie Fu
Abstract:
Binary classification tasks with imbalanced classes pose significant challenges in machine learning. Traditional classifiers often struggle to accurately capture the characteristics of the minority class, resulting in biased models with subpar predictive performance. In this paper, we introduce a novel approach to tackle this issue by leveraging Universum points to support the minority class withi…
▽ More
Binary classification tasks with imbalanced classes pose significant challenges in machine learning. Traditional classifiers often struggle to accurately capture the characteristics of the minority class, resulting in biased models with subpar predictive performance. In this paper, we introduce a novel approach to tackle this issue by leveraging Universum points to support the minority class within quadratic twin support vector machine models. Unlike traditional classifiers, our models utilize quadratic surfaces instead of hyperplanes for binary classification, providing greater flexibility in modeling complex decision boundaries. By incorporating Universum points, our approach enhances classification accuracy and generalization performance on imbalanced datasets. We generated four artificial datasets to demonstrate the flexibility of the proposed methods. Additionally, we validated the effectiveness of our approach through empirical evaluations on benchmark datasets, showing superior performance compared to conventional classifiers and existing methods for imbalanced classification.
△ Less
Submitted 2 December, 2024;
originally announced December 2024.
-
An Overview of Absolute Value Equations: From Theory to Solution Methods and Challenges
Authors:
Milan Hladík,
Hossein Moosaei,
Fakhrodin Hashemi,
Saeed Ketabchi,
Panos M. Pardalos
Abstract:
This paper provides a thorough exploration of the absolute value equations $Ax-|x|=b$, a seemingly straightforward concept that has gained heightened attention in recent years. It is an NP-hard and nondifferentiable problem and equivalent with the standard linear complementarity problem. Offering a comprehensive review of existing literature, the study delves into theorems concerning the existence…
▽ More
This paper provides a thorough exploration of the absolute value equations $Ax-|x|=b$, a seemingly straightforward concept that has gained heightened attention in recent years. It is an NP-hard and nondifferentiable problem and equivalent with the standard linear complementarity problem. Offering a comprehensive review of existing literature, the study delves into theorems concerning the existence and nonexistence of solutions to the absolute value equations, along with numerical methods for effectively addressing this complex equation. Going beyond conventional approaches, the paper investigates strategies for obtaining solutions with minimal norms, techniques for correcting infeasible systems, and other pertinent topics. By pinpointing challenging issues and emphasizing open problems, this paper serves as a valuable guide for shaping the future research trajectory in this dynamic and multifaceted field.
△ Less
Submitted 9 April, 2024;
originally announced April 2024.
-
Linear programming sensitivity measured by the optimal value worst-case analysis
Authors:
Milan Hladík
Abstract:
This paper introduces a concept of a derivative of the optimal value function in linear programming (LP). Basically, it is the the worst case optimal value of an interval LP problem when the nominal data the data are inflated to intervals according to given perturbation patterns. By definition, the derivative expresses how the optimal value can worsen when the data are subject to variation. In add…
▽ More
This paper introduces a concept of a derivative of the optimal value function in linear programming (LP). Basically, it is the the worst case optimal value of an interval LP problem when the nominal data the data are inflated to intervals according to given perturbation patterns. By definition, the derivative expresses how the optimal value can worsen when the data are subject to variation. In addition, it also gives a certain sensitivity measure or condition number of an LP problem.
If the LP problem is nondegenerate, the derivatives are easy to calculate from the computed primal and dual optimal solutions. For degenerate problems, the computation is more difficult. We propose an upper bound and some kind of characterization, but there are many open problems remaining.
We carried out numerical experiments with specific LP problems and with real LP data from Netlib repository. They show that the derivatives give a suitable sensitivity measure of LP problems. It remains an open problem how to efficiently and rigorously handle degenerate problems.
△ Less
Submitted 13 July, 2023;
originally announced July 2023.
-
Absolute value linear programming
Authors:
Milan Hladík,
David Hartman
Abstract:
We deal with linear programming problems involving absolute values in their formulations, so that they are no more expressible as standard linear programs. The presence of absolute values causes the problems to be nonconvex and nonsmooth, so hard to solve. In this paper, we study fundamental properties on the topology and the geometric shape of the solution set, and also conditions for convexity,…
▽ More
We deal with linear programming problems involving absolute values in their formulations, so that they are no more expressible as standard linear programs. The presence of absolute values causes the problems to be nonconvex and nonsmooth, so hard to solve. In this paper, we study fundamental properties on the topology and the geometric shape of the solution set, and also conditions for convexity, connectedness, boundedness and integrality of the vertices. Further, we address various complexity issues, showing that many basic questions are NP-hard to solve. We show that the feasible set is a (nonconvex) polyhedral set and, more importantly, every nonconvex polyhedral set can be described by means of absolute value constraints. We also provide a necessary and sufficient condition when a KKT point of a nonconvex quadratic programming reformulation solves the original problem.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Characterization of Unique Solvability of Absolute Value Equations: An Overview, Extensions, and Future Directions
Authors:
Shubham Kumar,
Deepmala,
Milan Hladik,
Hossein Moosaei
Abstract:
This paper provides an overview of the necessary and sufficient conditions for guaranteeing the unique solvability of absolute value equations. In addition to discussing the basic form of these equations, we also address several generalizations, including generalized absolute value equations and matrix absolute value equations. Our survey encompasses known results as well as novel characterization…
▽ More
This paper provides an overview of the necessary and sufficient conditions for guaranteeing the unique solvability of absolute value equations. In addition to discussing the basic form of these equations, we also address several generalizations, including generalized absolute value equations and matrix absolute value equations. Our survey encompasses known results as well as novel characterizations proposed in this study.
△ Less
Submitted 15 August, 2023; v1 submitted 29 May, 2023;
originally announced May 2023.
-
Properties of the solution set of absolute value equations and the related matrix classes
Authors:
Milan Hladík
Abstract:
The absolute value equations (AVE) problem is an algebraic problem of solving Ax+|x|=b. So far, most of the research focused on methods for solving AVEs, but we address the problem itself by analysing properties of AVE and the corresponding solution set. In particular, we investigate topological properties of the solution set, such as convexity, boundedness, connectedness, or whether it consists o…
▽ More
The absolute value equations (AVE) problem is an algebraic problem of solving Ax+|x|=b. So far, most of the research focused on methods for solving AVEs, but we address the problem itself by analysing properties of AVE and the corresponding solution set. In particular, we investigate topological properties of the solution set, such as convexity, boundedness, connectedness, or whether it consists of finitely many solutions. Further, we address problems related to nonnegativity of solutions such as solvability or unique solvability. AVE can be formulated by means of different optimization problems, and in this regard we are interested in how the solutions of AVE are related with optima, Karush-Kuhn-Tucker points and feasible solutions of these optimization problems.
We characterize the matrix classes associated with the above mentioned properties and inspect the computational complexity of the recognition problem; some of the classes are polynomially recognizable, but some others are proved to be NP-hard. For the intractable cases, we propose various sufficient conditions. We also post new challenging problems that raised during the investigation of the problem.
△ Less
Submitted 14 September, 2022;
originally announced September 2022.
-
Multi-task twin support vector machine with Universum data
Authors:
Hossein Moosaei,
Fatemeh Bazikar,
Milan Hladík
Abstract:
Multi-task learning (MTL) has emerged as a promising topic of machine learning in recent years, aiming to enhance the performance of numerous related learning tasks by exploiting beneficial information. During the training phase, most of the existing multi-task learning models concentrate entirely on the target task data and ignore the non-target task data contained in the target tasks. To address…
▽ More
Multi-task learning (MTL) has emerged as a promising topic of machine learning in recent years, aiming to enhance the performance of numerous related learning tasks by exploiting beneficial information. During the training phase, most of the existing multi-task learning models concentrate entirely on the target task data and ignore the non-target task data contained in the target tasks. To address this issue, Universum data, that do not correspond to any class of a classification problem, may be used as prior knowledge in the training model. This study looks at the challenge of multi-task learning using Universum data to employ non-target task data, which leads to better performance. It proposes a multi-task twin support vector machine with Universum data (UMTSVM) and provides two approaches to its solution. The first approach takes into account the dual formulation of UMTSVM and tries to solve a quadratic programming problem. The second approach formulates a least-squares version of UMTSVM and refers to it as LS-UMTSVM to further increase the generalization performance. The solution of the two primal problems in LS-UMTSVM is simplified to solving just two systems of linear equations, resulting in an incredibly simple and quick approach. Numerical experiments on several popular multi-task data sets and medical data sets demonstrate the efficiency of the proposed methods.
△ Less
Submitted 22 June, 2022;
originally announced June 2022.
-
Sparse Universum Quadratic Surface Support Vector Machine Models for Binary Classification
Authors:
Hossein Moosaei,
Ahmad Mousavi,
Milan Hladík,
Zheming Gao
Abstract:
In binary classification, kernel-free linear or quadratic support vector machines are proposed to avoid dealing with difficulties such as finding appropriate kernel functions or tuning their hyper-parameters. Furthermore, Universum data points, which do not belong to any class, can be exploited to embed prior knowledge into the corresponding models so that the generalization performance is improve…
▽ More
In binary classification, kernel-free linear or quadratic support vector machines are proposed to avoid dealing with difficulties such as finding appropriate kernel functions or tuning their hyper-parameters. Furthermore, Universum data points, which do not belong to any class, can be exploited to embed prior knowledge into the corresponding models so that the generalization performance is improved. In this paper, we design novel kernel-free Universum quadratic surface support vector machine models. Further, we propose the L1 norm regularized version that is beneficial for detecting potential sparsity patterns in the Hessian of the quadratic surface and reducing to the standard linear models if the data points are (almost) linearly separable. The proposed models are convex such that standard numerical solvers can be utilized for solving them. Nonetheless, we formulate a least squares version of the L1 norm regularized model and next, design an effective tailored algorithm that only requires solving one linear system. Several theoretical properties of these models are then reported/proved as well. We finally conduct numerical experiments on both artificial and public benchmark data sets to demonstrate the feasibility and effectiveness of the proposed models.
△ Less
Submitted 3 April, 2021;
originally announced April 2021.
-
On preconditioning and solving an extended class of interval parametric linear systems
Authors:
Iwona Skalna,
Milan Hladík
Abstract:
We deal with interval parametric systems of linear equations and the goal is to solve such systems, which basically comes down to finding an enclosure for a parametric solution set. Obviously we want this enclosure to be as tight as possible. The review of the available literature shows that in order to make a system more tractable most of the solution methods use left preconditioning of the syste…
▽ More
We deal with interval parametric systems of linear equations and the goal is to solve such systems, which basically comes down to finding an enclosure for a parametric solution set. Obviously we want this enclosure to be as tight as possible. The review of the available literature shows that in order to make a system more tractable most of the solution methods use left preconditioning of the system by the midpoint inverse. Surprisingly, and in contrast to standard interval linear systems, our investigations have shown that double preconditioning can be more efficient than a single one, both in terms of checking the regularity of the system matrix and enclosing the solution set. Consequently, right (which was hitherto mentioned in the context of checking regularity of interval parametric matrices) and double preconditioning together with the p-solution concept enable us to solve a larger class of interval parametric linear systems than most of existing methods. The applicability of the proposed approach to solving interval parametric linear systems is illustrated by several numerical examples.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
-
On unbounded directions of linear interval parametric systems and their extensions to AE solutions
Authors:
M. Hladík
Abstract:
We consider a system of linear equations, whose coefficients depend linearly on interval parameters. Its solution set is defined as the set of all solutions of all admissible realizations of the parameters. We study unbounded directions of the solution set and its relation with its kernel. The kernel of a matrix characterizes unbounded direction in the real case and in the case of ordinary interva…
▽ More
We consider a system of linear equations, whose coefficients depend linearly on interval parameters. Its solution set is defined as the set of all solutions of all admissible realizations of the parameters. We study unbounded directions of the solution set and its relation with its kernel. The kernel of a matrix characterizes unbounded direction in the real case and in the case of ordinary interval systems. In the general parametric case, however, this is not completely true. There is still a close relation preserved, which we discuss in the paper. Nevertheless, we identify several special sub-classes, for which the characterization remains valid. Next, we extend the results to the so called AE parametric systems, which are defined by forall-exists quantification.
△ Less
Submitted 18 February, 2020;
originally announced February 2020.
-
Walks on hyperplane arrangements and optimization of piecewise linear functions
Authors:
Michal Černý,
Milan Hladík,
Miroslav Rada
Abstract:
We propose an exact iterative algorithm for minimization of a class of continuous cell-wise linear convex functions on a hyperplane arrangement. Our particular setup is motivated by evaluation of so-called rank estimators used in robust regression, where every cell of the underlying arrangement corresponds to a permutation of residuals (and we also show that the class of function for which the met…
▽ More
We propose an exact iterative algorithm for minimization of a class of continuous cell-wise linear convex functions on a hyperplane arrangement. Our particular setup is motivated by evaluation of so-called rank estimators used in robust regression, where every cell of the underlying arrangement corresponds to a permutation of residuals (and we also show that the class of function for which the method works is more general). The main obstacle in the construction of the algorithm is how to find an improving direction while standing in a point incident with exponentially many cells of the arrangement. We overcome this difficulty using Birkhoff Theorem which allows us to express the cone of improving directions in the exponential number of cells using a linear system with quadratic number of variables only.
△ Less
Submitted 29 December, 2019;
originally announced December 2019.
-
Computing the spectral decomposition of interval matrices and a study on interval matrix power
Authors:
David Hartman,
Milan Hladík,
David Říha
Abstract:
We present an algorithm for computing a spectral decomposition of an interval matrix as an enclosure of spectral decompositions of particular realizations of interval matrices. The algorithm relies on tight outer estimations of eigenvalues and eigenvectors of corresponding interval matrices. We present a method for general interval matrices as well as its modification for symmetric interval matric…
▽ More
We present an algorithm for computing a spectral decomposition of an interval matrix as an enclosure of spectral decompositions of particular realizations of interval matrices. The algorithm relies on tight outer estimations of eigenvalues and eigenvectors of corresponding interval matrices. We present a method for general interval matrices as well as its modification for symmetric interval matrices. As an illustration, we apply the spectral decomposition to computing powers of interval matrices. Numerical results suggest that a simple binary exponentiation is more efficient for smaller exponents, but our approach becomes better when computing higher powers or powers of a special type of matrices. In particular, we consider symmetric interval and circulant interval matrices. In both cases we utilize some properties of the corresponding classes of matrices to make the power computation more efficient.
△ Less
Submitted 11 December, 2019;
originally announced December 2019.
-
A new polynomially solvable class of quadratic optimization problems with box constraints
Authors:
Milan Hladík,
Michal Černý,
Miroslav Rada
Abstract:
We consider the quadratic optimization problem $\max_{x \in C}\ x^T Q x + q^T x$, where $C\subseteq\mathbb{R}^n$ is a box and $r := \mathrm{rank}(Q)$ is assumed to be $\mathcal{O}(1)$ (i.e., fixed). We show that this case can be solved in polynomial time for an arbitrary $Q$ and $q$. The idea is based on a reduction of the problem to enumeration of faces of a certain zonotope in dimension $O(r)$.…
▽ More
We consider the quadratic optimization problem $\max_{x \in C}\ x^T Q x + q^T x$, where $C\subseteq\mathbb{R}^n$ is a box and $r := \mathrm{rank}(Q)$ is assumed to be $\mathcal{O}(1)$ (i.e., fixed). We show that this case can be solved in polynomial time for an arbitrary $Q$ and $q$. The idea is based on a reduction of the problem to enumeration of faces of a certain zonotope in dimension $O(r)$. This paper generalizes previous results where $Q$ had been assumed to be positive semidefinite and no linear term was allowed in the objective function. Positive definiteness was a strong restriction and it is now relaxed. Generally, the problem is NP-hard; this paper describes a new polynomially solvable class of instances, larger than those known previously.
△ Less
Submitted 25 November, 2019;
originally announced November 2019.
-
A class of optimization problems motivated by rank estimators in robust regression
Authors:
Michal Cerny,
Miroslav Rada,
Jaromir Antoch,
Milan Hladik
Abstract:
A rank estimator in robust regression is a minimizer of a function which depends (in addition to other factors) on the ordering of residuals but not on their values. Here we focus on the optimization aspects of rank estimators. We distinguish two classes of functions: the class with a continuous and convex objective function (CCC), which covers the class of rank estimators known from statistics, a…
▽ More
A rank estimator in robust regression is a minimizer of a function which depends (in addition to other factors) on the ordering of residuals but not on their values. Here we focus on the optimization aspects of rank estimators. We distinguish two classes of functions: the class with a continuous and convex objective function (CCC), which covers the class of rank estimators known from statistics, and also another class (GEN), which is far more general. We propose efficient algorithms for both classes. For GEN we propose an enumerative algorithm that works in polynomial time as long as the number of regressors is O(1). The proposed algorithm utilizes the special structure of arrangements of hyperplanes that occur in our problem and is superior to other known algorithms in this area. For the continuous and convex case, we propose an unconditionally polynomial algorithm finding the exact minimizer, unlike the heuristic or approximate methods implemented in statistical packages.
△ Less
Submitted 13 October, 2019;
originally announced October 2019.
-
Stability of the linear complementarity problem properties under interval uncertainty
Authors:
Milan Hladík
Abstract:
We consider the linear complementarity problem with uncertain data modeled by intervals, representing the range of possible values. Many properties of the linear complementarity problem (such as solvability, uniqueness, convexity, finite number of solutions etc.) are reflected by the properties of the constraint matrix. In order that the problem has desired properties even in the uncertain environ…
▽ More
We consider the linear complementarity problem with uncertain data modeled by intervals, representing the range of possible values. Many properties of the linear complementarity problem (such as solvability, uniqueness, convexity, finite number of solutions etc.) are reflected by the properties of the constraint matrix. In order that the problem has desired properties even in the uncertain environment, we have to be able to check them for all possible realizations of interval data. This leads us to the robust properties of interval matrices. In particular, we will discuss $S$-matrix, $Z$-matrix, copositivity, semimonotonicity, column sufficiency, principal nondegeneracy, $R_0$-matrix and $R$-matrix. We characterize the robust properties and also suggest efficiently recognizable subclasses.
△ Less
Submitted 21 August, 2019;
originally announced August 2019.
-
Determinants of Interval Matrices
Authors:
Jaroslav Horáček,
Milan Hladík,
Josef Matějka
Abstract:
In this paper we shed more light on determinants of interval matrices. Computing the exact bounds on a determinant of an interval matrix is an NP-hard problem. Therefore, attention is first paid to approximations. NP-hardness of both relative and absolute approximation is proved. Next, methods computing verified enclosures of interval determinants and their possible combination with preconditionin…
▽ More
In this paper we shed more light on determinants of interval matrices. Computing the exact bounds on a determinant of an interval matrix is an NP-hard problem. Therefore, attention is first paid to approximations. NP-hardness of both relative and absolute approximation is proved. Next, methods computing verified enclosures of interval determinants and their possible combination with preconditioning are discussed. A new method based on Cramer's rule was designed. It returns similar results to the state-of-the-art method, however, it is less consuming regarding computational time. As a byproduct, the Gerschgorin circles were generalized for interval matrices. New results about classes of interval matrices with polynomially computable tasks related to determinant are proved (symmetric positive definite matrices, class of matrices with identity midpoint matrix, tridiagonal H-matrices). The mentioned methods were exhaustively compared for random general and symmetric matrices.
△ Less
Submitted 11 September, 2018;
originally announced September 2018.
-
Regularity radius: Properties, approximation and a not a priori exponential algorithm
Authors:
David Hartman,
Milan Hladik
Abstract:
The radius of regularity sometimes spelled as the radius of nonsingularity is a measure providing the distance of a given matrix to the nearest singular one. Despite its possible application strength this measure is still far from being handled in an efficient way also due to findings of Poljak and Rohn providing proof that checking this property is NP-hard for a general matrix. To handle this we…
▽ More
The radius of regularity sometimes spelled as the radius of nonsingularity is a measure providing the distance of a given matrix to the nearest singular one. Despite its possible application strength this measure is still far from being handled in an efficient way also due to findings of Poljak and Rohn providing proof that checking this property is NP-hard for a general matrix. To handle this we can either find approximation algorithms or making known bounds for radius of regularity tighter. Improvements of both have been recently shown by Hartman and Hladik (doi:10.1007/978-3-319-31769-4\_9) utilizing relaxation to semidefinite programming. These approaches consider general matrices without or with just mild assumptions about the original matrix. This work explores a process of regularity radius analysis and identifies useful properties enabling easier estimation of the corresponding radius values based on utilization of properties of special class of considered matrices. At first, checking finiteness of regularity radius is shown to be a polynomial problem along with determining a maximal bound on number of nonzero elements of the matrix to obtain infinite radius. Further, relationship between maximum (Chebyshev) norm and spectral norm is used to construct new bounds for the radius of regularity. A new method based on Jansson-Rohn algorithm for testing regularity of an interval matrix is presented which is not a priory exponential along with numerical experiments. For a situation where an input matrix has a special form, several results are provided such as exact formulas for several special classes of matrices, e.g., for totally positive and inverse non-negative, or approximation algorithms, e.g., rank-one radius matrices. For tridiagonal matrices, an algorithm by Bar-On, Codenotti and Leoncini is utilized to design a polynomial algorithm to compute the regularity radius.
△ Less
Submitted 26 June, 2018;
originally announced June 2018.
-
Interval Linear Programming under Transformations: Optimal Solutions and Optimal Value Range
Authors:
Elif Garajová,
Milan Hladík,
Miroslav Rada
Abstract:
Interval linear programming provides a tool for solving real-world optimization problems under interval-valued uncertainty. Instead of approximating or estimating crisp input data, the coefficients of an interval program may perturb independently within the given lower and upper bounds. However, contrarily to classical linear programming, an interval program cannot always be converted into a desir…
▽ More
Interval linear programming provides a tool for solving real-world optimization problems under interval-valued uncertainty. Instead of approximating or estimating crisp input data, the coefficients of an interval program may perturb independently within the given lower and upper bounds. However, contrarily to classical linear programming, an interval program cannot always be converted into a desired form without affecting its properties, due to the so-called dependency problem.
In this paper, we discuss the common transformations used in linear programming, such as imposing non-negativity on free variables or splitting equations into inequalities, and their effects on interval programs. Specifically, we examine changes in the set of all optimal solutions, optimal values and the optimal value range. Since some of the considered properties do not holds in the general case, we also study a special class of interval programs, in which uncertainty only affects the objective function and the right-hand-side vector. For this class, we obtain stronger results.
△ Less
Submitted 27 February, 2018;
originally announced February 2018.
-
Duality Gap in Interval Linear Programming
Authors:
Jana Novotná,
Milan Hladík,
Tomáš Masařík
Abstract:
This paper deals with the problem of linear programming with inexact data represented by real closed intervals. Optimization problems with interval data arise in practical computations and they are of theoretical interest for more than forty years. We extend the concept of duality gap (DG), the difference between the primal and its dual optimal value, into interval linear programming. We consider…
▽ More
This paper deals with the problem of linear programming with inexact data represented by real closed intervals. Optimization problems with interval data arise in practical computations and they are of theoretical interest for more than forty years. We extend the concept of duality gap (DG), the difference between the primal and its dual optimal value, into interval linear programming. We consider two situations: First, DG is zero for every realization of interval parameters (the so called strongly zero DG) and, second, DG is zero for at least one realization of interval parameters (the so called weakly zero DG). We characterize strongly and weakly zero DG and its special case where the matrix of coefficients is real. We discuss computational complexity of testing weakly and strongly zero DG for commonly used types of interval linear programs and their variants with the real matrix of coefficients. We distinguish the NP-hard cases and the cases that are efficiently decidable. Based on DG conditions, we extend previous results about the bounds of the optimal value set given by Rohn. We provide equivalent statements for the bounds
△ Less
Submitted 15 February, 2018;
originally announced February 2018.
-
Testing weak optimality of a given solution in interval linear programming revisited: NP-hardness proof, algorithm and some polynomial cases
Authors:
Miroslav Rada,
Milan Hladík,
Elif Garajová
Abstract:
We address the problem of testing weak optimality of a given solution of a given interval linear program. The problem was recently wrongly stated to be polynomially solvable. We disprove it. We show that the problem is NP-hard in general. We propose a new algorithm for the problem, based on orthant decomposition and solving linear systems. Running time of the algorithm is exponential in the number…
▽ More
We address the problem of testing weak optimality of a given solution of a given interval linear program. The problem was recently wrongly stated to be polynomially solvable. We disprove it. We show that the problem is NP-hard in general. We propose a new algorithm for the problem, based on orthant decomposition and solving linear systems. Running time of the algorithm is exponential in the number of equality constraints. Interval linear programs with inequality constraints only can be processed in polynomial time.
△ Less
Submitted 1 December, 2017;
originally announced December 2017.
-
An Overview of Polynomially Computable Characteristics of Special Interval Matrices
Authors:
Milan Hladík
Abstract:
It is well known that many problems in interval computation are intractable, which restricts our attempts to solve large problems in reasonable time. This does not mean, however, that all problems are computationally hard. Identifying polynomially solvable classes thus belongs to important current trends. The purpose of this paper is to review some of such classes. In particular, we focus on sever…
▽ More
It is well known that many problems in interval computation are intractable, which restricts our attempts to solve large problems in reasonable time. This does not mean, however, that all problems are computationally hard. Identifying polynomially solvable classes thus belongs to important current trends. The purpose of this paper is to review some of such classes. In particular, we focus on several special interval matrices and investigate their convenient properties. We consider tridiagonal matrices, {M,H,P,B}-matrices, inverse M-matrices, inverse nonnegative matrices, nonnegative matrices, totally positive matrices and some others. We focus in particular on computing the range of the determinant, eigenvalues, singular values, and selected norms. Whenever possible, we state also formulae for determining the inverse matrix and the hull of the solution set of an interval system of linear equations. We survey not only the known facts, but we present some new views as well.
△ Less
Submitted 23 November, 2017;
originally announced November 2017.
-
Tolerances, robustness and parametrization of matrix properties related to optimization problems
Authors:
Milan Hladík
Abstract:
When we speak about parametric programming, sensitivity analysis, or related topics, we usually mean the problem of studying specified perturbations of the data such that for a given optimization problem some optimality criterion remains satisfied. In this paper, we turn to another question. Suppose that $A$ is a matrix having a specific property $\mathcal{P}$. What are the maximal allowable varia…
▽ More
When we speak about parametric programming, sensitivity analysis, or related topics, we usually mean the problem of studying specified perturbations of the data such that for a given optimization problem some optimality criterion remains satisfied. In this paper, we turn to another question. Suppose that $A$ is a matrix having a specific property $\mathcal{P}$. What are the maximal allowable variations of the data such that the property still remains valid for the matrix? We study two basic forms of perturbations. The first is a perturbation in a given direction, which is closely related to parametric programming. The second type consists of all possible data variations in a neighbourhood specified by a certain matrix norm; this is related to the tolerance approach to sensitivity analysis, or to stability. The matrix properties discussed in this paper are positive definiteness; P-matrix, H-matrix and P-matrix property; total positivity; inverse M-matrix property and inverse nonnegativity.
△ Less
Submitted 22 September, 2017;
originally announced September 2017.
-
AE regularity of interval matrices
Authors:
Milan Hladík
Abstract:
Consider a linear system of equations with interval coefficients, and each interval coefficient is associated with either a universal or an existential quantifier. The AE solution set and AE solvability of the system is defined by $\forall\exists$-quantification.
Herein, we deal with the problem what properties must the coefficient matrix have in order that there is guaranteed an existence of an…
▽ More
Consider a linear system of equations with interval coefficients, and each interval coefficient is associated with either a universal or an existential quantifier. The AE solution set and AE solvability of the system is defined by $\forall\exists$-quantification.
Herein, we deal with the problem what properties must the coefficient matrix have in order that there is guaranteed an existence of an AE solution. Based on this motivation, we introduce a concept of AE regularity, which implies that the AE solution set is nonempty and the system is AE solvable for every right-hand side. We discuss characterization of AE regularity, and we also focus on various classes of matrices that are implicitly AE regular. Some of these classes are polynomially decidable, and therefore give an efficient way for checking AE regularity. We also state open problems related to computational complexity and characterization.
△ Less
Submitted 7 July, 2017;
originally announced July 2017.
-
Positive Semidefiniteness and Positive Definiteness of a Linear Parametric Interval Matrix
Authors:
Milan Hladík
Abstract:
We consider a symmetric matrix, the entries of which depend linearly on some parameters. The domains of the parameters are compact real intervals. We investigate the problem of checking whether for each (or some) setting of the parameters, the matrix is positive definite (or positive semidefinite). We state a characterization in the form of equivalent conditions, and also propose some computationa…
▽ More
We consider a symmetric matrix, the entries of which depend linearly on some parameters. The domains of the parameters are compact real intervals. We investigate the problem of checking whether for each (or some) setting of the parameters, the matrix is positive definite (or positive semidefinite). We state a characterization in the form of equivalent conditions, and also propose some computationally cheap sufficient\,/\,necessary conditions. Our results extend the classical results on positive (semi-)definiteness of interval matrices. They may be useful for checking convexity or non-convexity in global optimization methods based on branch and bound framework and using interval techniques.
△ Less
Submitted 31 August, 2017; v1 submitted 19 April, 2017;
originally announced April 2017.
-
Eigenvalues of symmetric tridiagonal interval matrices revisited
Authors:
Milan Hladík
Abstract:
In this short note, we present a novel method for computing exact lower and upper bounds of eigenvalues of a symmetric tridiagonal interval matrix. Compared to the known methods, our approach is fast, simple to present and to implement, and avoids any assumptions. Our construction explicitly yields those matrices for which particular lower and upper bounds are attained.
In this short note, we present a novel method for computing exact lower and upper bounds of eigenvalues of a symmetric tridiagonal interval matrix. Compared to the known methods, our approach is fast, simple to present and to implement, and avoids any assumptions. Our construction explicitly yields those matrices for which particular lower and upper bounds are attained.
△ Less
Submitted 9 July, 2018; v1 submitted 12 April, 2017;
originally announced April 2017.
-
A novel data envelopment analysis ranking based on a robust approach
Authors:
Milan Hladík
Abstract:
We propose a novel DEA ranking based on a robust optimization viewpoint: the higher ranking for those DMU's that remain efficient even for larger variations of data and vice versa. This ranking can be computed by solving generalized linear fractional programming problems, but we also present a tight linear programming approximation that preserves the order of rankings. We show some remarkable prop…
▽ More
We propose a novel DEA ranking based on a robust optimization viewpoint: the higher ranking for those DMU's that remain efficient even for larger variations of data and vice versa. This ranking can be computed by solving generalized linear fractional programming problems, but we also present a tight linear programming approximation that preserves the order of rankings. We show some remarkable properties of our approach: It preserves the order of rankings compared to the classical approach. It is naturally normalized, so it can be used as universal ranking of DMU's of unrelated models. It gives ranking not only for inefficient, but also for efficient decision making units. It can also be easily extended to generalized model, for instance to deal with interval data. We present several examples confirming the desirable properties of the method.
△ Less
Submitted 1 August, 2017; v1 submitted 7 February, 2017;
originally announced February 2017.
-
Efficient Approaches for Enclosing the United Solution Set of the Interval Generalized Sylvester Matrix Equations
Authors:
Marzieh Dehghani-Madiseh,
Milan Hladík
Abstract:
In this work, we investigate the interval generalized Sylvester matrix equation ${\bf{A}}X{\bf{B}}+{\bf{C}}X{\bf{D}}={\bf{F}}$ and develop some techniques for obtaining outer estimations for the so-called united solution set of this interval system. First, we propose a modified variant of the Krawczyk operator which causes reducing computational complexity to cubic, compared to Kronecker product f…
▽ More
In this work, we investigate the interval generalized Sylvester matrix equation ${\bf{A}}X{\bf{B}}+{\bf{C}}X{\bf{D}}={\bf{F}}$ and develop some techniques for obtaining outer estimations for the so-called united solution set of this interval system. First, we propose a modified variant of the Krawczyk operator which causes reducing computational complexity to cubic, compared to Kronecker product form. We then propose an iterative technique for enclosing the solution set. These approaches are based on spectral decompositions of the midpoints of ${\bf{A}}$, ${\bf{B}}$, ${\bf{C}}$ and ${\bf{D}}$ and in both of them we suppose that the midpoints of ${\bf{A}}$ and ${\bf{C}}$ are simultaneously diagonalizable as well as for the midpoints of the matrices ${\bf{B}}$ and ${\bf{D}}$. Some numerical experiments are given to illustrate the performance of the proposed methods.
△ Less
Submitted 7 July, 2023; v1 submitted 16 October, 2015;
originally announced October 2015.
-
Selection-based Approach to Cooperative Interval Games
Authors:
Jan Bok,
Milan Hladík
Abstract:
Cooperative interval games are a generalized model of cooperative games in which the worth of every coalition corresponds to a closed interval representing the possible outcomes of its cooperation. Selections are all possible outcomes of the interval game with no additional uncertainty.
We introduce new selection-based classes of interval games and prove their characterization theorems and relat…
▽ More
Cooperative interval games are a generalized model of cooperative games in which the worth of every coalition corresponds to a closed interval representing the possible outcomes of its cooperation. Selections are all possible outcomes of the interval game with no additional uncertainty.
We introduce new selection-based classes of interval games and prove their characterization theorems and relations to existing classes based on the interval weakly better operator. We show new results regarding the core and imputations and examine a problem of equivalence for two different versions of the core, the main stability solution of cooperative games. Finally, we introduce the definition of strong imputation and strong core as universal solution concepts of interval games.
△ Less
Submitted 25 July, 2018; v1 submitted 14 October, 2014;
originally announced October 2014.
-
AE solutions and AE solvability to general interval linear systems
Authors:
Milan Hladík
Abstract:
We consider linear systems of equations and inequalities with coefficients varying inside given intervals. We define their solutions (so called AE solutions) and solvability (so called AE solvability) by using forall-exists quantification of interval parameters. We present an explicit description of the AE solutions, and discuss complexity issues as well. For AE solvability, we propose a sufficien…
▽ More
We consider linear systems of equations and inequalities with coefficients varying inside given intervals. We define their solutions (so called AE solutions) and solvability (so called AE solvability) by using forall-exists quantification of interval parameters. We present an explicit description of the AE solutions, and discuss complexity issues as well. For AE solvability, we propose a sufficient condition only, but for a specific sub-class of problems, a complete characterization is developed. Moreover, we investigate inequality systems for which AE solvability is equivalent to existence of an AE solution.
△ Less
Submitted 29 May, 2014;
originally announced May 2014.
-
Robust optimal solutions in interval linear programming with forall-exists quantifiers
Authors:
Milan Hladík
Abstract:
We introduce a novel kind of robustness in linear programming. A solution x* is called robust optimal if for all realizations of objective functions coefficients and constraint matrix entries from given interval domains there are appropriate choices of the right-hand side entries from their interval domains such that x* remains optimal. we propose a method to check for robustness of a given point,…
▽ More
We introduce a novel kind of robustness in linear programming. A solution x* is called robust optimal if for all realizations of objective functions coefficients and constraint matrix entries from given interval domains there are appropriate choices of the right-hand side entries from their interval domains such that x* remains optimal. we propose a method to check for robustness of a given point, and also recommend how a suitable candidate can be found. We also discuss topological properties of the robust optimal solution set. We illustrate applicability of our concept in a transportation problem.
△ Less
Submitted 28 March, 2014;
originally announced March 2014.
-
Efficient Solution of a Class of Quantified Constraints with Quantifier Prefix Exists-Forall
Authors:
Milan Hladík,
Stefan Ratschan
Abstract:
In various applications the search for certificates for certain properties (e.g., stability of dynamical systems, program termination) can be formulated as a quantified constraint solving problem with quantifier prefix exists-forall. In this paper, we present an algorithm for solving a certain class of such problems based on interval techniques in combination with conservative linear programming a…
▽ More
In various applications the search for certificates for certain properties (e.g., stability of dynamical systems, program termination) can be formulated as a quantified constraint solving problem with quantifier prefix exists-forall. In this paper, we present an algorithm for solving a certain class of such problems based on interval techniques in combination with conservative linear programming approximation. In comparison with previous work, the method is more general - allowing general Boolean structure in the input constraint, and more efficient - using splitting heuristics that learn from the success of previous linear programming approximations.
△ Less
Submitted 24 June, 2014; v1 submitted 20 December, 2013;
originally announced December 2013.
-
The Effect of Hessian Evaluations in the Global Optimization αBB Method
Authors:
Milan Hladík
Abstract:
We consider convex underestimators that are used in the global optimization αBB method and its variants. The method is based by augmenting the original nonconvex function by a relaxation term that is derived from an interval enclosure of the Hessian matrix. In this paper, we discuss the advantages of symbolic computation of the Hessian matrix. Symbolic computation often allows simplifications of t…
▽ More
We consider convex underestimators that are used in the global optimization αBB method and its variants. The method is based by augmenting the original nonconvex function by a relaxation term that is derived from an interval enclosure of the Hessian matrix. In this paper, we discuss the advantages of symbolic computation of the Hessian matrix. Symbolic computation often allows simplifications of the resulting expressions, which in turn means less conservative underestimators. We show by examples that even a small manipulation with the symbolic expressions, which can be processed automatically by computers, can have a large effect on the quality of underestimators.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
-
On the Efficient Gerschgorin Inclusion Usage in the Global Optimization αBB Method
Authors:
Milan Hladík
Abstract:
In this paper, we revisit the αBB method for solving global optimization problems. We investigate optimality of the scaling vector used in Gerschgorin's inclusion theorem to calculate bounds on the eigenvalues of the Hessian matrix. We propose two heuristics to compute good scaling vector d, and state three necessary optimality conditions for optimal d. Since the scaling vector calculated by the s…
▽ More
In this paper, we revisit the αBB method for solving global optimization problems. We investigate optimality of the scaling vector used in Gerschgorin's inclusion theorem to calculate bounds on the eigenvalues of the Hessian matrix. We propose two heuristics to compute good scaling vector d, and state three necessary optimality conditions for optimal d. Since the scaling vector calculated by the second presented method satisfies all three optimality conditions, it serves as a cheap but efficient solution.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
-
A New Operator and Method for Solving Interval Linear Equations
Authors:
Milan Hladík
Abstract:
We deal with interval linear systems of equations. We present a new operator, which generalizes the interval Gauss-Seidel method. Also, based on the new operator and properties of the well-known methods, we propose a new algorithm, called the magnitude method. We illustrate by numerical examples that our approach overcomes some classical methods with respect to both time and sharpness of enclosure…
▽ More
We deal with interval linear systems of equations. We present a new operator, which generalizes the interval Gauss-Seidel method. Also, based on the new operator and properties of the well-known methods, we propose a new algorithm, called the magnitude method. We illustrate by numerical examples that our approach overcomes some classical methods with respect to both time and sharpness of enclosures.
△ Less
Submitted 28 June, 2013;
originally announced June 2013.
-
Subsquares Approach - Simple Scheme for Solving Overdetermined Interval Linear Systems
Authors:
Jaroslav Horáček,
Milan Hladík
Abstract:
In this work we present a new simple but efficient scheme - Subsquares approach - for development of algorithms for enclosing the solution set of overdetermined interval linear systems. We are going to show two algorithms based on this scheme and discuss their features. We start with a simple algorithm as a motivation, then we continue with a sequential algorithm. Both algorithms can be easily par…
▽ More
In this work we present a new simple but efficient scheme - Subsquares approach - for development of algorithms for enclosing the solution set of overdetermined interval linear systems. We are going to show two algorithms based on this scheme and discuss their features. We start with a simple algorithm as a motivation, then we continue with a sequential algorithm. Both algorithms can be easily parallelized. The features of both algorithms will be discussed and numerically tested.
△ Less
Submitted 5 May, 2013;
originally announced May 2013.
-
Computing Enclosures of Overdetermined Interval Linear Systems
Authors:
Jaroslav Horáček,
Milan Hladík
Abstract:
This work considers special types of interval linear systems - overdetermined systems. Simply said these systems have more equations than variables. The solution set of an interval linear system is a collection of all solutions of all instances of an interval system. By the instance we mean a point real system that emerges when we independently choose a real number from each interval coefficient o…
▽ More
This work considers special types of interval linear systems - overdetermined systems. Simply said these systems have more equations than variables. The solution set of an interval linear system is a collection of all solutions of all instances of an interval system. By the instance we mean a point real system that emerges when we independently choose a real number from each interval coefficient of the interval system. Enclosing the solution set of these systems is in some ways more difficult than for square systems. The main goal of this work is to present various methods for solving overdetermined interval linear systems. We would like to present them in an understandable way even for nonspecialists in a field of linear systems. The second goal is a numerical comparison of all the methods on random interval linear systems regarding widths of enclosures, computation times and other special properties of methods.
△ Less
Submitted 17 April, 2013;
originally announced April 2013.
