-
On the Performance of a Novel Class of Linear System Solvers and Comparison with State-of-The-Art Algorithms
Authors:
Chun Lau,
Bahman Kalantari
Abstract:
We present a comprehensive computational study of a class of linear system solvers, called {\it Triangle Algorithm} (TA) and {\it Centering Triangle Algorithm} (CTA), developed by Kalantari \cite{kalantari23}. The algorithms compute an approximate solution or minimum-norm solution to $Ax=b$ or $A^TAx=A^Tb$, where $A$ is an $m \times n$ real matrix of arbitrary rank. The algorithms specialize when…
▽ More
We present a comprehensive computational study of a class of linear system solvers, called {\it Triangle Algorithm} (TA) and {\it Centering Triangle Algorithm} (CTA), developed by Kalantari \cite{kalantari23}. The algorithms compute an approximate solution or minimum-norm solution to $Ax=b$ or $A^TAx=A^Tb$, where $A$ is an $m \times n$ real matrix of arbitrary rank. The algorithms specialize when $A$ is symmetric positive semi-definite. Based on the description and theoretical properties of TA and CTA from \cite{kalantari23}, we give an implementation of the algorithms that is easy-to-use for practitioners, versatile for a wide range of problems, and robust in that our implementation does not necessitate any constraints on $A$. Next, we make computational comparisons of our implementation with the Matlab implementations of two state-of-the-art algorithms, GMRES and ``lsqminnorm". We consider square and rectangular matrices, for $m$ up to $10000$ and $n$ up to $1000000$, encompassing a variety of applications. These results indicate that our implementation outperforms GMRES and ``lsqminnorm" both in runtime and quality of residuals. Moreover, the relative residuals of CTA decrease considerably faster and more consistently than GMRES, and our implementation provides high precision approximation, faster than GMRES reports lack of convergence. With respect to ``lsqminnorm", our implementation runs faster, producing better solutions. Additionally, we present a theoretical study in the dynamics of iterations of residuals in CTA and complement it with revealing visualizations. Lastly, we extend TA for LP feasibility problems, handling non-negativity constraints. Computational results show that our implementation for this extension is on par with those of TA and CTA, suggesting applicability in linear programming and related problems.
△ Less
Submitted 24 April, 2023;
originally announced April 2023.
-
A Family of Iteration Functions for General Linear Systems
Authors:
Bahman Kalantari
Abstract:
We introduce innovative algorithms for computing exact or approximate (minimum-norm) solutions to $Ax=b$ or the {\it normal equation} $A^TAx=A^Tb$, where $A$ is an $m \times n$ real matrix of arbitrary rank. We present more efficient algorithms when $A$ is symmetric PSD. First, we introduce the {\it Triangle Algorithm} (TA), a {\it convex-hull membership} algorithm that given $b_k=Ax_k$ in the ell…
▽ More
We introduce innovative algorithms for computing exact or approximate (minimum-norm) solutions to $Ax=b$ or the {\it normal equation} $A^TAx=A^Tb$, where $A$ is an $m \times n$ real matrix of arbitrary rank. We present more efficient algorithms when $A$ is symmetric PSD. First, we introduce the {\it Triangle Algorithm} (TA), a {\it convex-hull membership} algorithm that given $b_k=Ax_k$ in the ellipsoid $E_{A,ρ}=\{Ax: \Vert x \Vert \leq ρ\}$, it either computes an improved approximation $b_{k+1}=Ax_{k+1}$ or proves $b \not \in E_{A,ρ}$. We then give a dynamic variant of TA, the {\it Centering Triangle Algorithm} (CTA), generating residual, $r_k=b -Ax_k$ via the iteration of $F_1(r)=r-(r^THr/r^TH^2r)Hr$, where $H=AA^T$. If $A$ is symmetric PSD, $H$ can be taken as $A$. Next, for each $t=1, \dots, m$, we derive $F_t(r)=r- \sum_{i=1}^t α_{t,i}(r) H^i r$ whose iterations correspond to a Krylov subspace method with restart. If $κ^+(H)$ is the ratio of the largest to smallest positive eigenvalues of $H$, when $Ax=b$ is consistent, in $k=O({κ^+(H)}{t^{-1}} \ln \varepsilon^{-1})$ iterations of $F_t$, $\Vert r_k \Vert \leq \varepsilon$. Each iteration takes $O(tN+t^3)$ operations, $N$ the number of nonzero entries in $A$. By directly applying $F_t$ to the normal equation, we get $\Vert A^TAx_k - A^Tb \Vert \leq \varepsilon$ in $O({κ^+(AA^T)}{t}^{-1} \ln \varepsilon^{-1})$ iterations. On the other hand, given any residual $r$, we compute $s$, the degree of its minimal polynomial with respect to $H$ in $O(sN+s^3)$ operations. Then $F_s(r)$ gives the minimum-norm solution of $Ax=b$ or an exact solution of $A^TAx=A^Tb$. The proposed algorithms are simple to implementation and theoretically robust. We present sample computational results, comparing the performance of CTA with CG and GMRES methods. The results support CTA as a highly competitive option.
△ Less
Submitted 28 November, 2023; v1 submitted 10 April, 2023;
originally announced April 2023.
-
Solution of Real Cubic Equations without Cardano's Formula
Authors:
Bahman Kalantari
Abstract:
Building on a classification of zeros of cubic equations due to the $12$-th century Persian mathematician Sharaf al-Din Tusi, together with Smale's theory of {\it point estimation}, we derive an efficient recipe for computing high-precision approximation to a real root of an arbitrary real cubic equation. First, via reversible transformations we reduce any real cubic equation into one of four cano…
▽ More
Building on a classification of zeros of cubic equations due to the $12$-th century Persian mathematician Sharaf al-Din Tusi, together with Smale's theory of {\it point estimation}, we derive an efficient recipe for computing high-precision approximation to a real root of an arbitrary real cubic equation. First, via reversible transformations we reduce any real cubic equation into one of four canonical forms with $0$, $\pm 1$ coefficients, except for the constant term as $\pm q$, $q \geq 0$. Next, given any form, if $ρ_q$ is an approximation to $\sqrt[3]{q}$ to within a relative error of five percent, we prove a {\it seed} $x_0$ in $\{ ρ_q, \pm .95 ρ_q, -\frac{1}{3}, 1 \}$ can be selected such that in $t$ Newton iterations $|x_t - θ_q| \leq \sqrt[3]{q}\cdot 2^{-2^{t}}$ for some real root $θ_q$. While computing a good seed, even for approximation of $\sqrt[3]{q}$, is considered to be ``somewhat of black art'' (see Wikipedia), as we justify, $ρ_q$ is readily computable from {\it mantissa} and {\it exponent} of $q$. It follows that the above approach gives a simple recipe for numerical approximation of solutions of real cubic equations independent of Cardano's formula.
△ Less
Submitted 30 March, 2023;
originally announced March 2023.
-
On Tusi's Classification of Cubic Equations and its Connections to Cardano's Formula and Khayyam's Geometric Solution
Authors:
Bahman Kalantari,
Rahim Zaare-Nahandi
Abstract:
Omar Khayyam's studies on cubic equations inspired the 12th century Persian mathematician Sharaf al-Din Tusi to investigate the number of positive roots. According to the noted mathematical historian Rashed, Tusi analyzed the problem for five different types of equations. In fact all cubic equations are reducible to a form {\it Tusi form} $x^2-x^3=c$. Tusi determined that the maximum of $x^2-x^3$…
▽ More
Omar Khayyam's studies on cubic equations inspired the 12th century Persian mathematician Sharaf al-Din Tusi to investigate the number of positive roots. According to the noted mathematical historian Rashed, Tusi analyzed the problem for five different types of equations. In fact all cubic equations are reducible to a form {\it Tusi form} $x^2-x^3=c$. Tusi determined that the maximum of $x^2-x^3$ on $(0,1)$ occurs at $\frac{2}{3}$ and concluded when $c=\frac{4}{27} δ$, $δ\in (0,1)$, there are roots in $(0, \frac{2}{3})$ and $(\frac{2}{3},1)$, ignoring the root in $(-\frac{1}{3},0)$. Given a {\it reduced form} $x^3+px+q=0$, when $p <0$, we show it is reducible to a Tusi form with $δ= \frac{1}{2} + {3\sqrt{3} q}/{4\sqrt{-p^3}}$. It follows there are three real roots if and only if $Δ=-(\frac{q^2}{4}+\frac{p^3}{27})$ is positive. This gives an explicit connection between $δ$ in Tusi form and $Δ$ in Cardano's formula. Thus when $δ\in (0,1)$, rather than using Cardano's formula in complex numbers one can approximate the roots iteratively. On the other hand, for a reduced form with $p >0$ we give a novel proof of Cardono's formula. While Rashed attributes Tusi's computation of the maximum to the use of derivatives, according to Hogendijk, Tusi was probably influenced by Euclid. Here we show the maximizer in Tusi form is computable via elementary algebraic manipulations. Indeed for a {\it quadratic Tusi form}, $x-x^2=δ/4$, Tusi's approach results in a simple derivation of the quadratic formula, comparable with the pedagogical approach of Po-Shen Loh. Moreover, we derive analogous results for the {\it general Tusi form}. Finally, we present a novel derivation of Khayyam's geometric solution. The results complement previous findings on Tusi's work and reveal further facts on history, mathematics and pedagogy in solving cubic equations.
△ Less
Submitted 28 January, 2022;
originally announced January 2022.
-
A Geometric Algorithm for Solving Linear Systems
Authors:
Bahman Kalantari,
Chun Lau,
Yikai Zhang
Abstract:
Based on the geometric {\it Triangle Algorithm} for testing membership of a point in a convex set, we present a novel iterative algorithm for testing the solvability of a real linear system $Ax=b$, where $A$ is an $m \times n$ matrix of arbitrary rank. Let $C_{A,r}$ be the ellipsoid determined as the image of the Euclidean ball of radius $r$ under the linear map $A$. The basic procedure in our alg…
▽ More
Based on the geometric {\it Triangle Algorithm} for testing membership of a point in a convex set, we present a novel iterative algorithm for testing the solvability of a real linear system $Ax=b$, where $A$ is an $m \times n$ matrix of arbitrary rank. Let $C_{A,r}$ be the ellipsoid determined as the image of the Euclidean ball of radius $r$ under the linear map $A$. The basic procedure in our algorithm computes a point in $C_{A,r}$ that is either within $\varepsilon$ distance to $b$, or acts as a certificate proving $b \not \in C_{A,r}$. Each iteration takes $O(mn)$ operations and when $b$ is well-situated in $C_{A,r}$, the number of iterations is proportional to $\log{(1/\varepsilon)}$. If $Ax=b$ is solvable the algorithm computes an approximate solution or the minimum-norm solution. Otherwise, it computes a certificate to unsolvability, or the minimum-norm least-squares solution. It is also applicable to complex input. In a computational comparison with the state-of-the-art algorithm BiCGSTAB ({\it Bi-conjugate gradient method stabilized}), the Triangle Algorithm is very competitive. In fact, when the iterates of BiCGSTAB do not converge, our algorithm can verify $Ax=b$ is unsolvable and approximate the minimum-norm least-squares solution. The Triangle Algorithm is robust, simple to implement, and requires no preconditioner, making it attractive to practitioners, as well as researchers and educators.
△ Less
Submitted 27 April, 2020;
originally announced April 2020.
-
A Globally Convergent Newton Method for Polynomials
Authors:
Bahman Kalantari
Abstract:
Newton's method for polynomial root finding is one of mathematics' most well-known algorithms. The method also has its shortcomings: it is undefined at critical points, it could exhibit chaotic behavior and is only guaranteed to converge locally. Based on the {\it Geometric Modulus Principle} for a complex polynomial $p(z)$, together with a {\it Modulus Reduction Theorem} proved here, we develop t…
▽ More
Newton's method for polynomial root finding is one of mathematics' most well-known algorithms. The method also has its shortcomings: it is undefined at critical points, it could exhibit chaotic behavior and is only guaranteed to converge locally. Based on the {\it Geometric Modulus Principle} for a complex polynomial $p(z)$, together with a {\it Modulus Reduction Theorem} proved here, we develop the {\it Robust Newton's method} (RNM), defined everywhere with a step-size that guarantees an {\it a priori} reduction in polynomial modulus in each iteration. Furthermore, we prove RNM iterates converge globally, either to a root or a critical point. Specifically, given $\varepsilon $ and any seed $z_0$, in $t=O(1/\varepsilon^{2})$ iterations of RNM, independent of degree of $p(z)$, either $|p(z_t)| \leq \varepsilon$ or $|p(z_t) p'(z_t)| \leq \varepsilon$. By adjusting the iterates at {\it near-critical points}, we describe a {\it modified} RNM that necessarily convergence to a root. In combination with Smale's point estimation, RNM results in a globally convergent Newton's method having a locally quadratic rate. We present sample polynomiographs that demonstrate how in contrast with Newton's method RNM smooths out the fractal boundaries of basins of attraction of roots. RNM also finds potentials in computing all roots of arbitrary degree polynomials. A particular consequence of RNM is a simple algorithm for solving cubic equations.
△ Less
Submitted 29 February, 2020;
originally announced March 2020.
-
Collatz polynomials: an introduction with bounds on their zeros
Authors:
Matt Hohertz,
Bahman Kalantari
Abstract:
The Collatz Conjecture (also known as the 3x+1 Problem) proposes that the following algorithm will, after a certain number of iterations, always yield the number 1: given a natural number, multiply by three and add one if the number is odd, halve the resulting number, then repeat. In this article, for each $N$ for which the Collatz Conjecture holds we define the $N^{th}$ Collatz polynomial to be t…
▽ More
The Collatz Conjecture (also known as the 3x+1 Problem) proposes that the following algorithm will, after a certain number of iterations, always yield the number 1: given a natural number, multiply by three and add one if the number is odd, halve the resulting number, then repeat. In this article, for each $N$ for which the Collatz Conjecture holds we define the $N^{th}$ Collatz polynomial to be the monic polynomial with constant term $N$ and $k^{th}$ term (for $k > 1$) the $k^{th}$ iterate of $N$ under the Collatz function. In particular, we bound the moduli of the roots of these polynomials, prove theorems on when they have rational integer roots, and suggest further applications and avenues of research.
△ Less
Submitted 25 January, 2020; v1 submitted 30 December, 2019;
originally announced January 2020.
-
On the Equivalence of SDP Feasibility and a Convex Hull Relaxation for System of Quadratic Equations
Authors:
Bahman Kalantari
Abstract:
We show {\it semidefinite programming} (SDP) feasibility problem is equivalent to solving a {\it convex hull relaxation} (CHR) for a finite system of quadratic equations. On the one hand, this offers a simple description of SDP. On the other hand, this equivalence makes it possible to describe a version of the {\it Triangle Algorithm} for SDP feasibility based on solving CHR. Specifically, the Tri…
▽ More
We show {\it semidefinite programming} (SDP) feasibility problem is equivalent to solving a {\it convex hull relaxation} (CHR) for a finite system of quadratic equations. On the one hand, this offers a simple description of SDP. On the other hand, this equivalence makes it possible to describe a version of the {\it Triangle Algorithm} for SDP feasibility based on solving CHR. Specifically, the Triangle Algorithm either computes an approximation to the least-norm feasible solution of SDP, or using its {\it distance duality}, provides a separation when no solution within a prescribed norm exists. The worst-case complexity of each iteration is computing the largest eigenvalue of a symmetric matrix arising in that iteration. Alternate complexity bounds on the total number of iterations can be derived. The Triangle Algorithm thus provides an alternative to the existing interior-point algorithms for SDP feasibility and SDP optimization. In particular, based on a preliminary computational result, we can efficiently solve SDP relaxation of {\it binary quadratic} feasibility via the Triangle Algorithm. This finds application in solving SDP relaxation of MAX-CUT. We also show in the case of testing the feasibility of a system of convex quadratic inequalities, the problem is reducible to a corresponding CHR, where the worst-case complexity of each iteration via the Triangle Algorithm is solving a {\it trust region subproblem}. Gaining from these results, we discuss potential extension of CHR and the Triangle Algorithm to solving general system of polynomial equations.
△ Less
Submitted 16 August, 2020; v1 submitted 10 November, 2019;
originally announced November 2019.
-
A Spectral Generalization of Von Neumann Minimax Theorem
Authors:
Bahman Kalantari
Abstract:
Given $n \times n$ real symmetric matrices $A_1, \dots, A_m$, the following {\it spectral minimax} property holds: $$\min_{X \in \mathbfΔ_n} \max_{y \in S_m} \sum_{i=1}^m y_iA_i \bullet X=\max_{y \in S_m} \min_{X \in \mathbfΔ_n} \sum_{i=1}^m y_iA_i \bullet X,$$ where $S_m$ is the simplex and $\mathbfΔ_n$ the spectraplex. For diagonal $A_i$'s this reduces to the classic minimax.
Given $n \times n$ real symmetric matrices $A_1, \dots, A_m$, the following {\it spectral minimax} property holds: $$\min_{X \in \mathbfΔ_n} \max_{y \in S_m} \sum_{i=1}^m y_iA_i \bullet X=\max_{y \in S_m} \min_{X \in \mathbfΔ_n} \sum_{i=1}^m y_iA_i \bullet X,$$ where $S_m$ is the simplex and $\mathbfΔ_n$ the spectraplex. For diagonal $A_i$'s this reduces to the classic minimax.
△ Less
Submitted 23 May, 2019;
originally announced May 2019.
-
A Triangle Algorithm for Semidefinite Version of Convex Hull Membership Problem
Authors:
Bahman Kalantari
Abstract:
Given a subset $\mathbf{S}=\{A_1, \dots, A_m\}$ of $\mathbb{S}^n$, the set of $n \times n$ real symmetric matrices, we define its {\it spectrahull} as the set $SH(\mathbf{S}) = \{p(X) \equiv (Tr(A_1 X), \dots, Tr(A_m X))^T : X \in \mathbfΔ_n\}$, where ${\bf Δ}_n$ is the {\it spectraplex}, $\{ X \in \mathbb{S}^n : Tr(X)=1, X \succeq 0 \}$. We let {\it spectrahull membership} (SHM) to be the problem…
▽ More
Given a subset $\mathbf{S}=\{A_1, \dots, A_m\}$ of $\mathbb{S}^n$, the set of $n \times n$ real symmetric matrices, we define its {\it spectrahull} as the set $SH(\mathbf{S}) = \{p(X) \equiv (Tr(A_1 X), \dots, Tr(A_m X))^T : X \in \mathbfΔ_n\}$, where ${\bf Δ}_n$ is the {\it spectraplex}, $\{ X \in \mathbb{S}^n : Tr(X)=1, X \succeq 0 \}$. We let {\it spectrahull membership} (SHM) to be the problem of testing if a given $b \in \mathbb{R}^m$ lies in $SH(\mathbf{S})$. On the one hand when $A_i$'s are diagonal matrices, SHM reduces to the {\it convex hull membership} (CHM), a fundamental problem in LP. On the other hand, a bounded SDP feasibility is reducible to SHM. By building on the {\it Triangle Algorithm} (TA) \cite{kalchar,kalsep}, developed for CHM and its generalization, we design a TA for SHM, where given $\varepsilon$, in $O(1/\varepsilon^2)$ iterations it either computes a hyperplane separating $b$ from $SH(\mathbf{S})$, or $X_\varepsilon \in \mathbfΔ_n$ such that $\Vert p(X_\varepsilon) - b \Vert \leq \varepsilon R$, $R$ maximum error over $\mathbfΔ_n$. Under certain conditions iteration complexity improves to $O(1/\varepsilon)$ or even $O(\ln 1/\varepsilon)$. The worst-case complexity of each iteration is $O(mn^2)$, plus testing the existence of a pivot, shown to be equivalent to estimating the least eigenvalue of a symmetric matrix. This together with a semidefinite version of Carathéodory theorem allow implementing TA as if solving a CHM, resorting to the {\it power method} only as needed, thereby improving the complexity of iterations. The proposed Triangle Algorithm for SHM is simple, practical and applicable to general SDP feasibility and optimization. Also, it extends to a spectral analogue of SVM for separation of two spectrahulls.
△ Less
Submitted 19 May, 2019; v1 submitted 15 April, 2019;
originally announced April 2019.
-
The edge-vertex inequality in a planar graph and a bipartition for the class of all planar graphs
Authors:
M. R. Emamy-K.,
Bahman Kalantari,
Tatiana Correa
Abstract:
For a planar graph with a given f-vector $(f_{0}, f_{1}, f_{2}),$ we introduce a cubic polynomial whose coefficients depend on the f-vector. The planar graph is said to be real if all the roots of the corresponding polynomial are real. Thus we have a bipartition of all planar graphs into two disjoint class of graphs, real and complex ones. As a contribution toward a full recognition of planar grap…
▽ More
For a planar graph with a given f-vector $(f_{0}, f_{1}, f_{2}),$ we introduce a cubic polynomial whose coefficients depend on the f-vector. The planar graph is said to be real if all the roots of the corresponding polynomial are real. Thus we have a bipartition of all planar graphs into two disjoint class of graphs, real and complex ones. As a contribution toward a full recognition of planar graphs in this bipartition, we study and recognize completely a subclass of planar graphs that includes all the connected grid subgraphs. Finally, all the 2-connected triangle-free complex planar graphs of 7 vertices are listed.
△ Less
Submitted 28 March, 2018;
originally announced March 2018.
-
An Invitation to Polynomiography via Exponential Series
Authors:
Bahman Kalantari
Abstract:
The subject of Polynomiography deals with algorithmic visualization of polynomial equations, having many applications in STEM and art, see [Kal04]. Here we consider the polynomiography of the partial sums of the exponential series. While the exponential function is taught in standard calculus courses, it is unlikely that properties of zeros of its partial sums are considered in such courses, let a…
▽ More
The subject of Polynomiography deals with algorithmic visualization of polynomial equations, having many applications in STEM and art, see [Kal04]. Here we consider the polynomiography of the partial sums of the exponential series. While the exponential function is taught in standard calculus courses, it is unlikely that properties of zeros of its partial sums are considered in such courses, let alone their visualization as science or art. The Monthly article Zemyan discusses some mathematical properties of these zeros. Here we exhibit some fractal and non-fractal polynomiographs of the partial sums while also presenting a brief introduction of the underlying concepts. Polynomiography establishes a different kind of appreciation of the significance of polynomials in STEM, as well as in art. It helps in the teaching of various topics at diverse levels. It also leads to new discoveries on polynomials and inspires new applications. We also present a link for the educator to get access to a demo polynomiography software together with a module that helps teach basic topics to middle and high school students, as well as undergraduates.
△ Less
Submitted 26 July, 2017;
originally announced July 2017.
-
How Many Real Attractive Fixed Points Can A Polynomial Have?
Authors:
Terence Coelho,
Bahman Kalantari
Abstract:
We prove a complex polynomial of degree $n$ has at most $\lceil n/2 \rceil$ attractive fixed points lying on a line. We also consider the general case.
We prove a complex polynomial of degree $n$ has at most $\lceil n/2 \rceil$ attractive fixed points lying on a line. We also consider the general case.
△ Less
Submitted 25 May, 2016;
originally announced May 2016.
-
A Necessary and Sufficient Condition for Local Maxima of Polynomial Modulus Over Unit Disc
Authors:
Bahman Kalantari
Abstract:
An important quantity associated with a complex polynomial $p(z)$ is $\Vert p \Vert_\infty$, the maximum of its modulus over the unit disc $D$. We prove, $z_* \in D$ is a local maximum of $|p(z)|$ if and only if $a_*$ satisfies, $z_*=p(z_*)|p'(z_*)|/p'(z_*)|p(z_*)|$, i.e. it is proportional to its corresponding Newton direction. This explicit formula gives rise to novel iterative algorithms for co…
▽ More
An important quantity associated with a complex polynomial $p(z)$ is $\Vert p \Vert_\infty$, the maximum of its modulus over the unit disc $D$. We prove, $z_* \in D$ is a local maximum of $|p(z)|$ if and only if $a_*$ satisfies, $z_*=p(z_*)|p'(z_*)|/p'(z_*)|p(z_*)|$, i.e. it is proportional to its corresponding Newton direction. This explicit formula gives rise to novel iterative algorithms for computing $\Vert p \Vert_\infty$. We describe two such algorithms, including a Newton-like method and present some visualization of their performance.
△ Less
Submitted 2 May, 2016;
originally announced May 2016.
-
Approximating Nash Equilibrium Via Multilinear Minimax
Authors:
Bahman Kalantari
Abstract:
Nash equilibrium} (NE) can be stated as a formal theorem on a multilinear form, free of game theory terminology. On the other hand, inspired by this formalism, we state and prove a {\it multilinear minimax theorem}, a generalization of von Neumann's bilinear minimax theorem. As in the bilinear case, the proof is based on relating the underlying optimizations to a primal-dual pair of linear program…
▽ More
Nash equilibrium} (NE) can be stated as a formal theorem on a multilinear form, free of game theory terminology. On the other hand, inspired by this formalism, we state and prove a {\it multilinear minimax theorem}, a generalization of von Neumann's bilinear minimax theorem. As in the bilinear case, the proof is based on relating the underlying optimizations to a primal-dual pair of linear programming problems, albeit more complicated LPs. The theorem together with its proof is of independent interest. Next, we use the theorem to associate to a multilinear form in NE a {\it multilinear minimax relaxation} (MMR), where the primal-dual pair of solutions induce an approximate equilibrium point that provides a nontrivial upper bound on a convex combination of {\it expected payoffs} in any NE solution. In fact we show any positive probability vector associated to the players induces a corresponding {\it diagonally-scaled} MMR approximate equilibrium with its associated upper bound. By virtue of the proof of the multilinear minimax theorem, MMR solution can be computed in polynomial-time. On the other hand, it is known that even in bimatrix games NE is {\it PPAD-complete}, a complexity class in NP not known to be in P. The quality of MMR solution and the efficiency of solving the underlying LPs are the subject of further investigation. However, as shown in a separate article, for a large set of test problems in bimatrix games, not only the MMR payoffs for both players are better than any NE payoffs, so is the computing time of MMR in contrast with that of Lemke-Howsen algorithm. In large size problems the latter algorithm even fails to produce a Nash equilibrium. In summary, solving MMR provides a worthy approximation even if Nash equilibrium is shown to be computable in polynomial-time.
△ Less
Submitted 28 December, 2023; v1 submitted 30 April, 2016;
originally announced May 2016.
-
Newton-Ellipsoid Method and its Polynomiography
Authors:
Bahman Kalantari,
Eric Lee
Abstract:
We introduce a new iterative root-finding method for complex polynomials, dubbed {\it Newton-Ellipsoid} method. It is inspired by the Ellipsoid method, a classical method in optimization, and a property of Newton's Method derived in \cite{kalFTA}, according to which at each complex number a half-space can be found containing a root. Newton-Ellipsoid method combines this property, bounds on zeros,…
▽ More
We introduce a new iterative root-finding method for complex polynomials, dubbed {\it Newton-Ellipsoid} method. It is inspired by the Ellipsoid method, a classical method in optimization, and a property of Newton's Method derived in \cite{kalFTA}, according to which at each complex number a half-space can be found containing a root. Newton-Ellipsoid method combines this property, bounds on zeros, together with the plane-cutting properties of the Ellipsoid Method. We present computational results for several examples, as well as corresponding polynomiography. Polynomiography refers to algorithmic visualization of root-finding. Newton's method is the first member of the infinite family of iterations, the {\it basic family}. We also consider general versions of this ellipsoid approach where Newton's method is replaced by a higher-order member of the family such as Halley's method.
△ Less
Submitted 8 October, 2014;
originally announced October 2014.
-
A One-Line Proof of the Fundamental Theorem of Algebra with Newton's Method as a Consequence
Authors:
Bahman Kalantari
Abstract:
Many proofs of the fundamental theorem of algebra rely on the fact that the minimum of the modulus of a complex polynomial over the complex plane is attained at some complex number. The proof then follows by arguing the minimum value is zero. This can be done by proving that at any complex number that is not a zero of the polynomial we can exhibit a direction of descent for the modulus. In this no…
▽ More
Many proofs of the fundamental theorem of algebra rely on the fact that the minimum of the modulus of a complex polynomial over the complex plane is attained at some complex number. The proof then follows by arguing the minimum value is zero. This can be done by proving that at any complex number that is not a zero of the polynomial we can exhibit a direction of descent for the modulus. In this note we present a very short and simple proof of the existence of such descent direction. In particular, our descent direction gives rise to Newton's method for solving a polynomial equation via modulus minimization and also makes the iterates definable at any critical point.
△ Less
Submitted 6 September, 2014;
originally announced September 2014.
-
Algorithms and Polynomiography for Solving Quaternion Quadratic Equations
Authors:
Fedor Andreev,
Bahman Kalantari
Abstract:
Solving a quadratic equation $P(x)=ax^2+bx+c=0$ with real coefficients is known to middle school students. Solving the equation over the quaternions is not straightforward. Huang and So \cite{Huang} give a complete set of formulas, breaking it into several cases depending on the coefficients. From a result of the second author in \cite{kalQ}, zeros of $P(x)$ can be expressed in terms of the zeros…
▽ More
Solving a quadratic equation $P(x)=ax^2+bx+c=0$ with real coefficients is known to middle school students. Solving the equation over the quaternions is not straightforward. Huang and So \cite{Huang} give a complete set of formulas, breaking it into several cases depending on the coefficients. From a result of the second author in \cite{kalQ}, zeros of $P(x)$ can be expressed in terms of the zeros of a real quartic equation. This drastically simplifies solving a quadratic equation. Here we also consider solving $P(x)=0$ iteratively via Newton and Halley methods developed in \cite{kalQ}. We prove a property of the Jacobian of Newton and Halley methods and describe several 2D polynomiography based on these methods. The images not only encode the outcome of the iterative process, but by measuring the time taken to render them we find the relative speed of convergence for the methods.
△ Less
Submitted 6 September, 2014;
originally announced September 2014.
-
Solving Cubic Equations By the Quadratic Formula
Authors:
Bahman Kalantari
Abstract:
Let $p(z)$ be a monic cubic complex polynomial with distinct roots and distinct critical points. We say a critical point has the {\it Voronoi property} if it lies in the Voronoi cell of a root $θ$, $V(θ)$, i.e. the set of points that are closer to $θ$ than to the other roots. We prove at least one critical point has the Voronoi property and characterize the cases when both satisfy this property. I…
▽ More
Let $p(z)$ be a monic cubic complex polynomial with distinct roots and distinct critical points. We say a critical point has the {\it Voronoi property} if it lies in the Voronoi cell of a root $θ$, $V(θ)$, i.e. the set of points that are closer to $θ$ than to the other roots. We prove at least one critical point has the Voronoi property and characterize the cases when both satisfy this property. It is known that for any $ξ\in V(θ)$, the sequence $B_m(ξ) =ξ- p(ξ) d_{m-2}/d_{m-1}$ converges to $θ$, where $d_m$ satisfies the recurrence $d_m =p'(ξ)d_{m-1}-0.5 p(ξ)p''(ξ)d_{m-2} +p^2(ξ)d_{m-3}$, $d_0 =1, d_{-1}=d_{-2}=0$. Thus by the Voronoi property, there is a solution $c$ of $p'(z)=0$ where $B_m(c)$ converges to a root of $p(z)$. The speed of convergence is dependent on the ratio of the distances between $c$ and the closest and the second closest roots of $p(z)$. This results in a different algorithm for solving a cubic equation than the classical methods. We give polynomiography for an example.
△ Less
Submitted 20 January, 2014;
originally announced January 2014.
-
Solving Linear System of Equations Via A Convex Hull Algorithm
Authors:
Bahman Kalantari
Abstract:
We present new iterative algorithms for solving a square linear system $Ax=b$ in dimension $n$ by employing the {\it Triangle Algorithm} \cite{kal12}, a fully polynomial-time approximation scheme for testing if the convex hull of a finite set of points in a Euclidean space contains a given point. By converting $Ax=b$ into a convex hull problem and solving via the Triangle Algorithm, together with…
▽ More
We present new iterative algorithms for solving a square linear system $Ax=b$ in dimension $n$ by employing the {\it Triangle Algorithm} \cite{kal12}, a fully polynomial-time approximation scheme for testing if the convex hull of a finite set of points in a Euclidean space contains a given point. By converting $Ax=b$ into a convex hull problem and solving via the Triangle Algorithm, together with a {\it sensitivity theorem}, we compute in $O(n^2ε^{-2})$ arithmetic operations an approximate solution satisfying $\Vert Ax_ε- b \Vert \leq ερ$, where $ρ= \max \{\Vert a_1 \Vert,..., \Vert a_n \Vert, \Vert b \Vert \}$, and $a_i$ is the $i$-th column of $A$. In another approach we apply the Triangle Algorithm incrementally, solving a sequence of convex hull problems while repeatedly employing a {\it distance duality}. The simplicity and theoretical complexity bounds of the proposed algorithms, requiring no structural restrictions on the matrix $A$, suggest their potential practicality, offering alternatives to the existing exact and iterative methods, especially for large scale linear systems. The assessment of computational performance however is the subject of future experimentations.
△ Less
Submitted 29 October, 2012;
originally announced October 2012.
