-
Superfast 1-Norm Estimation
Authors:
Soo Go,
Victor Y. Pan
Abstract:
A matrix algorithm is said to be superfast (that is, runs at sublinear cost) if it involves much fewer scalars and flops than the input matrix has entries. Such algorithms have been extensively studied and widely applied in modern computations for matrices with low displacement rank and more recently for low-rank approximation of matrices, even though they are known to fail on worst-case inputs in…
▽ More
A matrix algorithm is said to be superfast (that is, runs at sublinear cost) if it involves much fewer scalars and flops than the input matrix has entries. Such algorithms have been extensively studied and widely applied in modern computations for matrices with low displacement rank and more recently for low-rank approximation of matrices, even though they are known to fail on worst-case inputs in the latter application. We devise novel superfast algorithms that consistently produce accurate 1-norm estimates for real-world matrices and discuss some promising extensions of our surprisingly simple techniques. With further testing and refinement, our algorithms can potentially be adopted in practical computations.
△ Less
Submitted 26 May, 2025;
originally announced May 2025.
-
Robust Parameter Estimation for Rational Ordinary Differential Equations
Authors:
Oren Bassik,
Yosef Berman,
Soo Go,
Hoon Hong,
Ilia Ilmer,
Alexey Ovchinnikov,
Chris Rackauckas,
Pedro Soto,
Chee Yap
Abstract:
We present a new approach for estimating parameters in rational ODE models from given (measured) time series data.
In typical existing approaches, an initial guess for the parameter values is made from a given search interval. Then, in a loop, the corresponding outputs are computed by solving the ODE numerically, followed by computing the error from the given time series data. If the error is sm…
▽ More
We present a new approach for estimating parameters in rational ODE models from given (measured) time series data.
In typical existing approaches, an initial guess for the parameter values is made from a given search interval. Then, in a loop, the corresponding outputs are computed by solving the ODE numerically, followed by computing the error from the given time series data. If the error is small, the loop terminates and the parameter values are returned. Otherwise, heuristics/theories are used to possibly improve the guess and continue the loop.
These approaches tend to be non-robust in the sense that their accuracy depend on the search interval and the true parameter values; furthermore, they cannot handle the case where the parameters are locally identifiable.
In this paper, we propose a new approach, which does not suffer from the above non-robustness. In particular, it does not require making good initial guesses for the parameter values or specifying search intervals. Instead, it uses differential algebra, interpolation of the data using rational functions, and multivariate polynomial system solving. We also compare the performance of the resulting software with several other estimation software packages.
△ Less
Submitted 17 December, 2023; v1 submitted 2 March, 2023;
originally announced March 2023.
-
Fast Approximation of Polynomial Zeros and Matrix Eigenvalues
Authors:
Victor Y. Pan,
Soo Go,
Qi Luan,
Liang Zhao
Abstract:
We approximate the d complex zeros of a univariate polynomial p(x) of a degree d or those zeros that lie in a fixed region of interest on the complex plane such as a disc or a square. Our divide and conquer algorithm of STOC 1995 supports solution of this problem in optimal Boolean time (up to a poly-logarithmic factor), that is, runs nearly as fast as one can access the coefficients of p with the…
▽ More
We approximate the d complex zeros of a univariate polynomial p(x) of a degree d or those zeros that lie in a fixed region of interest on the complex plane such as a disc or a square. Our divide and conquer algorithm of STOC 1995 supports solution of this problem in optimal Boolean time (up to a poly-logarithmic factor), that is, runs nearly as fast as one can access the coefficients of p with the precision necessary to support required accuracy of the output. That record complexity has not been matched by any other algorithm yet, but our root-finder of 1995 is quite involved and has never been implemented. We present alternative nearly optimal root-finders based on our novel variants of the classical subdivision iterations. Unlike our predecessor of 1995, we require randomization of Las Vegas type, allowing us to detect any output error at a dominated computational cost, but our new root-finders are much simpler to implement than their predecessor of 1995. According to the results of extensive test with standard test polynomials for their preliminary version, which incorporates only a part of our novel techniques, the new root-finders compete and for a large class of inputs significantly supersedes the package of root-finding subroutines MPSolve, which for decades has been user's choice package. Unlike our predecessor of 1995 and all known fast algorithms for the cited tasks of polynomial root-finding, our new algorithms can be also applied to a polynomial given by a black box oracle for its evaluation rather than by its coefficients. This makes our root-finders particularly efficient for polynomials p(x) that can be evaluated fast such as the Mandelbrot polynomials or those given by the sum of a small number of shifted monomials. Our algorithm can be readily extended to fast approximation of the eigenvalues of a matrix or a matrix polynomial.
△ Less
Submitted 11 June, 2023; v1 submitted 31 December, 2022;
originally announced January 2023.
-
Iterative Refinement and Oversampling for Low Rank Approximation
Authors:
Victor Y. Pan,
Qi Luan,
Soo Go
Abstract:
Iterative refinement is particularly popular for numerical solution of linear systems of equations. We extend it to Low Rank Approximation of a matrix (LRA) and observe close link of the resulting algorithm to oversampling techniques, commonly used in randomized LRA algorithms. We elaborate upon this link and revisit oversampling and some efficient randomized LRA algorithms. Applied with sparse sk…
▽ More
Iterative refinement is particularly popular for numerical solution of linear systems of equations. We extend it to Low Rank Approximation of a matrix (LRA) and observe close link of the resulting algorithm to oversampling techniques, commonly used in randomized LRA algorithms. We elaborate upon this link and revisit oversampling and some efficient randomized LRA algorithms. Applied with sparse sketch matrices they run significantly faster and in particular yield Very Low Rank Approximation (VLRA) at sublinear cost, using much fewer scalars and flops than the input matrix has entries. This is achieved at the price of deterioration of output accuracy, but according to our formal and empirical study subsequent oversampling improves accuracy to near-optimal level under the spectral norm for a large sub-class of matrices with fast decaying spectra of singular values.
△ Less
Submitted 27 November, 2024; v1 submitted 10 June, 2019;
originally announced June 2019.
-
Solutions of $x^{q^k}+\cdots+x^{q}+x=a$ in $GF{2^n}$
Authors:
Kwang Ho Kim,
Jong Hyok Choe,
Dok Nam Lee,
Dae Song Go,
Sihem Mesnager
Abstract:
Though it is well known that the roots of any affine polynomial over a finite field can be computed by a system of linear equations by using a normal base of the field, such solving approach appears to be difficult to apply when the field is fairly large. Thus, it may be of great interest to find an explicit representation of the solutions independently of the field base. This was previously done…
▽ More
Though it is well known that the roots of any affine polynomial over a finite field can be computed by a system of linear equations by using a normal base of the field, such solving approach appears to be difficult to apply when the field is fairly large. Thus, it may be of great interest to find an explicit representation of the solutions independently of the field base. This was previously done only for quadratic equations over a binary finite field. This paper gives an explicit representation of solutions for a much wider class of affine polynomials over a binary prime field.
△ Less
Submitted 25 May, 2019;
originally announced May 2019.
