-
Bit complexity for computing one point in each connected component of a smooth real algebraic set
Authors:
Jesse Elliott,
Mark Giesbrecht,
Eric Schost
Abstract:
We analyze the bit complexity of an algorithm for the computation of at least one point in each connected component of a smooth real algebraic set. This work is a continuation of our analysis of the hypersurface case (On the bit complexity of finding points in connected components of a smooth real hypersurface, ISSAC'20). In this paper, we extend the analysis to more general cases.
Let…
▽ More
We analyze the bit complexity of an algorithm for the computation of at least one point in each connected component of a smooth real algebraic set. This work is a continuation of our analysis of the hypersurface case (On the bit complexity of finding points in connected components of a smooth real hypersurface, ISSAC'20). In this paper, we extend the analysis to more general cases.
Let $F=(f_1,..., f_p)$ in $\mathbb{Z}[X_1, ... , X_n]^p$ be a sequence of polynomials with $V = V(F) \subset \mathbb{C}^n$ a smooth and equidimensional variety and $\langle F \rangle \subset \mathbb{C}[X_1, ..., X_n]$ a radical ideal. To compute at least one point in each connected component of $V \cap \mathbb{R}^n$, our starting point is an algorithm by Safey El Din and Schost (Polar varieties and computation of one point in each connected component of a smooth real algebraic set, ISSAC'03). This algorithm uses random changes of variables that are proven to generically ensure certain desirable geometric properties. The cost of the algorithm was given in an algebraic complexity model; here, we analyze the bit complexity and the error probability, and we provide a quantitative analysis of the genericity statements. In particular, we are led to use Lagrange systems to describe polar varieties, as they make it simpler to rely on techniques such as weak transversality and an effective Nullstellensatz.
△ Less
Submitted 9 July, 2022;
originally announced July 2022.
-
Subquadratic-Time Algorithms for Normal Bases
Authors:
Mark Giesbrecht,
Armin Jamshidpey,
Éric Schost
Abstract:
For any finite Galois field extension $\mathsf{K}/\mathsf{F}$, with Galois group $G = \mathrm{Gal}(\mathsf{K}/\mathsf{F})$, there exists an element $α\in \mathsf{K}$ whose orbit $G\cdotα$ forms an $\mathsf{F}$-basis of $\mathsf{K}$. Such a $α$ is called a normal element and $G\cdotα$ is a normal basis. We introduce a probabilistic algorithm for testing whether a given $α\in \mathsf{K}$ is normal,…
▽ More
For any finite Galois field extension $\mathsf{K}/\mathsf{F}$, with Galois group $G = \mathrm{Gal}(\mathsf{K}/\mathsf{F})$, there exists an element $α\in \mathsf{K}$ whose orbit $G\cdotα$ forms an $\mathsf{F}$-basis of $\mathsf{K}$. Such a $α$ is called a normal element and $G\cdotα$ is a normal basis. We introduce a probabilistic algorithm for testing whether a given $α\in \mathsf{K}$ is normal, when $G$ is either a finite abelian or a metacyclic group. The algorithm is based on the fact that deciding whether $α$ is normal can be reduced to deciding whether $\sum_{g \in G} g(α)g \in \mathsf{K}[G]$ is invertible; it requires a slightly subquadratic number of operations. Once we know that $α$ is normal, we show how to perform conversions between the power basis of $\mathsf{K}/\mathsf{F}$ and the normal basis with the same asymptotic cost.
△ Less
Submitted 23 December, 2020; v1 submitted 5 May, 2020;
originally announced May 2020.
-
Efficient q-Integer Linear Decomposition of Multivariate Polynomials
Authors:
Mark Giesbrecht,
Hui Huang,
George Labahn,
Eugene Zima
Abstract:
We present two new algorithms for the computation of the q-integer linear decomposition of a multivariate polynomial. Such a decomposition is essential for the treatment of q-hypergeometric symbolic summation via creative telescoping and for describing the q-counterpart of Ore-Sato theory. Both of our algorithms require only basic integer and polynomial arithmetic and work for any unique factoriza…
▽ More
We present two new algorithms for the computation of the q-integer linear decomposition of a multivariate polynomial. Such a decomposition is essential for the treatment of q-hypergeometric symbolic summation via creative telescoping and for describing the q-counterpart of Ore-Sato theory. Both of our algorithms require only basic integer and polynomial arithmetic and work for any unique factorization domain containing the ring of integers. Complete complexity analyses are conducted for both our algorithms and two previous algorithms in the case of multivariate integer polynomials, showing that our algorithms have better theoretical performances. A Maple implementation is also included which suggests that our algorithms are also much faster in practice than previous algorithms.
△ Less
Submitted 12 February, 2021; v1 submitted 31 January, 2020;
originally announced February 2020.
-
Counting invariant subspaces and decompositions of additive polynomials
Authors:
Joachim von zur Gathen,
Mark Giesbrecht,
Konstantin Ziegler
Abstract:
The functional (de)composition of polynomials is a topic in pure and computer algebra with many applications. The structure of decompositions of (suitably normalized) polynomials f(x) = g(h(x)) in F[x] over a field F is well understood in many cases, but less well when the degree of f is divisible by the positive characteristic p of F. This work investigates the decompositions of r-additive polyno…
▽ More
The functional (de)composition of polynomials is a topic in pure and computer algebra with many applications. The structure of decompositions of (suitably normalized) polynomials f(x) = g(h(x)) in F[x] over a field F is well understood in many cases, but less well when the degree of f is divisible by the positive characteristic p of F. This work investigates the decompositions of r-additive polynomials, where every exponent and also the field size is a power of r, which itself is a power of p.
The decompositions of an r-additive polynomial f are intimately linked to the Frobenius-invariant subspaces of its root space V in the algebraic closure of F. We present an efficient algorithm to compute the rational Jordan form of the Frobenius automorphism on V. A formula of Fripertinger (2011) then counts the number of Frobenius-invariant subspaces of a given dimension and we derive the number of decompositions with prescribed degrees.
△ Less
Submitted 31 December, 2019; v1 submitted 30 November, 2019;
originally announced December 2019.
-
Efficient Rational Creative Telescoping
Authors:
Mark Giesbrecht,
Hui Huang,
George Labahn,
Eugene Zima
Abstract:
We present a new algorithm to compute minimal telescopers for rational functions in two discrete variables. As with recent reduction-based approaches, our algorithm has the important feature that the computation of a telescoper is independent of its certificate. In addition, our algorithm uses a compact representation of the certificate, which allows it to be easily manipulated and analyzed withou…
▽ More
We present a new algorithm to compute minimal telescopers for rational functions in two discrete variables. As with recent reduction-based approaches, our algorithm has the important feature that the computation of a telescoper is independent of its certificate. In addition, our algorithm uses a compact representation of the certificate, which allows it to be easily manipulated and analyzed without knowing the precise expanded form. This representation hides potential expression swell until the final (and optional) expansion, which can be accomplished in time polynomial in the size of the expanded certificate. A complexity analysis, along with a Maple implementation, indicates that our algorithm has better theoretical and practical performance than the reduction-based approach in the rational case.
△ Less
Submitted 9 August, 2021; v1 submitted 15 September, 2019;
originally announced September 2019.
-
Quadratic Probabilistic Algorithms for Normal Bases
Authors:
Mark Giesbrecht,
Armin Jamshidpey,
Éric Schost
Abstract:
It is well known that for any finite Galois extension field $K/F$, with Galois group $G = \mathrm{Gal}(K/F)$, there exists an element $α\in K$ whose orbit $G\cdotα$ forms an $F$-basis of $K$. Such an element $α$ is called \emph{normal} and $G\cdotα$ is called a normal basis. In this paper we introduce a probabilistic algorithm for finding a normal element when $G$ is either a finite abelian or a m…
▽ More
It is well known that for any finite Galois extension field $K/F$, with Galois group $G = \mathrm{Gal}(K/F)$, there exists an element $α\in K$ whose orbit $G\cdotα$ forms an $F$-basis of $K$. Such an element $α$ is called \emph{normal} and $G\cdotα$ is called a normal basis. In this paper we introduce a probabilistic algorithm for finding a normal element when $G$ is either a finite abelian or a metacyclic group. The algorithm is based on the fact that deciding whether a random element $α\in K$ is normal can be reduced to deciding whether $\sum_{σ\in G} σ(α)σ\in K[G]$ is invertible. In an algebraic model, the cost of our algorithm is quadratic in the size of $G$ for metacyclic $G$ and slightly subquadratic for abelian $G$.
△ Less
Submitted 7 March, 2019;
originally announced March 2019.
-
Computing Nearby Non-trivial Smith Forms
Authors:
Mark Giesbrecht,
Joseph Haraldson,
George Labahn
Abstract:
We consider the problem of computing the nearest matrix polynomial with a non-trivial Smith Normal Form. We show that computing the Smith form of a matrix polynomial is amenable to numeric computation as an optimization problem. Furthermore, we describe an effective optimization technique to find a nearby matrix polynomial with a non-trivial Smith form. The results are then generalized to include…
▽ More
We consider the problem of computing the nearest matrix polynomial with a non-trivial Smith Normal Form. We show that computing the Smith form of a matrix polynomial is amenable to numeric computation as an optimization problem. Furthermore, we describe an effective optimization technique to find a nearby matrix polynomial with a non-trivial Smith form. The results are then generalized to include the computation of a matrix polynomial having a maximum specified number of ones in the Smith Form (i.e., with a maximum specified McCoy rank). We discuss the geometry and existence of solutions and how our results can be used for an error analysis. We develop an optimization-based approach and demonstrate an iterative numerical method for computing a nearby matrix polynomial with the desired spectral properties. We also describe an implementation of our algorithms and demonstrate the robustness with examples in Maple.
△ Less
Submitted 7 September, 2019; v1 submitted 11 December, 2018;
originally announced December 2018.
-
Computing Lower Rank Approximations of Matrix Polynomials
Authors:
Mark Giesbrecht,
Joseph Haraldson,
George Labahn
Abstract:
Given an input matrix polynomial whose coefficients are floating point numbers, we consider the problem of finding the nearest matrix polynomial which has rank at most a specified value. This generalizes the problem of finding a nearest matrix polynomial that is algebraically singular with a prescribed lower bound on the dimension given in a previous paper by the authors. In this paper we prove th…
▽ More
Given an input matrix polynomial whose coefficients are floating point numbers, we consider the problem of finding the nearest matrix polynomial which has rank at most a specified value. This generalizes the problem of finding a nearest matrix polynomial that is algebraically singular with a prescribed lower bound on the dimension given in a previous paper by the authors. In this paper we prove that such lower rank matrices at minimal distance always exist, satisfy regularity conditions, and are all isolated and surrounded by a basin of attraction of non-minimal solutions. In addition, we present an iterative algorithm which, on given input sufficiently close to a rank-at-most matrix, produces that matrix. The algorithm is efficient and is proven to converge quadratically given a sufficiently good starting point. An implementation demonstrates the effectiveness and numerical robustness of our algorithm in practice.
△ Less
Submitted 11 December, 2017;
originally announced December 2017.
-
Computing Approximate Greatest Common Right Divisors of Differential Polynomials
Authors:
Mark Giesbrecht,
Joseph Haraldson,
Erich Kaltofen
Abstract:
Differential (Ore) type polynomials with "approximate" polynomial coefficients are introduced. These provide an effective notion of approximate differential operators, with a strong algebraic structure. We introduce the approximate Greatest Common Right Divisor Problem (GCRD) of differential polynomials, as a non-commutative generalization of the well-studied approximate GCD problem.
Given two d…
▽ More
Differential (Ore) type polynomials with "approximate" polynomial coefficients are introduced. These provide an effective notion of approximate differential operators, with a strong algebraic structure. We introduce the approximate Greatest Common Right Divisor Problem (GCRD) of differential polynomials, as a non-commutative generalization of the well-studied approximate GCD problem.
Given two differential polynomials, we present an algorithm to find nearby differential polynomials with a non-trivial GCRD, where nearby is defined with respect to a suitable coefficient norm. Intuitively, given two linear differential polynomials as input, the (approximate) GCRD problem corresponds to finding the (approximate) differential polynomial whose solution space is the intersection of the solution spaces of the two inputs.
The approximate GCRD problem is proven to be locally well-posed. A method based on the singular value decomposition of a differential Sylvester matrix is developed to produce an initial approximation of the GCRD. With a sufficiently good initial approximation, Newton iteration is shown to converge quadratically to an optimal solution. Finally, sufficient conditions for existence of a solution to the global problem are presented along with examples demonstrating that no solution exists when these conditions are not satisfied.
△ Less
Submitted 26 April, 2019; v1 submitted 8 January, 2017;
originally announced January 2017.
-
Faster Sparse Multivariate Polynomial Interpolation of Straight-Line Programs
Authors:
Andrew Arnold,
Mark Giesbrecht,
Daniel S. Roche
Abstract:
Given a straight-line program whose output is a polynomial function of the inputs, we present a new algorithm to compute a concise representation of that unknown function. Our algorithm can handle any case where the unknown function is a multivariate polynomial, with coefficients in an arbitrary finite field, and with a reasonable number of nonzero terms but possibly very large degree. It is compe…
▽ More
Given a straight-line program whose output is a polynomial function of the inputs, we present a new algorithm to compute a concise representation of that unknown function. Our algorithm can handle any case where the unknown function is a multivariate polynomial, with coefficients in an arbitrary finite field, and with a reasonable number of nonzero terms but possibly very large degree. It is competitive with previously known sparse interpolation algorithms that work over an arbitrary finite field, and provides an improvement when there are a large number of variables.
△ Less
Submitted 15 December, 2014; v1 submitted 12 December, 2014;
originally announced December 2014.
-
Computing GCRDs of Approximate Differential Polynomials
Authors:
Mark Giesbrecht,
Joseph Haraldson
Abstract:
Differential (Ore) type polynomials with approximate polynomial coefficients are introduced. These provide a useful representation of approximate differential operators with a strong algebraic structure, which has been used successfully in the exact, symbolic, setting. We then present an algorithm for the approximate Greatest Common Right Divisor (GCRD) of two approximate differential polynomials,…
▽ More
Differential (Ore) type polynomials with approximate polynomial coefficients are introduced. These provide a useful representation of approximate differential operators with a strong algebraic structure, which has been used successfully in the exact, symbolic, setting. We then present an algorithm for the approximate Greatest Common Right Divisor (GCRD) of two approximate differential polynomials, which intuitively is the differential operator whose solutions are those common to the two inputs operators. More formally, given approximate differential polynomials $f$ and $g$, we show how to find "nearby" polynomials $\widetilde f$ and $\widetilde g$ which have a non-trivial GCRD. Here "nearby" is under a suitably defined norm. The algorithm is a generalization of the SVD-based method of Corless et al. (1995) for the approximate GCD of regular polynomials. We work on an appropriately "linearized" differential Sylvester matrix, to which we apply a block SVD. The algorithm has been implemented in Maple and a demonstration of its robustness is presented.
△ Less
Submitted 23 July, 2014; v1 submitted 3 June, 2014;
originally announced June 2014.
-
Factoring Differential Operators in n Variables
Authors:
Mark Giesbrecht,
Albert Heinle,
Viktor Levandovskyy
Abstract:
In this paper, we present a new algorithm and an experimental implementation for factoring elements in the polynomial n'th Weyl algebra, the polynomial n'th shift algebra, and ZZ^n-graded polynomials in the n'th q-Weyl algebra.
The most unexpected result is that this noncommutative problem of factoring partial differential operators can be approached effectively by reducing it to the problem of…
▽ More
In this paper, we present a new algorithm and an experimental implementation for factoring elements in the polynomial n'th Weyl algebra, the polynomial n'th shift algebra, and ZZ^n-graded polynomials in the n'th q-Weyl algebra.
The most unexpected result is that this noncommutative problem of factoring partial differential operators can be approached effectively by reducing it to the problem of solving systems of polynomial equations over a commutative ring. In the case where a given polynomial is ZZ^n-graded, we can reduce the problem completely to factoring an element in a commutative multivariate polynomial ring.
The implementation in Singular is effective on a broad range of polynomials and increases the ability of computer algebra systems to address this important problem. We compare the performance and output of our algorithm with other implementations in commodity computer algebra systems on nontrivial examples.
△ Less
Submitted 31 March, 2014;
originally announced April 2014.
-
Ranks of Quotients, Remainders and $p$-Adic Digits of Matrices
Authors:
Mustafa Elsheikh,
Andy Novocin,
Mark Giesbrecht
Abstract:
For a prime $p$ and a matrix $A \in \mathbb{Z}^{n \times n}$, write $A$ as $A = p (A \,\mathrm{quo}\, p) + (A \,\mathrm{rem}\, p)$ where the remainder and quotient operations are applied element-wise. Write the $p$-adic expansion of $A$ as $A = A^{[0]} + p A^{[1]} + p^2 A^{[2]} + \cdots$ where each $A^{[i]} \in \mathbb{Z}^{n \times n}$ has entries between $[0, p-1]$. Upper bounds are proven for th…
▽ More
For a prime $p$ and a matrix $A \in \mathbb{Z}^{n \times n}$, write $A$ as $A = p (A \,\mathrm{quo}\, p) + (A \,\mathrm{rem}\, p)$ where the remainder and quotient operations are applied element-wise. Write the $p$-adic expansion of $A$ as $A = A^{[0]} + p A^{[1]} + p^2 A^{[2]} + \cdots$ where each $A^{[i]} \in \mathbb{Z}^{n \times n}$ has entries between $[0, p-1]$. Upper bounds are proven for the $\mathbb{Z}$-ranks of $A \,\mathrm{rem}\, p$, and $A \,\mathrm{quo}\, p$. Also, upper bounds are proven for the $\mathbb{Z}/p\mathbb{Z}$-rank of $A^{[i]}$ for all $i \ge 0$ when $p = 2$, and a conjecture is presented for odd primes.
△ Less
Submitted 31 January, 2014; v1 submitted 26 January, 2014;
originally announced January 2014.
-
Sparse interpolation over finite fields via low-order roots of unity
Authors:
Andrew Arnold,
Mark Giesbrecht,
Daniel S. Roche
Abstract:
We present a new Monte Carlo algorithm for the interpolation of a straight-line program as a sparse polynomial $f$ over an arbitrary finite field of size $q$. We assume a priori bounds $D$ and $T$ are given on the degree and number of terms of $f$. The approach presented in this paper is a hybrid of the diversified and recursive interpolation algorithms, the two previous fastest known probabilisti…
▽ More
We present a new Monte Carlo algorithm for the interpolation of a straight-line program as a sparse polynomial $f$ over an arbitrary finite field of size $q$. We assume a priori bounds $D$ and $T$ are given on the degree and number of terms of $f$. The approach presented in this paper is a hybrid of the diversified and recursive interpolation algorithms, the two previous fastest known probabilistic methods for this problem. By making effective use of the information contained in the coefficients themselves, this new algorithm improves on the bit complexity of previous methods by a "soft-Oh" factor of $T$, $\log D$, or $\log q$.
△ Less
Submitted 2 May, 2014; v1 submitted 19 January, 2014;
originally announced January 2014.
-
Relating $p$-adic eigenvalues and the local Smith normal form
Authors:
Mustafa Elsheikh,
Mark Giesbrecht
Abstract:
Conditions are established under which the $p$-adic valuations of the invariant factors (diagonal entries of the Smith form) of an integer matrix are equal to the $p$-adic valuations of the eigenvalues. It is then shown that this correspondence is the typical case for "most" matrices; precise density bounds are given for when the property holds, as well as easy transformations to this typical case…
▽ More
Conditions are established under which the $p$-adic valuations of the invariant factors (diagonal entries of the Smith form) of an integer matrix are equal to the $p$-adic valuations of the eigenvalues. It is then shown that this correspondence is the typical case for "most" matrices; precise density bounds are given for when the property holds, as well as easy transformations to this typical case.
△ Less
Submitted 7 May, 2015; v1 submitted 8 January, 2014;
originally announced January 2014.
-
Faster sparse interpolation of straight-line programs
Authors:
Andrew Arnold,
Mark Giesbrecht,
Daniel S. Roche
Abstract:
We give a new probabilistic algorithm for interpolating a "sparse" polynomial f given by a straight-line program. Our algorithm constructs an approximation f* of f, such that their difference probably has at most half the number of terms of f, then recurses on their difference. Our approach builds on previous work by Garg and Schost (2009), and Giesbrecht and Roche (2011), and is asymptotically mo…
▽ More
We give a new probabilistic algorithm for interpolating a "sparse" polynomial f given by a straight-line program. Our algorithm constructs an approximation f* of f, such that their difference probably has at most half the number of terms of f, then recurses on their difference. Our approach builds on previous work by Garg and Schost (2009), and Giesbrecht and Roche (2011), and is asymptotically more efficient in terms of the total cost of the probes required than previous methods, in many cases.
△ Less
Submitted 22 January, 2014; v1 submitted 11 April, 2013;
originally announced April 2013.
-
Fast Computation of Smith Forms of Sparse Matrices Over Local Rings
Authors:
Mustafa Elsheikh,
Mark Giesbrecht,
Andy Novocin,
B. David Saunders
Abstract:
We present algorithms to compute the Smith Normal Form of matrices over two families of local rings.
The algorithms use the \emph{black-box} model which is suitable for sparse and structured matrices. The algorithms depend on a number of tools, such as matrix rank computation over finite fields, for which the best-known time- and memory-efficient algorithms are probabilistic.
For an $\nxn$ mat…
▽ More
We present algorithms to compute the Smith Normal Form of matrices over two families of local rings.
The algorithms use the \emph{black-box} model which is suitable for sparse and structured matrices. The algorithms depend on a number of tools, such as matrix rank computation over finite fields, for which the best-known time- and memory-efficient algorithms are probabilistic.
For an $\nxn$ matrix $A$ over the ring $\Fzfe$, where $f^e$ is a power of an irreducible polynomial $f \in \Fz$ of degree $d$, our algorithm requires $\bigO(ηde^2n)$ operations in $\F$, where our black-box is assumed to require $\bigO(η)$ operations in $\F$ to compute a matrix-vector product by a vector over $\Fzfe$ (and $η$ is assumed greater than $\Pden$). The algorithm only requires additional storage for $\bigO(\Pden)$ elements of $\F$. In particular, if $η=\softO(\Pden)$, then our algorithm requires only $\softO(n^2d^2e^3)$ operations in $\F$, which is an improvement on known dense methods for small $d$ and $e$.
For the ring $\ZZ/p^e\ZZ$, where $p$ is a prime, we give an algorithm which is time- and memory-efficient when the number of nontrivial invariant factors is small. We describe a method for dimension reduction while preserving the invariant factors. The time complexity is essentially linear in $μn r e \log p,$ where $μ$ is the number of operations in $\ZZ/p\ZZ$ to evaluate the black-box (assumed greater than $n$) and $r$ is the total number of non-zero invariant factors.
To avoid the practical cost of conditioning, we give a Monte Carlo certificate, which at low cost, provides either a high probability of success or a proof of failure. The quest for a time- and memory-efficient solution without restrictions on the number of nontrivial invariant factors remains open. We offer a conjecture which may contribute toward that end.
△ Less
Submitted 28 April, 2012; v1 submitted 25 January, 2012;
originally announced January 2012.
-
Computing the Hermite Form of a Matrix of Ore Polynomials
Authors:
Mark Giesbrecht,
Myung Sub Kim
Abstract:
Let R=F[D;sigma,delta] be the ring of Ore polynomials over a field (or skew field) F, where sigma is a automorphism of F and delta is a sigma-derivation. Given a an m by n matrix A over R, we show how to compute the Hermite form H of A and a unimodular matrix U such that UA=H. The algorithm requires a polynomial number of operations in F in terms of both the dimensions m and n, and the degree of t…
▽ More
Let R=F[D;sigma,delta] be the ring of Ore polynomials over a field (or skew field) F, where sigma is a automorphism of F and delta is a sigma-derivation. Given a an m by n matrix A over R, we show how to compute the Hermite form H of A and a unimodular matrix U such that UA=H. The algorithm requires a polynomial number of operations in F in terms of both the dimensions m and n, and the degree of the entries in A. When F=k(z) for some field k, it also requires time polynomial in the degree in z, and if k is the rational numbers Q, it requires time polynomial in the bit length of the coefficients as well. Explicit analyses are provided for the complexity, in particular for the important cases of differential and shift polynomials over Q(z). To accomplish our algorithm, we apply the Dieudonne determinant and quasideterminant theory for Ore polynomial rings to get explicit bounds on the degrees and sizes of entries in H and U.
△ Less
Submitted 30 October, 2012; v1 submitted 16 September, 2011;
originally announced September 2011.
-
Diversification improves interpolation
Authors:
Mark Giesbrecht,
Daniel S. Roche
Abstract:
We consider the problem of interpolating an unknown multivariate polynomial with coefficients taken from a finite field or as numerical approximations of complex numbers. Building on the recent work of Garg and Schost, we improve on the best-known algorithm for interpolation over large finite fields by presenting a Las Vegas randomized algorithm that uses fewer black box evaluations. Using related…
▽ More
We consider the problem of interpolating an unknown multivariate polynomial with coefficients taken from a finite field or as numerical approximations of complex numbers. Building on the recent work of Garg and Schost, we improve on the best-known algorithm for interpolation over large finite fields by presenting a Las Vegas randomized algorithm that uses fewer black box evaluations. Using related techniques, we also address numerical interpolation of sparse polynomials with complex coefficients, and provide the first provably stable algorithm (in the sense of relative error) for this problem, at the cost of modestly more evaluations. A key new technique is a randomization which makes all coefficients of the unknown polynomial distinguishable, producing what we call a diverse polynomial. Another departure from most previous approaches is that our algorithms do not rely on root finding as a subroutine. We show how these improvements affect the practical performance with trial implementations.
△ Less
Submitted 3 April, 2011; v1 submitted 19 January, 2011;
originally announced January 2011.
-
Computing sparse multiples of polynomials
Authors:
Mark Giesbrecht,
Daniel S. Roche,
Hrushikesh Tilak
Abstract:
We consider the problem of finding a sparse multiple of a polynomial. Given f in F[x] of degree d over a field F, and a desired sparsity t, our goal is to determine if there exists a multiple h in F[x] of f such that h has at most t non-zero terms, and if so, to find such an h. When F=Q and t is constant, we give a polynomial-time algorithm in d and the size of coefficients in h. When F is a finit…
▽ More
We consider the problem of finding a sparse multiple of a polynomial. Given f in F[x] of degree d over a field F, and a desired sparsity t, our goal is to determine if there exists a multiple h in F[x] of f such that h has at most t non-zero terms, and if so, to find such an h. When F=Q and t is constant, we give a polynomial-time algorithm in d and the size of coefficients in h. When F is a finite field, we show that the problem is at least as hard as determining the multiplicative order of elements in an extension field of F (a problem thought to have complexity similar to that of factoring integers), and this lower bound is tight when t=2.
△ Less
Submitted 1 January, 2011; v1 submitted 16 September, 2010;
originally announced September 2010.
-
Composition collisions and projective polynomials
Authors:
Joachim von zur Gathen,
Mark Giesbrecht,
Konstantin Ziegler
Abstract:
The functional decomposition of polynomials has been a topic of great interest and importance in pure and computer algebra and their applications. The structure of compositions of (suitably normalized) polynomials f=g(h) over finite fields is well understood in many cases, but quite poorly when the degrees of both components are divisible by the characteristic p. This work investigates the decomp…
▽ More
The functional decomposition of polynomials has been a topic of great interest and importance in pure and computer algebra and their applications. The structure of compositions of (suitably normalized) polynomials f=g(h) over finite fields is well understood in many cases, but quite poorly when the degrees of both components are divisible by the characteristic p. This work investigates the decomposition of polynomials whose degree is a power of p.
△ Less
Submitted 6 May, 2010;
originally announced May 2010.
-
Some Results on the Functional Decomposition of Polynomials
Authors:
Mark Giesbrecht
Abstract:
If g and h are functions over some field, we can consider their composition f = g(h). The inverse problem is decomposition: given f, determine the ex- istence of such functions g and h. In this thesis we consider functional decom- positions of univariate and multivariate polynomials, and rational functions over a field F of characteristic p. In the polynomial case, "wild" behaviour occurs in both…
▽ More
If g and h are functions over some field, we can consider their composition f = g(h). The inverse problem is decomposition: given f, determine the ex- istence of such functions g and h. In this thesis we consider functional decom- positions of univariate and multivariate polynomials, and rational functions over a field F of characteristic p. In the polynomial case, "wild" behaviour occurs in both the mathematical and computational theory of the problem if p divides the degree of g. We consider the wild case in some depth, and deal with those polynomials whose decompositions are in some sense the "wildest": the additive polynomials. We determine the maximum number of decompositions and show some polynomial time algorithms for certain classes of polynomials with wild decompositions. For the rational function case we present a definition of the problem, a normalised version of the problem to which the general problem reduces, and an exponential time solution to the normal problem.
△ Less
Submitted 29 April, 2010;
originally announced April 2010.
-
On computing the Hermite form of a matrix of differential polynomials
Authors:
Mark Giesbrecht,
Myung Sub Kim
Abstract:
Given an n x n matrix over the ring of differential polynomials F(t)[\D;δ], we show how to compute the Hermite form H of A, and a unimodular matrix U such that UA=H. The algorithm requires a polynomial number of operations in terms of n, deg_D(A), and deg_t(A). When F is the field of rational numbers, it also requires time polynomial in the bit-length of the coefficients.
Given an n x n matrix over the ring of differential polynomials F(t)[\D;δ], we show how to compute the Hermite form H of A, and a unimodular matrix U such that UA=H. The algorithm requires a polynomial number of operations in terms of n, deg_D(A), and deg_t(A). When F is the field of rational numbers, it also requires time polynomial in the bit-length of the coefficients.
△ Less
Submitted 22 June, 2009;
originally announced June 2009.
-
Detecting lacunary perfect powers and computing their roots
Authors:
Mark Giesbrecht,
Daniel S. Roche
Abstract:
We consider solutions to the equation f = h^r for polynomials f and h and integer r > 1. Given a polynomial f in the lacunary (also called sparse or super-sparse) representation, we first show how to determine if f can be written as h^r and, if so, to find such an r. This is a Monte Carlo randomized algorithm whose cost is polynomial in the number of non-zero terms of f and in log(deg f), i.e., po…
▽ More
We consider solutions to the equation f = h^r for polynomials f and h and integer r > 1. Given a polynomial f in the lacunary (also called sparse or super-sparse) representation, we first show how to determine if f can be written as h^r and, if so, to find such an r. This is a Monte Carlo randomized algorithm whose cost is polynomial in the number of non-zero terms of f and in log(deg f), i.e., polynomial in the size of the lacunary representation, and it works over GF(q)[x] (for large characteristic) as well as Q[x]. We also give two deterministic algorithms to compute the perfect root h given f and r. The first is output-sensitive (based on the sparsity of h) and works only over Q[x]. A sparsity-sensitive Newton iteration forms the basis for the second approach to computing h, which is extremely efficient and works over both GF(q)[x] (for large characteristic) and Q[x], but depends on a number-theoretic conjecture. Work of Erdos, Schinzel, Zannier, and others suggests that both of these algorithms are unconditionally polynomial-time in the lacunary size of the input polynomial f. Finally, we demonstrate the efficiency of the randomized detection algorithm and the latter perfect root computation algorithm with an implementation in the C++ library NTL.
△ Less
Submitted 3 December, 2010; v1 submitted 13 January, 2009;
originally announced January 2009.
-
Interpolation of Shifted-Lacunary Polynomials
Authors:
Mark Giesbrecht,
Daniel S. Roche
Abstract:
Given a "black box" function to evaluate an unknown rational polynomial f in Q[x] at points modulo a prime p, we exhibit algorithms to compute the representation of the polynomial in the sparsest shifted power basis. That is, we determine the sparsity t, the shift s (a rational), the exponents 0 <= e1 < e2 < ... < et, and the coefficients c1,...,ct in Q\{0} such that f(x) = c1(x-s)^e1+c2(x-s)^e2+.…
▽ More
Given a "black box" function to evaluate an unknown rational polynomial f in Q[x] at points modulo a prime p, we exhibit algorithms to compute the representation of the polynomial in the sparsest shifted power basis. That is, we determine the sparsity t, the shift s (a rational), the exponents 0 <= e1 < e2 < ... < et, and the coefficients c1,...,ct in Q\{0} such that f(x) = c1(x-s)^e1+c2(x-s)^e2+...+ct(x-s)^et. The computed sparsity t is absolutely minimal over any shifted power basis. The novelty of our algorithm is that the complexity is polynomial in the (sparse) representation size, and in particular is logarithmic in deg(f). Our method combines previous celebrated results on sparse interpolation and computing sparsest shifts, and provides a way to handle polynomials with extremely high degree which are, in some sense, sparse in information.
△ Less
Submitted 23 August, 2010; v1 submitted 31 October, 2008;
originally announced October 2008.
-
Faster Inversion and Other Black Box Matrix Computations Using Efficient Block Projections
Authors:
Wayne Eberly,
Mark Giesbrecht,
Pascal Giorgi,
Arne Storjohann,
Gilles Villard
Abstract:
Block projections have been used, in [Eberly et al. 2006], to obtain an efficient algorithm to find solutions for sparse systems of linear equations. A bound of softO(n^(2.5)) machine operations is obtained assuming that the input matrix can be multiplied by a vector with constant-sized entries in softO(n) machine operations. Unfortunately, the correctness of this algorithm depends on the existe…
▽ More
Block projections have been used, in [Eberly et al. 2006], to obtain an efficient algorithm to find solutions for sparse systems of linear equations. A bound of softO(n^(2.5)) machine operations is obtained assuming that the input matrix can be multiplied by a vector with constant-sized entries in softO(n) machine operations. Unfortunately, the correctness of this algorithm depends on the existence of efficient block projections, and this has been conjectured. In this paper we establish the correctness of the algorithm from [Eberly et al. 2006] by proving the existence of efficient block projections over sufficiently large fields. We demonstrate the usefulness of these projections by deriving improved bounds for the cost of several matrix problems, considering, in particular, ``sparse'' matrices that can be be multiplied by a vector using softO(n) field operations. We show how to compute the inverse of a sparse matrix over a field F using an expected number of softO(n^(2.27)) operations in F. A basis for the null space of a sparse matrix, and a certification of its rank, are obtained at the same cost. An application to Kaltofen and Villard's Baby-Steps/Giant-Steps algorithms for the determinant and Smith Form of an integer matrix yields algorithms requiring softO(n^(2.66)) machine operations. The derived algorithms are all probabilistic of the Las Vegas type.
△ Less
Submitted 29 January, 2007;
originally announced January 2007.
-
Solving Sparse Integer Linear Systems
Authors:
Wayne Eberly,
Mark Giesbrecht,
Pascal Giorgi,
Arne Storjohann,
Gilles Villard
Abstract:
We propose a new algorithm to solve sparse linear systems of equations over the integers. This algorithm is based on a $p$-adic lifting technique combined with the use of block matrices with structured blocks. It achieves a sub-cubic complexity in terms of machine operations subject to a conjecture on the effectiveness of certain sparse projections. A LinBox-based implementation of this algorith…
▽ More
We propose a new algorithm to solve sparse linear systems of equations over the integers. This algorithm is based on a $p$-adic lifting technique combined with the use of block matrices with structured blocks. It achieves a sub-cubic complexity in terms of machine operations subject to a conjecture on the effectiveness of certain sparse projections. A LinBox-based implementation of this algorithm is demonstrated, and emphasizes the practical benefits of this new method over the previous state of the art.
△ Less
Submitted 21 March, 2006;
originally announced March 2006.