-
Erzeugunsgrad, VC-Dimension and Neural Networks with rational activation function
Authors:
Luis Miguel Pardo,
Daniel Sebastián
Abstract:
The notion of Erzeugungsgrad was introduced by Joos Heintz in 1983 to bound the number of non-empty cells occurring after a process of quantifier elimination. We extend this notion and the combinatorial bounds of Theorem 2 in Heintz (1983) using the degree for constructible sets defined in Pardo-Sebastián (2022). We show that the Erzeugungsgrad is the key ingredient to connect affine Intersection…
▽ More
The notion of Erzeugungsgrad was introduced by Joos Heintz in 1983 to bound the number of non-empty cells occurring after a process of quantifier elimination. We extend this notion and the combinatorial bounds of Theorem 2 in Heintz (1983) using the degree for constructible sets defined in Pardo-Sebastián (2022). We show that the Erzeugungsgrad is the key ingredient to connect affine Intersection Theory over algebraically closed fields and the VC-Theory of Computational Learning Theory for families of classifiers given by parameterized families of constructible sets. In particular, we prove that the VC-dimension and the Krull dimension are linearly related up to logarithmic factors based on Intersection Theory. Using this relation, we study the density of correct test sequences in evasive varieties. We apply these ideas to analyze parameterized families of neural networks with rational activation function.
△ Less
Submitted 15 April, 2025;
originally announced April 2025.
-
An unfeasability view of neural network learning
Authors:
Joos Heintz,
Hvara Ocar,
Luis Miguel Pardo,
Andres Rojas Paredes,
Enrique Carlos Segura
Abstract:
We define the notion of a continuously differentiable perfect learning algorithm for multilayer neural network architectures and show that such algorithms don't exist provided that the length of the data set exceeds the number of involved parameters and the activation functions are logistic, tanh or sin.
We define the notion of a continuously differentiable perfect learning algorithm for multilayer neural network architectures and show that such algorithms don't exist provided that the length of the data set exceeds the number of involved parameters and the activation functions are logistic, tanh or sin.
△ Less
Submitted 3 January, 2022;
originally announced January 2022.
-
A promenade through Correct Test Sequences I: Degree of constructible sets, Bézout's Inequality and density
Authors:
Luis Miguel Pardo,
Daniel Sebastián
Abstract:
In Heintz-Schnorr (1982), the authors introduced the notion of correct test sequence and since then it has been widely used to design probabilistic algorithms for Polynomial Equality Test. The aim of this manuscript is to study the foundations and generalizations of this notion. We show that correct test sequences are almost omnipresent and appear in many different forms in the mathematical litera…
▽ More
In Heintz-Schnorr (1982), the authors introduced the notion of correct test sequence and since then it has been widely used to design probabilistic algorithms for Polynomial Equality Test. The aim of this manuscript is to study the foundations and generalizations of this notion. We show that correct test sequences are almost omnipresent and appear in many different forms in the mathematical literature: As identity sequences for Function Identity Test, as norming sets in the field of Banach algebras or as samples in the context of Reproducing Kernel Hilbert Spaces. As main outcome, we generalize the main statement of Heintz-Schnorr (1982) proving that short correct test sequences for constructible sets of lists of polynomials do exist and are densely distributed in any constructible set of accurate dimension and degree. The main tool used to prove this result is the theory of degree of constructible sets, which we introduce and develop in this manuscript, generalizing the results of Heintz (1983) and proving two Bezout's Inequalities for two different notions of degree. We present a ${\bf BPP}_K$ algorithm to exhibit the power of correct test sequences, this algorithm decides whether a list of polynomials is a secant sequence by just evaluating the input list at some well-suited points. We show the differences between correct test sequences and Demillo-Lipton-Schwartz-Zippel probabilistic tests and we reformulate, prove and generalize two well-known results of the Polynomial Method: We prove Dvir's exponential lower bounds for Kakeya sets from lower bounds for the length of correct test sequences and generalize Alon's Combinatorial Nullstellensatz.
△ Less
Submitted 5 January, 2021; v1 submitted 30 December, 2020;
originally announced December 2020.
-
On Bezout Inequalities for non-homogeneous Polynomial Ideals
Authors:
Amir Hashemi,
Joos Heintz,
Luis Miguel Pardo,
Pablo Solernó
Abstract:
We introduce a "workable" notion of degree for non-homogeneous polynomial ideals and formulate and prove ideal theoretic Bézout Inequalities for the sum of two ideals in terms of this notion of degree and the degree of generators. We compute probabilistically the degree of an equidimensional ideal.
We introduce a "workable" notion of degree for non-homogeneous polynomial ideals and formulate and prove ideal theoretic Bézout Inequalities for the sum of two ideals in terms of this notion of degree and the degree of generators. We compute probabilistically the degree of an equidimensional ideal.
△ Less
Submitted 16 January, 2017;
originally announced January 2017.
-
Quiz Games as a model for Information Hiding
Authors:
Bernd Bank,
Joos Heintz,
Guillermo Matera,
Jose L. Montana,
Luis M. Pardo,
Andres Rojas Paredes
Abstract:
We present a general computation model inspired in the notion of information hiding in software engineering. This model has the form of a game which we call quiz game. It allows in a uniform way to prove exponential lower bounds for several complexity problems of elimination theory.
We present a general computation model inspired in the notion of information hiding in software engineering. This model has the form of a game which we call quiz game. It allows in a uniform way to prove exponential lower bounds for several complexity problems of elimination theory.
△ Less
Submitted 17 December, 2015; v1 submitted 31 August, 2015;
originally announced August 2015.
-
The hardness of polynomial equation solving
Authors:
David Castro,
Marc Giusti,
Joos Heintz,
Guillermo Matera,
Luis Miguel Pardo
Abstract:
In this paper we investigate the intrinsic sequential time complexity of universal elimination procedures for arbitrary continuous data structures encoding input and output objects of elimination theory (i.e. polynomial equation systems) and admitting the representation of certain limit objects.
Our main result is the following: let be given such a data structure and together with this data st…
▽ More
In this paper we investigate the intrinsic sequential time complexity of universal elimination procedures for arbitrary continuous data structures encoding input and output objects of elimination theory (i.e. polynomial equation systems) and admitting the representation of certain limit objects.
Our main result is the following: let be given such a data structure and together with this data structure a universal elimination algorithm, say P, solving arbitrary parametric polynomial equation systems. Suppose that the algorithm P avoids "unnecessary" branchings and that P admits the efficient computation of certain natural limit objects (as e.g. the Zariski closure of a given constructible algebraic set or the parametric greatest common divisor of two given algebraic families of univariate polynomials). Then P cannot be a polynomial time algorithm.
The paper contains different variants of this result and discusses their practical implications.
△ Less
Submitted 18 January, 2003;
originally announced January 2003.
-
On the uniform distribution of rational inputs with respect to condition numbers of Numerical Analysis
Authors:
D. Castro,
J. L. Montana,
L. M. Pardo,
J. San Martin
Abstract:
We show that rational data of bounded input length are uniformly distributed with respect to condition numbers of numerical analysis. We deal both with condition numbers of Linear Algebra and with condition numbers for systems of multivariate polynomial equations. For instance, we show that for any $w>1$ and for any $n\times n$ rational matrix $M$ of bit length $O(n^4\log n) + \log w$, the condi…
▽ More
We show that rational data of bounded input length are uniformly distributed with respect to condition numbers of numerical analysis. We deal both with condition numbers of Linear Algebra and with condition numbers for systems of multivariate polynomial equations. For instance, we show that for any $w>1$ and for any $n\times n$ rational matrix $M$ of bit length $O(n^4\log n) + \log w$, the condition number $k(M)$ satisfies $k(M) \leq w n^{5/2}$ with probability at least $1-2w^{-1}$. Similar estimates are shown for the condition number $μ_{norm}$ of M. Shub and S. Smale when applied to systems of multivariate homogeneous polynomial equations of bounded input length. Finally we apply these techniques to show the probability distribution of the precision (number of bits of the denominator) required to write down approximate zeros of affine systems of multivariate polynomial equations of bounded input length.
△ Less
Submitted 15 March, 2001;
originally announced March 2001.
-
Sharp estimates for the arithmetic Nullstellensatz
Authors:
Teresa Krick,
Luis Miguel Pardo,
Martin Sombra
Abstract:
We present sharp estimates for the degree and the height of the polynomials in the Nullstellensatz over $\Z$. The result improves previous work of Philippon, Berenstein-Yger and Krick-Pardo.
We also present degree and height estimates of intrinsic type, which depend mainly on the degree and the height of the input polynomial system. As an application, we derive an effective arithmetic Nullstel…
▽ More
We present sharp estimates for the degree and the height of the polynomials in the Nullstellensatz over $\Z$. The result improves previous work of Philippon, Berenstein-Yger and Krick-Pardo.
We also present degree and height estimates of intrinsic type, which depend mainly on the degree and the height of the input polynomial system. As an application, we derive an effective arithmetic Nullstellensatz for sparse polynomial systems.
The proof of these results relies heavily on the notion of local height of an affine variety defined over a number field. We introduce this notion and study its basic properties.
△ Less
Submitted 13 November, 1999;
originally announced November 1999.
-
Kronecker's and Newton's approaches to solving: A first comparison
Authors:
D. Castro,
K. Haegele,
J. E. Morais,
L. M. Pardo
Abstract:
In this extended abstract we deal with the relations between the numerical/diophantine approximation and the symbolic/algebraic geometry approachs to solving of multivariate diophentine polynomial systems, obtaining several consecuences ranging from diophantine approximation to effective number theory.
In this extended abstract we deal with the relations between the numerical/diophantine approximation and the symbolic/algebraic geometry approachs to solving of multivariate diophentine polynomial systems, obtaining several consecuences ranging from diophantine approximation to effective number theory.
△ Less
Submitted 16 August, 1999;
originally announced August 1999.
-
The intrinsic complexity of parametric elimination methods
Authors:
J. Heintz,
G. Matera,
L. M. Pardo,
R. Wachenchauzer
Abstract:
This paper is devoted to the complexity analysis of a particular property, called "algebraic robustness" owned by all known symbolic methods of parametric polynomial equation solving (geometric elimination). It is shown that any parametric elimination procedure which owns this property must neccessarily have an exponential sequential time complexity.
This paper is devoted to the complexity analysis of a particular property, called "algebraic robustness" owned by all known symbolic methods of parametric polynomial equation solving (geometric elimination). It is shown that any parametric elimination procedure which owns this property must neccessarily have an exponential sequential time complexity.
△ Less
Submitted 9 July, 1997;
originally announced July 1997.
-
Straight--Line Programs in Geometric Elimination Theory
Authors:
M. Giusti,
J. Heintz,
J. E. Morais,
J. Morgenstern,
L. M. Pardo
Abstract:
We present a new method for solving symbolically zero--dimensional polynomial equation systems in the affine and toric case. The main feature of our method is the use of problem adapted data structures: arithmetic networks and straight--line programs. For sequential time complexity measured by network size we obtain the following result: it is possible to solve any affine or toric zero--dimensio…
▽ More
We present a new method for solving symbolically zero--dimensional polynomial equation systems in the affine and toric case. The main feature of our method is the use of problem adapted data structures: arithmetic networks and straight--line programs. For sequential time complexity measured by network size we obtain the following result: it is possible to solve any affine or toric zero--dimensional equation system in non--uniform sequential time which is polynomial in the length of the input description and the ``geometric degree" of the equation system. Here, the input is thought to be given by a straight--line program (or alternatively in sparse representation), and the length of the input is measured by number of variables, degree of equations and size of the program (or sparsity of the equations). The geometric degree of the input system has to be adequately defined. It is always bounded by the algebraic--combinatoric "Bézout number" of the system which is given by the Hilbert function of a suitable homogeneous ideal. However, in many important cases, the value of the geometric degree of the system is much smaller than its Bézout number since this geometric degree does not take into account multiplicities or degrees of extraneous components (which may appear at infinity in the affine case or may be contained in some coordinate hyperplane in the toric case). Our method contains a new application of a classic tool to symbolic computation: we use Newton iteration in order to simplify straight--line programs occurring in elimination procedures. Our new technique allows for practical implementations a meaningful characterization of the intrinsic {\it algebraic complexity} of typic elimination problems and reduces the still unanswered question of their intrinsic {\it bit complexity} to
△ Less
Submitted 5 September, 1996;
originally announced September 1996.
-
Lower Bounds for diophantine Approximation
Authors:
M. Giusti,
J. Heintz,
K. Hägele,
J. E. Morais,
L. M. Pardo,
J. L. Montaña
Abstract:
We introduce a subexponential algorithm for geometric solving of multivariate polynomial equation systems whose bit complexity depends mainly on intrinsic geometric invariants of the solution set. From this algorithm, we derive a new procedure for the decision of consistency of polynomial equation systems whose bit complexity is subexponential, too. As a byproduct, we analyze the division of a p…
▽ More
We introduce a subexponential algorithm for geometric solving of multivariate polynomial equation systems whose bit complexity depends mainly on intrinsic geometric invariants of the solution set. From this algorithm, we derive a new procedure for the decision of consistency of polynomial equation systems whose bit complexity is subexponential, too. As a byproduct, we analyze the division of a polynomial modulo a reduced complete intersection ideal and from this, we obtain an intrinsic lower bound for the logarithmic height of diophantine approximations to a given solution of a zero--dimensional polynomial equation system. This result represents a multivariate version of Liouville's classical theorem on approximation of algebraic numbers by rationals. A special feature of our procedures is their {\em polynomial} character with respect to the mentioned geometric invariants when instead of bit operations only arithmetic operations are counted at unit cost. Technically our paper relies on the use of straight--line programs as a data structure for the encoding of polynomials, on a new symbolic application of Newton's algorithm to the Implicit Function Theorem and on a special, basis independent trace formula for affine Gorenstein algebras.
△ Less
Submitted 13 August, 1996;
originally announced August 1996.
