-
When can you trust feature selection? -- II: On the effects of random data on condition in statistics and optimisation
Abstract: In Part I, we defined a LASSO condition number and developed an algorithm -- for computing support sets (feature selection) of the LASSO minimisation problem -- that runs in polynomial time in the number of variables and the logarithm of the condition number. The algorithm is trustworthy in the sense that if the condition number is infinite, the algorithm will run forever and never produce an inco… ▽ More
Submitted 18 December, 2023; originally announced December 2023.
Comments: 24 pages, 1 figure
-
When can you trust feature selection? -- I: A condition-based analysis of LASSO and generalised hardness of approximation
Abstract: The arrival of AI techniques in computations, with the potential for hallucinations and non-robustness, has made trustworthiness of algorithms a focal point. However, trustworthiness of the many classical approaches are not well understood. This is the case for feature selection, a classical problem in the sciences, statistics, machine learning etc. Here, the LASSO optimisation problem is standard… ▽ More
Submitted 18 December, 2023; originally announced December 2023.
Comments: 24 pages, 1 figure
-
arXiv:2102.11727 [pdf, ps, other]
Functional norms, condition numbers and numerical algorithms in algebraic geometry
Abstract: In numerical linear algebra, a well-established practice is to choose a norm that exploits the structure of the problem at hand in order to optimize accuracy or computational complexity. In numerical polynomial algebra, a single norm (attributed to Weyl) dominates the literature. This article initiates the use of $L_p$ norms for numerical algebraic geometry, with an emphasis on $L_{\infty}$. This… ▽ More
Submitted 18 January, 2022; v1 submitted 23 February, 2021; originally announced February 2021.
Comments: 54 pages
MSC Class: 14Q20; 65Y20; 68Q25; 68U05
Journal ref: Forum of Mathematics, Sigma (2022), Vol. 10:e103 1-49
-
Rigid continuation paths II. Structured polynomial systems
Abstract: This work studies the average complexity of solving structured polynomial systems that are characterized by a low evaluation cost, as opposed to the dense random model previously used. Firstly, we design a continuation algorithm that computes, with high probability, an approximate zero of a polynomial system given only as black-box evaluation program. Secondly, we introduce a universal model of ra… ▽ More
Submitted 4 May, 2021; v1 submitted 21 October, 2020; originally announced October 2020.
MSC Class: Primary 68Q25; Secondary 65H10; 65H20; 65Y20
Journal ref: Forum of Mathematics, Pi, Volume 11, 2023 , e12
-
On the Complexity of the Plantinga-Vegter Algorithm
Abstract: We introduce tools from numerical analysis and high dimensional probability for precision control and complexity analysis of subdivision-based algorithms in computational geometry. We combine these tools with the continuous amortization framework from exact computation. We use these tools on a well-known example from the subdivision family: the adaptive subdivision algorithm due to Plantinga and V… ▽ More
Submitted 11 October, 2021; v1 submitted 15 April, 2020; originally announced April 2020.
Comments: 32 pages, 1 figure. This paper supersedes our earlier conference paper (arXiv:1901.09234). 2nd version: Re-structuring of the paper and correction of typos
MSC Class: 65D18; 68W40
Journal ref: Discrete & Computational Geometry, 68, pages 664-708 (2022)
-
arXiv:1905.08321 [pdf, ps, other]
On local analysis
Abstract: We extend to Gaussian distributions a result providing smoothed analysis estimates for condition numbers given as relativized distances to illposedness. We also introduce a notion of local analysis meant to capture the behavior of these condition numbers around a point.
Submitted 20 May, 2019; originally announced May 2019.
MSC Class: 65Y20
-
arXiv:1903.10710 [pdf, ps, other]
Computing the Homology of Semialgebraic Sets. II: General formulas
Abstract: We describe and analyze a numerical algorithm for computing the homology (Betti numbers and torsion coefficients) of semialgebraic sets given by Boolean formulas. The algorithm works in weak exponential time. This means that outside a subset of data having exponentially small measure, the cost of the algorithm is single exponential in the size of the data. This extends the previous work of the aut… ▽ More
Submitted 20 June, 2020; v1 submitted 26 March, 2019; originally announced March 2019.
Comments: 33 pages, 4 figures
MSC Class: 14P10; 65D18; 65Y20; 68Q25
Journal ref: Found Comput Math 21, 1279-1316 (2021)
-
arXiv:1901.09234 [pdf, ps, other]
Plantinga-Vegter algorithm takes average polynomial time
Abstract: We exhibit a condition-based analysis of the adaptive subdivision algorithm due to Plantinga and Vegter. The first complexity analysis of the PV Algorithm is due to Burr, Gao and Tsigaridas who proved a $O\big(2^{τd^{4}\log d}\big)$ worst-case cost bound for degree $d$ plane curves with maximum coefficient bit-size $τ$. This exponential bound, it was observed, is in stark contrast with the good pe… ▽ More
Submitted 18 April, 2019; v1 submitted 26 January, 2019; originally announced January 2019.
Comments: 8 pages, correction of typos
MSC Class: 65D18; 68W40 ACM Class: I.3.5; F.2.1; G.1.0
Journal ref: ACM Symposium on Symbolic and Algebraic Computation (ISSAC), 2019
-
arXiv:1807.06435 [pdf, ps, other]
Computing the Homology of Semialgebraic Sets I: Lax Formulas
Abstract: We describe and analyze an algorithm for computing the homology (Betti numbers and torsion coefficients) of closed semialgebraic sets given by Boolean formulas without negations over lax polynomial inequalities. The algorithm works in weak exponential time. This means that outside a subset of data having exponentially small measure, the cost of the algorithm is single exponential in the size of th… ▽ More
Submitted 19 March, 2019; v1 submitted 10 July, 2018; originally announced July 2018.
Comments: 43 pages
MSC Class: 14P10; 65D18; 65Y20; 68Q25
Journal ref: Found Comput Math 20, 71-118 (2020)
-
arXiv:1706.07473 [pdf, ps, other]
Computing the homology of basic semialgebraic sets in weak exponential time
Abstract: We describe and analyze an algorithm for computing the homology (Betti numbers and torsion coefficients) of basic semialgebraic sets which works in weak exponential time. That is, out of a set of exponentially small measure in the space of data the cost of the algorithm is exponential in the size of the data. All algorithms previously proposed for this problem have a complexity which is doubly exp… ▽ More
Submitted 28 September, 2019; v1 submitted 22 June, 2017; originally announced June 2017.
MSC Class: 14P10
Journal ref: Journal of the ACM 66(1), Article 5, 2018
-
arXiv:1602.02094 [pdf, ps, other]
Computing the Homology of Real Projective Sets
Abstract: We describe and analyze a numerical algorithm for computing the homology (Betti numbers and torsion coefficients) of real projective varieties. Here numerical means that the algorithm is numerically stable (in a sense to be made precise). Its cost depends on the condition of the input as well as on its size and is singly exponential in the number of variables (the dimension of the ambient space) a… ▽ More
Submitted 12 May, 2017; v1 submitted 5 February, 2016; originally announced February 2016.
Comments: 36 pages, 2 figures
MSC Class: 65Y20; 65H10; 55U10
-
arXiv:1510.04419 [pdf, ps, other]
On the condition of characteristic polynomials
Abstract: We prove that the expectation of the logarithm of the condition number of each of the zeros of the characteristic polynomial of a complex standard Gaussian matrix is $Ω(n)$. This may provide an explanation for the common wisdom in numerical linear algebra that advises against computing eigenvalues via root-finding for characteristic polynomials.
Submitted 22 November, 2015; v1 submitted 15 October, 2015; originally announced October 2015.
-
arXiv:1507.03896 [pdf, ps, other]
Condition length and complexity for the solution of polynomial systems
Abstract: Smale's 17th problem asks for an algorithm which finds an approximate zero of polynomial systems in average polynomial time (see Smale 2000). The main progress on Smale's problem is Beltrán-Pardo (2011) and Bürgisser-Cucker (2010). In this paper we will improve on both approaches and we prove an important intermediate result. Our main results are Theorem 1 on the complexity of a randomized algorit… ▽ More
Submitted 14 July, 2015; originally announced July 2015.
Comments: 20 pages
MSC Class: 65H10; 65H20; 65Y20; 60D99 ACM Class: F.2.1; G.1.5
-
arXiv:1505.03290 [pdf, ps, other]
A stable, polynomial-time algorithm for the eigenpair problem
Abstract: We describe algorithms for computing eigenpairs (eigenvalue-eigenvector pairs) of a complex $n\times n$ matrix $A$. These algorithms are numerically stable, strongly accurate, and theoretically efficient (i.e., polynomial-time). We do not believe they outperform in practice the algorithms currently used for this computational problem. The merit of our paper is to give a positive answer to a long-s… ▽ More
Submitted 13 May, 2015; originally announced May 2015.
Comments: 69 pages. This paper resulted after merging the independent works arXiv:1410.0116 and arXiv:1410.2179. The present work contains considerably more refined results than the two predecessors
MSC Class: 65F15; 65F22 ACM Class: F.2.1; G.1.5
-
arXiv:1410.0116 [pdf, ps, other]
A stable, polynomial-time algorithm for the eigenpair problem
Abstract: We describe algorithms for computing eigenpairs (eigenvalue--eigenvector) of a complex $n\times n$ matrix $A$. These algorithms are numerically stable, strongly accurate, and theoretically efficient (i.e., polynomial-time). We do not believe they outperform in practice the algorithms currently used for this computational problem. The merit of our paper is to give a positive answer to a long-standi… ▽ More
Submitted 1 October, 2014; originally announced October 2014.
Comments: 42 pages, 3 figures
MSC Class: 65F15; 65F22 ACM Class: F.2.1; G.1.5
-
arXiv:1403.6241 [pdf, ps, other]
A Theory of Complexity, Condition and Roundoff
Abstract: We develop a theory of complexity for numerical computations that takes into account the condition of the input data and allows for roundoff in the computations. We follow the lines of the theory developed by Blum, Shub, and Smale for computations over R (which in turn followed those of the classical, discrete, complexity theory as laid down by Cook, Karp, and Levin among others). In particular, w… ▽ More
Submitted 6 June, 2014; v1 submitted 25 March, 2014; originally announced March 2014.
Comments: 46 pages, 3 figures
MSC Class: 68Q05; 68Q15
-
arXiv:1302.6004 [pdf, ps, other]
Smoothed analysis of componentwise condition numbers for sparse matrices
Abstract: We perform a smoothed analysis of the componentwise condition numbers for determinant computation, matrix inversion, and linear equations solving for sparse n times n matrices. The bounds we obtain for the ex- pectations of the logarithm of these condition numbers are, in all three cases, of the order O(log n). As a consequence, small bounds on the smoothed loss of accuracy for triangular linear s… ▽ More
Submitted 25 February, 2013; originally announced February 2013.
-
arXiv:1205.0869 [pdf, ps, other]
Fast Computation of Zeros of Polynomial Systems with Bounded Degree under Finite-precision
Abstract: A solution for Smale's 17th problem, for the case of systems with bounded degree was recently given. This solution, an algorithm computing approximate zeros of complex polynomial systems in average polynomial time, assumed infinite precision. In this paper we describe a finite-precision version of this algorithm. Our main result shows that this version works within the same time bounds and require… ▽ More
Submitted 4 May, 2012; originally announced May 2012.
MSC Class: 65G50; 65H10; 65Y20
-
arXiv:1105.2169 [pdf, ps, other]
Solving Linear Problems with Finite Precision III: Sharp Expectation Bounds
Abstract: We prove an O(log n) bound for the expectation of the logarithm of the condition number K for the computation of optimizers of linear programs.
Submitted 11 May, 2011; originally announced May 2011.
-
arXiv:1104.1352 [pdf, ps, other]
Solving second-order conic systems with variable precision
Abstract: We describe and analyze an interior-point method to decide feasibility problems of second-order conic systems. A main feature of our algorithm is that arithmetic operations are performed with finite precision. Bounds for both the number of arithmetic operations and the finest precision required are exhibited.
Submitted 30 July, 2013; v1 submitted 7 April, 2011; originally announced April 2011.
-
arXiv:1007.1597 [pdf, ps, other]
A Numerical Algorithm for Zero Counting. III: Randomization and Condition
Abstract: In a recent paper (Cucker, Krick, Malajovich and Wschebor, A Numerical Algorithm for Zero Counting. I: Complexity and accuracy, J. Compl.,24:582-605, 2008) we analyzed a numerical algorithm for computing the number of real zeros of a polynomial system. The analysis relied on a condition number kappa(f) for the input system f. In this paper, we look at kappa(f) as a random variable derived from imp… ▽ More
Submitted 13 June, 2011; v1 submitted 9 July, 2010; originally announced July 2010.
MSC Class: 65H20; 68Q17; 60G60 ACM Class: F.2.1; G.1.5
Journal ref: Advances in Applied Mathematics 48-1, pp. 215-248 (January 2012)
-
arXiv:1002.4690 [pdf, ps, other]
Smoothed Analysis of Moore-Penrose Inversion
Abstract: We perform a smoothed analysis of the condition number of rectangular matrices. We prove that, asymptotically, the expected value of this condition number depends only of the elongation of the matrix, and not on the center and variance of the underlying probability distribution.
Submitted 30 April, 2010; v1 submitted 24 February, 2010; originally announced February 2010.
Comments: 19 pages. Version 2 contains a new section on applications
MSC Class: 65F20; 65F35
Journal ref: SIAM J. Matrix Anal. & Appl. 31(5): 2769-2783 (2010)
-
arXiv:0909.4101 [pdf, ps, other]
A Numerical Algorithm for Zero Counting. II: Distance to Ill-posedness and Smoothed Analysis
Abstract: We show a Condition Number Theorem for the condition number of zero counting for real polynomial systems. That is, we show that this condition number equals the inverse of the normalized distance to the set of ill-posed systems (i.e., those having multiple real zeros). As a consequence, a smoothed analysis of this condition number follows.
Submitted 22 September, 2009; originally announced September 2009.
ACM Class: F.2.1; G.1
Journal ref: Journal of Fixed Point Theory and Applications 6 No 2, pp 285-294 (Dec. 2009)
-
arXiv:0909.2114 [pdf, ps, other]
On a Problem Posed by Steve Smale
Abstract: The 17th of the problems proposed by Steve Smale for the 21st century asks for the existence of a deterministic algorithm computing an approximate solution of a system of $n$ complex polynomials in $n$ unknowns in time polynomial, on the average, in the size $N$ of the input system. A partial solution to this problem was given by Carlos Beltran and Luis Miguel Pardo who exhibited a randomized algo… ▽ More
Submitted 25 October, 2011; v1 submitted 11 September, 2009; originally announced September 2009.
Comments: V2: changes in Sections 6.1 and 6.5 leading to improved bounds. V3: confusing typos corrected. V4: restructuring of paper. In particular, the former Section 6 splits into the new Sections 7 and 8. V5: corrected typos, rewrote proofs in Section 8.4. Notes added in Proof. V6: due to a harmless error in the proof of Theorem 3.1, some of the constants appearing in various places had to be adapted
MSC Class: 65H20; 65Y20 ACM Class: F.2.1; G.1.5
Journal ref: Annals of Mathematics 174(3): 1785-1836 (2011)
-
arXiv:0903.3499 [pdf, ps, other]
Adversarial Smoothed Analysis
Abstract: The purpose of this note is to extend the results on uniform smoothed analysis of condition numbers from \cite{BuCuLo:07} to the case where the perturbation follows a radially symmetric probability distribution. In particular, we will show that the bounds derived in \cite{BuCuLo:07} still hold in the case of distributions whose density has a singularity at the center of the perturbation, which w… ▽ More
Submitted 20 March, 2009; originally announced March 2009.
Comments: 8 pages
MSC Class: 65Y20; 65G99
-
A numerical algorithm for zero counting II: Randomization and Condition
Abstract: This paper was witdrawn by the authors.
Submitted 22 September, 2009; v1 submitted 17 December, 2008; originally announced December 2008.
Comments: Withdrawn
MSC Class: 65H10; 60D05; 68Q25
-
arXiv:0807.0956 [pdf, ps, other]
Componentwise condition numbers of random sparse matrices
Abstract: We prove an O(log n) bound for the expected value of the logarithm of the componentwise (and, a fortiori, the mixed) condition number of a random sparse n x n matrix. As a consequence, small bounds on the average loss of accuracy for triangular linear systems follow.
Submitted 7 July, 2008; v1 submitted 7 July, 2008; originally announced July 2008.
MSC Class: 15A12; 15A52
-
arXiv:0712.2816 [pdf, ps, other]
Coverage processes on spheres and condition numbers for linear programming
Abstract: This paper has two agendas. Firstly, we exhibit new results for coverage processes. Let $p(n,m,α)$ be the probability that $n$ spherical caps of angular radius $α$ in $S^m$ do not cover the whole sphere $S^m$. We give an exact formula for $p(n,m,α)$ in the case $α\in[π/2,π]$ and an upper bound for $p(n,m,α)$ in the case $α\in [0,π/2]$ which tends to $p(n,m,π/2)$ when $α\toπ/2$. In the case… ▽ More
Submitted 1 October, 2010; v1 submitted 17 December, 2007; originally announced December 2007.
Comments: Published in at http://dx.doi.org/10.1214/09-AOP489 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)
Report number: IMS-AOP-AOP489
Journal ref: Annals of Probability 2010, Vol. 38, No. 2, 570-604
-
arXiv:0710.4508 [pdf, ps, other]
A Numerical Algorithm for Zero Counting. I: Complexity and Accuracy
Abstract: We describe an algorithm to count the number of distinct real zeros of a polynomial (square) system f. The algorithm performs O(n D kappa(f)) iterations where n is the number of polynomials (as well as the dimension of the ambient space), D is a bound on the polynomials' degree, and kappa(f) is a condition number for the system. Each iteration uses an exponential number of operations. The algori… ▽ More
Submitted 19 March, 2008; v1 submitted 24 October, 2007; originally announced October 2007.
Comments: We made minor but necessary improvements in the presentation
ACM Class: F.2.1; G.1; I.1.2
Journal ref: Journal of Complexity 24 Issues 5-6, pp 582-605 (Oct-Dec 2008)
-
arXiv:0706.3343 [pdf, ps, other]
Flocking in noisy environments
Abstract: We consider a perturbed version of the dynamics of a flock introduced by Cucker and Smale ("Emergent behaviour in flocks") and prove, under similar conditions, that nearly-alignment (a concept that is precised in the text) is achieved with a certain probability, bounded from below.
Submitted 22 June, 2007; originally announced June 2007.
MSC Class: 68T05;37H10
-
arXiv:math/0610270 [pdf, ps, other]
The probability that a small perturbation of a numerical analysis problem is difficult
Abstract: We prove a general theorem providing smoothed analysis estimates for conic condition numbers of problems of numerical analysis. Our probability estimates depend only on geometric invariants of the corresponding sets of ill-posed inputs. Several applications to linear and polynomial equation solving show that the estimates obtained in this way are easy to derive and quite accurate. The main theor… ▽ More
Submitted 9 October, 2006; originally announced October 2006.
Comments: 30 pages, 4 figures
MSC Class: 65F35; 53C65; 60D05; 14P10; 65Y20
Journal ref: Math. Comp. 77 (2008), 1559-1583
-
arXiv:math/0605635 [pdf, ps, other]
Smoothed analysis of complex conic condition numbers
Abstract: Smoothed analysis of complexity bounds and condition numbers has been done, so far, on a case by case basis. In this paper we consider a reasonably large class of condition numbers for problems over the complex numbers and we obtain smoothed analysis estimates for elements in this class depending only on geometric invariants of the corresponding sets of ill-posed inputs. These estimates are for… ▽ More
Submitted 24 May, 2006; originally announced May 2006.
Comments: 3 figures
MSC Class: 65F35; 65F22; 53C65; 53C56
-
arXiv:cs/0312007 [pdf, ps, other]
Counting complexity classes for numeric computations II: algebraic and semialgebraic sets
Abstract: We define counting classes #P_R and #P_C in the Blum-Shub-Smale setting of computations over the real or complex numbers, respectively. The problems of counting the number of solutions of systems of polynomial inequalities over R, or of systems of polynomial equalities over C, respectively, turn out to be natural complete problems in these classes. We investigate to what extent the new counting… ▽ More
Submitted 2 December, 2003; originally announced December 2003.
Comments: 54 pages, 2 figures
ACM Class: F.1.3; I1.2
Journal ref: Journal of Complexity 22(2): 147-191 (2006)
-
arXiv:math/0309278 [pdf, ps, other]
On Tail Decay and Moment Estimates of a Condition Number for Random Linear Conic Systems
Abstract: In this paper we study the distribution tails and the moments of a condition number which arises in the study of homogeneous systems of linear inequalities. We consider the case where this system is defined by a Gaussian random matrix and characterise the exact decay rates of the distribution tails, improve the existing moment estimates, and prove various limit theorems for large scale systems.… ▽ More
Submitted 17 September, 2003; originally announced September 2003.
Comments: 31 pages
Report number: OUCL NA-03/08 MSC Class: 90C31; 15A52 (Primary); 90C05; 90C60; 62H10 (Secondary)