Title:Superfast Low Rank Approximation

Abstract:Low rank approximation of a matrix (hereafter (LRA) is a highly important area of Numerical Linear and Multilinear Algebra and Data Mining and Analysis. One can operate with an LRA superfast -- by using much fewer memory cells and flops than an input matrix M has entries. Can we, however, compute an LRA of a matrix superfast? Yes and no. For worst case inputs, any LRA algorithm fails miserably unless it involves all entries of M, but in computational practice worst case inputs seem to appear rarely, and accurate LRA are routinely obtained superfast for large and important classes of matrices. We test numerically a number of superfast algorithms for various synthetic and real world matrices and consistently arrive at quite accurate LRA. Adequate formal support for these empirical observations is still a challenge, but our upper estimates for the output accuracy of our superfast deterministic LRA algorithms show that they only fail for a very narrow input class and moreover that the spectral and Frobenius error norms of the outputs of our randomized LRA algorithms are expected to stay within a noticeable but reasonable factor from their optima.