-
A time-frequency method for acoustic scattering with trapping
Authors:
Heather Wilber,
Wietse Vaes,
Abinand Gopal,
Gunnar Martinsson
Abstract:
A Fourier transform method is introduced for a class of hybrid time-frequency methods that solve the acoustic scattering problem in regimes where the solution exhibits both highly oscillatory behavior and slow decay in time. This extends the applicability of hybrid time-frequency schemes to domains with trapping regions. A fast sinc transform technique for managing highly oscillatory behavior and…
▽ More
A Fourier transform method is introduced for a class of hybrid time-frequency methods that solve the acoustic scattering problem in regimes where the solution exhibits both highly oscillatory behavior and slow decay in time. This extends the applicability of hybrid time-frequency schemes to domains with trapping regions. A fast sinc transform technique for managing highly oscillatory behavior and long time horizons is combined with a contour integration scheme that improves smoothness properties in the integrand.
△ Less
Submitted 18 June, 2025;
originally announced June 2025.
-
The Akhiezer iteration and inverse-free solvers for Sylvester matrix equations
Authors:
Cade Ballew,
Thomas Trogdon,
Heather Wilber
Abstract:
Two inverse-free iterative methods are developed for solving Sylvester matrix equations when the spectra of the coefficient matrices are on, or near, known disjoint subintervals of the real axis. Both methods use the recently-introduced Akhiezer iteration: one to address an equivalent problem of approximating the matrix sign function applied to a block matrix and the other to directly approximate…
▽ More
Two inverse-free iterative methods are developed for solving Sylvester matrix equations when the spectra of the coefficient matrices are on, or near, known disjoint subintervals of the real axis. Both methods use the recently-introduced Akhiezer iteration: one to address an equivalent problem of approximating the matrix sign function applied to a block matrix and the other to directly approximate the inverse of the Sylvester operator. In each case this results in provable and computable geometric rates of convergence. When the right-hand side matrix is low rank, both methods require only low-rank matrix-matrix products. Relative to existing approaches, the methods presented here can be more efficient and require less storage when the coefficient matrices are dense or otherwise costly to invert. Applications include solving partial differential equations and computing Fréchet derivatives.
△ Less
Submitted 5 June, 2025; v1 submitted 21 March, 2025;
originally announced March 2025.
-
Compression Properties for large Toeplitz-like matrices
Authors:
Bernhard Beckermann,
Daniel Kressner,
Heather Wilber
Abstract:
Toeplitz matrices are abundant in computational mathematics, and there is a rich literature on the development of fast and superfast algorithms for solving linear systems involving such matrices. Any Toeplitz matrix can be transformed into a matrix with off-diagonal blocks that are of low numerical rank.Surprisingly little is known about the compressibility of these matrices in a theoretically rig…
▽ More
Toeplitz matrices are abundant in computational mathematics, and there is a rich literature on the development of fast and superfast algorithms for solving linear systems involving such matrices. Any Toeplitz matrix can be transformed into a matrix with off-diagonal blocks that are of low numerical rank.Surprisingly little is known about the compressibility of these matrices in a theoretically rigorous sense, even though this compressibility is relied upon in practice in a number of superfast Toeplitz solvers. In this paper, we show that the compression properties of these matrices can be thoroughly explained using their displacement structure. We provide explicit bounds on the numerical ranks of important submatrices that arise when applying HSS, HODLR and other approximations with hierarchical low-rank structure to transformed Toeplitz and Toeplitz-like matrices. Our results lead to very efficient displacement-based compression strategies that can be used to formulate adaptive superfast rank-structured solvers.
△ Less
Submitted 13 February, 2025;
originally announced February 2025.
-
Computation of Zolotarev rational functions
Authors:
Lloyd N. Trefethen,
Heather D. Wilber
Abstract:
An algorithm is presented to compute Zolotarev rational functions, that is, rational functions $r_n^*$ of a given degree that are as small as possible on one set $E\subseteq\complex\cup\{\infty\}$ relative to their size on another set $F\subseteq\complex\cup\{\infty\}$ (the third Zolotarev problem). Along the way we also approximate the sign function relative to $E$ and $F$ (the fourth Zolotarev p…
▽ More
An algorithm is presented to compute Zolotarev rational functions, that is, rational functions $r_n^*$ of a given degree that are as small as possible on one set $E\subseteq\complex\cup\{\infty\}$ relative to their size on another set $F\subseteq\complex\cup\{\infty\}$ (the third Zolotarev problem). Along the way we also approximate the sign function relative to $E$ and $F$ (the fourth Zolotarev problem).
△ Less
Submitted 1 April, 2025; v1 submitted 26 August, 2024;
originally announced August 2024.
-
Superfast direct inversion of the nonuniform discrete Fourier transform via hierarchically semi-separable least squares
Authors:
Heather Wilber,
Ethan N. Epperly,
Alex H. Barnett
Abstract:
A direct solver is introduced for solving overdetermined linear systems involving nonuniform discrete Fourier transform matrices. Such matrices can be transformed into a Cauchy-like form that has hierarchical low rank structure. The rank structure of this matrix is explained, and it is shown that the ranks of the relevant submatrices grow only logarithmically with the number of columns of the matr…
▽ More
A direct solver is introduced for solving overdetermined linear systems involving nonuniform discrete Fourier transform matrices. Such matrices can be transformed into a Cauchy-like form that has hierarchical low rank structure. The rank structure of this matrix is explained, and it is shown that the ranks of the relevant submatrices grow only logarithmically with the number of columns of the matrix. A fast rank-structured hierarchical approximation method based on this analysis is developed, along with a hierarchical least-squares solver for these and related systems. This result is a direct method for inverting nonuniform discrete transforms with a complexity that is usually nearly linear with respect to the degrees of freedom in the problem.This solver is benchmarked against various iterative and direct solvers in the setting of inverting the one-dimensional type-II (or forward) transform, for a range of condition numbers and problem sizes (up to $4\times 10^6$ by $2\times 10^6$). These experiments demonstrate that this method is especially useful for large problems with multiple right-hand sides.
△ Less
Submitted 18 November, 2024; v1 submitted 19 April, 2024;
originally announced April 2024.
-
Data-driven Algorithms for signal processing with trigonometric rational functions
Authors:
Heather Wilber,
Anil Damle,
Alex Townsend
Abstract:
Rational approximation schemes for reconstructing periodic signals from samples with poorly separated spectral content are described. These methods are automatic and adaptive, requiring no tuning or manual parameter selection. Collectively, they form a framework for fitting trigonometric rational models to data that is robust to various forms of corruption, including additive Gaussian noise, pertu…
▽ More
Rational approximation schemes for reconstructing periodic signals from samples with poorly separated spectral content are described. These methods are automatic and adaptive, requiring no tuning or manual parameter selection. Collectively, they form a framework for fitting trigonometric rational models to data that is robust to various forms of corruption, including additive Gaussian noise, perturbed sampling grids, and missing data. Our approach combines a variant of Prony's method with a modified version of the AAA algorithm. Using representations in both frequency and time space, a collection of algorithms is described for adaptively computing with trigonometric rationals. This includes procedures for differentiation, filtering, convolution, and more. A new MATLAB software system based on these algorithms is introduced. Its effectiveness is illustrated with synthetic and practical examples drawn from applications including biomedical monitoring, acoustic denoising, and feature detection.
△ Less
Submitted 9 December, 2021; v1 submitted 15 May, 2021;
originally announced May 2021.
-
Bounding Zolotarev numbers using Faber rational functions
Authors:
Daniel Rubin,
Alex Townsend,
Heather Wilber
Abstract:
By closely following a construction by Ganelius, we construct Faber rational functions that allow us to derive tight and explicit bounds on Zolotarev numbers. We use our results to bound the singular values of matrices, including complex-valued Cauchy matrices and Vandermonde matrices with nodes inside the unit disk. We construct Faber rational functions using doubly-connected conformal maps and u…
▽ More
By closely following a construction by Ganelius, we construct Faber rational functions that allow us to derive tight and explicit bounds on Zolotarev numbers. We use our results to bound the singular values of matrices, including complex-valued Cauchy matrices and Vandermonde matrices with nodes inside the unit disk. We construct Faber rational functions using doubly-connected conformal maps and use their zeros and poles to supply shift parameters in the alternating direction implicit method.
△ Less
Submitted 7 May, 2020; v1 submitted 26 November, 2019;
originally announced November 2019.
-
Chebyshev approximation and the global geometry of sloppy models
Authors:
Katherine N. Quinn,
Heather Wilber,
Alex Townsend,
James P. Sethna
Abstract:
Sloppy models are complex nonlinear models with outcomes that are significantly affected by only a small subset of parameter combinations. Despite forming an important universality class and arising frequently in practice, formal and systematic explanations of sloppiness are lacking. By unifying geometric interpretations of sloppiness with Chebyshev approximation theory, we offer such an explanati…
▽ More
Sloppy models are complex nonlinear models with outcomes that are significantly affected by only a small subset of parameter combinations. Despite forming an important universality class and arising frequently in practice, formal and systematic explanations of sloppiness are lacking. By unifying geometric interpretations of sloppiness with Chebyshev approximation theory, we offer such an explanation, and show how sloppiness can be described explicitly in terms of model smoothness. Our approach results in universal bounds on model predictions for classes of smooth models, and our bounds capture global geometric features that are intrinsic to their model manifolds. We illustrate these ideas using three disparate models: exponential decay, reaction rates from an enzyme-catalysed chemical reaction, and an epidemiology model of an infected population.
△ Less
Submitted 22 September, 2018;
originally announced September 2018.
-
On the singular values of matrices with high displacement rank
Authors:
Alex Townsend,
Heather Wilber
Abstract:
We introduce a new ADI-based low rank solver for $AX-XB=F$, where $F$ has rapidly decaying singular values. Our approach results in both theoretical and practical gains, including (1) the derivation of new bounds on singular values for classes of matrices with high displacement rank, (2) a practical algorithm for solving certain Lyapunov and Sylvester matrix equations with high rank right-hand sid…
▽ More
We introduce a new ADI-based low rank solver for $AX-XB=F$, where $F$ has rapidly decaying singular values. Our approach results in both theoretical and practical gains, including (1) the derivation of new bounds on singular values for classes of matrices with high displacement rank, (2) a practical algorithm for solving certain Lyapunov and Sylvester matrix equations with high rank right-hand sides, and (3) a collection of low rank Poisson solvers that achieve spectral accuracy and optimal computational complexity.
△ Less
Submitted 11 January, 2018; v1 submitted 15 December, 2017;
originally announced December 2017.
-
Computing with functions in spherical and polar geometries II. The disk
Authors:
Heather Wilber,
Alex Townsend,
Grady Wright
Abstract:
A collection of algorithms is described for numerically computing with smooth functions defined on the unit disk. Low rank approximations to functions in polar geometries are formed by synthesizing the disk analogue of the double Fourier sphere method with a structure-preserving variant of iterative Gaussian elimination that is shown to converge geometrically for certain analytic functions. This a…
▽ More
A collection of algorithms is described for numerically computing with smooth functions defined on the unit disk. Low rank approximations to functions in polar geometries are formed by synthesizing the disk analogue of the double Fourier sphere method with a structure-preserving variant of iterative Gaussian elimination that is shown to converge geometrically for certain analytic functions. This adaptive procedure is near-optimal in its sampling strategy, producing approximants that are stable for differentiation and facilitate the use of FFT-based algorithms in both variables. The low rank form of the approximants is especially useful for operations such as integration and differentiation, reducing them to essentially 1D procedures, and it is also exploited to formulate a new fast disk Poisson solver that computes low rank approximations to solutions. This work complements a companion paper (Part I) on computing with functions on the surface of the unit sphere.
△ Less
Submitted 27 March, 2017; v1 submitted 11 April, 2016;
originally announced April 2016.
-
Computing with functions in spherical and polar geometries I. The sphere
Authors:
Alex Townsend,
Heather Wilber,
Grady B. Wright
Abstract:
A collection of algorithms is described for numerically computing with smooth functions defined on the unit sphere. Functions are approximated to essentially machine precision by using a structure-preserving iterative variant of Gaussian elimination together with the double Fourier sphere method. We show that this procedure allows for stable differentiation, reduces the oversampling of functions n…
▽ More
A collection of algorithms is described for numerically computing with smooth functions defined on the unit sphere. Functions are approximated to essentially machine precision by using a structure-preserving iterative variant of Gaussian elimination together with the double Fourier sphere method. We show that this procedure allows for stable differentiation, reduces the oversampling of functions near the poles, and converges for certain analytic functions. Operations such as function evaluation, differentiation, and integration are particularly efficient and can be computed by essentially one-dimensional algorithms. A highlight is an optimal complexity direct solver for Poisson's equation on the sphere using a spectral method. Without parallelization, we solve Poisson's equation with $100$ million degrees of freedom in one minute on a standard laptop. Numerical results are presented throughout. In a companion paper (part II) we extend the ideas presented here to computing with functions on the disk.
△ Less
Submitted 1 April, 2016; v1 submitted 27 October, 2015;
originally announced October 2015.
