Showing 1–50 of 67 results for author: Greengard, L

Accelerating Fast Ewald Summation with Prolates for Molecular Dynamics Simulations

Authors: Jiuyang Liang, Libin Lu, Alex Barnett, Leslie Greengard, Shidong Jiang

Abstract: Fast Ewald summation is the most widely used approach for computing long-range Coulomb interactions in molecular dynamics (MD) simulations. While the asymptotic scaling is nearly optimal, its performance on parallel architectures is dominated by the global communication required for the underlying fast Fourier transform (FFT). Here, we develop a novel method, ESP - Ewald summation with prolate sph… ▽ More Fast Ewald summation is the most widely used approach for computing long-range Coulomb interactions in molecular dynamics (MD) simulations. While the asymptotic scaling is nearly optimal, its performance on parallel architectures is dominated by the global communication required for the underlying fast Fourier transform (FFT). Here, we develop a novel method, ESP - Ewald summation with prolate spheroidal wave functions (PSWFs) - that, for a fixed precision, sharply reduces the size of this transform by performing the Ewald split via a PSWF. In addition, PSWFs minimize the cost of spreading and interpolation steps that move information between the particles and the underlying uniform grid. We have integrated the ESP method into two widely-used open-source MD packages: LAMMPS and GROMACS. Detailed benchmarks show that this reduces the cost of computing far-field electrostatic interactions by an order of magnitude, leading to better strong scaling with respect to number of cores. The total execution time is reduced by a factor of 2 to 3 when using more than one thousand cores, even after optimally tuning the existing internal parameters in the native codes. We validate the accelerated codes in realistic long-time biological simulations. △ Less

Submitted 14 May, 2025; originally announced May 2025.

Comments: 21 pages, 10 figures

A Lightweight, Geometrically Flexible Fast Algorithm for the Evaluation of Layer and Volume Potentials

Authors: Fredrik Fryklund, Leslie Greengard, Shidong Jiang, Samuel Potter

Abstract: Over the last two decades, several fast, robust, and high-order accurate methods have been developed for solving the Poisson equation in complicated geometry using potential theory. In this approach, rather than discretizing the partial differential equation itself, one first evaluates a volume integral to account for the source distribution within the domain, followed by solving a boundary integr… ▽ More Over the last two decades, several fast, robust, and high-order accurate methods have been developed for solving the Poisson equation in complicated geometry using potential theory. In this approach, rather than discretizing the partial differential equation itself, one first evaluates a volume integral to account for the source distribution within the domain, followed by solving a boundary integral equation to impose the specified boundary conditions. Here, we present a new fast algorithm which is easy to implement and compatible with virtually any discretization technique, including unstructured domain triangulations, such as those used in standard finite element or finite volume methods. Our approach combines earlier work on potential theory for the heat equation, asymptotic analysis, the nonuniform fast Fourier transform (NUFFT), and the dual-space multilevel kernel-splitting (DMK) framework. It is insensitive to flaws in the triangulation, permitting not just nonconforming elements, but arbitrary aspect ratio triangles, gaps and various other degeneracies. On a single CPU core, the scheme computes the solution at a rate comparable to that of the fast Fourier transform (FFT) in work per gridpoint. △ Less

Submitted 18 September, 2024; originally announced September 2024.

MSC Class: 31A10; 65E05; 35S30; 65R10; 45M05

Coordinate complexification for the Helmholtz equation with Dirichlet boundary conditions in a perturbed half-space

Authors: Charles L. Epstein, Leslie Greengard, Jeremy Hoskins, Shidong Jiang, Manas Rachh

Abstract: We present a new complexification scheme based on the classical double layer potential for the solution of the Helmholtz equation with Dirichlet boundary conditions in compactly perturbed half-spaces in two and three dimensions. The kernel for the double layer potential is the normal derivative of the free-space Green's function, which has a well-known analytic continuation into the complex plane… ▽ More We present a new complexification scheme based on the classical double layer potential for the solution of the Helmholtz equation with Dirichlet boundary conditions in compactly perturbed half-spaces in two and three dimensions. The kernel for the double layer potential is the normal derivative of the free-space Green's function, which has a well-known analytic continuation into the complex plane as a function of both target and source locations. Here, we prove that - when the incident data are analytic and satisfy a precise asymptotic estimate - the solution to the boundary integral equation itself admits an analytic continuation into specific regions of the complex plane, and satisfies a related asymptotic estimate (this class of data includes both plane waves and the field induced by point sources). We then show that, with a carefully chosen contour deformation, the oscillatory integrals are converted to exponentially decaying integrals, effectively reducing the infinite domain to a domain of finite size. Our scheme is different from existing methods that use complex coordinate transformations, such as perfectly matched layers, or absorbing regions, such as the gradual complexification of the governing wavenumber. More precisely, in our method, we are still solving a boundary integral equation, albeit on a truncated, complexified version of the original boundary. In other words, no volumetric/domain modifications are introduced. The scheme can be extended to other boundary conditions, to open wave guides and to layered media. We illustrate the performance of the scheme with two and three dimensional examples. △ Less

Submitted 6 January, 2025; v1 submitted 10 September, 2024; originally announced September 2024.

Comments: 27 pages, 8 figures

MSC Class: 31A10; 65E05; 65Y20

On the construction of scattering matrices for irregular or elongated enclosures using Green's representation formula

Authors: Carlos Borges, Leslie Greengard, Michael O'Neil, Manas Rachh

Abstract: Multiple scattering methods are widely used to reduce the computational complexity of acoustic or electromagnetic scattering problems when waves propagate through media containing many identical inclusions. Historically, this numerical technique has been limited to situations in which the inclusions (particles) can be covered by nonoverlapping disks in two dimensions or spheres in three dimensions… ▽ More Multiple scattering methods are widely used to reduce the computational complexity of acoustic or electromagnetic scattering problems when waves propagate through media containing many identical inclusions. Historically, this numerical technique has been limited to situations in which the inclusions (particles) can be covered by nonoverlapping disks in two dimensions or spheres in three dimensions. This allows for the use of separation of variables in cylindrical or spherical coordinates to represent the solution to the governing partial differential equation. Here, we provide a more flexible approach, applicable to a much larger class of geometries. We use a Green's representation formula and the associated layer potentials to construct incoming and outgoing solutions on rectangular enclosures. The performance and flexibility of the resulting scattering operator formulation in two-dimensions is demonstrated via several numerical examples for multi-particle scattering in free space as well as in layered media. The mathematical formalism extends directly to the three dimensional case as well, and can easily be coupled with several commercial numerical PDE software packages. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Comments: 14 pages, 7 figures

MSC Class: 65R20; 78A45; 35J05

A Dual-space Multilevel Kernel-splitting Framework for Discrete and Continuous Convolution

Authors: Shidong Jiang, Leslie Greengard

Abstract: We introduce a new class of multilevel, adaptive, dual-space methods for computing fast convolutional transforms. These methods can be applied to a broad class of kernels, from the Green's functions for classical partial differential equations (PDEs) to power functions and radial basis functions such as those used in statistics and machine learning. The DMK (dual-space multilevel kernel-splitting)… ▽ More We introduce a new class of multilevel, adaptive, dual-space methods for computing fast convolutional transforms. These methods can be applied to a broad class of kernels, from the Green's functions for classical partial differential equations (PDEs) to power functions and radial basis functions such as those used in statistics and machine learning. The DMK (dual-space multilevel kernel-splitting) framework uses a hierarchy of grids, computing a smoothed interaction at the coarsest level, followed by a sequence of corrections at finer and finer scales until the problem is entirely local, at which point direct summation is applied. The main novelty of DMK is that the interaction at each scale is diagonalized by a short Fourier transform, permitting the use of separation of variables, but without requiring the FFT for its asymptotic performance. The DMK framework substantially simplifies the algorithmic structure of the fast multipole method (FMM) and unifies the FMM, Ewald summation, and multilevel summation, achieving speeds comparable to the FFT in work per gridpoint, even in a fully adaptive context. For continuous source distributions, the evaluation of local interactions is further accelerated by approximating the kernel at the finest level as a sum of Gaussians with a highly localized remainder. The Gaussian convolutions are calculated using tensor product transforms, and the remainder term is calculated using asymptotic methods. We illustrate the performance of DMK for both continuous and discrete sources with extensive numerical examples in two and three dimensions. △ Less

Submitted 10 September, 2023; v1 submitted 1 August, 2023; originally announced August 2023.

Comments: 53 pages, 15 figures

MSC Class: 31A10; 65F30; 65E05; 65Y20

Fast adaptive high-order integral equation methods for electromagnetic scattering from smooth perfect electric conductors

Authors: Felipe Vico, Leslie Greengard, Michael O'Neil, Manas Rachh

Abstract: Many integral equation-based methods are available for problems of time-harmonic electromagnetic scattering from perfect electric conductors. Moreover, there are numerous ways in which the geometry can be represented, numerous ways to represent the relevant surface current and/or charge densities, numerous quadrature methods that can be deployed, and numerous fast methods that can be used to accel… ▽ More Many integral equation-based methods are available for problems of time-harmonic electromagnetic scattering from perfect electric conductors. Moreover, there are numerous ways in which the geometry can be represented, numerous ways to represent the relevant surface current and/or charge densities, numerous quadrature methods that can be deployed, and numerous fast methods that can be used to accelerate the solution of the large linear systems which arise from discretization. Among the many issues that arise in such scattering calculations are the avoidance of spurious resonances, the applicability of the chosen method to scatterers of non-trivial topology, the robustness of the method when applied to objects with multiscale features, the stability of the method under mesh refinement, the ease of implementation with high-order basis functions, and the behavior of the method as the frequency tends to zero. Since three-dimensional scattering is a challenging, large-scale problem, many of these issues have been historically difficult to investigate. It is only with the advent of fast algorithms and modern iterative methods that a careful study of these issues can be carried out effectively. In this paper, we use GMRES as our iterative solver and the fast multipole method as our acceleration scheme in order to investigate some of these questions. In particular, we compare the behavior of the following integral equation formulations with regard to the issues noted above: the standard electric, magnetic, and combined field integral equations with standard RWG basis functions, the non-resonant charge-current integral equation, the electric charge-current integral equation, the augmented regularized combined source integral equation and the decoupled potential integral equation DPIE. Various numerical results are provided to demonstrate the behavior of each of these schemes. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Comments: 27 pages, 9 figures

A new version of the adaptive fast Gauss transform for discrete and continuous sources

Authors: Leslie Greengard, Shidong Jiang, Manas Rachh, Jun Wang

Abstract: We present a new version of the fast Gauss transform (FGT) for discrete and continuous sources. Classical Hermite expansions are avoided entirely, making use only of the plane-wave representation of the Gaussian kernel and a new hierarchical merging scheme. For continuous source distributions sampled on adaptive tensor-product grids, we exploit the separable structure of the Gaussian kernel to acc… ▽ More We present a new version of the fast Gauss transform (FGT) for discrete and continuous sources. Classical Hermite expansions are avoided entirely, making use only of the plane-wave representation of the Gaussian kernel and a new hierarchical merging scheme. For continuous source distributions sampled on adaptive tensor-product grids, we exploit the separable structure of the Gaussian kernel to accelerate the computation. For discrete sources, the scheme relies on the nonuniform fast Fourier transform (NUFFT) to construct near field plane wave representations. The scheme has been implemented for either free-space or periodic boundary conditions. In many regimes, the speed is comparable to or better than that of the conventional FFT in work per gridpoint, despite being fully adaptive. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Comments: 26 pages, 10 figures

MSC Class: 31A10; 65F30; 65E05; 65Y20

An FMM Accelerated Poisson Solver for Complicated Geometries in the Plane using Function Extension

Authors: Fredrik Fryklund, Leslie Greengard

Abstract: We describe a new, adaptive solver for the two-dimensional Poisson equation in complicated geometries. Using classical potential theory, we represent the solution as the sum of a volume potential and a double layer potential. Rather than evaluating the volume potential over the given domain, we first extend the source data to a geometrically simpler region with high order accuracy. This allows us… ▽ More We describe a new, adaptive solver for the two-dimensional Poisson equation in complicated geometries. Using classical potential theory, we represent the solution as the sum of a volume potential and a double layer potential. Rather than evaluating the volume potential over the given domain, we first extend the source data to a geometrically simpler region with high order accuracy. This allows us to accelerate the evaluation of the volume potential using an efficient, geometry-unaware fast multipole-based algorithm. To impose the desired boundary condition, it remains only to solve the Laplace equation with suitably modified boundary data. This is accomplished with existing fast and accurate boundary integral methods. The novelty of our solver is the scheme used for creating the source extension, assuming it is provided on an adaptive quad-tree. For leaf boxes intersected by the boundary, we construct a universal "stencil" and require that the data be provided at the subset of those points that lie within the domain interior. This universality permits us to precompute and store an interpolation matrix which is used to extrapolate the source data to an extended set of leaf nodes with full tensor-product grids on each. We demonstrate the method's speed, robustness and high-order convergence with several examples, including domains with piecewise smooth boundaries. △ Less

Submitted 26 November, 2022; originally announced November 2022.

MSC Class: 65R20; 65N80; 65D15

On the robustness of inverse scattering for penetrable, homogeneous objects with complicated boundary

Authors: Carlos Borges, Manas Rachh, Leslie Greengard

Abstract: The acoustic inverse obstacle scattering problem consists of determining the shape of a domain from measurements of the scattered far field due to some set of incident fields (probes). For a penetrable object with known sound speed, this can be accomplished by treating the boundary alone as an unknown curve. Alternatively, one can treat the entire object as unknown and use a more general volumetri… ▽ More The acoustic inverse obstacle scattering problem consists of determining the shape of a domain from measurements of the scattered far field due to some set of incident fields (probes). For a penetrable object with known sound speed, this can be accomplished by treating the boundary alone as an unknown curve. Alternatively, one can treat the entire object as unknown and use a more general volumetric representation, without making use of the known sound speed. Both lead to strongly nonlinear and nonconvex optimization problems for which recursive linearization provides a useful framework for numerical analysis. After extending our shape optimization approach developed earlier for impenetrable bodies, we carry out a systematic study of both methods and compare their performance on a variety of examples. Our findings indicate that the volumetric approach is more robust, even though the number of degrees of freedom is significantly larger. We conclude with a discussion of this phenomenon and potential directions for further research. △ Less

Submitted 20 October, 2022; originally announced October 2022.

Comments: 24 pages, 9 figures

MSC Class: 65NA21; 45Q05

Eliminating artificial boundary conditions in time-dependent density functional theory using Fourier contour deformation

Authors: Jason Kaye, Alex Barnett, Leslie Greengard, Umberto De Giovannini, Angel Rubio

Abstract: We present an efficient method for propagating the time-dependent Kohn-Sham equations in free space, based on the recently introduced Fourier contour deformation (FCD) approach. For potentials which are constant outside a bounded domain, FCD yields a high-order accurate numerical solution of the time-dependent Schrodinger equation directly in free space, without the need for artificial boundary co… ▽ More We present an efficient method for propagating the time-dependent Kohn-Sham equations in free space, based on the recently introduced Fourier contour deformation (FCD) approach. For potentials which are constant outside a bounded domain, FCD yields a high-order accurate numerical solution of the time-dependent Schrodinger equation directly in free space, without the need for artificial boundary conditions. Of the many existing artificial boundary condition schemes, FCD is most similar to an exact nonlocal transparent boundary condition, but it works directly on Cartesian grids in any dimension, and runs on top of the fast Fourier transform rather than fast algorithms for the application of nonlocal history integral operators. We adapt FCD to time-dependent density functional theory (TDDFT), and describe a simple algorithm to smoothly and automatically truncate long-range Coulomb-like potentials to a time-dependent constant outside of a bounded domain of interest, so that FCD can be used. This approach eliminates errors originating from the use of artificial boundary conditions, leaving only the error of the potential truncation, which is controlled and can be systematically reduced. The method enables accurate simulations of ultrastrong nonlinear electronic processes in molecular complexes in which the inteference between bound and continuum states is of paramount importance. We demonstrate results for many-electron TDDFT calculations of absorption and strong field photoelectron spectra for one and two-dimensional models, and observe a significant reduction in the size of the computational domain required to achieve high quality results, as compared with the popular method of complex absorbing potentials. △ Less

Submitted 27 December, 2022; v1 submitted 22 September, 2022; originally announced September 2022.

Robust ab initio solution of the cryo-EM reconstruction problem at low resolution with small data sets

Authors: Aaditya V. Rangan, Leslie Greengard

Abstract: Single particle cryo-electron microscopy has become a critical tool in structural biology over the last decade, able to achieve atomic scale resolution in three dimensional models from hundreds of thousands of (noisy) two-dimensional projection views of particles frozen at unknown orientations. This is accomplished by using a suite of software tools to (i) identify particles in large micrographs,… ▽ More Single particle cryo-electron microscopy has become a critical tool in structural biology over the last decade, able to achieve atomic scale resolution in three dimensional models from hundreds of thousands of (noisy) two-dimensional projection views of particles frozen at unknown orientations. This is accomplished by using a suite of software tools to (i) identify particles in large micrographs, (ii) obtain low-resolution reconstructions, (iii) refine those low-resolution structures, and (iv) finally match the obtained electron scattering density to the constituent atoms that make up the macromolecule or macromolecular complex of interest. Here, we focus on the second stage of the reconstruction pipeline: obtaining a low resolution model from picked particle images. Our goal is to create an algorithm that is capable of ab initio reconstruction from small data sets (on the order of a few thousand selected particles). More precisely, we propose an algorithm that is robust, automatic, and fast enough that it can potentially be used to assist in the assessment of particle quality as the data is being generated during the microscopy experiment. △ Less

Submitted 18 July, 2023; v1 submitted 14 September, 2022; originally announced September 2022.

Comments: 43 pages, 15 figures

FMM-LU: A fast direct solver for multiscale boundary integral equations in three dimensions

Authors: Daria Sushnikova, Leslie Greengard, Michael O'Neil, Manas Rachh

Abstract: We present a fast direct solver for boundary integral equations on complex surfaces in three dimensions using an extension of the recently introduced recursive strong skeletonization scheme. For problems that are not highly oscillatory, our algorithm computes an ${LU}$-like hierarchical factorization of the dense system matrix, permitting application of the inverse in $\mathcal O(n)$ time, where… ▽ More We present a fast direct solver for boundary integral equations on complex surfaces in three dimensions using an extension of the recently introduced recursive strong skeletonization scheme. For problems that are not highly oscillatory, our algorithm computes an ${LU}$-like hierarchical factorization of the dense system matrix, permitting application of the inverse in $\mathcal O(n)$ time, where $n$ is the number of unknowns on the surface. The factorization itself also scales linearly with the system size, albeit with a somewhat larger constant. The scheme is built on a level-restricted adaptive octree data structure, and therefore it is compatible with highly nonuniform discretizations. Furthermore, the scheme is coupled with high-order accurate locally-corrected Nyström quadrature methods to integrate the singular and weakly-singular Green's functions used in the integral representations. Our method has immediate applications to a variety of problems in computational physics. We concentrate here on studying its performance in acoustic scattering (governed by the Helmholtz equation) at low to moderate frequencies, and provide rigorous justification for compression of submatrices via proxy surfaces. △ Less

Submitted 12 January, 2023; v1 submitted 18 January, 2022; originally announced January 2022.

Periodic Fast Multipole Method

Authors: Ruqi Pei, Travis Askham, Leslie Greengard, Shidong Jiang

Abstract: A new scheme is presented for imposing periodic boundary conditions on unit cells with arbitrary source distributions. We restrict our attention here to the Poisson, modified Helmholtz, Stokes and modified Stokes equations. The approach extends to the oscillatory equations of mathematical physics, including the Helmholtz and Maxwell equations, but we will address these in a companion paper, since… ▽ More A new scheme is presented for imposing periodic boundary conditions on unit cells with arbitrary source distributions. We restrict our attention here to the Poisson, modified Helmholtz, Stokes and modified Stokes equations. The approach extends to the oscillatory equations of mathematical physics, including the Helmholtz and Maxwell equations, but we will address these in a companion paper, since the nature of the problem is somewhat different and includes the consideration of quasiperiodic boundary conditions and resonances. Unlike lattice sum-based methods, the scheme is insensitive to the unit cell's aspect ratio and is easily coupled to adaptive fast multipole methods (FMMs). Our analysis relies on classical "plane-wave" representations of the fundamental solution, and yields an explicit low-rank representation of the field due to all image sources beyond the first layer of neighboring unit cells. When the aspect ratio of the unit cell is large, our scheme can be coupled with the nonuniform fast Fourier transform (NUFFT) to accelerate the evaluation of the induced field. Its performance is illustrated with several numerial examples. △ Less

Submitted 1 November, 2021; originally announced November 2021.

Comments: 46 pages, 5 figures

A fast spectral method for electrostatics in doubly-periodic slit channels

Authors: Ondrej Maxian, Raul P. Peláez, Leslie Greengard, Aleksandar Donev

Abstract: We develop a fast method for computing the electrostatic energy and forces for a collection of charges in doubly-periodic slabs with jumps in the dielectric permittivity at the slab boundaries. Our method achieves spectral accuracy by using Ewald splitting to replace the original Poisson equation for nearly-singular sources with a smooth far-field Poisson equation, combined with a localized near-f… ▽ More We develop a fast method for computing the electrostatic energy and forces for a collection of charges in doubly-periodic slabs with jumps in the dielectric permittivity at the slab boundaries. Our method achieves spectral accuracy by using Ewald splitting to replace the original Poisson equation for nearly-singular sources with a smooth far-field Poisson equation, combined with a localized near-field correction. Unlike existing spectral Ewald methods, which make use of the Fourier transform in the aperiodic direction, we recast the problem as a two-point boundary value problem in the aperiodic direction for each transverse Fourier mode, for which exact analytic boundary conditions are available. We solve each of these boundary value problems using a fast, well-conditioned Chebyshev method. In the presence of dielectric jumps, combining Ewald splitting with the classical method of images results in smoothed charge distributions which overlap the dielectric boundaries themselves. We show how to preserve spectral accuracy in this case through the use of a harmonic correction which involves solving a simple Laplace equation with smooth boundary data. We implement our method on Graphical Processing Units, and combine our doubly-periodic Poisson solver with Brownian Dynamics to study the equilibrium structure of double layers in binary electrolytes confined by dielectric boundaries. Consistent with prior studies, we find strong charge depletion near the interfaces due to repulsive interactions with image charges, which points to the need for incorporating polarization effects in understanding confined electrolytes, both theoretically and computationally. △ Less

Submitted 3 June, 2021; v1 submitted 18 January, 2021; originally announced January 2021.

Comments: 60 pages, 7 figures

MSC Class: 65N35; 78M22

Fast multipole methods for evaluation of layer potentials with locally-corrected quadratures

Authors: Leslie Greengard, Michael O'Neil, Manas Rachh, Felipe Vico

Abstract: While fast multipole methods (FMMs) are in widespread use for the rapid evaluation of potential fields governed by the Laplace, Helmholtz, Maxwell or Stokes equations, their coupling to high-order quadratures for evaluating layer potentials is still an area of active research. In three dimensions, a number of issues need to be addressed, including the specification of the surface as the union of h… ▽ More While fast multipole methods (FMMs) are in widespread use for the rapid evaluation of potential fields governed by the Laplace, Helmholtz, Maxwell or Stokes equations, their coupling to high-order quadratures for evaluating layer potentials is still an area of active research. In three dimensions, a number of issues need to be addressed, including the specification of the surface as the union of high-order patches, the incorporation of accurate quadrature rules for integrating singular or weakly singular Green's functions on such patches, and their coupling to the oct-tree data structures on which the FMM separates near and far field interactions. Although the latter is straightforward for point distributions, the near field for a patch is determined by its physical dimensions, not the distribution of discretization points on the surface. Here, we present a general framework for efficiently coupling locally corrected quadratures with FMMs, relying primarily on what are called generalized Gaussian quadratures rules, supplemented by adaptive integration. The approach, however, is quite general and easily applicable to other schemes, such as Quadrature by Expansion (QBX). We also introduce a number of accelerations to reduce the cost of quadrature generation itself, and present several numerical examples of acoustic scattering that demonstrate the accuracy, robustness, and computational efficiency of the scheme. On a single core of an Intel i5 2.3GHz processor, a Fortran implementation of the scheme can generate near field quadrature corrections for between 1000 and 10,000 points per second, depending on the order of accuracy and the desired precision. A Fortran implementation of the algorithm described in this work is available at https://gitlab.com/fastalgorithms/fmm3dbie. △ Less

Submitted 23 April, 2021; v1 submitted 3 June, 2020; originally announced June 2020.

Recovering missing data in coherent diffraction imaging

Authors: David Barmherzig, Alex B. Barnett, Charles L. Epstein, Leslie F. Greengard, Jeremy F. Magland, Manas Rachh

Abstract: In coherent diffraction imaging (CDI) experiments, the intensity of the scattered wave impinging on an object is measured on an array of detectors. This signal can be interpreted as the square of the modulus of the Fourier transform of the unknown scattering density. A beam-stop obstructs the forward scattered wave and, hence, the modulus Fourier data from a neighborhood of k=0 cannot be measured.… ▽ More In coherent diffraction imaging (CDI) experiments, the intensity of the scattered wave impinging on an object is measured on an array of detectors. This signal can be interpreted as the square of the modulus of the Fourier transform of the unknown scattering density. A beam-stop obstructs the forward scattered wave and, hence, the modulus Fourier data from a neighborhood of k=0 cannot be measured. In this note, we describe a linear method for recovering this unmeasured modulus Fourier data from the measured values and an estimate of the support of the image's autocorrelation function without consideration of phase retrieval. We analyze the conditioning of this problem, which grows exponentially with the modulus of the maximum spatial frequency not measured, and the effects of noise. △ Less

Submitted 2 June, 2020; v1 submitted 7 February, 2020; originally announced February 2020.

Comments: Version 2 is a substantial revision with a stronger focus on the conditioning of our algorithm

MSC Class: 78A46; 78A45; 42A16; 65T40

A high-order integral equation-based solver for the time-dependent Schrodinger equation

Authors: Jason Kaye, Alex Barnett, Leslie Greengard

Abstract: We introduce a numerical method for the solution of the time-dependent Schrodinger equation with a smooth potential, based on its reformulation as a Volterra integral equation. We present versions of the method both for periodic boundary conditions, and for free space problems with compactly supported initial data and potential. A spatially uniform electric field may be included, making the solver… ▽ More We introduce a numerical method for the solution of the time-dependent Schrodinger equation with a smooth potential, based on its reformulation as a Volterra integral equation. We present versions of the method both for periodic boundary conditions, and for free space problems with compactly supported initial data and potential. A spatially uniform electric field may be included, making the solver applicable to simulations of light-matter interaction. The primary computational challenge in using the Volterra formulation is the application of a space-time history dependent integral operator. This may be accomplished by projecting the solution onto a set of Fourier modes, and updating their coefficients from one time step to the next by a simple recurrence. In the periodic case, the modes are those of the usual Fourier series, and the fast Fourier transform (FFT) is used to alternate between physical and frequency domain grids. In the free space case, the oscillatory behavior of the spectral Green's function leads us to use a set of complex-frequency Fourier modes obtained by discretizing a contour deformation of the inverse Fourier transform, and we develop a corresponding fast transform based on the FFT. Our approach is related to pseudo-spectral methods, but applied to an integral rather than the usual differential formulation. This has several advantages: it avoids the need for artificial boundary conditions, admits simple, inexpensive high-order implicit time marching schemes, and naturally includes time-dependent potentials. We present examples in one and two dimensions showing spectral accuracy in space and eighth-order accuracy in time for both periodic and free space problems. △ Less

Submitted 16 January, 2020; originally announced January 2020.

Comments: 38 pages, 11 figures

Fast integral equation methods for linear and semilinear heat equations in moving domains

Authors: Jun Wang, Leslie Greengard, Shidong Jiang, Shravan Veerapaneni

Abstract: We present a family of integral equation-based solvers for the linear or semilinear heat equation in complicated moving (or stationary) geometries. This approach has significant advantages over more standard finite element or finite difference methods in terms of accuracy, stability and space-time adaptivity. In order to be practical, however, a number of technical capabilites are required: fast a… ▽ More We present a family of integral equation-based solvers for the linear or semilinear heat equation in complicated moving (or stationary) geometries. This approach has significant advantages over more standard finite element or finite difference methods in terms of accuracy, stability and space-time adaptivity. In order to be practical, however, a number of technical capabilites are required: fast algorithms for the evaluation of heat potentials, high-order accurate quadratures for singular and weakly integrals over space-time domains, and robust automatic mesh refinement and coarsening capabilities. We describe all of these components and illustrate the performance of the approach with numerical examples in two space dimensions. △ Less

Submitted 3 December, 2022; v1 submitted 1 October, 2019; originally announced October 2019.

Comments: 53 pages, 9 figures

MSC Class: 31A10; 31B10; 35K05; 35K08; 35K58; 45D05; 65M38; 65M80; 65R10; 65R20

A fast boundary integral method for high-order multiscale mesh generation

Authors: Felipe Vico, Leslie Greengard, Michael O'Neil, Manas Rachh

Abstract: In this work we present an algorithm to construct an infinitely differentiable smooth surface from an input consisting of a (rectilinear) triangulation of a surface of arbitrary shape. The original surface can have non-trivial genus and multiscale features, and our algorithm has computational complexity which is linear in the number of input triangles. We use a smoothing kernel to define a functio… ▽ More In this work we present an algorithm to construct an infinitely differentiable smooth surface from an input consisting of a (rectilinear) triangulation of a surface of arbitrary shape. The original surface can have non-trivial genus and multiscale features, and our algorithm has computational complexity which is linear in the number of input triangles. We use a smoothing kernel to define a function $Φ$ whose level set defines the surface of interest. Charts are subsequently generated as maps from the original user-specified triangles to $\mathbb R^3$. The degree of smoothness is controlled locally by the kernel to be commensurate with the fineness of the input triangulation. The expression for~$Φ$ can be transformed into a boundary integral, whose evaluation can be accelerated using a fast multipole method. We demonstrate the effectiveness and cost of the algorithm with polyhedral and quadratic skeleton surfaces obtained from CAD and meshing software. △ Less

Submitted 29 September, 2019; originally announced September 2019.

A fast solver for the narrow capture and narrow escape problems in the sphere

Authors: Jason Kaye, Leslie Greengard

Abstract: We present an efficient method to solve the narrow capture and narrow escape problems for the sphere. The narrow capture problem models the equilibrium behavior of a Brownian particle in the exterior of a sphere whose surface is reflective, except for a collection of small absorbing patches. The narrow escape problem is the dual problem: it models the behavior of a Brownian particle confined to th… ▽ More We present an efficient method to solve the narrow capture and narrow escape problems for the sphere. The narrow capture problem models the equilibrium behavior of a Brownian particle in the exterior of a sphere whose surface is reflective, except for a collection of small absorbing patches. The narrow escape problem is the dual problem: it models the behavior of a Brownian particle confined to the interior of a sphere whose surface is reflective, except for a collection of small patches through which it can escape. Mathematically, these give rise to mixed Dirichlet/Neumann boundary value problems of the Poisson equation. They are numerically challenging for two main reasons: (1) the solutions are non-smooth at Dirichlet-Neumann interfaces, and (2) they involve adaptive mesh refinement and the solution of large, ill-conditioned linear systems when the number of small patches is large. By using the Neumann Green's functions for the sphere, we recast each boundary value problem as a system of first-kind integral equations on the collection of patches. A block-diagonal preconditioner together with a multiple scattering formalism leads to a well-conditioned system of second-kind integral equations and a very efficient approach to discretization. This system is solved iteratively using GMRES. We develop a hierarchical, fast multipole method-like algorithm to accelerate each matrix-vector product. Our method is insensitive to the patch size, and the total cost scales with the number N of patches as O(N log N), after a precomputation whose cost depends only on the patch size and not on the number or arrangement of patches. We demonstrate the method with several numerical examples, and are able to achieve highly accurate solutions with 100,000 patches in one hour on a 60-core workstation. △ Less

Submitted 10 June, 2019; originally announced June 2019.

Comments: 29 pages, 11 figures

Journal ref: J. Comput. Phys. X 5 (2020)

High-order discretization of a stable time-domain integral equation for 3D acoustic scattering

Authors: Alex H. Barnett, Leslie Greengard, Tom Hagstrom

Abstract: We develop a high-order, explicit method for acoustic scattering in three space dimensions based on a combined-field time-domain integral equation. The spatial discretization, of Nyström type, uses Gaussian quadrature on panels combined with a special treatment of the weakly singular kernels arising in near-neighbor interactions. In time, a new class of convolution splines is used in a predictor-c… ▽ More We develop a high-order, explicit method for acoustic scattering in three space dimensions based on a combined-field time-domain integral equation. The spatial discretization, of Nyström type, uses Gaussian quadrature on panels combined with a special treatment of the weakly singular kernels arising in near-neighbor interactions. In time, a new class of convolution splines is used in a predictor-corrector algorithm. Experiments on a torus and a perturbed torus are used to explore the stability and accuracy of the proposed scheme. This involved around one thousand solver runs, at up to 8th order and up to around 20,000 spatial unknowns, demonstrating 5-9 digits of accuracy. In addition we show that parameters in the combined field formulation, chosen on the basis of analysis for the sphere and other convex scatterers, work well in these cases. △ Less

Submitted 29 March, 2019; originally announced April 2019.

Comments: 24 pages, 10 figures

MSC Class: 65R20; 65M38

Explicit unconditionally stable methods for the heat equation via potential theory

Authors: Alex H. Barnett, Charles L. Epstein, Leslie Greengard, Shidong Jiang, Jun Wang

Abstract: We study the stability properties of explicit marching schemes for second-kind Volterra integral equations that arise when solving boundary value problems for the heat equation by means of potential theory. It is well known that explicit finite difference or finite element schemes for the heat equation are stable only if the time step $Δt$ is of the order $O(Δx^2)$, where $Δx$ is the finest spatia… ▽ More We study the stability properties of explicit marching schemes for second-kind Volterra integral equations that arise when solving boundary value problems for the heat equation by means of potential theory. It is well known that explicit finite difference or finite element schemes for the heat equation are stable only if the time step $Δt$ is of the order $O(Δx^2)$, where $Δx$ is the finest spatial grid spacing. In contrast, for the Dirichlet and Neumann problems on the unit ball in all dimensions $d\ge 1$, we show that the simplest Volterra marching scheme, i.e., the forward Euler scheme, is unconditionally stable. Our proof is based on an explicit spectral radius bound of the marching matrix, leading to an estimate that an $L^2$-norm of the solution to the integral equation is bounded by $c_dT^{d/2}$ times the norm of the right hand side. For the Robin problem on the half space in any dimension, with constant Robin (heat transfer) coefficient $κ$, we exhibit a constant $C$ such that the forward Euler scheme is stable if $Δt < C/κ^2$, independent of any spatial discretization. This relies on new lower bounds on the spectrum of real symmetric Toeplitz matrices defined by convex sequences. Finally, we show that the forward Euler scheme is unconditionally stable for the Dirichlet problem on any smooth convex domain in any dimension, in $L^\infty$-norm. △ Less

Submitted 16 April, 2019; v1 submitted 22 February, 2019; originally announced February 2019.

Comments: 37 pages

MSC Class: 65M12; 65R20; 35K05; 45D05

Journal ref: Pure Appl. Analysis 1 (2019) 709-742

Transparent Boundary Conditions for the Time-Dependent Schrödinger Equation with a Vector Potential

Authors: Jason Kaye, Leslie Greengard

Abstract: We consider the problem of constructing transparent boundary conditions for the time-dependent Schrödinger equation with a compactly supported binding potential and, if desired, a spatially uniform, time-dependent electromagnetic vector potential. Such conditions prevent nonphysical boundary effects from corrupting a numerical solution in a bounded computational domain. We use ideas from potential… ▽ More We consider the problem of constructing transparent boundary conditions for the time-dependent Schrödinger equation with a compactly supported binding potential and, if desired, a spatially uniform, time-dependent electromagnetic vector potential. Such conditions prevent nonphysical boundary effects from corrupting a numerical solution in a bounded computational domain. We use ideas from potential theory to build exact nonlocal conditions for arbitrary piecewise-smooth domains. These generalize the standard Dirichlet-to-Neumann and Neumann-to-Dirichlet maps known for the equation in one dimension without a vector potential. When the vector potential is included, the condition becomes non-convolutional in time. For the one-dimensional problem, we propose a simple discretization scheme and a fast algorithm to accelerate the evaluation of the boundary condition. △ Less

Submitted 5 July, 2019; v1 submitted 10 December, 2018; originally announced December 2018.

Comments: 12 pages, 3 figures

MSC Class: 35Q41 (Primary) 45P05 (Secondary)

On the accurate evaluation of unsteady Stokes layer potentials in moving two-dimensional geometries

Authors: Leslie Greengard, Shidong Jiang, Jun Wang

Abstract: Two fundamental difficulties are encountered in the numerical evaluation of time-dependent layer potentials. One is the quadratic cost of history dependence, which has been successfully addressed by splitting the potentials into two parts - a local part that contains the most recent contributions and a history part that contains the contributions from all earlier times. The history part is smooth,… ▽ More Two fundamental difficulties are encountered in the numerical evaluation of time-dependent layer potentials. One is the quadratic cost of history dependence, which has been successfully addressed by splitting the potentials into two parts - a local part that contains the most recent contributions and a history part that contains the contributions from all earlier times. The history part is smooth, easily discretized using high-order quadratures, and straightforward to compute using a variety of fast algorithms. The local part, however, involves complicated singularities in the underlying Green's function. Existing methods, based on exchanging the order of integration in space and time, are able to achieve high order accuracy, but are limited to the case of stationary boundaries. Here, we present a new quadrature method that leaves the order of integration unchanged, making use of a change of variables that converts the singular integrals with respect to time into smooth ones. We have also derived asymptotic formulas for the local part that lead to fast and accurate hybrid schemes, extending earlier work for scalar heat potentials and applicable to moving boundaries. The performance of the overall scheme is demonstrated via numerical examples. △ Less

Submitted 5 November, 2018; originally announced November 2018.

A new mixed potential representation for the equations of unsteady, incompressible flow

Authors: Leslie Greengard, Shidong Jiang

Abstract: We present a new integral representation for the unsteady, incompressible Stokes or Navier-Stokes equations, based on a linear combination of heat and harmonic potentials. For velocity boundary conditions, this leads to a coupled system of integral equations: one for the normal component of velocity and one for the tangential components. Each individual equation is well-condtioned, and we show tha… ▽ More We present a new integral representation for the unsteady, incompressible Stokes or Navier-Stokes equations, based on a linear combination of heat and harmonic potentials. For velocity boundary conditions, this leads to a coupled system of integral equations: one for the normal component of velocity and one for the tangential components. Each individual equation is well-condtioned, and we show that using them in predictor-corrector fashion, combined with spectral deferred correction, leads to high-order accuracy solvers. The fundamental unknowns in the mixed potential representation are densities supported on the boundary of the domain. We refer to one as the vortex source, the other as the pressure source and the coupled system as the combined source integral equation. △ Less

Submitted 27 September, 2018; v1 submitted 22 September, 2018; originally announced September 2018.

Comments: 31 pages, 3 figures

MSC Class: 31A10; 31A35; 31B10; 31B35; 45F15; 65N80; 65R20; 76D05; 76D07

Geometry of the Phase Retrieval Problem

Authors: Alexander Barnett, Charles L. Epstein, Leslie Greengard, Jeremy Magland

Abstract: One of the most powerful approaches to imaging at the nanometer or subnanometer length scale is coherent diffraction imaging using X-ray sources. For amorphous (non-crystalline) samples, the raw data can be interpreted as the modulus of the continuous Fourier transform of the unknown object. Making use of prior information about the sample (such as its support), a natural goal is to recover the ph… ▽ More One of the most powerful approaches to imaging at the nanometer or subnanometer length scale is coherent diffraction imaging using X-ray sources. For amorphous (non-crystalline) samples, the raw data can be interpreted as the modulus of the continuous Fourier transform of the unknown object. Making use of prior information about the sample (such as its support), a natural goal is to recover the phase through computational means, after which the unknown object can be visualized at high resolution. While many algorithms have been proposed for this phase retrieval problem, careful analysis of its well-posedness has received relatively little attention. In this paper, we show that the problem is, in general, not well-posed and describe some of the underlying issues that are responsible for the ill-posedness. We then show how this analysis can be used to develop experimental protocols that lead to better conditioned inverse problems. △ Less

Submitted 1 April, 2020; v1 submitted 23 August, 2018; originally announced August 2018.

Comments: This is a substantial revision of version 1

MSC Class: 49N45; 94A08; 92C55; 94A12; 65R32; 65H99

Integral equation methods for electrostatics, acoustics and electromagnetics in smoothly varying, anisotropic media

Authors: Lise-Marie Imbert-Gerard, Felipe Vico, Leslie Greengard, Miguel Ferrando

Abstract: We present a collection of well-conditioned integral equation methods for the solution of electrostatic, acoustic or electromagnetic scattering problems involving anisotropic, inhomogeneous media. In the electromagnetic case, our approach involves a minor modification of a classical formulation. In the electrostatic or acoustic setting, we introduce a new vector partial differential equation, from… ▽ More We present a collection of well-conditioned integral equation methods for the solution of electrostatic, acoustic or electromagnetic scattering problems involving anisotropic, inhomogeneous media. In the electromagnetic case, our approach involves a minor modification of a classical formulation. In the electrostatic or acoustic setting, we introduce a new vector partial differential equation, from which the desired solution is easily obtained. It is the vector equation for which we derive a well-conditioned integral equation. In addition to providing a unified framework for these solvers, we illustrate their performance using iterative solution methods coupled with the FFT-based technique of [1] to discretize and apply the relevant integral operators. △ Less

Submitted 12 May, 2018; originally announced May 2018.

Comments: 25 pages, 3 figures

MSC Class: 31B10; 35Q60; 35Q61; 45B05; 65N80; 65R20; 65Z05

Hybrid asymptotic/numerical methods for the evaluation of layer heat potentials in two dimensions

Authors: Jun Wang, Leslie Greengard

Abstract: We present a hybrid asymptotic/numerical method for the accurate computation of single and double layer heat potentials in two dimensions. It has been shown in previous work that simple quadrature schemes suffer from a phenomenon called "geometrically-induced stiffness," meaning that formally high-order accurate methods require excessively small time steps before the rapid convergence rate is obse… ▽ More We present a hybrid asymptotic/numerical method for the accurate computation of single and double layer heat potentials in two dimensions. It has been shown in previous work that simple quadrature schemes suffer from a phenomenon called "geometrically-induced stiffness," meaning that formally high-order accurate methods require excessively small time steps before the rapid convergence rate is observed. This can be overcome by analytic integration in time, requiring the evaluation of a collection of spatial boundary integral operators with non-physical, weakly singular kernels. In our hybrid scheme, we combine a local asymptotic approximation with the evaluation of a few boundary integral operators involving only Gaussian kernels, which are easily accelerated by a new version of the fast Gauss transform. This new scheme is robust, avoids geometrically-induced stiffness, and is easy to use in the presence of moving geometries. Its extension to three dimensions is natural and straightforward, and should permit layer heat potentials to become flexible and powerful tools for modeling diffusion processes. △ Less

Submitted 20 March, 2018; originally announced March 2018.

Comments: 16 pages, 3 Figures

MSC Class: 31A10; 65R20; 65M12; 45D05; 45L05

An adaptive fast Gauss transform in two dimensions

Authors: Jun Wang, Leslie Greengard

Abstract: A variety of problems in computational physics and engineering require the convolution of the heat kernel (a Gaussian) with either discrete sources, densities supported on boundaries, or continuous volume distributions. We present a unified fast Gauss transform for this purpose in two dimensions, making use of an adaptive quad-tree discretization on a unit square which is assumed to contain all so… ▽ More A variety of problems in computational physics and engineering require the convolution of the heat kernel (a Gaussian) with either discrete sources, densities supported on boundaries, or continuous volume distributions. We present a unified fast Gauss transform for this purpose in two dimensions, making use of an adaptive quad-tree discretization on a unit square which is assumed to contain all sources. Our implementation permits either free-space or periodic boundary conditions to be imposed, and is efficient for any choice of variance in the Gaussian. △ Less

Submitted 1 December, 2017; originally announced December 2017.

Comments: 23 pages, 13 figures

MSC Class: 31A10; 35K10; 65R10; 65Y20

A fluctuating boundary integral method for Brownian suspensions

Authors: Yuanxun Bao, Manas Rachh, Eric Keaveny, Leslie Greengard, Aleksandar Donev

Abstract: We present a fluctuating boundary integral method (FBIM) for overdamped Brownian Dynamics (BD) of two-dimensional periodic suspensions of rigid particles of complex shape immersed in a Stokes fluid. We develop a novel approach for generating Brownian displacements that arise in response to the thermal fluctuations in the fluid. Our approach relies on a first-kind boundary integral formulation of a… ▽ More We present a fluctuating boundary integral method (FBIM) for overdamped Brownian Dynamics (BD) of two-dimensional periodic suspensions of rigid particles of complex shape immersed in a Stokes fluid. We develop a novel approach for generating Brownian displacements that arise in response to the thermal fluctuations in the fluid. Our approach relies on a first-kind boundary integral formulation of a mobility problem in which a random surface velocity is prescribed on the particle surface, with zero mean and covariance proportional to the Green's function for Stokes flow (Stokeslet). This approach yields an algorithm that scales linearly in the number of particles for both deterministic and stochastic dynamics, handles particles of complex shape, achieves high order of accuracy, and can be generalized to three dimensions and other boundary conditions. We show that Brownian displacements generated by our method obey the discrete fluctuation-dissipation balance relation (DFDB). Based on a recently-developed Positively Split Ewald method [A. M. Fiore, F. Balboa Usabiaga, A. Donev and J. W. Swan, J. Chem. Phys., 146, 124116, 2017], near-field contributions to the Brownian displacements are efficiently approximated by iterative methods in real space, while far-field contributions are rapidly generated by fast Fourier-space methods based on fluctuating hydrodynamics. FBIM provides the key ingredient for time integration of the overdamped Langevin equations for Brownian suspensions of rigid particles. We demonstrate that FBIM obeys DFDB by performing equilibrium BD simulations of suspensions of starfish-shaped bodies using a random finite difference temporal integrator. △ Less

Submitted 16 April, 2018; v1 submitted 5 September, 2017; originally announced September 2017.

Comments: Submitted to J. Comp. Phys

A high-order wideband direct solver for electromagnetic scattering from bodies of revolution

Authors: Charles L. Epstein, Leslie Greengard, Michael O'Neil

Abstract: The generalized Debye source representation of time-harmonic electromagnetic fields yields well-conditioned second-kind integral equations for a variety of boundary value problems, including the problems of scattering from perfect electric conductors and dielectric bodies. Furthermore, these representations, and resulting integral equations, are fully stable in the static limit as $ω\to 0$ in mult… ▽ More The generalized Debye source representation of time-harmonic electromagnetic fields yields well-conditioned second-kind integral equations for a variety of boundary value problems, including the problems of scattering from perfect electric conductors and dielectric bodies. Furthermore, these representations, and resulting integral equations, are fully stable in the static limit as $ω\to 0$ in multiply connected geometries. In this paper, we present the first high-order accurate solver based on this representation for bodies of revolution. The resulting solver uses a Nyström discretization of a one-dimensional generating curve and high-order integral equation methods for applying and inverting surface differentials. The accuracy and speed of the solvers are demonstrated in several numerical examples. △ Less

Submitted 15 February, 2019; v1 submitted 31 July, 2017; originally announced August 2017.

Rapid solution of the cryo-EM reconstruction problem by frequency marching

Authors: Alex Barnett, Leslie Greengard, Andras Pataki, Marina Spivak

Abstract: Determining the three-dimensional structure of proteins and protein complexes at atomic resolution is a fundamental task in structural biology. Over the last decade, remarkable progress has been made using "single particle" cryo-electron microscopy (cryo-EM) for this purpose. In cryo-EM, hundreds of thousands of two-dimensional images are obtained of individual copies of the same particle, each he… ▽ More Determining the three-dimensional structure of proteins and protein complexes at atomic resolution is a fundamental task in structural biology. Over the last decade, remarkable progress has been made using "single particle" cryo-electron microscopy (cryo-EM) for this purpose. In cryo-EM, hundreds of thousands of two-dimensional images are obtained of individual copies of the same particle, each held in a thin sheet of ice at some unknown orientation. Each image corresponds to the noisy projection of the particle's electron-scattering density. The reconstruction of a high-resolution image from this data is typically formulated as a nonlinear, non-convex optimization problem for unknowns which encode the angular pose and lateral offset of each particle. Since there are hundreds of thousands of such parameters, this leads to a very CPU-intensive task---limiting both the number of particle images which can be processed and the number of independent reconstructions which can be carried out for the purpose of statistical validation. Here, we propose a deterministic method for high-resolution reconstruction that operates in an ab initio manner---that is, without the need for an initial guess. It requires a predictable and relatively modest amount of computational effort, by marching out radially in the Fourier domain from low to high frequency, increasing the resolution by a fixed increment at each step. △ Less

Submitted 1 June, 2017; v1 submitted 3 October, 2016; originally announced October 2016.

Comments: 20 pages, 6 figures; to appear, SIAM J. Imaging Sciences

MSC Class: 92C55; 94A08; 65K10

A Fast Summation Method for Oscillatory Lattice Sums

Authors: Ryan Denlinger, Zydrunas Gimbutas, Leslie Greengard, Vladimir Rokhlin

Abstract: We present a fast summation method for lattice sums of the type which arise when solving wave scattering problems with periodic boundary conditions. While there are a variety of effective algorithms in the literature for such calculations, the approach presented here is new and leads to a rigorous analysis of Wood's anomalies. These arise when illuminating a grating at specific combinations of the… ▽ More We present a fast summation method for lattice sums of the type which arise when solving wave scattering problems with periodic boundary conditions. While there are a variety of effective algorithms in the literature for such calculations, the approach presented here is new and leads to a rigorous analysis of Wood's anomalies. These arise when illuminating a grating at specific combinations of the angle of incidence and the frequency of the wave, for which the lattice sums diverge. They were discovered by Wood in 1902 as singularities in the spectral response. The primary tools in our approach are the Euler-Maclaurin formula and a steepest descent argument. The resulting algorithm has super-algebraic convergence and requires only milliseconds of CPU time. △ Less

Submitted 28 September, 2016; v1 submitted 27 September, 2016; originally announced September 2016.

Comments: 22 pages, 4 figures

MSC Class: 31A10; 31B10; 33E20; 35P25; 65B10; 65B15; 65N80; 78M16; 78M25

High resolution inverse scattering in two dimensions using recursive linearization

Authors: Carlos Borges, Adrianna Gillman, Leslie Greengard

Abstract: We describe a fast, stable algorithm for the solution of the inverse acoustic scattering problem in two dimensions. Given full aperture far field measurements of the scattered field for multiple angles of incidence, we use Chen's method of recursive linearization to reconstruct an unknown sound speed at resolutions of thousands of square wavelengths in a fully nonlinear regime. Despite the fact th… ▽ More We describe a fast, stable algorithm for the solution of the inverse acoustic scattering problem in two dimensions. Given full aperture far field measurements of the scattered field for multiple angles of incidence, we use Chen's method of recursive linearization to reconstruct an unknown sound speed at resolutions of thousands of square wavelengths in a fully nonlinear regime. Despite the fact that the underlying optimization problem is formally ill-posed and non-convex, recursive linearization requires only the solution of a sequence of linear least squares problems at successively higher frequencies. By seeking a suitably band-limited approximation of the sound speed profile, each least squares calculation is well-conditioned and involves the solution of a large number of forward scattering problems, for which we employ a recently developed, spectrally accurate, fast direct solver. For the largest problems considered, involving 19,600 unknowns, approximately one million partial differential equations were solved, requiring approximately two days to compute using a parallel MATLAB implementation on a multi-core workstation. △ Less

Submitted 24 August, 2016; originally announced August 2016.

Comments: 21 pages, 9 figures, 3 tables

Pseudo-spectral methods for the Laplace-Beltrami equation and the Hodge decomposition on surfaces of genus one

Authors: Lise-Marie Imbert-Gerard, Leslie Greengard

Abstract: The inversion of the Laplace-Beltrami operator and the computation of the Hodge decomposition of a tangential vector field on smooth surfaces arise as computational tasks in many areas of science, from computer graphics to machine learning to com- putational physics. Here, we present a high-order accurate pseudo-spectral approach, applicable to closed surfaces of genus one in three dimensional spa… ▽ More The inversion of the Laplace-Beltrami operator and the computation of the Hodge decomposition of a tangential vector field on smooth surfaces arise as computational tasks in many areas of science, from computer graphics to machine learning to com- putational physics. Here, we present a high-order accurate pseudo-spectral approach, applicable to closed surfaces of genus one in three dimensional space, with a view toward applications in plasma physics and fluid dynamics. △ Less

Submitted 28 September, 2016; v1 submitted 15 August, 2016; originally announced August 2016.

An integral equation formulation for rigid bodies in Stokes flow in three dimensions

Authors: Eduardo Corona, Leslie Greengard, Manas Rachh, Shravan Veerapaneni

Abstract: We present a new derivation of a boundary integral equation (BIE) for simulating the three-dimensional dynamics of arbitrarily-shaped rigid particles of genus zero immersed in a Stokes fluid, on which are prescribed forces and torques. Our method is based on a single-layer representation and leads to a simple second-kind integral equation. It avoids the use of auxiliary sources within each particl… ▽ More We present a new derivation of a boundary integral equation (BIE) for simulating the three-dimensional dynamics of arbitrarily-shaped rigid particles of genus zero immersed in a Stokes fluid, on which are prescribed forces and torques. Our method is based on a single-layer representation and leads to a simple second-kind integral equation. It avoids the use of auxiliary sources within each particle that play a role in some classical formulations. We use a spectrally accurate quadrature scheme to evaluate the corresponding layer potentials, so that only a small number of spatial discretization points per particle are required. The resulting discrete sums are computed in $\mathcal{O}(n)$ time, where $n$ denotes the number of particles, using the fast multipole method (FMM). The particle positions and orientations are updated by a high-order time-stepping scheme. We illustrate the accuracy, conditioning and scaling of our solvers with several numerical examples. △ Less

Submitted 22 June, 2016; originally announced June 2016.

Robust integral formulations for electromagnetic scattering from three-dimensional cavities

Authors: Jun Lai, Leslie Greengard, Michael O'Neil

Abstract: Scattering from large, open cavity structures is of importance in a variety of electromagnetic applications. In this paper, we propose a new well conditioned integral equation for scattering from general open cavities embedded in an infinite, perfectly conducting half-space. The integral representation permits the stable evaluation of both the electric and magnetic field, even in the low-frequency… ▽ More Scattering from large, open cavity structures is of importance in a variety of electromagnetic applications. In this paper, we propose a new well conditioned integral equation for scattering from general open cavities embedded in an infinite, perfectly conducting half-space. The integral representation permits the stable evaluation of both the electric and magnetic field, even in the low-frequency regime, using the continuity equation in a post-processing step. We establish existence and uniqueness results, and demonstrate the performance of the scheme in the cavity-of-revolution case. High-order accuracy is obtained using a Nystrom discretization with generalized Gaussian quadratures. △ Less

Submitted 11 June, 2016; originally announced June 2016.

Fast convolution with free-space Green's functions

Authors: Felipe Vico, Leslie Greengard, Miguel Ferrando

Abstract: We introduce a fast algorithm for computing volume potentials - that is, the convolution of a translation invariant, free-space Green's function with a compactly supported source distribution defined on a uniform grid. The algorithm relies on regularizing the Fourier transform of the Green's function by cutting off the interaction in physical space beyond the domain of interest. This permits the s… ▽ More We introduce a fast algorithm for computing volume potentials - that is, the convolution of a translation invariant, free-space Green's function with a compactly supported source distribution defined on a uniform grid. The algorithm relies on regularizing the Fourier transform of the Green's function by cutting off the interaction in physical space beyond the domain of interest. This permits the straightforward application of trapezoidal quadrature and the standard FFT, with superalgebraic convergence for smooth data. Moreover, the method can be interpreted as employing a Nystrom discretization of the corresponding integral operator, with matrix entries which can be obtained explicitly and rapidly. This is of use in the design of preconditioners or fast direct solvers for a variety of volume integral equations. The method proposed permits the computation of any derivative of the potential, at the cost of an additional FFT. △ Less

Submitted 11 April, 2016; originally announced April 2016.

Comments: 21 pages, 10 Figures, 7 Tables

MSC Class: 31A10; 31A30; 31B10; 35J05; 44A35; 65N80; 65R10

Integral equation methods for elastance and mobility problems in two dimensions

Authors: Manas Rachh, Leslie Greengard

Abstract: We present new integral representations in two dimensions for the elastance problem in electrostatics and the mobility problem in Stokes flow. These representations lead to resonance-free Fredholm integral equations of the second kind and well conditioned linear systems upon discretization. By coupling our integral equations with high order quadrature and fast multipole acceleration, large-scale p… ▽ More We present new integral representations in two dimensions for the elastance problem in electrostatics and the mobility problem in Stokes flow. These representations lead to resonance-free Fredholm integral equations of the second kind and well conditioned linear systems upon discretization. By coupling our integral equations with high order quadrature and fast multipole acceleration, large-scale problems can be solved with only modest computing resources. We also discuss some applications of these boundary value problems in applied physics. △ Less

Submitted 21 July, 2015; originally announced July 2015.

Comments: 38 pages, 11 figures

A new hybrid integral representation for frequency domain scattering in layered media

Authors: Jun Lai, Leslie Greengard, Michael O'Neil

Abstract: A variety of problems in acoustic and electromagnetic scattering require the evaluation of impedance or layered media Green's functions. Given a point source located in an unbounded half-space or an infinitely extended layer, Sommerfeld and others showed that Fourier analysis combined with contour integration provides a systematic and broadly effective approach, leading to what is generally referr… ▽ More A variety of problems in acoustic and electromagnetic scattering require the evaluation of impedance or layered media Green's functions. Given a point source located in an unbounded half-space or an infinitely extended layer, Sommerfeld and others showed that Fourier analysis combined with contour integration provides a systematic and broadly effective approach, leading to what is generally referred to as the Sommerfeld integral representation. When either the source or target is at some distance from an infinite boundary, the number of degrees of freedom needed to resolve the scattering response is very modest. When both are near an interface, however, the Sommerfeld integral involves a very large range of integration and its direct application becomes unwieldy. Historically, three schemes have been employed to overcome this difficulty: the method of images, contour deformation, and asymptotic methods of various kinds. None of these methods make use of classical layer potentials in physical space, despite their advantages in terms of adaptive resolution and high-order accuracy. The reason for this is simple: layer potentials are impractical in layered media or half-space geometries since they require the discretization of an infinite boundary. In this paper, we propose a hybrid method which combines layer potentials (physical-space) on a finite portion of the interface together with a Sommerfeld-type (Fourier) correction. We prove that our method is efficient and rapidly convergent for arbitrarily located sources and targets, and show that the scheme is particularly effective when solving scattering problems for objects which are close to the half-space boundary or even embedded across a layered media interface. △ Less

Submitted 22 July, 2015; v1 submitted 13 July, 2015; originally announced July 2015.

Fast, adaptive, high order accurate discretization of the Lippmann-Schwinger equation in two dimension

Authors: Sivaram Ambikasaran, Carlos Borges, Lise-Marie Imbert-Gerard, Leslie Greengard

Abstract: We present a fast direct solver for two dimensional scattering problems, where an incident wave impinges on a penetrable medium with compact support. We represent the scattered field using a volume potential whose kernel is the outgoing Green's function for the exterior domain. Inserting this representation into the governing partial differential equation, we obtain an integral equation of the Lip… ▽ More We present a fast direct solver for two dimensional scattering problems, where an incident wave impinges on a penetrable medium with compact support. We represent the scattered field using a volume potential whose kernel is the outgoing Green's function for the exterior domain. Inserting this representation into the governing partial differential equation, we obtain an integral equation of the Lippmann-Schwinger type. The principal contribution here is the development of an automatically adaptive, high-order accurate discretization based on a quad tree data structure which provides rapid access to arbitrary elements of the discretized system matrix. This permits the straightforward application of state-of-the-art algorithms for constructing compressed versions of the solution operator. These solvers typically require $O(N^{3/2})$ work, where $N$ denotes the number of degrees of freedom. We demonstrate the performance of the method for a variety of problems in both the low and high frequency regimes. △ Less

Submitted 26 May, 2015; originally announced May 2015.

Comments: 18 pages

MSC Class: 65R20

On the stability of time-domain integral equations for acoustic wave propagation

Authors: Charles L. Epstein, Leslie Greengard, Thomas Hagstrom

Abstract: We give a principled approach for the selection of a boundary integral, retarded potential representation for the solution of scattering problems for the wave equation in an exterior domain. We give a principled approach for the selection of a boundary integral, retarded potential representation for the solution of scattering problems for the wave equation in an exterior domain. △ Less

Submitted 15 April, 2015; originally announced April 2015.

Comments: 6 figures, 19 pages

MSC Class: 65M80; 31B10; 35P25; 35L20

Inverse Obstacle scattering in two dimensions with multiple frequency data and multiple angles of incidence

Authors: Carlos Borges, Leslie Greengard

Abstract: We consider the problem of reconstructing the shape of an impenetrable sound-soft obstacle from scattering measurements. The input data is assumed to be the far-field pattern generated when a plane wave impinges on an unknown obstacle from one or more directions and at one or more frequencies. It is well known that this inverse scattering problem is both ill posed and nonlinear. It is common pract… ▽ More We consider the problem of reconstructing the shape of an impenetrable sound-soft obstacle from scattering measurements. The input data is assumed to be the far-field pattern generated when a plane wave impinges on an unknown obstacle from one or more directions and at one or more frequencies. It is well known that this inverse scattering problem is both ill posed and nonlinear. It is common practice to overcome the ill posedness through the use of a penalty method or Tikhonov regularization. Here, we present a more physical regularization, based simply on restricting the unknown boundary to be band-limited in a suitable sense. To overcome the nonlinearity of the problem, we use a variant of Newton's method. When multiple frequency data is available, we supplement Newton's method with the recursive linearization approach due to Chen. During the course of solving the inverse problem, we need to compute the solution to a large number of forward scattering problems. For this, we use high-order accurate integral equation discretizations, coupled with fast direct solvers when the problem is sufficiently large. △ Less

Submitted 22 August, 2014; originally announced August 2014.

Comments: 20 pages, 1 table, 16 figures

MSC Class: 35R30 49N45

A fast solver for multi-particle scattering in a layered medium

Authors: Jun Lai, Motoki Kobayashi, Leslie Greengard

Abstract: In this paper, we consider acoustic or electromagnetic scattering in two dimensions from an infinite three-layer medium with thousands of wavelength-size dielectric particles embedded in the middle layer. Such geometries are typical of microstructured composite materials, and the evaluation of the scattered field requires a suitable fast solver for either a single configuration or for a sequence o… ▽ More In this paper, we consider acoustic or electromagnetic scattering in two dimensions from an infinite three-layer medium with thousands of wavelength-size dielectric particles embedded in the middle layer. Such geometries are typical of microstructured composite materials, and the evaluation of the scattered field requires a suitable fast solver for either a single configuration or for a sequence of configurations as part of a design or optimization process. We have developed an algorithm for problems of this type by combining the Sommerfeld integral representation, high order integral equation discretization, the fast multipole method and classical multiple scattering theory. The efficiency of the solver is illustrated with several numerical experiments. △ Less

Submitted 14 July, 2014; originally announced July 2014.

A fast direct solver for high frequency scattering from a large cavity in two dimensions

Authors: Jun Lai, Sivaram Ambikasaran, Leslie F. Greengard

Abstract: We present a fast direct solver for the simulation of electromagnetic scattering from an arbitrarily-shaped, large, empty cavity embedded in an infinite perfectly conducting half space. The governing Maxwell equations are reformulated as a well-conditioned second kind integral equation and the resulting linear system is solved in nearly linear time using a hierarchical matrix factorization techniq… ▽ More We present a fast direct solver for the simulation of electromagnetic scattering from an arbitrarily-shaped, large, empty cavity embedded in an infinite perfectly conducting half space. The governing Maxwell equations are reformulated as a well-conditioned second kind integral equation and the resulting linear system is solved in nearly linear time using a hierarchical matrix factorization technique. We illustrate the performance of the scheme with several numerical examples for complex cavity shapes over a wide range of frequencies. △ Less

Submitted 13 April, 2014; originally announced April 2014.

Comments: 15 pages, 9 figures. Contact author for animation

MSC Class: 97N40; 65F05; 45B05; 45A05 ACM Class: G.1; G.1.3

Visualizing Skin Effects in Conductors with MRI: ${}^7$Li MRI Experiments and Calculations

Authors: Andrew J. Ilott, S. Chandrashekar, Andreas Klöckner, Hee Jung Chang, Nicole M. Trease, Clare P. Grey, Leslie Greengard, Alexej Jerschow

Abstract: While experiments on metals have been performed since the early days of NMR (and DNP), the use of bulk metal is normally avoided. Instead, often powders have been used in combination with low fields, so that skin depth effects could be neglected. Another complicating factor of acquiring NMR spectra or MRI images of bulk metal is the strong signal dependence on the orientation between the sample an… ▽ More While experiments on metals have been performed since the early days of NMR (and DNP), the use of bulk metal is normally avoided. Instead, often powders have been used in combination with low fields, so that skin depth effects could be neglected. Another complicating factor of acquiring NMR spectra or MRI images of bulk metal is the strong signal dependence on the orientation between the sample and the radio frequency (RF) coil, leading to non-intuitive image distortions and inaccurate quantification. Such factors are particularly important for NMR and MRI of batteries and other electrochemical devices. Here, we show results from a systematic study combining RF field calculations with experimental MRI of $^7$Li metal to visualize skin depth effects directly and to analyze the RF field orientation effect on MRI of bulk metal. It is shown that a certain degree of selectivity can be achieved for particular faces of the metal, simply based on the orientation of the sample. By combining RF field calculations with bulk magnetic susceptibility calculations accurate NMR spectra can be obtained from first principles. Such analyses will become valuable in many applications involving battery systems, but also metals, in general. △ Less

Submitted 24 March, 2014; originally announced March 2014.

Journal ref: Journal of Magnetic Resonance (2014), pp. 143-149

Fast Direct Methods for Gaussian Processes

Authors: Sivaram Ambikasaran, Daniel Foreman-Mackey, Leslie Greengard, David W. Hogg, Michael O'Neil

Abstract: A number of problems in probability and statistics can be addressed using the multivariate normal (Gaussian) distribution. In the one-dimensional case, computing the probability for a given mean and variance simply requires the evaluation of the corresponding Gaussian density. In the $n$-dimensional setting, however, it requires the inversion of an $n \times n$ covariance matrix, $C$, as well as t… ▽ More A number of problems in probability and statistics can be addressed using the multivariate normal (Gaussian) distribution. In the one-dimensional case, computing the probability for a given mean and variance simply requires the evaluation of the corresponding Gaussian density. In the $n$-dimensional setting, however, it requires the inversion of an $n \times n$ covariance matrix, $C$, as well as the evaluation of its determinant, $\det(C)$. In many cases, such as regression using Gaussian processes, the covariance matrix is of the form $C = σ^2 I + K$, where $K$ is computed using a specified covariance kernel which depends on the data and additional parameters (hyperparameters). The matrix $C$ is typically dense, causing standard direct methods for inversion and determinant evaluation to require $\mathcal O(n^3)$ work. This cost is prohibitive for large-scale modeling. Here, we show that for the most commonly used covariance functions, the matrix $C$ can be hierarchically factored into a product of block low-rank updates of the identity matrix, yielding an $\mathcal O (n\log^2 n) $ algorithm for inversion. More importantly, we show that this factorization enables the evaluation of the determinant $\det(C)$, permitting the direct calculation of probabilities in high dimensions under fairly broad assumptions on the kernel defining $K$. Our fast algorithm brings many problems in marginalization and the adaptation of hyperparameters within practical reach using a single CPU core. The combination of nearly optimal scaling in terms of problem size with high-performance computing resources will permit the modeling of previously intractable problems. We illustrate the performance of the scheme on standard covariance kernels. △ Less

Submitted 4 April, 2015; v1 submitted 24 March, 2014; originally announced March 2014.

Randomized methods for rank-deficient linear systems

Authors: Josef Sifuentes, Zydrunas Gimbutas, Leslie Greengard

Abstract: We present a simple, accurate method for solving consistent, rank-deficient linear systems, with or without addi- tional rank-completing constraints. Such problems arise in a variety of applications, such as the computation of the eigenvectors of a matrix corresponding to a known eigenvalue. The method is based on elementary linear algebra combined with the ob- servation that if the matrix is rank… ▽ More We present a simple, accurate method for solving consistent, rank-deficient linear systems, with or without addi- tional rank-completing constraints. Such problems arise in a variety of applications, such as the computation of the eigenvectors of a matrix corresponding to a known eigenvalue. The method is based on elementary linear algebra combined with the ob- servation that if the matrix is rank-k deficient, then a random rank-k perturbation yields a nonsingular matrix with probability 1. △ Less

Submitted 13 January, 2014; originally announced January 2014.

Fast and Accurate Evaluation of Nonlocal Coulomb and Dipole-Dipole Interactions via the Nonuniform FFT

Authors: Shidong Jiang, Leslie Greengard, Weizhu Bao

Abstract: We present a fast and accurate algorithm for the evaluation of nonlocal (long-range) Coulomb and dipole-dipole interactions in free space. The governing potential is simply the convolution of an interaction kernel $U(\bx)$ and a density function $ρ(\bx)=|ψ(\bx)|^2$, for some complex-valued wave function $ψ(\bx)$, permitting the formal use of Fourier methods. These are hampered by the fact that the… ▽ More We present a fast and accurate algorithm for the evaluation of nonlocal (long-range) Coulomb and dipole-dipole interactions in free space. The governing potential is simply the convolution of an interaction kernel $U(\bx)$ and a density function $ρ(\bx)=|ψ(\bx)|^2$, for some complex-valued wave function $ψ(\bx)$, permitting the formal use of Fourier methods. These are hampered by the fact that the Fourier transform of the interaction kernel $\widehat{U}(\bk)$ has a singularity at the origin $\bk={\bf 0}$ in Fourier (phase) space. Thus, accuracy is lost when using a uniform Cartesian grid in $\bk$ which would otherwise permit the use of the FFT for evaluating the convolution. Here, we make use of a high-order discretization of the Fourier integral, accelerated by the nonuniform fast Fourier transform (NUFFT). By adopting spherical and polar phase-space discretizations in three and two dimensions, respectively, the singularity in $\hat{U}(\bk)$ at the origin is canceled, so that only a modest number of degrees of freedom are required to evaluate the Fourier integral, assuming that the density function $ρ(\bx)$ is smooth and decays sufficiently fast as $\bx \rightarrow \infty$. More precisely, the calculation requires $O(N\log N)$ operations, where $N$ is the total number of discretization points in the computational domain. Numerical examples are presented to demonstrate the performance of the algorithm. △ Less

Submitted 5 January, 2014; v1 submitted 17 November, 2013; originally announced November 2013.

Comments: 17 pages, 0 figure

MSC Class: 33C10; 33F05; 44A35; 65R10; 65T50; 81Q40

Journal ref: SIAM J. Sci. Comput., Vol. 36, pp. B777-B794, 2014

Debye Sources, Beltrami Fields, and a Complex Structure on Maxwell Fields

Authors: Charles L. Epstein, Leslie Greengard, Michael O'Neil

Abstract: The Debye source representation for solutions to the time harmonic Maxwell equations is extended to bounded domains with finitely many smooth boundary components. A strong uniqueness result is proved for this representation. Natural complex structures are identified on the vector spaces of time-harmonic Maxwell fields. It is shown that in terms of Debye source data, these complex structures are un… ▽ More The Debye source representation for solutions to the time harmonic Maxwell equations is extended to bounded domains with finitely many smooth boundary components. A strong uniqueness result is proved for this representation. Natural complex structures are identified on the vector spaces of time-harmonic Maxwell fields. It is shown that in terms of Debye source data, these complex structures are uniformized, that is, represented by a fixed linear map on a fixed vector space, independent of the frequency. This complex structure relates time-harmonic Maxwell fields to constant-k Beltrami fields, i.e. solutions of the equation curl(E) = kE. A family of self-adjoint boundary conditions are defined for the Beltrami operator. This leads to a proof of the existence of zero-flux, constant-k, force-free Beltrami fields for any bounded region in R^3, as well as a constructive method to find them. The family of self-adjoint boundary value problems defines a new spectral invariant for bounded domains in R^3. △ Less

Submitted 25 August, 2013; originally announced August 2013.