-
Mixed-Precision in High-Order Methods: the Impact of Floating-Point Precision on the ADER-DG Algorithm
Authors:
Marc Marot-Lassauzaie,
Michael Bader
Abstract:
We present a mixed-precision implementation of the high-order discontinuous Galerkin method with ADER time stepping (ADER-DG) for solving hyperbolic systems of partial differential equations (PDEs) in the hyperbolic PDE engine ExaHyPE. The implementation provides a simple API extension for specifying the numerical precision for individual kernels, and thus allows for testing the effect of low and…
▽ More
We present a mixed-precision implementation of the high-order discontinuous Galerkin method with ADER time stepping (ADER-DG) for solving hyperbolic systems of partial differential equations (PDEs) in the hyperbolic PDE engine ExaHyPE. The implementation provides a simple API extension for specifying the numerical precision for individual kernels, and thus allows for testing the effect of low and mixed precision on the accuracy of the solution. To showcase this, we study the impact of precision on the overall convergence order and actual accuracy of the method as achieved for four common hyperbolic PDE systems and five relevant scenarios that feature an analytic solution. For all scenarios, we also assess how sensitive each kernel of the ADER-DG algorithm is to using double, single or even half precision. This addresses the question where thoughtful adoption of mixed precision can mitigate hurtful effects of low precision on the overall simulation.
△ Less
Submitted 9 April, 2025;
originally announced April 2025.
-
Superstep wavefield propagation
Authors:
Tamas Nemeth,
Kurt Nihei,
Alex Loddoch,
Anusha Sekar,
Ken Bube,
John Washbourne,
Luke Decker,
Sam Kaplan,
Chunling Wu,
Andrey Shabelansky,
Milad Bader,
Ovidiu Cristea,
Ziyi Yin
Abstract:
This paper describes how to propagate wavefields for arbitrary numbers of traditional time steps in a single step, called a superstep. We show how to construct operators that accomplish this task for finite-difference time domain schemes, including temporal first-order schemes in isotropic, anisotropic and elastic media, as well as temporal second-order schemes for acoustic media. This task is ach…
▽ More
This paper describes how to propagate wavefields for arbitrary numbers of traditional time steps in a single step, called a superstep. We show how to construct operators that accomplish this task for finite-difference time domain schemes, including temporal first-order schemes in isotropic, anisotropic and elastic media, as well as temporal second-order schemes for acoustic media. This task is achieved by implementing a computational tradeoff differing from traditional single step wavefield propagators by precomputing propagator matrices for each model location for k timesteps (a superstep) and using these propagator matrices to advance the wavefield k time steps at once. This tradeoff separates the physics of the propagator matrix computation from the computer science of wavefield propagation and allows each discipline to provide their optimal modular solutions.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
High Performance Uncertainty Quantification with Parallelized Multilevel Markov Chain Monte Carlo
Authors:
Linus Seelinger,
Anne Reinarz,
Leonhard Rannabauer,
Michael Bader,
Peter Bastian,
Robert Scheichl
Abstract:
Numerical models of complex real-world phenomena often necessitate High Performance Computing (HPC). Uncertainties increase problem dimensionality further and pose even greater challenges.
We present a parallelization strategy for multilevel Markov chain Monte Carlo, a state-of-the-art, algorithmically scalable Uncertainty Quantification (UQ) algorithm for Bayesian inverse problems, and a new so…
▽ More
Numerical models of complex real-world phenomena often necessitate High Performance Computing (HPC). Uncertainties increase problem dimensionality further and pose even greater challenges.
We present a parallelization strategy for multilevel Markov chain Monte Carlo, a state-of-the-art, algorithmically scalable Uncertainty Quantification (UQ) algorithm for Bayesian inverse problems, and a new software framework allowing for large-scale parallelism across forward model evaluations and the UQ algorithms themselves. The main scalability challenge presents itself in the form of strong data dependencies introduced by the MLMCMC method, prohibiting trivial parallelization.
Our software is released as part of the modular and open-source MIT UQ Library (MUQ), and can easily be coupled with arbitrary user codes. We demonstrate it using the DUNE and the ExaHyPE Engine. The latter provides a realistic, large-scale tsunami model in which identify the source of a tsunami from buoy-elevation data.
△ Less
Submitted 30 July, 2021;
originally announced July 2021.
-
A stable discontinuous Galerkin method for the perfectly matched layer for elastodynamics in first order form
Authors:
Kenneth Duru,
Leonhard Rannabauer,
Alice-Agnes Gabriel,
Gunilla Kreiss,
Michael Bader
Abstract:
We present a stable discontinuous Galerkin (DG) method with a perfectly matched layer (PML) for three and two space dimensional linear elastodynamics, in velocity-stress formulation, subject to well-posed linear boundary conditions. First, we consider the elastodynamics equation, in a cuboidal domain, and derive an unsplit PML truncating the domain using complex coordinate stretching. Leveraging t…
▽ More
We present a stable discontinuous Galerkin (DG) method with a perfectly matched layer (PML) for three and two space dimensional linear elastodynamics, in velocity-stress formulation, subject to well-posed linear boundary conditions. First, we consider the elastodynamics equation, in a cuboidal domain, and derive an unsplit PML truncating the domain using complex coordinate stretching. Leveraging the hyperbolic structure of the underlying system, we construct continuous energy estimates, in the time domain for the elastic wave equation, and in the Laplace space for a sequence of PML model problems, with variations in one, two and three space dimensions, respectively. They correspond to PMLs normal to boundary faces, along edges and in corners. Second, we develop a DG numerical method for the linear elastodynamics equation using physically motivated numerical flux and penalty parameters, which are compatible with all well-posed, internal and external, boundary conditions. When the PML damping vanishes, by construction, our choice of penalty parameters yield an upwind scheme and a discrete energy estimate analogous to the continuous energy estimate. Third, to ensure numerical stability of the discretization when PML damping is present, it is necessary to extend the numerical DG fluxes, and the numerical inter-element and boundary procedures, to the PML auxiliary differential equations. This is crucial for deriving discrete energy estimates analogous to the continuous energy estimates. By combining the DG spatial approximation with the high order ADER time stepping scheme and the accuracy of the PML we obtain an arbitrarily accurate wave propagation solver in the time domain. Numerical experiments are presented in two and three space dimensions corroborating the theoretical results.
△ Less
Submitted 6 January, 2020; v1 submitted 14 October, 2019;
originally announced October 2019.
-
A stable discontinuous Galerkin method for linear elastodynamics in 3D geometrically complex media using physics based numerical fluxes
Authors:
Kenneth Duru,
Leonhard Rannabauer,
Alice-Agnes Gabriel,
On Ki Angel Ling,
Heiner Igel,
Michael Bader
Abstract:
High order accurate and explicit time-stable solvers are well suited for hyperbolic wave propagation problems. As a result of the complexities of real geometries, internal interfaces and nonlinear boundary and interface conditions, discontinuities and sharp wave fronts may become fundamental features of the solution. Thus, geometrically flexible and adaptive numerical algorithms are critical for h…
▽ More
High order accurate and explicit time-stable solvers are well suited for hyperbolic wave propagation problems. As a result of the complexities of real geometries, internal interfaces and nonlinear boundary and interface conditions, discontinuities and sharp wave fronts may become fundamental features of the solution. Thus, geometrically flexible and adaptive numerical algorithms are critical for high fidelity and efficient simulations of wave phenomena in many applications. Adaptive curvilinear meshes hold promise to minimise the effort to represent complicated geometries or heterogeneous material data avoiding the bottleneck of feature-preserving meshing. To enable the design of stable DG methods on three space dimensional (3D) curvilinear elements we construct a structure preserving anti-symmetric coordinate transformation motivated by the underlying physics. Using a physics-based numerical penalty-flux, we develop a 3D provably energy-stable discontinuous Galerkin finite element approximation of the elastic wave equation in geometrically complex and heterogenous media. By construction, our numerical flux is upwind and yields a discrete energy estimate analogous to the continuous energy estimate. The ability to treat conforming and non-conforming curvilinear elements allows for flexible adaptive mesh refinement strategies. The numerical scheme has been implemented in ExaHyPE, a simulation engine for parallel dynamically adaptive simulations of wave problems on adaptive Cartesian meshes. We present 3D numerical experiments of wave propagation in heterogeneous isotropic and anisotropic elastic solids demonstrating stability and high order accuracy. We demonstrate the potential of our approach for computational seismology in a regional wave propagation scenario in a geologically constrained 3D model including the geometrically complex free-surface topography of Mount Zugspitze, Germany.
△ Less
Submitted 10 April, 2021; v1 submitted 4 July, 2019;
originally announced July 2019.
-
ExaHyPE: An Engine for Parallel Dynamically Adaptive Simulations of Wave Problems
Authors:
Anne Reinarz,
Dominic E. Charrier,
Michael Bader,
Luke Bovard,
Michael Dumbser,
Kenneth Duru,
Francesco Fambri,
Alice-Agnes Gabriel,
Jean-Matthieu Gallard,
Sven Köppel,
Lukas Krenz,
Leonhard Rannabauer,
Luciano Rezzolla,
Philipp Samfass,
Maurizio Tavelli,
Tobias Weinzierl
Abstract:
ExaHyPE ("An Exascale Hyperbolic PDE Engine") is a software engine for solving systems of first-order hyperbolic partial differential equations (PDEs). Hyperbolic PDEs are typically derived from the conservation laws of physics and are useful in a wide range of application areas. Applications powered by ExaHyPE can be run on a student's laptop, but are also able to exploit thousands of processor c…
▽ More
ExaHyPE ("An Exascale Hyperbolic PDE Engine") is a software engine for solving systems of first-order hyperbolic partial differential equations (PDEs). Hyperbolic PDEs are typically derived from the conservation laws of physics and are useful in a wide range of application areas. Applications powered by ExaHyPE can be run on a student's laptop, but are also able to exploit thousands of processor cores on state-of-the-art supercomputers. The engine is able to dynamically increase the accuracy of the simulation using adaptive mesh refinement where required. Due to the robustness and shock capturing abilities of ExaHyPE's numerical methods, users of the engine can simulate linear and non-linear hyperbolic PDEs with very high accuracy. Users can tailor the engine to their particular PDE by specifying evolved quantities, fluxes, and source terms. A complete simulation code for a new hyperbolic PDE can often be realised within a few hours - a task that, traditionally, can take weeks, months, often years for researchers starting from scratch. In this paper, we showcase ExaHyPE's workflow and capabilities through real-world scenarios from our two main application areas: seismology and astrophysics.
△ Less
Submitted 18 May, 2020; v1 submitted 20 May, 2019;
originally announced May 2019.
-
Efficient implementation of ADER discontinuous Galerkin schemes for a scalable hyperbolic PDE engine
Authors:
Michael Dumbser,
Francesco Fambri,
Maurizio Tavelli,
Michael Bader,
Tobias Weinzierl
Abstract:
In this paper we discuss a new and very efficient implementation of high order accurate ADER discontinuous Galerkin (ADER-DG) finite element schemes on modern massively parallel supercomputers. The numerical methods apply to a very broad class of nonlinear systems of hyperbolic partial differential equations. ADER-DG schemes are by construction communication avoiding and cache blocking and are fur…
▽ More
In this paper we discuss a new and very efficient implementation of high order accurate ADER discontinuous Galerkin (ADER-DG) finite element schemes on modern massively parallel supercomputers. The numerical methods apply to a very broad class of nonlinear systems of hyperbolic partial differential equations. ADER-DG schemes are by construction communication avoiding and cache blocking and are furthermore very well-suited for vectorization, so that they appear to be a good candidate for the future generation of exascale supercomputers. We introduce the numerical algorithm and show some applications to a set of hyperbolic equations with increasing level of complexity, ranging from the compressible Euler equations over the equations of linear elasticity and the unified Godunov-Peshkov-Romenski (GPR) model of continuum mechanics to general relativistic magnetohydrodynamics (GRMHD) and the Einstein field equations of general relativity. We present strong scaling results of the new ADER-DG schemes up to 180,000 CPU cores. To our knowledge, these are the largest runs ever carried out with high order ADER-DG schemes for nonlinear hyperbolic PDE systems. We also provide a detailed performance comparison with traditional Runge-Kutta DG schemes.
△ Less
Submitted 11 August, 2018;
originally announced August 2018.
-
A simple diffuse interface approach on adaptive Cartesian grids for the linear elastic wave equations with complex topography
Authors:
Maurizio Tavelli,
Michael Dumbser,
Dominic Etienne Charrier,
Leonhard Rannabauer,
Tobias Weinzierl,
Michael Bader
Abstract:
In most classical approaches of computational geophysics for seismic wave propagation problems, complex surface topography is either accounted for by boundary-fitted unstructured meshes, or, where possible, by mapping the complex computational domain from physical space to a topologically simple domain in a reference coordinate system. In this paper we propose a completely different strategy. We a…
▽ More
In most classical approaches of computational geophysics for seismic wave propagation problems, complex surface topography is either accounted for by boundary-fitted unstructured meshes, or, where possible, by mapping the complex computational domain from physical space to a topologically simple domain in a reference coordinate system. In this paper we propose a completely different strategy. We address the problem of geometrically complex free surface boundary conditions with a novel diffuse interface method on adaptive Cartesian meshes that consists in the introduction of a characteristic function $ 0\leqα\leq 1$ which identifies the location of the solid medium and the surrounding air and thus implicitly defines the location of the free surface boundary. Our new approach completely avoids the problem of mesh generation, since all that is needed for the definition of the complex surface topography is to set a scalar color function to unity inside the regions covered by the solid and to zero outside. An analysis of the eigenvalues of the PDE system shows that the complexity of the geometry has no influence on the admissible time step size due to the CFL condition. The model reduces to the classical linear elasticity equations inside the solid medium where the gradients of $α$ are zero, while in the diffuse interface zone at the free surface boundary the governing PDE system becomes nonlinear. We can prove that the solution of the Riemann problem with arbitrary data and a jump in $α$ from unity to zero yields a Godunov-state at the interface that satisfies the free-surface boundary condition exactly. In order to reduce numerical dissipation, we use high order DG finite element schemes on adaptive AMR grids together with a high resolution shock capturing subcell finite volume (FV) limiter in the diffuse interface region.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
-
The power collection method for connection relations: Meixner polynomials
Authors:
Michael A. Baeder,
Howard S. Cohl,
Roberto S. Costas-Santos,
Wenqing Xu
Abstract:
We introduce the power collection method for easily deriving connection relations for certain hypergeometric orthogonal polynomials in the $(q-)$Askey scheme. We summarize the full-extent to which the power collection method may be used. As an example, we use the power collection method to derive connection and connection-type relations for Meixner and Krawtchouk polynomials. These relations are t…
▽ More
We introduce the power collection method for easily deriving connection relations for certain hypergeometric orthogonal polynomials in the $(q-)$Askey scheme. We summarize the full-extent to which the power collection method may be used. As an example, we use the power collection method to derive connection and connection-type relations for Meixner and Krawtchouk polynomials. These relations are then used to derive generalizations of generating functions for these orthogonal polynomials. The coefficients of these generalized generating functions are in general, given in term of multiple hypergeometric functions. From derived generalized generating functions, we derive corresponding contour integral and infinite series expressions by using orthogonality.
△ Less
Submitted 12 January, 2016; v1 submitted 3 September, 2015;
originally announced September 2015.
-
Generalizations of generating functions for higher continuous hypergeometric orthogonal polynomials in the Askey scheme
Authors:
Michael A. Baeder,
Howard S. Cohl,
Hans Volkmer
Abstract:
We use connection relations and series rearrangement to generalize generating functions for several higher continuous orthogonal polynomials in the Askey scheme, namely the Wilson, continuous dual Hahn, continuous Hahn, and Meixner-Pollaczek polynomials. We also determine corresponding definite integrals using the orthogonality relations for these polynomials.
We use connection relations and series rearrangement to generalize generating functions for several higher continuous orthogonal polynomials in the Askey scheme, namely the Wilson, continuous dual Hahn, continuous Hahn, and Meixner-Pollaczek polynomials. We also determine corresponding definite integrals using the orthogonality relations for these polynomials.
△ Less
Submitted 23 October, 2014; v1 submitted 8 May, 2014;
originally announced May 2014.
-
Quivers, Geometric Invariant Theory, and Moduli of Linear Dynamical Systems
Authors:
Markus Bader
Abstract:
We use geometric invariant theory and the language of quivers to study compactifications of moduli spaces of linear dynamical systems. A general approach to this problem is presented and applied to two well known cases: We show how both Lomadze's and Helmke's compactification arises naturally as a geometric invariant theory quotient. Both moduli spaces are proven to be smooth projective manifold…
▽ More
We use geometric invariant theory and the language of quivers to study compactifications of moduli spaces of linear dynamical systems. A general approach to this problem is presented and applied to two well known cases: We show how both Lomadze's and Helmke's compactification arises naturally as a geometric invariant theory quotient. Both moduli spaces are proven to be smooth projective manifolds. Furthermore, a description of Lomadze's compactification as a Quot scheme is given, whereas Helmke's compactification is shown to be an algebraic Grassmann bundle over a Quot scheme. This gives an algebro-geometric description of both compactifications. As an application, we determine the cohomology ring of Helmke's compactification and prove that the two compactifications are not isomorphic when the number of outputs is positive.
△ Less
Submitted 4 December, 2007;
originally announced December 2007.
