-
Graph Neural Networks and Applied Linear Algebra
Authors:
Nicholas S. Moore,
Eric C. Cyr,
Peter Ohm,
Christopher M. Siefert,
Raymond S. Tuminaro
Abstract:
Sparse matrix computations are ubiquitous in scientific computing. With the recent interest in scientific machine learning, it is natural to ask how sparse matrix computations can leverage neural networks (NN). Unfortunately, multi-layer perceptron (MLP) neural networks are typically not natural for either graph or sparse matrix computations. The issue lies with the fact that MLPs require fixed-si…
▽ More
Sparse matrix computations are ubiquitous in scientific computing. With the recent interest in scientific machine learning, it is natural to ask how sparse matrix computations can leverage neural networks (NN). Unfortunately, multi-layer perceptron (MLP) neural networks are typically not natural for either graph or sparse matrix computations. The issue lies with the fact that MLPs require fixed-sized inputs while scientific applications generally generate sparse matrices with arbitrary dimensions and a wide range of nonzero patterns (or matrix graph vertex interconnections). While convolutional NNs could possibly address matrix graphs where all vertices have the same number of nearest neighbors, a more general approach is needed for arbitrary sparse matrices, e.g. arising from discretized partial differential equations on unstructured meshes. Graph neural networks (GNNs) are one approach suitable to sparse matrices. GNNs define aggregation functions (e.g., summations) that operate on variable size input data to produce data of a fixed output size so that MLPs can be applied. The goal of this paper is to provide an introduction to GNNs for a numerical linear algebra audience. Concrete examples are provided to illustrate how many common linear algebra tasks can be accomplished using GNNs. We focus on iterative methods that employ computational kernels such as matrix-vector products, interpolation, relaxation methods, and strength-of-connection measures. Our GNN examples include cases where parameters are determined a-priori as well as cases where parameters must be learned. The intent with this article is to help computational scientists understand how GNNs can be used to adapt machine learning concepts to computational tasks associated with sparse matrices. It is hoped that this understanding will stimulate data-driven extensions of classical sparse linear algebra tasks.
△ Less
Submitted 21 October, 2023;
originally announced October 2023.
-
Monolithic multigrid for a reduced-quadrature discretization of poroelasticity
Authors:
James H. Adler,
Yunhui He,
Xiaozhe Hu,
Scott MacLachlan,
Peter Ohm
Abstract:
Advanced finite-element discretizations and preconditioners for models of poroelasticity have attracted significant attention in recent years. The equations of poroelasticity offer significant challenges in both areas, due to the potentially strong coupling between unknowns in the system, saddle-point structure, and the need to account for wide ranges of parameter values, including limiting behavi…
▽ More
Advanced finite-element discretizations and preconditioners for models of poroelasticity have attracted significant attention in recent years. The equations of poroelasticity offer significant challenges in both areas, due to the potentially strong coupling between unknowns in the system, saddle-point structure, and the need to account for wide ranges of parameter values, including limiting behavior such as incompressible elasticity. This paper was motivated by an attempt to develop monolithic multigrid preconditioners for the discretization developed in [48]; we show here why this is a difficult task and, as a result, we modify the discretization in [48] through the use of a reduced quadrature approximation, yielding a more "solver-friendly" discretization. Local Fourier analysis is used to optimize parameters in the resulting monolithic multigrid method, allowing a fair comparison between the performance and costs of methods based on Vanka and Braess-Sarazin relaxation. Numerical results are presented to validate the LFA predictions and demonstrate efficiency of the algorithms. Finally, a comparison to existing block-factorization preconditioners is also given.
△ Less
Submitted 7 January, 2022; v1 submitted 8 July, 2021;
originally announced July 2021.
-
Non-invasive multigrid for semi-structured grids
Authors:
Matthias Mayr,
Luc Berger-Vergiat,
Peter Ohm,
Raymond S. Tuminaro
Abstract:
Multigrid solvers for hierarchical hybrid grids (HHG) have been proposed to promote the efficient utilization of high performance computer architectures. These HHG meshes are constructed by uniformly refining a relatively coarse fully unstructured mesh. While HHG meshes provide some flexibility for unstructured applications, most multigrid calculations can be accomplished using efficient structure…
▽ More
Multigrid solvers for hierarchical hybrid grids (HHG) have been proposed to promote the efficient utilization of high performance computer architectures. These HHG meshes are constructed by uniformly refining a relatively coarse fully unstructured mesh. While HHG meshes provide some flexibility for unstructured applications, most multigrid calculations can be accomplished using efficient structured grid ideas and kernels. This paper focuses on generalizing the HHG idea so that it is applicable to a broader community of computational scientists, and so that it is easier for existing applications to leverage structured multigrid components. Specifically, we adapt the structured multigrid methodology to significantly more complex semi-structured meshes. Further, we illustrate how mature applications might adopt a semi-structured solver in a relatively non-invasive fashion. To do this, we propose a formal mathematical framework for describing the semi-structured solver. This formalism allows us to precisely define the associated multigrid method and to show its relationship to a more traditional multigrid solver. Additionally, the mathematical framework clarifies the associated software design and implementation. Numerical experiments highlight the relationship of the new solver with classical multigrid. We also demonstrate the generality and potential performance gains associated with this type of semi-structured multigrid.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
-
A Monolithic Algebraic Multigrid Framework for Multiphysics Applications with Examples from Resistive MHD
Authors:
Peter Ohm,
Tobias Wiesner,
Eric C. Cyr,
Jonathan J. Hu,
John N. Shadid,
Raymond S. Tuminaro
Abstract:
A multigrid framework is described for multiphysics applications. The framework allows one to construct, adapt, and tailor a monolithic multigrid methodology to different linear systems coming from discretized partial differential equations. The main idea centers on developing multigrid components in a blocked fashion where each block corresponds to separate sets of physical unknowns and equations…
▽ More
A multigrid framework is described for multiphysics applications. The framework allows one to construct, adapt, and tailor a monolithic multigrid methodology to different linear systems coming from discretized partial differential equations. The main idea centers on developing multigrid components in a blocked fashion where each block corresponds to separate sets of physical unknowns and equations within the larger discretization matrix. Once defined, these components are ultimately assembled into a monolithic multigrid solver for the entire system. We demonstrate the potential of the framework by applying it to representative linear solution sub-problems arising from resistive MHD.
△ Less
Submitted 22 March, 2021; v1 submitted 12 March, 2021;
originally announced March 2021.
-
Robust preconditioners for a new stabilized discretization of the poroelastic equations
Authors:
James H. Adler,
Francisco J. Gaspar,
Xiaozhe Hu,
Peter Ohm,
Carmen Rodrigo,
Ludmil T. Zikatanov
Abstract:
In this paper, we present block preconditioners for a stabilized discretization of the poroelastic equations developed in [45]. The discretization is proved to be well-posed with respect to the physical and discretization parameters, and thus provides a framework to develop preconditioners that are robust with respect to such parameters as well. We construct both norm-equivalent (diagonal) and fie…
▽ More
In this paper, we present block preconditioners for a stabilized discretization of the poroelastic equations developed in [45]. The discretization is proved to be well-posed with respect to the physical and discretization parameters, and thus provides a framework to develop preconditioners that are robust with respect to such parameters as well. We construct both norm-equivalent (diagonal) and field-of-value-equivalent (triangular) preconditioners for both the stabilized discretization and a perturbation of the stabilized discretization that leads to a smaller overall problem after static condensation. Numerical tests for both two- and three-dimensional problems confirm the robustness of the block preconditioners with respect to the physical and discretization parameters.
△ Less
Submitted 3 January, 2020; v1 submitted 24 May, 2019;
originally announced May 2019.
-
New stabilized discretizations for poroelasticity and the Stokes' equations
Authors:
Carmen Rodrigo,
Xiaozhe Hu,
Peter Ohm,
James H. Adler,
Francisco J. Gaspar,
Ludmil Zikatanov
Abstract:
In this work, we consider the popular P1-RT0-P0 discretization of the three-field formulation of Biot's consolidation problem. Since this finite-element formulation does not satisfy an inf-sup condition uniformly with respect to the physical parameters, several issues arise in numerical simulations. For example, when the permeability is small with respect to the mesh size, volumetric locking may o…
▽ More
In this work, we consider the popular P1-RT0-P0 discretization of the three-field formulation of Biot's consolidation problem. Since this finite-element formulation does not satisfy an inf-sup condition uniformly with respect to the physical parameters, several issues arise in numerical simulations. For example, when the permeability is small with respect to the mesh size, volumetric locking may occur. Thus, we propose a stabilization technique that enriches the piecewise linear finite-element space of the displacement with the span of edge/face bubble functions. We show that for Biot's model this does give rise to discretizations that are uniformly stable with respect to the physical parameters. We also propose a perturbation of the bilinear form, which allows for local elimination of the bubble functions and provides a uniformly stable scheme with the same number of degrees of freedom as the classical P1-RT0-P0 approach. We prove optimal stability and error estimates for this discretization. Finally, we show that this scheme can also be successfully applied to Stokes' equations, yielding a discrete problem with optimal approximation properties and with minimum number of degrees of freedom (equivalent to a P1-P0 discretization). Numerical tests confirm the theory for both poroelastic and Stokes' test problems.
△ Less
Submitted 20 June, 2017; v1 submitted 16 June, 2017;
originally announced June 2017.
