-
Stabilization of isogeometric finite element method with optimal test functions computed from $L_2$ norm residual minimization
Authors:
Marcin Łoś,
Tomasz Służalec,
Maciej Paszyński,
Eirik Valseth
Abstract:
We compare several stabilization methods in the context of isogeometric analysis and B-spline basis functions, using an advection-dominated advection\revision{-}diffusion as a model problem. We derive (1) the least-squares finite element method formulation using the framework of Petrov-Galerkin method with optimal test functions in the $L_2$ norm, which guarantee automatic preservation of the \emp…
▽ More
We compare several stabilization methods in the context of isogeometric analysis and B-spline basis functions, using an advection-dominated advection\revision{-}diffusion as a model problem. We derive (1) the least-squares finite element method formulation using the framework of Petrov-Galerkin method with optimal test functions in the $L_2$ norm, which guarantee automatic preservation of the \emph{inf-sup} condition of the continuous formulation. We also combine it with the standard Galerkin method to recover (2) the Galerkin/least-squares formulation, and derive coercivity constant bounds valid for B-spline basis functions. The resulting stabilization method are compared with the least-squares and (3) the Streamline-Upwind Petrov-Galerkin (SUPG)method using again the Eriksson-Johnson model problem. The results indicate that least-squares (equivalent to Petrov-Galerkin with $L_2$-optimal test functions) outperforms the other stabilization methods for small Péclet numbers, while strongly advection-dominated problems are better handled with SUPG or Galerkin/least-squares.
△ Less
Submitted 23 November, 2024;
originally announced November 2024.
-
Collocation-based Robust Variational Physics-Informed Neural Networks (CRVPINN)
Authors:
Marcin Łoś,
Tomasz Służalec,
Paweł Maczuga,
Askold Vilkha,
Carlos Uriarte,
Maciej Paszyński
Abstract:
Physics-Informed Neural Networks (PINNs) have been successfully applied to solve Partial Differential Equations (PDEs). Their loss function is founded on a strong residual minimization scheme. Variational Physics-Informed Neural Networks (VPINNs) are their natural extension to weak variational settings. In this context, the recent work of Robust Variational Physics-Informed Neural Networks (RVPINN…
▽ More
Physics-Informed Neural Networks (PINNs) have been successfully applied to solve Partial Differential Equations (PDEs). Their loss function is founded on a strong residual minimization scheme. Variational Physics-Informed Neural Networks (VPINNs) are their natural extension to weak variational settings. In this context, the recent work of Robust Variational Physics-Informed Neural Networks (RVPINNs) highlights the importance of conveniently translating the norms of the underlying continuum-level spaces to the discrete level. Otherwise, VPINNs might become unrobust, implying that residual minimization might be highly uncorrelated with a desired minimization of the error in the energy norm. However, applying this robustness to VPINNs typically entails dealing with the inverse of a Gram matrix, usually producing slow convergence speeds during training. In this work, we accelerate the implementation of RVPINN, establishing a LU factorization of sparse Gram matrix in a kind of point-collocation scheme with the same spirit as original PINNs. We call out method the Collocation-based Robust Variational Physics Informed Neural Networks (CRVPINN). We test our efficient CRVPINN algorithm on Laplace, advection-diffusion, and Stokes problems in two spatial dimensions.
△ Less
Submitted 16 October, 2024; v1 submitted 4 January, 2024;
originally announced January 2024.
-
Automatic stabilization of finite-element simulations using neural networks and hierarchical matrices
Authors:
Tomasz Sluzalec,
Mateusz Dobija,
Anna Paszynska,
Ignacio Muga,
Maciej Paszynski
Abstract:
Petrov-Galerkin formulations with optimal test functions allow for the stabilization of finite element simulations. In particular, given a discrete trial space, the optimal test space induces a numerical scheme delivering the best approximation in terms of a problem-dependent energy norm. This ideal approach has two shortcomings: first, we need to explicitly know the set of optimal test functions;…
▽ More
Petrov-Galerkin formulations with optimal test functions allow for the stabilization of finite element simulations. In particular, given a discrete trial space, the optimal test space induces a numerical scheme delivering the best approximation in terms of a problem-dependent energy norm. This ideal approach has two shortcomings: first, we need to explicitly know the set of optimal test functions; and second, the optimal test functions may have large supports inducing expensive dense linear systems. Nevertheless, parametric families of PDEs are an example where it is worth investing some (offline) computational effort to obtain stabilized linear systems that can be solved efficiently, for a given set of parameters, in an online stage. Therefore, as a remedy for the first shortcoming, we explicitly compute (offline) a function mapping any PDE-parameter, to the matrix of coefficients of optimal test functions (in a basis expansion) associated with that PDE-parameter. Next, as a remedy for the second shortcoming, we use the low-rank approximation to hierarchically compress the (non-square) matrix of coefficients of optimal test functions. In order to accelerate this process, we train a neural network to learn a critical bottleneck of the compression algorithm (for a given set of PDE-parameters). When solving online the resulting (compressed) Petrov-Galerkin formulation, we employ a GMRES iterative solver with inexpensive matrix-vector multiplications thanks to the low-rank features of the compressed matrix. We perform experiments showing that the full online procedure as fast as the original (unstable) Galerkin approach. In other words, we get the stabilization with hierarchical matrices and neural networks practically for free. We illustrate our findings by means of 2D Eriksson-Johnson and Hemholtz model problems.
△ Less
Submitted 24 December, 2022;
originally announced December 2022.
-
Quasi-optimal $hp$-finite element refinements towards singularities via deep neural network prediction
Authors:
Tomasz Sluzalec,
Rafal Grzeszczuk,
Sergio Rojas,
Witold Dzwinel,
Maciej Paszynski
Abstract:
We show how to construct the deep neural network (DNN) expert to predict quasi-optimal $hp$-refinements for a given computational problem. The main idea is to train the DNN expert during executing the self-adaptive $hp$-finite element method ($hp$-FEM) algorithm and use it later to predict further $hp$ refinements. For the training, we use a two-grid paradigm self-adaptive $hp$-FEM algorithm. It e…
▽ More
We show how to construct the deep neural network (DNN) expert to predict quasi-optimal $hp$-refinements for a given computational problem. The main idea is to train the DNN expert during executing the self-adaptive $hp$-finite element method ($hp$-FEM) algorithm and use it later to predict further $hp$ refinements. For the training, we use a two-grid paradigm self-adaptive $hp$-FEM algorithm. It employs the fine mesh to provide the optimal $hp$ refinements for coarse mesh elements. We aim to construct the DNN expert to identify quasi-optimal $hp$ refinements of the coarse mesh elements. During the training phase, we use the direct solver to obtain the solution for the fine mesh to guide the optimal refinements over the coarse mesh element. After training, we turn off the self-adaptive $hp$-FEM algorithm and continue with quasi-optimal refinements as proposed by the DNN expert trained. We test our method on three-dimensional Fichera and two-dimensional L-shaped domain problems. We verify the convergence of the numerical accuracy with respect to the mesh size. We show that the exponential convergence delivered by the self-adaptive $hp$-FEM can be preserved if we continue refinements with a properly trained DNN expert. Thus, in this paper, we show that from the self-adaptive $hp$-FEM it is possible to train the DNN expert the location of the singularities, and continue with the selection of the quasi-optimal $hp$ refinements, preserving the exponential convergence of the method.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
