-
Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core
Authors:
Robert Jendersie,
Christian Lessig,
Thomas Richter
Abstract:
The cryosphere plays a significant role in Earth's climate system. Therefore, an accurate simulation of sea ice is of great importance to improve climate projections. To enable higher resolution simulations, graphics processing units (GPUs) have become increasingly attractive as they offer higher floating point peak performance and better energy efficiency compared to CPUs. However, making use of…
▽ More
The cryosphere plays a significant role in Earth's climate system. Therefore, an accurate simulation of sea ice is of great importance to improve climate projections. To enable higher resolution simulations, graphics processing units (GPUs) have become increasingly attractive as they offer higher floating point peak performance and better energy efficiency compared to CPUs. However, making use of this theoretical peak performance, which is based on massive data parallelism, usually requires more care and effort in the implementation. In recent years, a number of frameworks have become available that promise to simplify general purpose GPU programming. In this work, we compare multiple such frameworks, including CUDA, SYCL, Kokkos and PyTorch, for the parallelization of \nextsim, a finite-element based dynamical core for sea ice. We evaluate the different approaches according to their usability and performance.
△ Less
Submitted 28 February, 2024; v1 submitted 1 February, 2024;
originally announced February 2024.
-
DNN-MG: A Hybrid Neural Network/Finite Element Method with Applications to 3D Simulations of the Navier-Stokes Equations
Authors:
Nils Margenberg,
Robert Jendersie,
Christian Lessig,
Thomas Richter
Abstract:
We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information obtained using deep neural networks.
The neural network operates locally on small patches of grid elements. The local approach proves to be highly efficient, since…
▽ More
We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information obtained using deep neural networks.
The neural network operates locally on small patches of grid elements. The local approach proves to be highly efficient, since the network can be kept (relatively) small and since it can be applied in parallel on all grid patches. However, the main advantage of the local approach is the inherent generalizability of the method. Since the network only processes data of small sub-areas, it never ``sees'' the global problem and thus does not learn false biases.
We describe the method with a focus on the interplay between the finite element method and deep neural networks. Further, we demonstrate with numerical examples the excellent efficiency of the hybrid approach, which allows us to achieve very high accuracy with a coarse grid and thus reduce the computation time by orders of magnitude.
△ Less
Submitted 1 November, 2023; v1 submitted 27 July, 2023;
originally announced July 2023.
-
Deep neural networks for geometric multigrid methods
Authors:
Nils Margenberg,
Robert Jendersie,
Thomas Richter,
Christian Lessig
Abstract:
We investigate scaling and efficiency of the deep neural network multigrid method (DNN-MG).
DNN-MG is a novel neural network-based technique for the simulation of the Navier-Stokes equations that combines an adaptive geometric multigrid solver, i.e. a highly efficient
classical solution scheme, with a recurrent neural network with memory.
The neural network replaces in DNN-MG one or multiple…
▽ More
We investigate scaling and efficiency of the deep neural network multigrid method (DNN-MG).
DNN-MG is a novel neural network-based technique for the simulation of the Navier-Stokes equations that combines an adaptive geometric multigrid solver, i.e. a highly efficient
classical solution scheme, with a recurrent neural network with memory.
The neural network replaces in DNN-MG one or multiple finest multigrid layers and provides a correction for the classical solve in the next time step.
This leads to little degradation in the solution quality while substantially reducing the overall computational costs.
At the same time, the use of the multigrid solver at the coarse scales allows for a compact network that is easy to train, generalizes well, and allows for the incorporation of physical constraints.
Previous work on DNN-MG focused on the overall scheme and how to enforce divergence freedom in the solution.
In this work, we investigate how the network size affects training and solution quality and the overall runtime of the computations.
Our results demonstrate that larger networks are able to capture the
flow behavior better while requiring only little additional training time.
At runtime, the use of the neural network correction can even reduce the computation time compared to a classical multigrid simulation through a faster convergence of the nonlinear solve that is required at every time step.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
