-
waLBerla-wind: a lattice-Boltzmann-based high-performance flow solver for wind energy applications
Authors:
Helen Schottenhamml,
Ani Anciaux-Sedrakian,
Frédéric Blondel,
Harald Köstler,
Ulrich Rüde
Abstract:
This article presents the development of a new wind turbine simulation software to study wake flow physics. To this end, the design and development of waLBerla-wind, a new simulator based on the lattice-Boltzmann method that is known for its excellent performance and scaling properties, will be presented. Here it will be used for large eddy simulations (LES) coupled with actuator wind turbine mode…
▽ More
This article presents the development of a new wind turbine simulation software to study wake flow physics. To this end, the design and development of waLBerla-wind, a new simulator based on the lattice-Boltzmann method that is known for its excellent performance and scaling properties, will be presented. Here it will be used for large eddy simulations (LES) coupled with actuator wind turbine models. Due to its modular software design, waLBerla-wind is flexible and extensible with regard to turbine configurations. Additionally it is performance portable across different hardware architectures, another critical design goal. The new solver is validated by presenting force distributions and velocity profiles and comparing them with experimental data and a vortex solver. Furthermore, waLBerla-wind's performance is \revision{compared to a theoretical peak performance}, and analysed with weak and strong scaling benchmarks on CPU and GPU systems. This analysis demonstrates the suitability for large-scale applications and future cost-effective full wind farm simulations.
△ Less
Submitted 8 December, 2023;
originally announced February 2024.
-
Development of a central-moment phase-field lattice Boltzmann model for thermocapillary flows: Droplet capture and computational performance
Authors:
Markus Holzer,
Travis Mitchell,
Christopher R. Leonardi,
Ulrich Ruede
Abstract:
This study develops a computationally efficient phase-field lattice Boltzmann model with the capability to simulate thermocapillary flows. The model was implemented into the open-source simulation framework, waLBerla, and extended to conduct the collision stage using central moments. The multiphase model was coupled with both a passive-scalar thermal LB, and a RK solution to the energy equation in…
▽ More
This study develops a computationally efficient phase-field lattice Boltzmann model with the capability to simulate thermocapillary flows. The model was implemented into the open-source simulation framework, waLBerla, and extended to conduct the collision stage using central moments. The multiphase model was coupled with both a passive-scalar thermal LB, and a RK solution to the energy equation in order to resolve temperature-dependent surface tension phenomena. Various lattice stencils (D3Q7, D3Q15, D3Q19, D3Q27) were tested for the passive-scalar LB and both the second- and fourth-order RK methods were investigated. There was no significant difference observed in the accuracy of the LB or RK schemes. The passive scalar D3Q7 LB discretisation tended to provide computational benefits, while the second order RK scheme is superior in memory usage. This paper makes contributions relating to the modelling of thermocapillary flows and to understanding the behaviour of droplet capture with thermal sources analogous to thermal tweezers. Four primary contributions to the literature are identified. First, a new 3D thermocapillary, central-moment phase-field LB model is presented and implemented in the open-source software, waLBerla. Second, the accuracy and computational performance of various techniques to resolve the energy equation for multiphase, incompressible fluids is investigated. Third, the dynamic droplet transport behaviour in the presence of thermal sources is studied and insight is provided on the potential ability to manipulate droplets based on local domain heating. Finally, a concise analysis of the computational performance together with near-perfect scaling results on NVIDIA and AMD GPU-clusters is shown. This research enables the detailed study of droplet manipulation and control in thermocapillary devices.
△ Less
Submitted 5 January, 2024;
originally announced January 2024.
-
Scalable Flow Simulations with the Lattice Boltzmann Method
Authors:
Markus Holzer,
Jayesh Badwaik,
Radim Vavrik,
Gabriel Staffelbach,
Andreas Herten,
Ondrej Vysocky,
Ilan Rocchi,
Lubomir Riha,
Romain Cuidard,
Ulrich Ruede
Abstract:
The primary goal of the EuroHPC JU project SCALABLE is to develop an industrial Lattice Boltzmann Method (LBM)-based computational fluid dynamics (CFD) solver capable of exploiting current and future extreme scale architectures, expanding current capabilities of existing industrial LBM solvers by at least two orders of magnitude in terms of processor cores and lattice cells, while preserving its a…
▽ More
The primary goal of the EuroHPC JU project SCALABLE is to develop an industrial Lattice Boltzmann Method (LBM)-based computational fluid dynamics (CFD) solver capable of exploiting current and future extreme scale architectures, expanding current capabilities of existing industrial LBM solvers by at least two orders of magnitude in terms of processor cores and lattice cells, while preserving its accessibility from both the end-user and software developer's point of view. This is accomplished by transferring technology and knowledge between an academic code (waLBerla) and an industrial code (LaBS). This paper briefly introduces the characteristics and main features of both software packages involved in the process. We also highlight some of the performance achievements in scales of up to tens of thousand of cores presented on one academic and one industrial benchmark case.
△ Less
Submitted 16 May, 2023;
originally announced May 2023.
-
Particle-resolved simulation of antidunes in free-surface flows
Authors:
Christoph Schwarzmeier,
Christoph Rettinger,
Samuel Kemmler,
Jonas Plewinski,
Francisco Núñez-González,
Harald Köstler,
Ulrich Rüde,
Bernhard Vowinckel
Abstract:
The interaction of supercritical turbulent flows with granular sediment beds is challenging to study both experimentally and numerically; this challenging task has hampered the advances in understanding antidunes, the most characteristic bedform of supercritical flows. This article presents the first numerical attempt to simulate upstream-migrating antidunes with geometrically resolved particles a…
▽ More
The interaction of supercritical turbulent flows with granular sediment beds is challenging to study both experimentally and numerically; this challenging task has hampered the advances in understanding antidunes, the most characteristic bedform of supercritical flows. This article presents the first numerical attempt to simulate upstream-migrating antidunes with geometrically resolved particles and a liquid-gas interface. Our simulations provide data at a resolution higher than laboratory experiments, and they can therefore provide new insights into the mechanisms of antidune migration and contribute to a deeper understanding of the underlying physics. To manage the simulations' computational costs and physical complexity, we employ the cumulant lattice Boltzmann method in conjunction with a discrete element method for particle interactions, as well as a volume of fluid scheme to track the deformable free surface of the fluid. By reproducing two flow configurations of previous experiments (Pascal et al., Earth Surf. Proc. Land., vol. 46(9), 2021, 1750-1765), we demonstrate that our approach is robust and accurately predicts the antidunes' amplitude, wavelength, and celerity. Furthermore, the simulated wall-shear stress, a key parameter governing sediment transport, is in excellent agreement with the experimental measurements. The highly resolved data of fluid and particle motion from our simulation approach open new perspectives for detailed studies of morphodynamics in shallow supercritical flows.
△ Less
Submitted 23 March, 2023; v1 submitted 25 January, 2023;
originally announced January 2023.
-
Advanced Automatic Code Generation for Multiple Relaxation-Time Lattice Boltzmann Methods
Authors:
Frederik Hennig,
Markus Holzer,
Ulrich Rüde
Abstract:
The scientific code generation package lbmpy supports the automated design and the efficient implementation of lattice Boltzmann methods (LBMs) through metaprogramming. It is based on a new, concise calculus for describing multiple relaxation-time LBMs, including techniques that enable the numerically advantageous subtraction of the constant background component from the populations. These techniq…
▽ More
The scientific code generation package lbmpy supports the automated design and the efficient implementation of lattice Boltzmann methods (LBMs) through metaprogramming. It is based on a new, concise calculus for describing multiple relaxation-time LBMs, including techniques that enable the numerically advantageous subtraction of the constant background component from the populations. These techniques are generalized to a wide range of collision spaces and equilibrium distributions. The article contains an overview of lbmpy's front-end and its code generation pipeline, which implements the new LBM calculus by means of symbolic formula manipulation tools and object-oriented programming. The generated codes have only a minimal number of arithmetic operations. Their automatic derivation rests on two novel Chimera transforms that have been specifically developed for efficiently computing raw and central moments. Information contained in the symbolic representation of the methods is further exploited in a customized sequence of algebraic simplifications, further reducing computational cost. When combined, these algebraic transformations lead to concise and compact numerical kernels. Specifically, with these optimizations, the advanced central moment- and cumulant-based methods can be realized with only little additional cost as when compared with the simple BGK method. The effectiveness and flexibility of the new lbmpy code generation system is demonstrated in simulating Taylor-Green vortex decay and the automatic derivation of an LBM algorithm to solve the shallow water equations.
△ Less
Submitted 4 November, 2022;
originally announced November 2022.
-
Comparison of refilling schemes in the free-surface lattice Boltzmann method
Authors:
Christoph Schwarzmeier,
Ulrich Rüde
Abstract:
Simulating mobile liquid-gas interfaces with the free-surface lattice Boltzmann method (FSLBM) requires frequent re-initialization of fluid flow information in computational cells that convert from gas to liquid. The corresponding algorithm, here referred to as the refilling scheme, is crucial for the successful application of the FSLBM in terms of accuracy and numerical stability. This study comp…
▽ More
Simulating mobile liquid-gas interfaces with the free-surface lattice Boltzmann method (FSLBM) requires frequent re-initialization of fluid flow information in computational cells that convert from gas to liquid. The corresponding algorithm, here referred to as the refilling scheme, is crucial for the successful application of the FSLBM in terms of accuracy and numerical stability. This study compares five refilling schemes that extract information from the surrounding liquid and interface cells by averaging, extrapolating, or assuming one of the three different equilibrium states. Six numerical experiments were performed, covering a broad spectrum of possible scenarios. These include a standing gravity wave, a rectangular and cylindrical dam break, a Taylor bubble, a drop impact into liquid, and a bubbly plane Poiseuille flow. In some simulations, the averaging, extrapolation, and one equilibrium-based scheme were numerically unstable. Overall, the results have shown that the simplest equilibrium-based scheme should be preferred in terms of numerical stability, computational cost, accuracy, and ease of implementation.
△ Less
Submitted 24 November, 2022; v1 submitted 29 July, 2022;
originally announced July 2022.
-
Analysis and comparison of boundary condition variants in the free-surface lattice Boltzmann method
Authors:
Christoph Schwarzmeier,
Ulrich Rüde
Abstract:
The accuracy of the free-surface lattice Boltzmann method (FSLBM) depends significantly on the boundary condition employed at the free interface. Ideally, the chosen boundary condition balances the forces exerted by the liquid and gas pressure. Different variants of the same boundary condition are possible, depending on the number and choice of the particle distribution functions (PDFs) to which i…
▽ More
The accuracy of the free-surface lattice Boltzmann method (FSLBM) depends significantly on the boundary condition employed at the free interface. Ideally, the chosen boundary condition balances the forces exerted by the liquid and gas pressure. Different variants of the same boundary condition are possible, depending on the number and choice of the particle distribution functions (PDFs) to which it is applied. This study analyzes and compares four variants, in which (i) the boundary condition is applied to all PDFs oriented in the opposite direction of the free interface's normal vector, including or (ii) excluding the central PDF. While these variants overwrite existing information, the boundary condition can also be applied (iii) to only missing PDFs without dropping available data or (iv) to only missing PDFs but at least three PDFs as suggested in the literature. It is shown that neither variant generally balances the forces exerted by the liquid and gas pressure at the free surface. The four variants' accuracy was compared in five different numerical experiments covering various applications. These include a standing gravity wave, a rectangular and cylindrical dam break, a rising Taylor bubble, and a droplet impacting a thin pool of liquid. Overall, variant (iii) was substantially more accurate than the other variants in the numerical experiments performed in this study.
△ Less
Submitted 22 January, 2023; v1 submitted 28 July, 2022;
originally announced July 2022.
-
Comparison of free-surface and conservative Allen-Cahn phase-field lattice Boltzmann method
Authors:
Christoph Schwarzmeier,
Markus Holzer,
Travis Mitchell,
Moritz Lehmann,
Fabian Häusl,
Ulrich Rüde
Abstract:
This study compares the free-surface lattice Boltzmann method (FSLBM) with the conservative Allen-Cahn phase-field lattice Boltzmann method (PFLBM) in their ability to model two-phase flows in which the behavior of the system is dominated by the heavy phase. Both models are introduced and their individual properties, strengths and weaknesses are thoroughly discussed. Six numerical benchmark cases…
▽ More
This study compares the free-surface lattice Boltzmann method (FSLBM) with the conservative Allen-Cahn phase-field lattice Boltzmann method (PFLBM) in their ability to model two-phase flows in which the behavior of the system is dominated by the heavy phase. Both models are introduced and their individual properties, strengths and weaknesses are thoroughly discussed. Six numerical benchmark cases were simulated with both models, including (i) a standing gravity and (ii) capillary wave, (iii) an unconfined rising gas bubble in liquid, (iv) a Taylor bubble in a cylindrical tube, and (v) the vertical and (vi) oblique impact of a drop into a pool of liquid. Comparing the simulation results with either analytical models or experimental data from the literature, four major observations were made. Firstly, the PFLBM selected was able to simulate flows purely governed by surface tension with reasonable accuracy. Secondly, the FSLBM, a sharp interface model, generally requires a lower resolution than the PFLBM, a diffuse interface model. However, in the limit case of a standing wave, this was not observed. Thirdly, in simulations of a bubble moving in a liquid, the FSLBM accurately predicted the bubble's shape and rise velocity with low computational resolution. Finally, the PFLBM's accuracy is found to be sensitive to the choice of the model's mobility parameter and interface width.
△ Less
Submitted 24 November, 2022; v1 submitted 23 June, 2022;
originally announced June 2022.
-
Effect of Sediment Form and Form Distribution on Porosity: A Simulation Study Based on the Discrete Element Method
Authors:
Christoph Rettinger,
Ulrich Rüde,
Stefan Vollmer,
Roy M. Frings
Abstract:
Porosity is one of the key properties of dense particle packings like sediment deposits and is influenced by a multitude of grain characteristics such as their size distribution and shape. In the present work, we focus on the form, a specific aspect of the overall shape, of sedimentary grains in order to investigate and quantify its effect on porosity, ultimately deriving novel porosity-prediction…
▽ More
Porosity is one of the key properties of dense particle packings like sediment deposits and is influenced by a multitude of grain characteristics such as their size distribution and shape. In the present work, we focus on the form, a specific aspect of the overall shape, of sedimentary grains in order to investigate and quantify its effect on porosity, ultimately deriving novel porosity-prediction models. To this end, we develop a robust and accurate simulation tool based on the discrete element method which we validate against laboratory experiments. Utilizing digital representations of actual sediment from the Rhine river, we first study packings that are composed of particles with a single form. There, the porosity is found to be mainly determined by the inverse equancy, i.e., the ratio of the longest to the smallest form-defining axis. Only for small ratios, additional shape-related properties become relevant, as revealed by a direct comparison to packings of form-equivalent ellipsoids. Since sediment naturally features form mixtures, we extend our simulation tool to study sediment packings with normally-distributed forms. In agreement with our single form studies, the porosity depends primarily on the inverse of the mean equancy. By supplying additional information about a second form factor and the standard deviations, we derive an accurate model for porosity prediction. Due to its simplicity, it can be readily applied to sediment packings for which some measurements of flatness and elongation, the two most common form factors, are available.
△ Less
Submitted 16 May, 2022;
originally announced May 2022.
-
Coupling fully resolved light particles with the Lattice Boltzmann method on adaptively refined grids
Authors:
Lukas Werner,
Christoph Rettinger,
Ulrich Rüde
Abstract:
The simulation of geometrically resolved rigid particles in a fluid relies on coupling algorithms to transfer momentum both ways between the particles and the fluid. In this article, the fluid flow is modeled with a parallel Lattice Boltzmann method using adaptive grid refinement to improve numerical efficiency. The coupling with the particles is realized with the momentum exchange method. When im…
▽ More
The simulation of geometrically resolved rigid particles in a fluid relies on coupling algorithms to transfer momentum both ways between the particles and the fluid. In this article, the fluid flow is modeled with a parallel Lattice Boltzmann method using adaptive grid refinement to improve numerical efficiency. The coupling with the particles is realized with the momentum exchange method. When implemented in plain form, instabilities may arise in the coupling when the particles are lighter than the fluid. The algorithm can be stabilized with a virtual mass correction specifically developed for the Lattice Boltzmann method. The method is analyzed for a wide set of physically relevant regimes, varying independently the body-to-fluid density ratio and the relative magnitude of inertial and viscous effects. These studies of a single rising particle exhibit periodic regimes of particle motion as well as chaotic behavior, as previously reported in the literature. The new method is carefully compared with available experimental and numerical results. This serves to validate the presented new coupled Lattice Boltzmann method and additionally it leads to new physical insight for some of the parameter settings.
△ Less
Submitted 19 March, 2021;
originally announced March 2021.
-
Rheology of mobile sediment beds in laminar shear flow: effects of creep and polydispersity
Authors:
Christoph Rettinger,
Sebastian Eibl,
Ulrich Rüde,
Bernhard Vowinckel
Abstract:
Classical scaling relationships for rheological quantities such as the $μ(J)$-rheology have become increasingly popular for closures of two-phase flow modeling. However, these frameworks have been derived for monodisperse particles. We aim to extend these considerations to sediment transport modeling by using a more realistic sediment composition. We investigate the rheological behavior of sheared…
▽ More
Classical scaling relationships for rheological quantities such as the $μ(J)$-rheology have become increasingly popular for closures of two-phase flow modeling. However, these frameworks have been derived for monodisperse particles. We aim to extend these considerations to sediment transport modeling by using a more realistic sediment composition. We investigate the rheological behavior of sheared sediment beds composed of polydisperse spherical particles in a laminar Couette-type shear flow. The sediment beds consist of particles with a diameter size ratio of up to ten, which corresponds to grains ranging from fine to coarse sand. The data was generated using fully coupled, grain resolved direct numerical simulations using a combined lattice Boltzmann - discrete element method. These highly-resolved data yield detailed depth-resolved profiles of the relevant physical quantities that determine the rheology, i.e., the local shear rate of the fluid, particle volume fraction, total shear, and granular pressure. A comparison against experimental data shows excellent agreement for the monodisperse case. We improve upon the parameterization of the $μ(J)$-rheology by expressing its empirically derived parameters as a function of the maximum particle volume fraction. Furthermore, we extend these considerations by exploring the creeping regime for viscous numbers much lower than used by previous studies to calibrate these correlations. Considering the low viscous numbers of our data, we found that the friction coefficient governing the quasi-static state in the creeping regime tends to a finite value for vanishing shear, which decreases the critical friction coefficient by a factor of three for all cases investigated.
△ Less
Submitted 30 June, 2021; v1 submitted 6 March, 2021;
originally announced March 2021.
-
Highly Efficient Lattice-Boltzmann Multiphase Simulations of Immiscible Fluids at High-Density Ratios on CPUs and GPUs through Code Generation
Authors:
Markus Holzer,
Martin Bauer,
Ulrich Rüde
Abstract:
A high-performance implementation of a multiphase lattice Boltzmann method based on the conservative Allen-Cahn model supporting high-density ratios and high Reynolds numbers is presented. Metaprogramming techniques are used to generate optimized code for CPUs and GPUs automatically. The coupled model is specified in a high-level symbolic description and optimized through automatic transformations…
▽ More
A high-performance implementation of a multiphase lattice Boltzmann method based on the conservative Allen-Cahn model supporting high-density ratios and high Reynolds numbers is presented. Metaprogramming techniques are used to generate optimized code for CPUs and GPUs automatically. The coupled model is specified in a high-level symbolic description and optimized through automatic transformations. The memory footprint of the resulting algorithm is reduced through the fusion of compute kernels. A roofline analysis demonstrates the excellent efficiency of the generated code on a single GPU. The resulting single GPU code has been integrated into the multiphysics framework waLBerla to run massively parallel simulations on large domains. Communication hiding and GPUDirect-enabled MPI yield near-perfect scaling behaviour. Scaling experiments are conducted on the Piz Daint supercomputer with up to 2048 GPUs, simulating several hundred fully resolved bubbles. Further, validation of the implementation is shown in a physically relevant scenario-a three-dimensional rising air bubble in water.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
An efficient four-way coupled lattice Boltzmann - discrete element method for fully resolved simulations of particle-laden flows
Authors:
Christoph Rettinger,
Ulrich Rüde
Abstract:
A four-way coupling scheme for the direct numerical simulation of particle-laden flows is developed and analyzed. It employs a novel adaptive multi-relaxation time lattice Boltzmann method to simulate the fluid phase efficiently. The momentum exchange method is used to couple the fluid and the particulate phase. The particle interactions in normal and tangential direction are accounted for by a di…
▽ More
A four-way coupling scheme for the direct numerical simulation of particle-laden flows is developed and analyzed. It employs a novel adaptive multi-relaxation time lattice Boltzmann method to simulate the fluid phase efficiently. The momentum exchange method is used to couple the fluid and the particulate phase. The particle interactions in normal and tangential direction are accounted for by a discrete element method using linear contact forces. All parameters of the scheme are studied and evaluated in detail and precise guidelines for their choice are developed. The development is based on several carefully selected calibration and validation tests of increasing physical complexity. It is found that a well-calibrated lubrication model is crucial to obtain the correct trajectories of a sphere colliding with a plane wall in a viscous fluid. For adequately resolving the collision dynamics it is found that the collision time must be stretched appropriately. The complete set of tests establishes a validation pipeline that can be universally applied to other fluid-particle coupling schemes providing a systematic methodology that can guide future developments.
△ Less
Submitted 3 March, 2020;
originally announced March 2020.
-
waLBerla: A block-structured high-performance framework for multiphysics simulations
Authors:
Martin Bauer,
Sebastian Eibl,
Christian Godenschwager,
Nils Kohl,
Michael Kuron,
Christoph Rettinger,
Florian Schornbaum,
Christoph Schwarzmeier,
Dominik Thönnes,
Harald Köstler,
Ulrich Rüde
Abstract:
Programming current supercomputers efficiently is a challenging task. Multiple levels of parallelism on the core, on the compute node, and between nodes need to be exploited to make full use of the system. Heterogeneous hardware architectures with accelerators further complicate the development process. waLBerla addresses these challenges by providing the user with highly efficient building blocks…
▽ More
Programming current supercomputers efficiently is a challenging task. Multiple levels of parallelism on the core, on the compute node, and between nodes need to be exploited to make full use of the system. Heterogeneous hardware architectures with accelerators further complicate the development process. waLBerla addresses these challenges by providing the user with highly efficient building blocks for developing simulations on block-structured grids. The block-structured domain partitioning is flexible enough to handle complex geometries, while the structured grid within each block allows for highly efficient implementations of stencil-based algorithms. We present several example applications realized with waLBerla, ranging from lattice Boltzmann methods to rigid particle simulations. Most importantly, these methods can be coupled together, enabling multiphysics simulations. The framework uses meta-programming techniques to generate highly efficient code for CPUs and GPUs from a symbolic method formulation. To ensure software quality and performance portability, a continuous integration toolchain automatically runs an extensive test suite encompassing multiple compilers, hardware architectures, and software configurations.
△ Less
Submitted 30 September, 2019;
originally announced September 2019.
-
Dynamic Load Balancing Techniques for Particulate Flow Simulations
Authors:
Christoph Rettinger,
Ulrich Rüde
Abstract:
Parallel multiphysics simulations often suffer from load imbalances originating from the applied coupling of algorithms with spatially and temporally varying workloads. It is thus desirable to minimize these imbalances to reduce the time to solution and to better utilize the available hardware resources. Taking particulate flows as an illustrating example application, we present and evaluate load…
▽ More
Parallel multiphysics simulations often suffer from load imbalances originating from the applied coupling of algorithms with spatially and temporally varying workloads. It is thus desirable to minimize these imbalances to reduce the time to solution and to better utilize the available hardware resources. Taking particulate flows as an illustrating example application, we present and evaluate load balancing techniques that tackle this challenging task. This involves a load estimation step in which the currently generated workload is predicted. We describe in detail how such a workload estimator can be developed. In a second step, load distribution strategies like space-filling curves or graph partitioning are applied to dynamically distribute the load among the available processes. To compare and analyze their performance, we employ these techniques to a benchmark scenario and observe a reduction of the load imbalances by almost a factor of four. This results in a decrease of the overall runtime by 14% for space-filling curves.
△ Less
Submitted 30 November, 2018;
originally announced November 2018.
-
An improved lattice Boltzmann D3Q19 method based on an alternative equilibrium discretization
Authors:
Martin Bauer,
Ulrich Rüde
Abstract:
Lattice Boltzmann simulations of three-dimensional, isothermal hydrodynamics often use either the D3Q19 or the D3Q27 velocity sets. While both models correctly approximate Navier-Stokes in the continuum limit, the D3Q19 model is computationally less expensive but has some known deficiencies regarding Galilean invariance, especially for high Reynolds number flows. In this work we present a novel me…
▽ More
Lattice Boltzmann simulations of three-dimensional, isothermal hydrodynamics often use either the D3Q19 or the D3Q27 velocity sets. While both models correctly approximate Navier-Stokes in the continuum limit, the D3Q19 model is computationally less expensive but has some known deficiencies regarding Galilean invariance, especially for high Reynolds number flows. In this work we present a novel methodology to construct lattice Boltzmann equilibria for hydrodynamics directly from the continuous Maxwellian equilibrium. While our new approach reproduces the well known LBM equilibrium for D2Q9 and D3Q27 lattice models, it yields a different equilibrium formulation for the D3Q19 stencil. This newly proposed formulation is shown to be more accurate than the widely used second order equilibrium, while having the same computation costs. We present a steady state Chapman-Enskog analysis of the standard and the improved D3Q19 model and conduct numerical experiments that demonstrate the superior accuracy of our newly developed D3Q19 equilibrium.
△ Less
Submitted 28 August, 2018; v1 submitted 13 March, 2018;
originally announced March 2018.
-
A local parallel communication algorithm for polydisperse rigid body dynamics
Authors:
Sebastian Eibl,
Ulrich Rüde
Abstract:
The simulation of large ensembles of particles is usually parallelized by partitioning the domain spatially and using message passing to communicate between the processes handling neighboring subdomains. The particles are represented as individual geometric objects and are associated to the subdomains. Handling collisions and migrating particles between subdomains, as required for proper parallel…
▽ More
The simulation of large ensembles of particles is usually parallelized by partitioning the domain spatially and using message passing to communicate between the processes handling neighboring subdomains. The particles are represented as individual geometric objects and are associated to the subdomains. Handling collisions and migrating particles between subdomains, as required for proper parallel execution, requires a complex communication protocol. Typically, the parallelization is restricted to handling only particles that are smaller than a subdomain. In many applications, however, particle sizes may vary drastically with some of them being larger than a subdomain. In this article we propose a new communication and synchronization algorithm that can handle the parallelization without size restrictions on the particles. Despite the additional complexity and extended functionality, the new algorithm introduces only minimal overhead. We demonstrate the scalability of the previous and the new communication algorithms up to almost two million parallel processes and for handling ten billion (1e10) geometrically resolved particles on a state-of-the-art petascale supercomputer. Different scenarios are presented to analyze the performance of the new algorithm and to demonstrate its capability to simulate polydisperse scenarios, where large individual particles can extend across several subdomains.
△ Less
Submitted 2 August, 2018; v1 submitted 8 February, 2018;
originally announced February 2018.
-
Direct simulation of liquid-gas-solid flow with a free surface lattice Boltzmann method
Authors:
Simon Bogner,
Jens Harting,
Ulrich Rüde
Abstract:
Direct numerical simulation of liquid-gas-solid flows is uncommon due to the considerable computational cost. As the grid spacing is determined by the smallest involved length scale, large grid sizes become necessary -- in particular if the bubble-particle aspect ratio is on the order of 10 or larger. Hence, it arises the question of both feasibility and reasonability. In this paper, we present a…
▽ More
Direct numerical simulation of liquid-gas-solid flows is uncommon due to the considerable computational cost. As the grid spacing is determined by the smallest involved length scale, large grid sizes become necessary -- in particular if the bubble-particle aspect ratio is on the order of 10 or larger. Hence, it arises the question of both feasibility and reasonability. In this paper, we present a fully parallel, scalable method for direct numerical simulation of bubble-particle interaction at a size ratio of 1-2 orders of magnitude that makes simulations feasible on currently available super-computing resources. With the presented approach, simulations of bubbles in suspension columns consisting of more than $100\,000$ fully resolved particles become possible. Furthermore, we demonstrate the significance of particle-resolved simulations by comparison to previous unresolved solutions. The results indicate that fully-resolved direct numerical simulation is indeed necessary to predict the flow structure of bubble-particle interaction problems correctly.
△ Less
Submitted 19 December, 2017;
originally announced December 2017.
-
A Coupled Lattice Boltzmann Method and Discrete Element Method for Discrete Particle Simulations of Particulate Flows
Authors:
Christoph Rettinger,
Ulrich Rüde
Abstract:
Discrete particle simulations are widely used to study large-scale particulate flows in complex geometries where particle-particle and particle-fluid interactions require an adequate representation but the computational cost has to be kept low. In this work, we present a novel coupling approach for such simulations. A lattice Boltzmann formulation of the generalized Navier-Stokes equations is used…
▽ More
Discrete particle simulations are widely used to study large-scale particulate flows in complex geometries where particle-particle and particle-fluid interactions require an adequate representation but the computational cost has to be kept low. In this work, we present a novel coupling approach for such simulations. A lattice Boltzmann formulation of the generalized Navier-Stokes equations is used to describe the fluid motion. This promises efficient simulations suitable for high performance computing and, since volume displacement effects by the solid phase are considered, our approach is also applicable to non-dilute particulate systems. The discrete element method is combined with an explicit evaluation of interparticle lubrication forces to simulate the motion of individual submerged particles. Drag, pressure and added mass forces determine the momentum transfer by fluid-particle interactions. A stable coupling algorithm is presented and discussed in detail. We demonstrate the validity of our approach for dilute as well as dense systems by predicting the settling velocity of spheres over a broad range of solid volume fractions in good agreement with semi-empirical correlations. Additionally, the accuracy of particle-wall interactions in a viscous fluid is thoroughly tested and established. Our approach can thus be readily used for various particulate systems and can be extended straightforward to e.g. non-spherical particles.
△ Less
Submitted 1 November, 2017;
originally announced November 2017.
-
A comparative study of fluid-particle coupling methods for fully resolved lattice Boltzmann simulations
Authors:
Christoph Rettinger,
Ulrich Rüde
Abstract:
The direct numerical simulation of particulate systems offers a unique approach to study the dynamics of fluid-solid suspensions by fully resolving the submerged particles and without introducing empirical models. For the lattice Boltzmann method, different variants exist to incorporate the fluid-particle interaction into the simulation. This paper provides a detailed and systematic comparison of…
▽ More
The direct numerical simulation of particulate systems offers a unique approach to study the dynamics of fluid-solid suspensions by fully resolving the submerged particles and without introducing empirical models. For the lattice Boltzmann method, different variants exist to incorporate the fluid-particle interaction into the simulation. This paper provides a detailed and systematic comparison of two different methods, namely the momentum exchange method and the partially saturated cells method by Noble and Torczynski. Three subvariants of each method are used in the benchmark scenario of a single heavy sphere settling in ambient fluid to study their characteristics and accuracy for particle Reynolds numbers from 185 up to 365. The sphere must be resolved with at least 24 computational cells per diameter to achieve velocity errors below 5%. The momentum exchange method is found to be more accurate in predicting the streamwise velocity component whereas the partially saturated cells method is more accurate in the spanwise components. The study reveals that the resolution should be chosen with respect to the coupling dynamics, and not only based on the flow properties, to avoid large errors in the fluid-particle interaction.
△ Less
Submitted 16 February, 2017;
originally announced February 2017.
-
Free Surface Lattice Boltzmann with Enhanced Bubble Model
Authors:
Daniela Anderl,
Simon Bogner,
Cornelia Rauh,
Ulrich Rüde,
Antonio Delgado
Abstract:
This paper presents an enhancement to the free surface lattice Boltzmann method (FSLBM) for the simulation of bubbly flows including rupture and breakup of bubbles. The FSLBM uses a volume of fluid approach to reduce the problem of a liquid-gas two-phase flow to a single-phase free surface simulation. In bubbly flows compression effects leading to an increase or decrease of pressure in the suspend…
▽ More
This paper presents an enhancement to the free surface lattice Boltzmann method (FSLBM) for the simulation of bubbly flows including rupture and breakup of bubbles. The FSLBM uses a volume of fluid approach to reduce the problem of a liquid-gas two-phase flow to a single-phase free surface simulation. In bubbly flows compression effects leading to an increase or decrease of pressure in the suspended bubbles cannot be neglected. Therefore, the free surface simulation is augmented by a bubble model that supplies the missing information by tracking the topological changes of the free surface in the flow. The new model presented here is capable of handling the effects of bubble breakup and coalesce without causing a significant computational overhead. Thus, the enhanced bubble model extends the applicability of the FSLBM to a new range of practically relevant problems, like bubble formation and development in chemical reactors or foaming processes.
△ Less
Submitted 6 April, 2016;
originally announced April 2016.
-
Microswimming with inertia
Authors:
Jayant Pande,
Kristina Pickl,
Oleg Trosman,
Ulrich Rüde,
Ana-Sunčana Smith
Abstract:
Microswimmers, especially in theoretical treatments, are generally taken to be completely inertia-free, since inertial effects on their motion are typically small and assuming their absence simplifies the problem considerably. Yet in nature there is no discrete break between swimmers for which inertia is negligibly small and for which it is detectable. Here we study a microswimming model for which…
▽ More
Microswimmers, especially in theoretical treatments, are generally taken to be completely inertia-free, since inertial effects on their motion are typically small and assuming their absence simplifies the problem considerably. Yet in nature there is no discrete break between swimmers for which inertia is negligibly small and for which it is detectable. Here we study a microswimming model for which the effect of inertia is calculated explicitly in the regime of transition between the Stokesian and the non-Stokesian flow limits, which we term the intermediate regime. The model in the inertialess limit is the bead-spring swimmer. We first show that in the intermediate regime a mechanical microswimmer exhibits damped inertial coasting like an underdamped harmonic oscillator. We then calculate analytically the swimmer's velocity by including a mass-acceleration term in the equations of motion which are otherwise based on the Stokes flow. We show that this hybrid treatment combining aspects of underdamped and overdamped dynamics provides an accurate description of the motion in the intermediate regime, as verified here by comparison to simulations using the lattice Boltzmann method, and is a significant improvement over the results from the inertialess theory when either the mass of the swimmer or the forces driving its motion is/are large enough.
△ Less
Submitted 6 November, 2016; v1 submitted 15 March, 2016;
originally announced March 2016.
-
Curvature estimation from a volume of fluid indicator function for the simulation of surface tension and wetting with a free surface lattice Boltzmann method
Authors:
Simon Bogner,
Ulrich Rüde,
Jens Harting
Abstract:
The free surface lattice Boltzmann method (FSLBM) is a combination of the hydrodynamic lattice Boltzmann method (LBM) with a volume of fluid (VOF) interface apturing technique for the simulation of incompressible free surface flows. Capillary effects are modeled by extracting the curvature of the interface from the VOF indicator function and imposing a pressure jump at the free boundary. However,…
▽ More
The free surface lattice Boltzmann method (FSLBM) is a combination of the hydrodynamic lattice Boltzmann method (LBM) with a volume of fluid (VOF) interface apturing technique for the simulation of incompressible free surface flows. Capillary effects are modeled by extracting the curvature of the interface from the VOF indicator function and imposing a pressure jump at the free boundary. However, obtaining accurate curvature estimates from a VOF description can introduce significant errors. This article reports numerical results for three different surface tension models in standard test cases, and compares the according errors in the velocity field (spurious currents). Furthermore, the FSLBM is shown to be suited to simulate wetting effects at solid boundaries. To this end, a new method is developed to represent wetting boundary conditions in a least squares curvature econstruction technique. The main limitations of the current FSLBM are analyzed and are found to be caused by its simplified advection scheme. Possible improvements are suggested.
△ Less
Submitted 10 February, 2016; v1 submitted 25 September, 2015;
originally announced September 2015.
-
Pore-scale lattice Boltzmann simulation of laminar and turbulent flow through a sphere pack
Authors:
Ehsan Fattahia,
Christian Waluga,
Barbara Wohlmuth,
Ulrich Rüde,
Michael Manhart,
Rainer Helmig
Abstract:
The lattice Boltzmann method can be used to simulate flow through porous media with full geometrical resolution. With such a direct numerical simulation, it becomes possible to study fundamental effects which are difficult to assess either by developing macroscopic mathematical models or experiments. We first evaluate the lattice Boltzmann method with various boundary handling of the solid-wall an…
▽ More
The lattice Boltzmann method can be used to simulate flow through porous media with full geometrical resolution. With such a direct numerical simulation, it becomes possible to study fundamental effects which are difficult to assess either by developing macroscopic mathematical models or experiments. We first evaluate the lattice Boltzmann method with various boundary handling of the solid-wall and various collision operators to assess their suitability for large scale direct numerical simulation of porous media flow. A periodic pressure drop boundary condition is used to mimic the pressure driven flow through the simple sphere pack in a periodic domain. The evaluation of the method is done in the Darcy regime and the results are compared to a semi-analytic solution. Taking into account computational cost and accuracy, we choose the most efficient combination of the solid boundary condition and collision operator. We apply this method to perform simulations for a wide range of Reynolds numbers from Stokes flow over seven orders of magnitude to turbulent flow. Contours and streamlines of the flow field are presented to show the flow behavior in different flow regimes. Moreover, unknown parameters of the Forchheimer, the Barree--Conway and friction factor models are evaluated numerically for the considered flow regimes.
△ Less
Submitted 12 August, 2015;
originally announced August 2015.
-
Massively Parallel Phase-Field Simulations for Ternary Eutectic Directional Solidification
Authors:
Martin Bauer,
Johannes Hötzer,
Philipp Steinmetz,
Marcus Jainta,
Marco Berghoff,
Florian Schornbaum,
Christian Godenschwager,
Harald Köstler,
Britta Nestler,
Ulrich Rüde
Abstract:
Microstructures forming during ternary eutectic directional solidification processes have significant influence on the macroscopic mechanical properties of metal alloys. For a realistic simulation, we use the well established thermodynamically consistent phase-field method and improve it with a new grand potential formulation to couple the concentration evolution. This extension is very compute in…
▽ More
Microstructures forming during ternary eutectic directional solidification processes have significant influence on the macroscopic mechanical properties of metal alloys. For a realistic simulation, we use the well established thermodynamically consistent phase-field method and improve it with a new grand potential formulation to couple the concentration evolution. This extension is very compute intensive due to a temperature dependent diffusive concentration. We significantly extend previous simulations that have used simpler phase-field models or were performed on smaller domain sizes. The new method has been implemented within the massively parallel HPC framework waLBerla that is designed to exploit current supercomputers efficiently. We apply various optimization techniques, including buffering techniques, explicit SIMD kernel vectorization, and communication hiding. Simulations utilizing up to 262,144 cores have been run on three different supercomputing architectures and weak scalability results are shown. Additionally, a hierarchical, mesh-based data reduction strategy is developed to keep the I/O problem manageable at scale.
△ Less
Submitted 4 June, 2015;
originally announced June 2015.
-
Two Computational Models for Simulating the Tumbling Motion of Elongated Particles in Fluids
Authors:
Dominik Bartuschat,
Ellen Fischermeier,
Katarina Gustavsson,
Ulrich Rüde
Abstract:
Suspensions with fiber-like particles in the low Reynolds number regime are modeled by two different approaches that both use a Lagrangian representation of individual particles. The first method is the well-established formulation based on Stokes flow that is formulated as integral equations. It uses a slender body approximation for the fibers to represent the interaction between them directly wi…
▽ More
Suspensions with fiber-like particles in the low Reynolds number regime are modeled by two different approaches that both use a Lagrangian representation of individual particles. The first method is the well-established formulation based on Stokes flow that is formulated as integral equations. It uses a slender body approximation for the fibers to represent the interaction between them directly without explicitly computing the flow field. The second is a new technique using the 3D lattice Boltzmann method on parallel supercomputers. Here the flow computation is coupled to a computational model of the dynamics of rigid bodies using fluid-structure interaction techniques. Both methods can be applied to simulate fibers in fluid flow. They are carefully validated and compared against each other, exposing systematically their strengths and weaknesses regarding their accuracy, the computational cost, and possible model extensions.
△ Less
Submitted 23 March, 2015;
originally announced March 2015.
-
Ultrascale Simulations of Non-smooth Granular Dynamics
Authors:
Tobias Preclik,
Ulrich Rüde
Abstract:
This article presents new algorithms for massively parallel granular dynamics simulations on distributed memory architectures using a domain partitioning approach. Collisions are modelled with hard contacts in order to hide their micro-dynamics and thus to extend the time and length scales that can be simulated. The multi-contact problem is solved using a non-linear block Gauss-Seidel method that…
▽ More
This article presents new algorithms for massively parallel granular dynamics simulations on distributed memory architectures using a domain partitioning approach. Collisions are modelled with hard contacts in order to hide their micro-dynamics and thus to extend the time and length scales that can be simulated. The multi-contact problem is solved using a non-linear block Gauss-Seidel method that is conforming to the subdomain structure. The parallel algorithms employ a sophisticated protocol between processors that delegate algorithmic tasks such as contact treatment and position integration uniquely and robustly to the processors. Communication overhead is minimized through aggressive message aggregation, leading to excellent strong and weak scaling. The robustness and scalability is assessed on three clusters including two peta-scale supercomputers with up to 458752 processor cores. The simulations can reach unprecedented resolution of up to ten billion non-spherical particles and contacts.
△ Less
Submitted 23 January, 2015;
originally announced January 2015.
-
Parallel Multiphysics Simulations of Charged Particles in Microfluidic Flows
Authors:
Dominik Bartuschat,
Ulrich Rüde
Abstract:
The article describes parallel multiphysics simulations of charged particles in microfluidic flows with the waLBerla framework. To this end, three physical effects are coupled: rigid body dynamics, fluid flow modelled by a lattice Boltzmann algorithm, and electric potentials represented by a finite volume discretisation. For solving the finite volume discretisation for the electrostatic forces, a…
▽ More
The article describes parallel multiphysics simulations of charged particles in microfluidic flows with the waLBerla framework. To this end, three physical effects are coupled: rigid body dynamics, fluid flow modelled by a lattice Boltzmann algorithm, and electric potentials represented by a finite volume discretisation. For solving the finite volume discretisation for the electrostatic forces, a cell-centered multigrid algorithm is developed that conforms to the lattice Boltzmann meshes and the parallel communication structure of waLBerla. The new functionality is validated with suitable benchmark scenarios. Additionally, the parallel scaling and the numerical efficiency of the algorithms are analysed on an advanced supercomputer.
△ Less
Submitted 24 October, 2014;
originally announced October 2014.
-
Boundary Conditions for Free Interfaces with the Lattice Boltzmann Method
Authors:
Simon Bogner,
Regina Ammer,
Ulrich Rüde
Abstract:
In this paper we analyze the boundary treatment of the lattice Boltzmann method (LBM) for simulating 3D flows with free surfaces. The widely used free surface boundary condition of Körner et al. (2005) is shown to be first order accurate. The article presents a new free surface boundary scheme that is suitable for second order accurate simulations based on the LBM. The new method takes into accoun…
▽ More
In this paper we analyze the boundary treatment of the lattice Boltzmann method (LBM) for simulating 3D flows with free surfaces. The widely used free surface boundary condition of Körner et al. (2005) is shown to be first order accurate. The article presents a new free surface boundary scheme that is suitable for second order accurate simulations based on the LBM. The new method takes into account the free surface position and its orientation with respect to the computational lattice. Numerical experiments confirm the theoretical findings and illustrate the different behavior of the original method and the new method.
△ Less
Submitted 16 February, 2015; v1 submitted 19 September, 2014;
originally announced September 2014.
-
Drag correlation for dilute and moderately dense fluid-particle systems using the lattice Boltzmann method
Authors:
Simon Bogner,
Swati Mohanty,
Ulrich Rüde
Abstract:
This paper presents a numerical study of flow through static random assemblies of monodisperse, spherical particles. A lattice Boltzmann approach based on a two relaxation time collision operator is used to obtain reliable predictions of the particle drag by direct numerical simulation. From these predictions a closure law $F(Re, {\varphi})$ of the drag force relationship to the bed density…
▽ More
This paper presents a numerical study of flow through static random assemblies of monodisperse, spherical particles. A lattice Boltzmann approach based on a two relaxation time collision operator is used to obtain reliable predictions of the particle drag by direct numerical simulation. From these predictions a closure law $F(Re, {\varphi})$ of the drag force relationship to the bed density ${\varphi}$ and the particle Reynolds number $Re$ is derived. The present study includes densities ${\varphi}$ ranging from $0.01$ to $0.35$ with Re ranging up to $300$, that is compiled into a single drag correlation valid for the whole range. The corelation has a more compact expression compared to others previously reported in literature. At low particle densities, the new correlation is close to the widely used Wen & Yu - correlation. Recently, there has been reported a discrepancy between results obtained using different numerical methods, namely the comprehensive lattice Boltzmann study of Beetstra et al. (2007) and the predictions based on an immersed boundary - pseudo-spectral Navier-Stokes approach (Tenneti et al., 2011). The present study excludes significant finite resolution effects, which have been suspected to cause the reported deviations, but does not coincide exactly with either of the previous studies. This indicates the need for yet more accurate simulation methods in the future.
△ Less
Submitted 7 October, 2014; v1 submitted 9 January, 2014;
originally announced January 2014.
-
Permeability of porous materials determined from the Euler characteristic
Authors:
Christian Scholz,
Frank Wirner,
Jan Götz,
Ulrich Rüde,
Gerd E. Schröder-Turk,
Klaus Mecke,
Clemens Bechinger
Abstract:
We study the permeability of quasi two-dimensional porous structures of randomly placed overlapping monodisperse circular and elliptical grains. Measurements in microfluidic devices and lattice Boltzmann simulations demonstrate that the permeability is determined by the Euler characteristic of the conducting phase. We obtain an expression for the permeability that is independent of the percolation…
▽ More
We study the permeability of quasi two-dimensional porous structures of randomly placed overlapping monodisperse circular and elliptical grains. Measurements in microfluidic devices and lattice Boltzmann simulations demonstrate that the permeability is determined by the Euler characteristic of the conducting phase. We obtain an expression for the permeability that is independent of the percolation threshold and shows agreement with experimental and simulated data over a wide range of porosities. Our approach suggests that the permeability explicitly depends on the overlapping probability of grains rather than their shape.
△ Less
Submitted 29 November, 2012;
originally announced November 2012.
-
Liquid-gas-solid flows with lattice Boltzmann: Simulation of floating bodies
Authors:
Simon Bogner,
Ulrich Rüde
Abstract:
This paper presents a model for the simulation of liquid-gas-solid flows by means of the lattice Boltzmann method. The approach is built upon previous works for the simulation of liquid-solid particle suspensions on the one hand, and on a liquid-gas free surface model on the other. We show how the two approaches can be unified by a novel set of dynamic cell conversion rules. For evaluation, we con…
▽ More
This paper presents a model for the simulation of liquid-gas-solid flows by means of the lattice Boltzmann method. The approach is built upon previous works for the simulation of liquid-solid particle suspensions on the one hand, and on a liquid-gas free surface model on the other. We show how the two approaches can be unified by a novel set of dynamic cell conversion rules. For evaluation, we concentrate on the rotational stability of non-spherical rigid bodies floating on a plane water surface - a classical hydrostatic problem known from naval architecture. We show the consistency of our method in this kind of flows and obtain convergence towards the ideal solution for the measured heeling stability of a floating box.
△ Less
Submitted 1 January, 2012;
originally announced January 2012.
-
All good things come in threes - Three beads learn to swim with lattice Boltzmann and a rigid body solver
Authors:
Kristina Pickl,
Jan Götz,
Klaus Iglberger,
Jayant Pande,
Klaus Mecke,
Ana-Suncana Smith,
Ulrich Rüde
Abstract:
We simulate the self-propulsion of devices in a fluid in the regime of low Reynolds numbers. Each device consists of three bodies (spheres or capsules) connected with two damped harmonic springs. Sinusoidal driving forces compress the springs which are resolved within a rigid body physics engine. The latter is consistently coupled to a 3D lattice Boltzmann framework for the fluid dynamics. In simu…
▽ More
We simulate the self-propulsion of devices in a fluid in the regime of low Reynolds numbers. Each device consists of three bodies (spheres or capsules) connected with two damped harmonic springs. Sinusoidal driving forces compress the springs which are resolved within a rigid body physics engine. The latter is consistently coupled to a 3D lattice Boltzmann framework for the fluid dynamics. In simulations of three-sphere devices, we find that the propulsion velocity agrees well with theoretical predictions. In simulations where some or all spheres are replaced by capsules, we find that the asymmetry of the design strongly affects the propelling efficiency.
△ Less
Submitted 3 August, 2011;
originally announced August 2011.
