-
A thermodynamics-based turbulence model for isothermal compressible flows
Authors:
Zhiting Ma,
Wen-An Yong,
Yi Zhu
Abstract:
This study presents a new turbulence model for isothermal compressible flows. The model is derived by combining the Favre averaging and the Conservation-dissipation formalism -- a newly developed thermodynamics theory. The latter provides a systematic methodology to construct closure relations that intrinsically satisfy the first and second laws of thermodynamics. The new model is a hyperbolic sys…
▽ More
This study presents a new turbulence model for isothermal compressible flows. The model is derived by combining the Favre averaging and the Conservation-dissipation formalism -- a newly developed thermodynamics theory. The latter provides a systematic methodology to construct closure relations that intrinsically satisfy the first and second laws of thermodynamics. The new model is a hyperbolic system of first-order partial differential equations. It has a number of numerical advantages, and addresses some drawbacks of classical turbulence models by resolving the non-physical infinite information propagation paradox of the parabolic-type models and accurately capturing the interaction between compressibility and turbulence dissipation. Furthermore, we show the compatibility of the proposed model with Prandtl's one-equation model for incompressible flows by deliberately rescaling the model and studying its low Mach number limit.
△ Less
Submitted 25 April, 2025;
originally announced April 2025.
-
Poisson quadrature method of moments for 2D kinetic equations with velocity of constant magnitude
Authors:
Yihong Chen,
Qian Huang,
Wen-An Yong,
Ruixi Zhang
Abstract:
This work is concerned with kinetic equations with velocity of constant magnitude. We propose a quadrature method of moments based on the Poisson kernel, called Poisson-EQMOM. The derived moment closure systems are well defined for all physically relevant moments and the resultant approximations of the distribution function converge as the number of moments goes to infinity. The convergence makes…
▽ More
This work is concerned with kinetic equations with velocity of constant magnitude. We propose a quadrature method of moments based on the Poisson kernel, called Poisson-EQMOM. The derived moment closure systems are well defined for all physically relevant moments and the resultant approximations of the distribution function converge as the number of moments goes to infinity. The convergence makes our method stand out from most existing moment methods. Moreover, we devise a delicate moment inversion algorithm. As an application, the Vicsek model is studied for overdamped active particles. Then the Poisson-EQMOM is validated with a series of numerical tests including spatially homogeneous, one-dimensional and two-dimensional problems.
△ Less
Submitted 19 November, 2024; v1 submitted 19 August, 2023;
originally announced August 2023.
-
Stability analysis of an extended quadrature method of moments for kinetic equations
Authors:
Ruixi Zhang,
Qian Huang,
Wen-An Yong
Abstract:
This paper performs a stability analysis of a class of moment closure systems derived with an extended quadrature method of moments (EQMOM) for the one-dimensional BGK equation. The class is characterized with a kernel function. A sufficient condition on the kernel is identified for the EQMOM-derived moment systems to be strictly hyperbolic. We also investigate the realizability of the moment meth…
▽ More
This paper performs a stability analysis of a class of moment closure systems derived with an extended quadrature method of moments (EQMOM) for the one-dimensional BGK equation. The class is characterized with a kernel function. A sufficient condition on the kernel is identified for the EQMOM-derived moment systems to be strictly hyperbolic. We also investigate the realizability of the moment method. Moreover, sufficient and necessary conditions are established for the two-node systems to be well-defined and strictly hyperbolic, and to preserve the dissipation property of the kinetic equation.
△ Less
Submitted 13 June, 2023;
originally announced June 2023.
-
Discrete-velocity-direction models of BGK-type with minimum entropy: II. Weighted models
Authors:
Yihong Chen,
Qian Huang,
Wen-An Yong
Abstract:
In this series of works, we develop a discrete-velocity-direction model (DVDM) with collisions of BGK-type for simulating gas flows, where the molecular motion is confined to some prescribed directions but the speed is still a continuous variable in each orientation. In this article, we introduce a weighted function in each orientation when recovering the macroscopic parameters. Moreover, the inte…
▽ More
In this series of works, we develop a discrete-velocity-direction model (DVDM) with collisions of BGK-type for simulating gas flows, where the molecular motion is confined to some prescribed directions but the speed is still a continuous variable in each orientation. In this article, we introduce a weighted function in each orientation when recovering the macroscopic parameters. Moreover, the internal molecular degrees of freedom are considered. With this weighted DVDM, we develop three submodels by incorporating the discrete velocity method, the Gaussian-extended quadrature method of moments and the Hermite spectral method in each direction. These spatial-time submodels are novel multidimensional versions corresponding to the three approaches. Numerical tests with a series of 1-D and 2-D flow problems show the efficiency of the weighted DVDM.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
Neuroevolution of Physics-Informed Neural Nets: Benchmark Problems and Comparative Results
Authors:
Nicholas Sung Wei Yong,
Jian Cheng Wong,
Pao-Hsiung Chiu,
Abhishek Gupta,
Chinchun Ooi,
Yew-Soon Ong
Abstract:
The potential of learned models for fundamental scientific research and discovery is drawing increasing attention worldwide. Physics-informed neural networks (PINNs), where the loss function directly embeds governing equations of scientific phenomena, is one of the key techniques at the forefront of recent advances. PINNs are typically trained using stochastic gradient descent methods, akin to the…
▽ More
The potential of learned models for fundamental scientific research and discovery is drawing increasing attention worldwide. Physics-informed neural networks (PINNs), where the loss function directly embeds governing equations of scientific phenomena, is one of the key techniques at the forefront of recent advances. PINNs are typically trained using stochastic gradient descent methods, akin to their deep learning counterparts. However, analysis in this paper shows that PINNs' unique loss formulations lead to a high degree of complexity and ruggedness that may not be conducive for gradient descent. Unlike in standard deep learning, PINN training requires globally optimum parameter values that satisfy physical laws as closely as possible. Spurious local optimum, indicative of erroneous physics, must be avoided. Hence, neuroevolution algorithms, with their superior global search capacity, may be a better choice for PINNs relative to gradient descent methods. Here, we propose a set of five benchmark problems, with open-source codes, spanning diverse physical phenomena for novel neuroevolution algorithm development. Using this, we compare two neuroevolution algorithms against the commonly used stochastic gradient descent, and our baseline results support the claim that neuroevolution can surpass gradient descent, ensuring better physics compliance in the predicted outputs. %Furthermore, implementing neuroevolution with JAX leads to orders of magnitude speedup relative to standard implementations.
△ Less
Submitted 6 December, 2023; v1 submitted 15 December, 2022;
originally announced December 2022.
-
Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures
Authors:
Juntao Huang,
Yingda Cheng,
Andrew J. Christlieb,
Luke F. Roberts,
Wen-An Yong
Abstract:
This is the second paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE). In our previous work \cite{huang2021gradient}, we proposed an approach to directly learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, the ML moment c…
▽ More
This is the second paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE). In our previous work \cite{huang2021gradient}, we proposed an approach to directly learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, the ML moment closure model in \cite{huang2021gradient} is not able to guarantee hyperbolicity and long time stability. We propose in this paper a method to enforce the global hyperbolicity of the ML closure model. The main idea is to seek a symmetrizer (a symmetric positive definite matrix) for the closure system, and derive constraints such that the system is globally symmetrizable hyperbolic. It is shown that the new ML closure system inherits the dissipativeness of the RTE and preserves the correct diffusion limit as the Knunsden number goes to zero. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, long time stability and generalizability of our globally hyperbolic ML closure model.
△ Less
Submitted 29 May, 2021;
originally announced May 2021.
-
Data-driven discovery of multiscale chemical reactions governed by the law of mass action
Authors:
Juntao Huang,
Yizhou Zhou,
Wen-An Yong
Abstract:
In this paper, we propose a data-driven method to discover multiscale chemical reactions governed by the law of mass action. First, we use a single matrix to represent the stoichiometric coefficients for both the reactants and products in a system without catalysis reactions. The negative entries in the matrix denote the stoichiometric coefficients for the reactants and the positive ones for the p…
▽ More
In this paper, we propose a data-driven method to discover multiscale chemical reactions governed by the law of mass action. First, we use a single matrix to represent the stoichiometric coefficients for both the reactants and products in a system without catalysis reactions. The negative entries in the matrix denote the stoichiometric coefficients for the reactants and the positive ones for the products. Second, we find that the conventional optimization methods usually get stuck in the local minima and could not find the true solution in learning the multiscale chemical reactions. To overcome this difficulty, we propose a partial-parameters-freezing (PPF) technique to progressively determine the network parameters by using the fact that the stoichiometric coefficients are integers. With such a technique, the dimension of the searching space is gradually reduced in the training process and the global mimina can be eventually obtained. Several numerical experiments including the classical Michaelis-Menten kinetics, the hydrogen oxidation reactions, and the simplified GRI-3.0 mechanism verify the good performance of our algorithm in learning the multiscale chemical reactions. The code is available at \url{https://github.com/JuntaoHuang/multiscale-chemical-reaction}.
△ Less
Submitted 26 September, 2021; v1 submitted 16 January, 2021;
originally announced January 2021.
-
Equilibrium Stability Analysis of Hyperbolic Shallow Water Moment Equations
Authors:
Qian Huang,
Julian Koellermeier,
Wen-An Yong
Abstract:
In this paper we analyze the stability of equilibrium manifolds of hyperbolic shallow water moment equations. Shallow water moment equations describe shallow flows for complex velocity profiles which vary in vertical direction and the models can be seen as extensions of the standard shallow water equations. Equilibrium stability is an important property of balance laws that determines the linear s…
▽ More
In this paper we analyze the stability of equilibrium manifolds of hyperbolic shallow water moment equations. Shallow water moment equations describe shallow flows for complex velocity profiles which vary in vertical direction and the models can be seen as extensions of the standard shallow water equations. Equilibrium stability is an important property of balance laws that determines the linear stability of solutions in the vicinity of equilibrium manifolds and it is seen as a necessary condition for stable numerical solutions. After an analysis of the hyperbolic structure of the models, we identify three different stability manifolds based on three different limits of the right-hand side friction term, which physically correspond to water-at-rest, constant-velocity, and bottom-at-rest velocity profiles. The stability analysis then shows that the structural stability conditions are fulfilled for the water-at-rest equilibrium and the constant-velocity equilibrium. However, the bottom-at-rest equilibrium can lead to instable modes depending on the velocity profile. Relaxation towards the respective equilibrium manifolds is investigated numerically for different models.
△ Less
Submitted 17 November, 2020;
originally announced November 2020.
-
Learning Thermodynamically Stable and Galilean Invariant Partial Differential Equations for Non-equilibrium Flows
Authors:
Juntao Huang,
Zhiting Ma,
Yizhou Zhou,
Wen-An Yong
Abstract:
In this work, we develop a method for learning interpretable, thermodynamically stable and Galilean invariant partial differential equations (PDEs) based on the Conservation-dissipation Formalism of irreversible thermodynamics. As governing equations for non-equilibrium flows in one dimension, the learned PDEs are parameterized by fully-connected neural networks and satisfy the conservation-dissip…
▽ More
In this work, we develop a method for learning interpretable, thermodynamically stable and Galilean invariant partial differential equations (PDEs) based on the Conservation-dissipation Formalism of irreversible thermodynamics. As governing equations for non-equilibrium flows in one dimension, the learned PDEs are parameterized by fully-connected neural networks and satisfy the conservation-dissipation principle automatically. In particular, they are hyperbolic balance laws and Galilean invariant. The training data are generated from a kinetic model with smooth initial data. Numerical results indicate that the learned PDEs can achieve good accuracy in a wide range of Knudsen numbers. Remarkably, the learned dynamics can give satisfactory results with randomly sampled discontinuous initial data and Sod's shock tube problem although it is trained only with smooth initial data.
△ Less
Submitted 25 November, 2020; v1 submitted 28 September, 2020;
originally announced September 2020.
-
Properties of Conservation-dissipation Formalism of Irreversible Thermodynamics
Authors:
Wen-An Yong
Abstract:
This paper proposes four fundamental requirements for establishing PDEs (partial differential equations) modeling irreversible processes. We show that the PDEs derived via the CDF (conservation-dissipation formalism) meet all the requirements. In doing so, we find useful constraints on the freedoms of CDF and point out that a shortcoming of the formalism can be remedied with the help of the Maxwel…
▽ More
This paper proposes four fundamental requirements for establishing PDEs (partial differential equations) modeling irreversible processes. We show that the PDEs derived via the CDF (conservation-dissipation formalism) meet all the requirements. In doing so, we find useful constraints on the freedoms of CDF and point out that a shortcoming of the formalism can be remedied with the help of the Maxwell iteration. It is proved that the iteration preserves the gradient structure and strong dissipativeness of the CDF-based PDEs. A refined formulation of the second law of thermodynamics is given to characterize the strong dissipativeness, while the gradient structure corresponds to nonlinear Onsager relations. Further advantages and limitations of CDF will also be presented.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
-
Relaxation-rate formula for the entropic lattice Boltzmann method
Authors:
Weifeng Zhao,
Wen-An Yong
Abstract:
An elegant and uniform relaxation-rate formula is presented for the entropic lattice Boltzmann method (ELBM). The formula not only guarantees the discrete time H-theorem at numerical level but also gives full consideration to the consistency with hydrodynamics. With this novel formula, the computational cost of the ELBM is significantly reduced and the method now can be efficiently used for a broa…
▽ More
An elegant and uniform relaxation-rate formula is presented for the entropic lattice Boltzmann method (ELBM). The formula not only guarantees the discrete time H-theorem at numerical level but also gives full consideration to the consistency with hydrodynamics. With this novel formula, the computational cost of the ELBM is significantly reduced and the method now can be efficiently used for a broad range of hydrodynamics applications including high Renolds number flows. Moreover, we demonstrate that the grid points where flow fields change drastically are effectively marked by the formula.
△ Less
Submitted 1 April, 2019;
originally announced April 2019.
-
A family of single-node second-order boundary schemes for the lattice Boltzmann method
Authors:
Weifeng Zhao,
Wen-An Yong
Abstract:
In this work, we propose a family of single-node second-order boundary schemes for the lattice Boltzmann method with general collision terms. The construction of the schemes is quite universal and simple, it does not involve concrete lattice Boltzmann models and uses the half-way bounce-back rule as a central step. The constructed schemes are all second-order accurate if so is the bounce-back rule…
▽ More
In this work, we propose a family of single-node second-order boundary schemes for the lattice Boltzmann method with general collision terms. The construction of the schemes is quite universal and simple, it does not involve concrete lattice Boltzmann models and uses the half-way bounce-back rule as a central step. The constructed schemes are all second-order accurate if so is the bounce-back rule. In addition, the proposed schemes have good stability thanks to convex combinations. The accuracy and stability of several specific schemes are numerically validated for multiple-relaxation-time models in both 2D and 3D.
△ Less
Submitted 21 December, 2017;
originally announced December 2017.
-
A Novel Dissipation Property of the Master Equation
Authors:
Liu Hong,
Chen Jia,
Yi Zhu,
Wen-An Yong
Abstract:
Recent studies have shown that the entropy production rate for the master equation consists of two nonnegative terms: the adiabatic and non-adiabatic parts, where the non-adiabatic part is also known as the dissipation rate of a Boltzmann-Shannon relative entropy. In this paper, we provide some nonzero lower bounds for the relative entropy, the entropy production rate, and its adiabatic and non-ad…
▽ More
Recent studies have shown that the entropy production rate for the master equation consists of two nonnegative terms: the adiabatic and non-adiabatic parts, where the non-adiabatic part is also known as the dissipation rate of a Boltzmann-Shannon relative entropy. In this paper, we provide some nonzero lower bounds for the relative entropy, the entropy production rate, and its adiabatic and non-adiabatic parts. These nonzero lower bounds not only reveal some novel dissipative properties for general nonequilibrium processes which are much stronger than the second law of thermodynamics, but also impose some new constraints on thermodynamic constitutive relations. Moreover, we also provide a mathematical application of these nonzero lower bounds by studying the long-time behavior of the master equation. Extensions to the Tsallis statistics are also discussed, including the nonzero lower bounds for the Tsallis-type relative entropy and its dissipation rate.
△ Less
Submitted 25 November, 2015; v1 submitted 26 November, 2014;
originally announced November 2014.
-
Boltzmann-Equation Based Derivation of Balance Laws in Irreversible Thermodynamics
Authors:
Liu Hong,
Zaibao Yang,
Yi Zhu,
Wen-An Yong
Abstract:
In this paper we propose a novel approach to construct macroscopic balance equations and constitutive equations describing various irreversible phenomena. It is based on the general principles of non-equilibrium thermodynamics and consists of four basic steps: picking suitable state variables, choosing a strictly concave entropy function, separating entropy fluxes and production rates properly, an…
▽ More
In this paper we propose a novel approach to construct macroscopic balance equations and constitutive equations describing various irreversible phenomena. It is based on the general principles of non-equilibrium thermodynamics and consists of four basic steps: picking suitable state variables, choosing a strictly concave entropy function, separating entropy fluxes and production rates properly, and determining a dissipation matrix. Our approach takes the advantage of both EIT and GENERIC formalisms, and shows a direct correspondence with Levermore's moment closure hierarchies for the Boltzmann equation. This result may put various macroscopic modeling approaches starting from the general principles of non-equilibrium thermodynamics on a solid microscopic foundation based on the Boltzmann equation.
△ Less
Submitted 25 November, 2014;
originally announced November 2014.
-
Asymptotic analysis of the lattice Boltzmann method for generalized Newtonian fluid flows
Authors:
Zai-Bao Yang,
Wen-An Yong
Abstract:
In this article, we present a detailed asymptotic analysis of the lattice Boltzmann method with two different collision mechanisms of BGK-type on the D2Q9-lattice for generalized Newtonian fluids. Unlike that based on the Chapman-Enskog expansion leading to the compressible Navier-Stokes equations, our analysis gives the incompressible ones directly and exposes certain important features of the la…
▽ More
In this article, we present a detailed asymptotic analysis of the lattice Boltzmann method with two different collision mechanisms of BGK-type on the D2Q9-lattice for generalized Newtonian fluids. Unlike that based on the Chapman-Enskog expansion leading to the compressible Navier-Stokes equations, our analysis gives the incompressible ones directly and exposes certain important features of the lattice Boltzmann solutions. Moreover, our analysis provides a theoretical basis for using the iteration to compute the rate-of-strain tensor, which makes sense specially for generalized Newtonian fluids. As a by-product, a seemingly new structural condition on the generalized Newtonian fluids is singled out. This condition reads as "the magnitude of the stress tensor increases with increasing the shear rate". We verify this condition for all the existing constitutive relations which are known to us. In addition, it it straightforward to extend our analysis to MRT models or to three-dimensional lattices.
△ Less
Submitted 30 September, 2013;
originally announced September 2013.
-
Newtonian limit of Maxwell fluid flows
Authors:
Wen-An Yong
Abstract:
In this paper, we revise Maxwell's constitutive relation and formulate a system of first-order partial differential equations with two parameters for compressible viscoelastic fluid flows. The system is shown to possess a nice conservation-dissipation (relaxation) structure and therefore is symmetrizable hyperbolic. Moreover, for smooth flows we rigorously verify that the revised Maxwell's constit…
▽ More
In this paper, we revise Maxwell's constitutive relation and formulate a system of first-order partial differential equations with two parameters for compressible viscoelastic fluid flows. The system is shown to possess a nice conservation-dissipation (relaxation) structure and therefore is symmetrizable hyperbolic. Moreover, for smooth flows we rigorously verify that the revised Maxwell's constitutive relations are compatible with Newton's law of viscosity.
△ Less
Submitted 2 March, 2013;
originally announced March 2013.
-
Partial equilibrium approximations in Apoptosis
Authors:
Ya-Jing Huang,
Wen-An Yong
Abstract:
Apoptosis is one of the most basic biological processes. In apoptosis, tens of species are involved in many biochemical reactions with times scales of widely differing orders of magnitude. By the law of mass action, the process is mathematically described with a large and stiff system of ODEs (ordinary differential equations). The goal of this work is to simplify such systems of ODEs with the PEA…
▽ More
Apoptosis is one of the most basic biological processes. In apoptosis, tens of species are involved in many biochemical reactions with times scales of widely differing orders of magnitude. By the law of mass action, the process is mathematically described with a large and stiff system of ODEs (ordinary differential equations). The goal of this work is to simplify such systems of ODEs with the PEA (partial equilibrium approximation) method. In doing so, we propose a general framework of the PEA method together with some conditions, under which the PEA method can be justified rigorously. The main condition is the principle of detailed balance for fast reactions as a whole. With the justified method as a tool, we made many attempts via numerical tests to simplify the Fas-signaling pathway model due to Hua et al. (2005) and found that nine of reactions therein can be well regarded as relatively fast. This paper reports our simplification of Hua at el.'s model with the PEA method based on the fastness of the nine reactions, together with numerical results which confirm the reliability of our simplified model.
△ Less
Submitted 28 September, 2012;
originally announced September 2012.
-
An Onsager-like Relation for the Lattice Boltzmann Method
Authors:
Wen-an Yong
Abstract:
An Onsager-like relation is proposed as a new criterion for constructing and analysing the lattice Boltzmann (LB) method. For LB models obeying the relation, we analyse their linearized stability, establish their diffusive limit, and find new constraints for those with free parameters. The new relation seems of fundamental importance for the LB method.
An Onsager-like relation is proposed as a new criterion for constructing and analysing the lattice Boltzmann (LB) method. For LB models obeying the relation, we analyse their linearized stability, establish their diffusive limit, and find new constraints for those with free parameters. The new relation seems of fundamental importance for the LB method.
△ Less
Submitted 10 May, 2008;
originally announced May 2008.
