-
Lagrangian Attention Tensor Networks for Velocity Gradient Statistical Modeling
Authors:
Criston Hyett,
Yifeng Tian,
Michael Woodward,
Misha Stepanov,
Chris Fryer,
Daniel Livescu,
Michael Chertkov
Abstract:
Direct numerical simulation of turbulence at realistic Reynolds numbers is still beyond current computational capability, necessitating models that reduce the number of resolved spatial scales. Motivated by phenomenology and recent data-driven works based on universality of the smallest scales in fully developed turbulence, the statistical dynamics of the velocity gradient tensor (VGT) at the Kolm…
▽ More
Direct numerical simulation of turbulence at realistic Reynolds numbers is still beyond current computational capability, necessitating models that reduce the number of resolved spatial scales. Motivated by phenomenology and recent data-driven works based on universality of the smallest scales in fully developed turbulence, the statistical dynamics of the velocity gradient tensor (VGT) at the Kolmogorov scale become of critical importance in advancing turbulence models. Physics-informed machine learning has found considerable success in exploiting large datasets taken from direct numerical simulation of Navier-Stokes to improve models for the evolution of the VGT. In this work, we follow the long line of blending physical insight with data analysis to simultaneously advance both the modeling and understanding of the phenomenology of the VGT. Using the intimate connection between VGT evolution and fluid deformation, we develop the Lagrangian attention tensor network approach that significantly improves over current physics-informed machine learning methods. We demonstrate state-of-the-art performance in both a-priori and a-posteriori metrics, before interpreting the trained attention mechanisms to discover a surprising connection between the history of the strain-rate-tensor and the pressure Hessian.
△ Less
Submitted 16 May, 2025; v1 submitted 10 February, 2025;
originally announced February 2025.
-
Control of Line Pack in Natural Gas System: Balancing Limited Resources under Uncertainty
Authors:
Criston Hyett,
Laurent Pagnier,
Jean Alisse,
Lilach Sabban,
Igal Goldshtein,
Michael Chertkov
Abstract:
We build and experiment with a realistic but reduced natural gas model of Israel. The system is unusual because (a) it is controlled from a limited number of points which are at, or close to, the gas extraction sites offshore of Israel's Mediterranean coast; (b) control specifies average flux at inlet, not pressure; (c) there are no inland compressors to regulate pressure; (d) power system is the…
▽ More
We build and experiment with a realistic but reduced natural gas model of Israel. The system is unusual because (a) it is controlled from a limited number of points which are at, or close to, the gas extraction sites offshore of Israel's Mediterranean coast; (b) control specifies average flux at inlet, not pressure; (c) there are no inland compressors to regulate pressure; (d) power system is the main consumer of gas (70\% of Israel's power is generated at gas-fired power plants distributed across the country). Nature of the system suggests that a special attention should be given to understanding dynamics driven by fast transients in gas consumption meeting intra-day variations in the electricity demand, and accounting for increasing role of uncertain renewable generation (mainly solar). Based on all of the above we pose and resolve a sequence of dynamic and control challenges, such as: How to time ramping up- and down- injection of gas to guarantee a healthy intra-day line-pack which meets both pressure constraints and gas-extraction patterns? We report simulation results and utilize monotonicity properties of the natural gas flows which render robustness of our conclusions to the uncertainties of the edge withdrawals of gas.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.
-
Lagrangian Large Eddy Simulations via Physics Informed Machine Learning
Authors:
Yifeng Tian,
Michael Woodward,
Mikhail Stepanov,
Chris Fryer,
Criston Hyett,
Daniel Livescu,
Michael Chertkov
Abstract:
High Reynolds Homogeneous Isotropic Turbulence is fully described within the Navier-Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as Large Eddy Simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field de…
▽ More
High Reynolds Homogeneous Isotropic Turbulence is fully described within the Navier-Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as Large Eddy Simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field defined over a spatial grid with the mean-spacing correspondent to the resolved scale. This classic Eulerian LES depends on assumptions about effects of sub-grid scales on the resolved scales.
Here, we take an alternative approach and design novel LES heuristics stated in terms of Lagrangian particles moving with the flow. Our Lagrangian LES, thus L-LES, is described by equations generalizing the weakly compressible Smoothed Particle Hydrodynamics formulation with extended parametric and functional freedom, which is then resolved via Machine Learning training on Lagrangian data from Direct Numerical Simulations of the NS equations. The L-LES model includes physics-informed parameterization and functional form, by combining physics-based parameters and physics-inspired Neural Networks to describe the evolution of turbulence within the resolved range of scales. The sub-grid scale contributions are modeled separately with physical constraints to account for the effects from un-resolved scales. We build the resulting model under the Differentiable Programming framework to facilitate efficient training. We experiment with loss functions of different types, including physics-informed ones accounting for statistics of Lagrangian particles. We show that our Lagrangian LES model is capable of reproducing Eulerian and unique Lagrangian turbulence structures and statistics over a range of turbulent Mach numbers.
△ Less
Submitted 10 August, 2022; v1 submitted 8 July, 2022;
originally announced July 2022.
-
Physics informed machine learning with Smoothed Particle Hydrodynamics: Hierarchy of reduced Lagrangian models of turbulence
Authors:
Michael Woodward,
Yifeng Tian,
Criston Hyett,
Chris Fryer,
Daniel Livescu,
Mikhail Stepanov,
Michael Chertkov
Abstract:
Building efficient, accurate and generalizable reduced order models of developed turbulence remains a major challenge. This manuscript approaches this problem by developing a hierarchy of parameterized reduced Lagrangian models for turbulent flows, and investigates the effects of enforcing physical structure through Smoothed Particle Hydrodynamics (SPH) versus relying on neural networks (NN)s as u…
▽ More
Building efficient, accurate and generalizable reduced order models of developed turbulence remains a major challenge. This manuscript approaches this problem by developing a hierarchy of parameterized reduced Lagrangian models for turbulent flows, and investigates the effects of enforcing physical structure through Smoothed Particle Hydrodynamics (SPH) versus relying on neural networks (NN)s as universal function approximators. Starting from Neural Network (NN) parameterizations of a Lagrangian acceleration operator, this hierarchy of models gradually incorporates a weakly compressible and parameterized SPH framework, which enforces physical symmetries, such as Galilean, rotational and translational invariances. Within this hierarchy, two new parameterized smoothing kernels are developed in order to increase the flexibility of the learn-able SPH simulators. For each model we experiment with different loss functions which are minimized using gradient based optimization, where efficient computations of gradients are obtained by using Automatic Differentiation (AD) and Sensitivity Analysis (SA). Each model within the hierarchy is trained on two data sets associated with weekly compressible Homogeneous Isotropic Turbulence (HIT): (1) a validation set using weakly compressible SPH; and (2) a high fidelity set from Direct Numerical Simulations (DNS). Numerical evidence shows that encoding more SPH structure improves generalizability to different turbulent Mach numbers and time shifts, and that including the novel parameterized smoothing kernels improves the accuracy of SPH at the resolved scales.
△ Less
Submitted 8 November, 2023; v1 submitted 25 October, 2021;
originally announced October 2021.
