-
Lagrangian Attention Tensor Networks for Velocity Gradient Statistical Modeling
Authors:
Criston Hyett,
Yifeng Tian,
Michael Woodward,
Misha Stepanov,
Chris Fryer,
Daniel Livescu,
Michael Chertkov
Abstract:
Direct numerical simulation of turbulence at realistic Reynolds numbers is still beyond current computational capability, necessitating models that reduce the number of resolved spatial scales. Motivated by phenomenology and recent data-driven works based on universality of the smallest scales in fully developed turbulence, the statistical dynamics of the velocity gradient tensor (VGT) at the Kolm…
▽ More
Direct numerical simulation of turbulence at realistic Reynolds numbers is still beyond current computational capability, necessitating models that reduce the number of resolved spatial scales. Motivated by phenomenology and recent data-driven works based on universality of the smallest scales in fully developed turbulence, the statistical dynamics of the velocity gradient tensor (VGT) at the Kolmogorov scale become of critical importance in advancing turbulence models. Physics-informed machine learning has found considerable success in exploiting large datasets taken from direct numerical simulation of Navier-Stokes to improve models for the evolution of the VGT. In this work, we follow the long line of blending physical insight with data analysis to simultaneously advance both the modeling and understanding of the phenomenology of the VGT. Using the intimate connection between VGT evolution and fluid deformation, we develop the Lagrangian attention tensor network approach that significantly improves over current physics-informed machine learning methods. We demonstrate state-of-the-art performance in both a-priori and a-posteriori metrics, before interpreting the trained attention mechanisms to discover a surprising connection between the history of the strain-rate-tensor and the pressure Hessian.
△ Less
Submitted 16 May, 2025; v1 submitted 10 February, 2025;
originally announced February 2025.
-
Lagrangian Large Eddy Simulations via Physics Informed Machine Learning
Authors:
Yifeng Tian,
Michael Woodward,
Mikhail Stepanov,
Chris Fryer,
Criston Hyett,
Daniel Livescu,
Michael Chertkov
Abstract:
High Reynolds Homogeneous Isotropic Turbulence is fully described within the Navier-Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as Large Eddy Simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field de…
▽ More
High Reynolds Homogeneous Isotropic Turbulence is fully described within the Navier-Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as Large Eddy Simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field defined over a spatial grid with the mean-spacing correspondent to the resolved scale. This classic Eulerian LES depends on assumptions about effects of sub-grid scales on the resolved scales.
Here, we take an alternative approach and design novel LES heuristics stated in terms of Lagrangian particles moving with the flow. Our Lagrangian LES, thus L-LES, is described by equations generalizing the weakly compressible Smoothed Particle Hydrodynamics formulation with extended parametric and functional freedom, which is then resolved via Machine Learning training on Lagrangian data from Direct Numerical Simulations of the NS equations. The L-LES model includes physics-informed parameterization and functional form, by combining physics-based parameters and physics-inspired Neural Networks to describe the evolution of turbulence within the resolved range of scales. The sub-grid scale contributions are modeled separately with physical constraints to account for the effects from un-resolved scales. We build the resulting model under the Differentiable Programming framework to facilitate efficient training. We experiment with loss functions of different types, including physics-informed ones accounting for statistics of Lagrangian particles. We show that our Lagrangian LES model is capable of reproducing Eulerian and unique Lagrangian turbulence structures and statistics over a range of turbulent Mach numbers.
△ Less
Submitted 10 August, 2022; v1 submitted 8 July, 2022;
originally announced July 2022.
-
Physics informed machine learning with Smoothed Particle Hydrodynamics: Hierarchy of reduced Lagrangian models of turbulence
Authors:
Michael Woodward,
Yifeng Tian,
Criston Hyett,
Chris Fryer,
Daniel Livescu,
Mikhail Stepanov,
Michael Chertkov
Abstract:
Building efficient, accurate and generalizable reduced order models of developed turbulence remains a major challenge. This manuscript approaches this problem by developing a hierarchy of parameterized reduced Lagrangian models for turbulent flows, and investigates the effects of enforcing physical structure through Smoothed Particle Hydrodynamics (SPH) versus relying on neural networks (NN)s as u…
▽ More
Building efficient, accurate and generalizable reduced order models of developed turbulence remains a major challenge. This manuscript approaches this problem by developing a hierarchy of parameterized reduced Lagrangian models for turbulent flows, and investigates the effects of enforcing physical structure through Smoothed Particle Hydrodynamics (SPH) versus relying on neural networks (NN)s as universal function approximators. Starting from Neural Network (NN) parameterizations of a Lagrangian acceleration operator, this hierarchy of models gradually incorporates a weakly compressible and parameterized SPH framework, which enforces physical symmetries, such as Galilean, rotational and translational invariances. Within this hierarchy, two new parameterized smoothing kernels are developed in order to increase the flexibility of the learn-able SPH simulators. For each model we experiment with different loss functions which are minimized using gradient based optimization, where efficient computations of gradients are obtained by using Automatic Differentiation (AD) and Sensitivity Analysis (SA). Each model within the hierarchy is trained on two data sets associated with weekly compressible Homogeneous Isotropic Turbulence (HIT): (1) a validation set using weakly compressible SPH; and (2) a high fidelity set from Direct Numerical Simulations (DNS). Numerical evidence shows that encoding more SPH structure improves generalizability to different turbulent Mach numbers and time shifts, and that including the novel parameterized smoothing kernels improves the accuracy of SPH at the resolved scales.
△ Less
Submitted 8 November, 2023; v1 submitted 25 October, 2021;
originally announced October 2021.
-
Gravitational Gamma Spectrometer for Studying the Gamma Resonance of the Long-Lived Isomer 103mRh
Authors:
A. V. Davydov,
Yu. N. Isaev,
V. D. Kalantarov,
M. M. Korotkov,
V. V. Migachev,
Yu. B. Novozhilov,
A. M. Stepanov
Abstract:
The principle of operation and the construction are described of the gravitational gamma spectrometer to study the gamma resonance of the long-lived isomer $^{103m}$Rh. This is a table-top device which measures the form of gamma resonance by the dependence of counting rate of gamma-rays in collimated beams on the angle of their inclination with respect of the horizontal plane. Methods of fabricati…
▽ More
The principle of operation and the construction are described of the gravitational gamma spectrometer to study the gamma resonance of the long-lived isomer $^{103m}$Rh. This is a table-top device which measures the form of gamma resonance by the dependence of counting rate of gamma-rays in collimated beams on the angle of their inclination with respect of the horizontal plane. Methods of fabrication of gamma-sources for this device are considered.
△ Less
Submitted 28 December, 2015;
originally announced December 2015.
-
Second harmonic generation in dissipative metamaterials
Authors:
Ye. S. Mukhametkarimov,
Zh. A. Kudyshev,
A. E. Davletov,
I. R. Gabitov,
A. I. Maimistov,
M. G. Stepanov
Abstract:
Second harmonic generation is considered in lossy negative-index metamaterials. It is shown that energy transfer from fundamental to harmonic takes place in the entire sample for the range of phase mismatch values. Note that in conventional case this range collapses to the point (ideal phase matching). The dependance of the boundary of this range as function of dissipation values is obtained using…
▽ More
Second harmonic generation is considered in lossy negative-index metamaterials. It is shown that energy transfer from fundamental to harmonic takes place in the entire sample for the range of phase mismatch values. Note that in conventional case this range collapses to the point (ideal phase matching). The dependance of the boundary of this range as function of dissipation values is obtained using computer simulations.
△ Less
Submitted 11 October, 2013;
originally announced October 2013.
-
Exact and Efficient Algorithm to Discover Extreme Stochastic Events in Wind Generation over Transmission Power Grids
Authors:
Michael Chertkov,
Mikhail Stepanov,
Feng Pan,
Ross Baldick
Abstract:
In this manuscript we continue the thread of [M. Chertkov, F. Pan, M. Stepanov, Predicting Failures in Power Grids: The Case of Static Overloads, IEEE Smart Grid 2011] and suggest a new algorithm discovering most probable extreme stochastic events in static power grids associated with intermittent generation of wind turbines. The algorithm becomes EXACT and EFFICIENT (polynomial) in the case of th…
▽ More
In this manuscript we continue the thread of [M. Chertkov, F. Pan, M. Stepanov, Predicting Failures in Power Grids: The Case of Static Overloads, IEEE Smart Grid 2011] and suggest a new algorithm discovering most probable extreme stochastic events in static power grids associated with intermittent generation of wind turbines. The algorithm becomes EXACT and EFFICIENT (polynomial) in the case of the proportional (or other low parametric) control of standard generation, and log-concave probability distribution of the renewable generation, assumed known from the wind forecast. We illustrate the algorithm's ability to discover problematic extreme events on the example of the IEEE RTS-96 model of transmission with additions of 10%, 20% and 30% of renewable generation. We observe that the probability of failure may grow but it may also decrease with increase in renewable penetration, if the latter is sufficiently diversified and distributed.
△ Less
Submitted 6 September, 2011; v1 submitted 1 April, 2011;
originally announced April 2011.
-
Predicting Failures in Power Grids: The Case of Static Overloads
Authors:
Michael Chertkov,
Feng Pan,
Mikhail G. Stepanov
Abstract:
Here we develop an approach to predict power grid weak points, and specifically to efficiently identify the most probable failure modes in static load distribution for a given power network. This approach is applied to two examples: Guam's power system and also the IEEE RTS-96 system, both modeled within the static Direct Current power flow model. Our algorithm is a power network adaption of the w…
▽ More
Here we develop an approach to predict power grid weak points, and specifically to efficiently identify the most probable failure modes in static load distribution for a given power network. This approach is applied to two examples: Guam's power system and also the IEEE RTS-96 system, both modeled within the static Direct Current power flow model. Our algorithm is a power network adaption of the worst configuration heuristics, originally developed to study low probability events in physics and failures in error-correction. One finding is that, if the normal operational mode of the grid is sufficiently healthy, the failure modes, also called instantons, are sufficiently sparse, i.e. the failures are caused by load fluctuations at only a few buses. The technique is useful for discovering weak links which are saturated at the instantons. It can also identify generators working at the capacity and generators under capacity, thus providing predictive capability for improving the reliability of any power network.
△ Less
Submitted 15 September, 2010; v1 submitted 3 June, 2010;
originally announced June 2010.
-
Rain initiation time in turbulent warm clouds
Authors:
G. Falkovich,
M. G. Stepanov,
M. Vucelja
Abstract:
We present a mean-field model that describes droplet growth due to condensation and collisions and droplet loss due to fallout. The model allows for an effective numerical simulation. We study how the rain initiation time depends on different parameters. We also present a simple model that allows one to estimate the rain initiation time for turbulent clouds with an inhomogeneous concentration of…
▽ More
We present a mean-field model that describes droplet growth due to condensation and collisions and droplet loss due to fallout. The model allows for an effective numerical simulation. We study how the rain initiation time depends on different parameters. We also present a simple model that allows one to estimate the rain initiation time for turbulent clouds with an inhomogeneous concentration of cloud condensation nuclei. In particular, we show that over-seeding even a part of a cloud by small hygroscopic nuclei one can substantially delay the onset of precipitation.
△ Less
Submitted 21 November, 2004;
originally announced November 2004.
-
Large negative velocity gradients in Burgers turbulence
Authors:
A. I. Chernykh,
M. G. Stepanov
Abstract:
We consider 1D Burgers equation driven by large-scale white-in-time random force. The tails of the velocity gradients probability distribution function (PDF) are analyzed by saddle-point approximation in the path integral describing the velocity statistics. The structure of the saddle-point (instanton), that is velocity field configuration realizing the maximum of probability, is studied numeric…
▽ More
We consider 1D Burgers equation driven by large-scale white-in-time random force. The tails of the velocity gradients probability distribution function (PDF) are analyzed by saddle-point approximation in the path integral describing the velocity statistics. The structure of the saddle-point (instanton), that is velocity field configuration realizing the maximum of probability, is studied numerically in details. The numerical results allow us to find analytical solution for the long-time part of the instanton. Its careful analysis confirms the result of [Phys. Rev. Lett. 78 (8) 1452 (1997) [chao-dyn/9609005]] based on short-time estimations that the left tail of PDF has the form ln P(u_x) \propto -|u_x|^(3/2).
△ Less
Submitted 8 May, 2001; v1 submitted 13 January, 2000;
originally announced January 2000.
-
Autler - Townes doublet probed by strong field
Authors:
M. Stepanov
Abstract:
This paper deals with the Autler - Townes doublet structure. Applied driving and probing laser fields can have arbitrary intensities. The explanation is given of the broadening of doublet components with the growth of probing field intensity, which was observed in experiment. The effects of Doppler averaging are discussed.
This paper deals with the Autler - Townes doublet structure. Applied driving and probing laser fields can have arbitrary intensities. The explanation is given of the broadening of doublet components with the growth of probing field intensity, which was observed in experiment. The effects of Doppler averaging are discussed.
△ Less
Submitted 21 October, 1998;
originally announced October 1998.
-
Notes about Passive Scalar in Large-Scale Velocity Field
Authors:
I. Kolokolov,
V. Lebedev,
M. Stepanov
Abstract:
We consider advection of a passive scalar theta(t,r) by an incompressible large-scale turbulent flow. In the framework of the Kraichnan model the whole PDF's (probability distribution functions) for the single-point statistics of theta and for the passive scalar difference theta(r_1)-theta(r_2) (for separations r_1-r_2 lying in the convective interval) are found.
We consider advection of a passive scalar theta(t,r) by an incompressible large-scale turbulent flow. In the framework of the Kraichnan model the whole PDF's (probability distribution functions) for the single-point statistics of theta and for the passive scalar difference theta(r_1)-theta(r_2) (for separations r_1-r_2 lying in the convective interval) are found.
△ Less
Submitted 15 October, 1998;
originally announced October 1998.
-
Narrowing of Bennett Hole in Collisional Plasma
Authors:
E. V. Podivilov,
D. A. Shapiro,
M. G. Stepanov
Abstract:
The profile of a Bennett hole induced by laser field in ionic distribution in collisional plasma is calculated. Influence of Chandrasekhar's dependence of coefficients of velocity space transport on the profile is included into the calculation for the first time. It is found that the hole narrows down as the field detuning frequency increases. Physical cause of the effect is the falling dependen…
▽ More
The profile of a Bennett hole induced by laser field in ionic distribution in collisional plasma is calculated. Influence of Chandrasekhar's dependence of coefficients of velocity space transport on the profile is included into the calculation for the first time. It is found that the hole narrows down as the field detuning frequency increases. Physical cause of the effect is the falling dependence of Coulomb collision frequency on the ionic velocity. Estimations show that the effect is quite observable under conditions of high-current gas-discharge plasma.
△ Less
Submitted 30 March, 1995;
originally announced March 1995.
