-
ELPINN: Eulerian Lagrangian Physics-Informed Neural Network
Authors:
Sukirt Thakur,
Maziar Raissi
Abstract:
Physics-Informed Neural Networks (PINNs) have gained widespread popularity for solving inverse and forward problems across a range of scientific and engineering domains. However, most existing PINN frameworks are limited to the Eulerian domain, where physical quantities are described at fixed spatial locations. In this work, we propose a novel PINN-based framework that couples Eulerian and Lagrang…
▽ More
Physics-Informed Neural Networks (PINNs) have gained widespread popularity for solving inverse and forward problems across a range of scientific and engineering domains. However, most existing PINN frameworks are limited to the Eulerian domain, where physical quantities are described at fixed spatial locations. In this work, we propose a novel PINN-based framework that couples Eulerian and Lagrangian perspectives by using particle trajectory data to reconstruct Eulerian velocity and pressure fields.
We evaluate the performance of our method across three distinct fluid flow scenarios: two-dimensional external flow past a cylinder, two-dimensional internal flow in a confined geometry, and three-dimensional internal flow inside an airplane cabin. In all three cases, we successfully reconstruct the velocity field from Lagrangian particle data. Moreover, for the 2D external and internal flows, we recover the pressure field solely through the physics-informed learning process, without using any direct pressure measurements.
We also conduct a sensitivity analysis to understand the effects of temporal resolution and particle count on the reconstruction accuracy. Our results show that smaller time-step sizes significantly improve the predictions, while the total number of particles has a comparatively smaller influence.
These findings establish the potential of our coupled Eulerian-Lagrangian PINN framework as a powerful tool for enhancing experimental methods such as Particle Tracking Velocimetry (PTV). Looking ahead, this approach may be extended to infer hidden quantities such as pressure in three-dimensional flows or material properties like viscosity, opening new avenues for data-driven fluid dynamics in complex geometries.
△ Less
Submitted 11 April, 2025;
originally announced April 2025.
-
Temporal Consistency Loss for Physics-Informed Neural Networks
Authors:
Sukirt Thakur,
Maziar Raissi,
Harsa Mitra,
Arezoo Ardekani
Abstract:
Physics-informed neural networks (PINNs) have been widely used to solve partial differential equations in a forward and inverse manner using deep neural networks. However, training these networks can be challenging for multiscale problems. While statistical methods can be employed to scale the regression loss on data, it is generally challenging to scale the loss terms for equations. This paper pr…
▽ More
Physics-informed neural networks (PINNs) have been widely used to solve partial differential equations in a forward and inverse manner using deep neural networks. However, training these networks can be challenging for multiscale problems. While statistical methods can be employed to scale the regression loss on data, it is generally challenging to scale the loss terms for equations. This paper proposes a method for scaling the mean squared loss terms in the objective function used to train PINNs. Instead of using automatic differentiation to calculate the temporal derivative, we use backward Euler discretization. This provides us with a scaling term for the equations. In this work, we consider the two and three-dimensional Navier-Stokes equations and determine the kinematic viscosity using the spatio-temporal data on the velocity and pressure fields. We first consider numerical datasets to test our method. We test the sensitivity of our method to the time step size, the number of timesteps, noise in the data, and spatial resolution. Finally, we use the velocity field obtained using Particle Image Velocimetry (PIV) experiments to generate a reference pressure field. We then test our framework using the velocity and reference pressure field.
△ Less
Submitted 30 January, 2023;
originally announced January 2023.
-
ViscoelasticNet: A physics informed neural network framework for stress discovery and model selection
Authors:
Sukirt Thakur,
Maziar Raissi,
Arezoo M. Ardekani
Abstract:
Viscoelastic fluids are a class of fluids that exhibit both viscous and elastic nature. Modelling such fluids requires constitutive equations for the stress, and choosing the most appropriate constitutive relationship can be difficult. We present viscoelasticNet, a physics-informed deep learning framework that uses the velocity flow field to select the constitutive model and learn the stress field…
▽ More
Viscoelastic fluids are a class of fluids that exhibit both viscous and elastic nature. Modelling such fluids requires constitutive equations for the stress, and choosing the most appropriate constitutive relationship can be difficult. We present viscoelasticNet, a physics-informed deep learning framework that uses the velocity flow field to select the constitutive model and learn the stress field. Our framework requires data only for the velocity field, initial \& boundary conditions for the stress tensor, and the boundary condition for the pressure field. Using this information, we learn the model parameters, the pressure field, and the stress tensor. {This work considers} three commonly used non-linear viscoelastic models: Oldroyd-B, Giesekus, and linear Phan-Thien-Tanner (PTT). We demonstrate that our framework works well with noisy and sparse data. Our framework can be combined with velocity fields acquired from experimental techniques like particle image velocimetry to get the pressure \& stress fields and model parameters for the constitutive equation. Once the model has been discovered using viscoelasticNet, the fluid can be simulated and modeled for further applications.
△ Less
Submitted 20 June, 2024; v1 submitted 14 September, 2022;
originally announced September 2022.
-
Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's next
Authors:
Salvatore Cuomo,
Vincenzo Schiano di Cola,
Fabio Giampaolo,
Gianluigi Rozza,
Maziar Raissi,
Francesco Piccialli
Abstract:
Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional equations, integral-differential equations, and stochastic PDEs. This novel methodology has arisen as a multi-task learning framework in which a NN must fit observed d…
▽ More
Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional equations, integral-differential equations, and stochastic PDEs. This novel methodology has arisen as a multi-task learning framework in which a NN must fit observed data while reducing a PDE residual. This article provides a comprehensive review of the literature on PINNs: while the primary goal of the study was to characterize these networks and their related advantages and disadvantages. The review also attempts to incorporate publications on a broader range of collocation-based physics informed neural networks, which stars form the vanilla PINN, as well as many other variants, such as physics-constrained neural networks (PCNN), variational hp-VPINN, and conservative PINN (CPINN). The study indicates that most research has focused on customizing the PINN through different activation functions, gradient optimization techniques, neural network structures, and loss function structures. Despite the wide range of applications for which PINNs have been used, by demonstrating their ability to be more feasible in some contexts than classical numerical techniques like Finite Element Method (FEM), advancements are still possible, most notably theoretical issues that remain unresolved.
△ Less
Submitted 7 June, 2022; v1 submitted 14 January, 2022;
originally announced January 2022.
-
Deep Learning of Turbulent Scalar Mixing
Authors:
Maziar Raissi,
Hessam Babaee,
Peyman Givi
Abstract:
Based on recent developments in physics-informed deep learning and deep hidden physics models, we put forth a framework for discovering turbulence models from scattered and potentially noisy spatio-temporal measurements of the probability density function (PDF). The models are for the conditional expected diffusion and the conditional expected dissipation of a Fickian scalar described by its trans…
▽ More
Based on recent developments in physics-informed deep learning and deep hidden physics models, we put forth a framework for discovering turbulence models from scattered and potentially noisy spatio-temporal measurements of the probability density function (PDF). The models are for the conditional expected diffusion and the conditional expected dissipation of a Fickian scalar described by its transported single-point PDF equation. The discovered model are appraised against exact solution derived by the amplitude mapping closure (AMC)/ Johnsohn-Edgeworth translation (JET) model of binary scalar mixing in homogeneous turbulence.
△ Less
Submitted 16 November, 2018;
originally announced November 2018.
-
Deep Learning of Vortex Induced Vibrations
Authors:
Maziar Raissi,
Zhicheng Wang,
Michael S. Triantafyllou,
George Em Karniadakis
Abstract:
Vortex induced vibrations of bluff bodies occur when the vortex shedding frequency is close to the natural frequency of the structure. Of interest is the prediction of the lift and drag forces on the structure given some limited and scattered information on the velocity field. This is an inverse problem that is not straightforward to solve using standard computational fluid dynamics (CFD) methods,…
▽ More
Vortex induced vibrations of bluff bodies occur when the vortex shedding frequency is close to the natural frequency of the structure. Of interest is the prediction of the lift and drag forces on the structure given some limited and scattered information on the velocity field. This is an inverse problem that is not straightforward to solve using standard computational fluid dynamics (CFD) methods, especially since no information is provided for the pressure. An even greater challenge is to infer the lift and drag forces given some dye or smoke visualizations of the flow field. Here we employ deep neural networks that are extended to encode the incompressible Navier-Stokes equations coupled with the structure's dynamic motion equation. In the first case, given scattered data in space-time on the velocity field and the structure's motion, we use four coupled deep neural networks to infer very accurately the structural parameters, the entire time-dependent pressure field (with no prior training data), and reconstruct the velocity vector field and the structure's dynamic motion. In the second case, given scattered data in space-time on a concentration field only, we use five coupled deep neural networks to infer very accurately the vector velocity field and all other quantities of interest as before. This new paradigm of inference in fluid mechanics for coupled multi-physics problems enables velocity and pressure quantification from flow snapshots in small subdomains and can be exploited for flow control applications and also for system identification.
△ Less
Submitted 26 August, 2018;
originally announced August 2018.
-
Hidden Fluid Mechanics: A Navier-Stokes Informed Deep Learning Framework for Assimilating Flow Visualization Data
Authors:
Maziar Raissi,
Alireza Yazdani,
George Em Karniadakis
Abstract:
We present hidden fluid mechanics (HFM), a physics informed deep learning framework capable of encoding an important class of physical laws governing fluid motions, namely the Navier-Stokes equations. In particular, we seek to leverage the underlying conservation laws (i.e., for mass, momentum, and energy) to infer hidden quantities of interest such as velocity and pressure fields merely from spat…
▽ More
We present hidden fluid mechanics (HFM), a physics informed deep learning framework capable of encoding an important class of physical laws governing fluid motions, namely the Navier-Stokes equations. In particular, we seek to leverage the underlying conservation laws (i.e., for mass, momentum, and energy) to infer hidden quantities of interest such as velocity and pressure fields merely from spatio-temporal visualizations of a passive scaler (e.g., dye or smoke), transported in arbitrarily complex domains (e.g., in human arteries or brain aneurysms). Our approach towards solving the aforementioned data assimilation problem is unique as we design an algorithm that is agnostic to the geometry or the initial and boundary conditions. This makes HFM highly flexible in choosing the spatio-temporal domain of interest for data acquisition as well as subsequent training and predictions. Consequently, the predictions made by HFM are among those cases where a pure machine learning strategy or a mere scientific computing approach simply cannot reproduce. The proposed algorithm achieves accurate predictions of the pressure and velocity fields in both two and three dimensional flows for several benchmark problems motivated by real-world applications. Our results demonstrate that this relatively simple methodology can be used in physical and biomedical problems to extract valuable quantitative information (e.g., lift and drag forces or wall shear stresses in arteries) for which direct measurements may not be possible.
△ Less
Submitted 13 August, 2018;
originally announced August 2018.
-
Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
Authors:
Maziar Raissi,
Paris Perdikaris,
George Em Karniadakis
Abstract:
The process of transforming observed data into predictive mathematical models of the physical world has always been paramount in science and engineering. Although data is currently being collected at an ever-increasing pace, devising meaningful models out of such observations in an automated fashion still remains an open problem. In this work, we put forth a machine learning approach for identifyi…
▽ More
The process of transforming observed data into predictive mathematical models of the physical world has always been paramount in science and engineering. Although data is currently being collected at an ever-increasing pace, devising meaningful models out of such observations in an automated fashion still remains an open problem. In this work, we put forth a machine learning approach for identifying nonlinear dynamical systems from data. Specifically, we blend classical tools from numerical analysis, namely the multi-step time-stepping schemes, with powerful nonlinear function approximators, namely deep neural networks, to distill the mechanisms that govern the evolution of a given data-set. We test the effectiveness of our approach for several benchmark problems involving the identification of complex, nonlinear and chaotic dynamics, and we demonstrate how this allows us to accurately learn the dynamics, forecast future states, and identify basins of attraction. In particular, we study the Lorenz system, the fluid flow behind a cylinder, the Hopf bifurcation, and the Glycoltic oscillator model as an example of complicated nonlinear dynamics typical of biological systems.
△ Less
Submitted 3 January, 2018;
originally announced January 2018.