-
Accelerating Transient CFD through Machine Learning-Based Flow Initialization
Authors:
Peter Sharpe,
Rishikesh Ranade,
Kaustubh Tangsali,
Mohammad Amin Nabian,
Ram Cherukuri,
Sanjay Choudhry
Abstract:
Transient computational fluid dynamics (CFD) simulations are essential for many industrial applications, but a significant portion of their computational cost stems from the time needed to reach statistical steadiness from initial conditions. We present a novel machine learning-based initialization method that reduces the cost of this subsequent transient solve substantially, achieving a 50% reduc…
▽ More
Transient computational fluid dynamics (CFD) simulations are essential for many industrial applications, but a significant portion of their computational cost stems from the time needed to reach statistical steadiness from initial conditions. We present a novel machine learning-based initialization method that reduces the cost of this subsequent transient solve substantially, achieving a 50% reduction in time-to-convergence compared to traditional uniform and potential flow-based initializations. Through a case study in automotive aerodynamics using a 16.7M-cell unsteady RANS simulation, we evaluate three ML-based initialization strategies. Two of these strategies are recommended for general use: (1) a physics-informed hybrid method combining ML predictions with potential flow solutions, and (2) a more versatile approach integrating ML predictions with uniform flow. Both strategies enable CFD solvers to achieve convergence times comparable to computationally expensive steady RANS initializations, while requiring only seconds of computation. We develop a robust statistical convergence metric based on windowed time-averaging for performance comparison between initialization strategies. Notably, these improvements are achieved using an ML model trained on a different dataset of automotive geometries, demonstrating strong generalization capabilities. The proposed methods integrate seamlessly with existing CFD workflows without requiring modifications to the underlying flow solver, providing a practical approach to accelerating industrial CFD simulations through improved ML-based initialization strategies.
△ Less
Submitted 21 April, 2025; v1 submitted 19 March, 2025;
originally announced March 2025.
-
DoMINO: A Decomposable Multi-scale Iterative Neural Operator for Modeling Large Scale Engineering Simulations
Authors:
Rishikesh Ranade,
Mohammad Amin Nabian,
Kaustubh Tangsali,
Alexey Kamenev,
Oliver Hennigh,
Ram Cherukuri,
Sanjay Choudhry
Abstract:
Numerical simulations play a critical role in design and development of engineering products and processes. Traditional computational methods, such as CFD, can provide accurate predictions but are computationally expensive, particularly for complex geometries. Several machine learning (ML) models have been proposed in the literature to significantly reduce computation time while maintaining accept…
▽ More
Numerical simulations play a critical role in design and development of engineering products and processes. Traditional computational methods, such as CFD, can provide accurate predictions but are computationally expensive, particularly for complex geometries. Several machine learning (ML) models have been proposed in the literature to significantly reduce computation time while maintaining acceptable accuracy. However, ML models often face limitations in terms of accuracy and scalability and depend on significant mesh downsampling, which can negatively affect prediction accuracy and generalization. In this work, we propose a novel ML model architecture, DoMINO (Decomposable Multi-scale Iterative Neural Operator) developed in NVIDIA Modulus to address the various challenges of machine learning based surrogate modeling of engineering simulations. DoMINO is a point cloudbased ML model that uses local geometric information to predict flow fields on discrete points. The DoMINO model is validated for the automotive aerodynamics use case using the DrivAerML dataset. Through our experiments we demonstrate the scalability, performance, accuracy and generalization of our model to both in-distribution and out-of-distribution testing samples. Moreover, the results are analyzed using a range of engineering specific metrics important for validating numerical simulations.
△ Less
Submitted 22 January, 2025;
originally announced January 2025.
-
X-MeshGraphNet: Scalable Multi-Scale Graph Neural Networks for Physics Simulation
Authors:
Mohammad Amin Nabian,
Chang Liu,
Rishikesh Ranade,
Sanjay Choudhry
Abstract:
Graph Neural Networks (GNNs) have gained significant traction for simulating complex physical systems, with models like MeshGraphNet demonstrating strong performance on unstructured simulation meshes. However, these models face several limitations, including scalability issues, requirement for meshing at inference, and challenges in handling long-range interactions. In this work, we introduce X-Me…
▽ More
Graph Neural Networks (GNNs) have gained significant traction for simulating complex physical systems, with models like MeshGraphNet demonstrating strong performance on unstructured simulation meshes. However, these models face several limitations, including scalability issues, requirement for meshing at inference, and challenges in handling long-range interactions. In this work, we introduce X-MeshGraphNet, a scalable, multi-scale extension of MeshGraphNet designed to address these challenges. X-MeshGraphNet overcomes the scalability bottleneck by partitioning large graphs and incorporating halo regions that enable seamless message passing across partitions. This, combined with gradient aggregation, ensures that training across partitions is equivalent to processing the entire graph at once. To remove the dependency on simulation meshes, X-MeshGraphNet constructs custom graphs directly from tessellated geometry files (e.g., STLs) by generating point clouds on the surface or volume of the object and connecting k-nearest neighbors. Additionally, our model builds multi-scale graphs by iteratively combining coarse and fine-resolution point clouds, where each level refines the previous, allowing for efficient long-range interactions. Our experiments demonstrate that X-MeshGraphNet maintains the predictive accuracy of full-graph GNNs while significantly improving scalability and flexibility. This approach eliminates the need for time-consuming mesh generation at inference, offering a practical solution for real-time simulation across a wide range of applications. The code for reproducing the results presented in this paper is available through NVIDIA Modulus.
△ Less
Submitted 19 December, 2024; v1 submitted 26 November, 2024;
originally announced November 2024.
-
Neuro-symbolic partial differential equation solver
Authors:
Pouria Mistani,
Samira Pakravan,
Rajesh Ilango,
Sanjay Choudhry,
Frederic Gibou
Abstract:
We present a highly scalable strategy for developing mesh-free neuro-symbolic partial differential equation solvers from existing numerical discretizations found in scientific computing. This strategy is unique in that it can be used to efficiently train neural network surrogate models for the solution functions and the differential operators, while retaining the accuracy and convergence propertie…
▽ More
We present a highly scalable strategy for developing mesh-free neuro-symbolic partial differential equation solvers from existing numerical discretizations found in scientific computing. This strategy is unique in that it can be used to efficiently train neural network surrogate models for the solution functions and the differential operators, while retaining the accuracy and convergence properties of state-of-the-art numerical solvers. This neural bootstrapping method is based on minimizing residuals of discretized differential systems on a set of random collocation points with respect to the trainable parameters of the neural network, achieving unprecedented resolution and optimal scaling for solving physical and biological systems.
△ Less
Submitted 25 October, 2022;
originally announced October 2022.
-
Data Collection and Analysis of French Dialects
Authors:
Omar Shaur Choudhry,
Paul Omara Odida,
Joshua Reiner,
Keiron Appleyard,
Danielle Kushnir,
William Toon
Abstract:
This paper discusses creating and analysing a new dataset for data mining and text analytics research, contributing to a joint Leeds University research project for the Corpus of National Dialects. This report investigates machine learning classifiers to classify samples of French dialect text across various French-speaking countries. Following the steps of the CRISP-DM methodology, this report ex…
▽ More
This paper discusses creating and analysing a new dataset for data mining and text analytics research, contributing to a joint Leeds University research project for the Corpus of National Dialects. This report investigates machine learning classifiers to classify samples of French dialect text across various French-speaking countries. Following the steps of the CRISP-DM methodology, this report explores the data collection process, data quality issues and data conversion for text analysis. Finally, after applying suitable data mining techniques, the evaluation methods, best overall features and classifiers and conclusions are discussed.
△ Less
Submitted 1 August, 2022;
originally announced August 2022.
-
Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations
Authors:
Benjamin Wu,
Oliver Hennigh,
Jan Kautz,
Sanjay Choudhry,
Wonmin Byeon
Abstract:
Physics-informed neural networks allow models to be trained by physical laws described by general nonlinear partial differential equations. However, traditional architectures struggle to solve more challenging time-dependent problems due to their architectural nature. In this work, we present a novel physics-informed framework for solving time-dependent partial differential equations. Using only t…
▽ More
Physics-informed neural networks allow models to be trained by physical laws described by general nonlinear partial differential equations. However, traditional architectures struggle to solve more challenging time-dependent problems due to their architectural nature. In this work, we present a novel physics-informed framework for solving time-dependent partial differential equations. Using only the governing differential equations and problem initial and boundary conditions, we generate a latent representation of the problem's spatio-temporal dynamics. Our model utilizes discrete cosine transforms to encode spatial frequencies and recurrent neural networks to process the time evolution. This efficiently and flexibly produces a compressed representation which is used for additional conditioning of physics-informed models. We show experimental results on the Taylor-Green vortex solution to the Navier-Stokes equations. Our proposed model achieves state-of-the-art performance on the Taylor-Green vortex relative to other physics-informed baseline models.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
-
Physics-Informed Machine Learning and Uncertainty Quantification for Mechanics of Heterogeneous Materials
Authors:
B V S S Bharadwaja,
Mohammad Amin Nabian,
Bharatkumar Sharma,
Sanjay Choudhry,
Alankar Alankar
Abstract:
In this work, a model based on the Physics - Informed Neural Networks (PINNs) for solving elastic deformation of heterogeneous solids and associated Uncertainty Quantification (UQ) is presented. For the present study, the PINNs framework - Modulus developed by Nvidia is utilized, wherein we implement a module for mechanics of heterogeneous solids. We use PINNs to approximate momentum balance by as…
▽ More
In this work, a model based on the Physics - Informed Neural Networks (PINNs) for solving elastic deformation of heterogeneous solids and associated Uncertainty Quantification (UQ) is presented. For the present study, the PINNs framework - Modulus developed by Nvidia is utilized, wherein we implement a module for mechanics of heterogeneous solids. We use PINNs to approximate momentum balance by assuming isotropic linear elastic constitutive behavior against a loss function. Along with governing equations, the associated initial / boundary conditions also softly participate in the loss function. Solids where the heterogeneity manifests as voids (low elastic modulus regions) and fibers (high elastic modulus regions) in a matrix are analyzed, and the results are validated against solutions obtained from a commercial Finite Element (FE) analysis package. The present study also reveals that PINNs can capture the stress jumps precisely at the material interfaces. Additionally, the present study explores the advantages associated with the surrogate features in PINNs via the variation in geometry and material properties. The presented UQ studies suggest that the mean and standard deviation of the PINNs solution are in good agreement with Monte Carlo FE results. The effective Young's modulus predicted by PINNs for single representative void and single fiber composites compare very well against the ones predicted by FE, which establishes the PINNs formulation as an efficient homogenization tool.
△ Less
Submitted 22 February, 2022; v1 submitted 14 February, 2022;
originally announced February 2022.
-
NVIDIA SimNet^{TM}: an AI-accelerated multi-physics simulation framework
Authors:
Oliver Hennigh,
Susheela Narasimhan,
Mohammad Amin Nabian,
Akshay Subramaniam,
Kaustubh Tangsali,
Max Rietmann,
Jose del Aguila Ferrandis,
Wonmin Byeon,
Zhiwei Fang,
Sanjay Choudhry
Abstract:
We present SimNet, an AI-driven multi-physics simulation framework, to accelerate simulations across a wide range of disciplines in science and engineering. Compared to traditional numerical solvers, SimNet addresses a wide range of use cases - coupled forward simulations without any training data, inverse and data assimilation problems. SimNet offers fast turnaround time by enabling parameterized…
▽ More
We present SimNet, an AI-driven multi-physics simulation framework, to accelerate simulations across a wide range of disciplines in science and engineering. Compared to traditional numerical solvers, SimNet addresses a wide range of use cases - coupled forward simulations without any training data, inverse and data assimilation problems. SimNet offers fast turnaround time by enabling parameterized system representation that solves for multiple configurations simultaneously, as opposed to the traditional solvers that solve for one configuration at a time. SimNet is integrated with parameterized constructive solid geometry as well as STL modules to generate point clouds. Furthermore, it is customizable with APIs that enable user extensions to geometry, physics and network architecture. It has advanced network architectures that are optimized for high-performance GPU computing, and offers scalable performance for multi-GPU and multi-Node implementation with accelerated linear algebra as well as FP32, FP64 and TF32 computations. In this paper we review the neural network solver methodology, the SimNet architecture, and the various features that are needed for effective solution of the PDEs. We present real-world use cases that range from challenging forward multi-physics simulations with turbulence and complex 3D geometries, to industrial design optimization and inverse problems that are not addressed efficiently by the traditional solvers. Extensive comparisons of SimNet results with open source and commercial solvers show good correlation.
△ Less
Submitted 14 December, 2020;
originally announced December 2020.