-
NeurIPS 2024 ML4CFD Competition: Harnessing Machine Learning for Computational Fluid Dynamics in Airfoil Design
Authors:
Mouadh Yagoubi,
David Danan,
Milad Leyli-abadi,
Jean-Patrick Brunet,
Jocelyn Ahmed Mazari,
Florent Bonnet,
maroua gmati,
Asma Farjallah,
Paola Cinnella,
Patrick Gallinari,
Marc Schoenauer
Abstract:
The integration of machine learning (ML) techniques for addressing intricate physics problems is increasingly recognized as a promising avenue for expediting simulations. However, assessing ML-derived physical models poses a significant challenge for their adoption within industrial contexts. This competition is designed to promote the development of innovative ML approaches for tackling physical…
▽ More
The integration of machine learning (ML) techniques for addressing intricate physics problems is increasingly recognized as a promising avenue for expediting simulations. However, assessing ML-derived physical models poses a significant challenge for their adoption within industrial contexts. This competition is designed to promote the development of innovative ML approaches for tackling physical challenges, leveraging our recently introduced unified evaluation framework known as Learning Industrial Physical Simulations (LIPS). Building upon the preliminary edition held from November 2023 to March 2024, this iteration centers on a task fundamental to a well-established physical application: airfoil design simulation, utilizing our proposed AirfRANS dataset. The competition evaluates solutions based on various criteria encompassing ML accuracy, computational efficiency, Out-Of-Distribution performance, and adherence to physical principles. Notably, this competition represents a pioneering effort in exploring ML-driven surrogate methods aimed at optimizing the trade-off between computational efficiency and accuracy in physical simulations. Hosted on the Codabench platform, the competition offers online training and evaluation for all participating solutions.
△ Less
Submitted 30 June, 2024;
originally announced July 2024.
-
Understanding Radicals via Orbital Parities
Authors:
Reza G. Shirazi,
Benedikt M. Schoenauer,
Peter Schmitteckert,
Michael Marthaler,
Vladimir Rybkin
Abstract:
We introduce analysis of orbital parities as a concept and a tool for understanding radicals. Based on fundamental reduced one- and two-electron density matrices, our approach allows us to evaluate a total measure of radical character and provides spin-like orbitals to visualize real excess spin or odd electron distribution of singlet polyradicals. Finding spin-like orbitals aumotically results in…
▽ More
We introduce analysis of orbital parities as a concept and a tool for understanding radicals. Based on fundamental reduced one- and two-electron density matrices, our approach allows us to evaluate a total measure of radical character and provides spin-like orbitals to visualize real excess spin or odd electron distribution of singlet polyradicals. Finding spin-like orbitals aumotically results in their localization in the case of disjoint (zwitterionic) radicals and so enables radical classification based on spin-site separability. We demonstrate capabilities of the parity analysis by applying it to a number of polyradicals and to prototypical covalent bond breaking.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Interpretable learning of effective dynamics for multiscale systems
Authors:
Emmanuel Menier,
Sebastian Kaltenbach,
Mouadh Yagoubi,
Marc Schoenauer,
Petros Koumoutsakos
Abstract:
The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model order reduction techniques. In recent y…
▽ More
The modeling and simulation of high-dimensional multiscale systems is a critical challenge across all areas of science and engineering. It is broadly believed that even with today's computer advances resolving all spatiotemporal scales described by the governing equations remains a remote target. This realization has prompted intense efforts to develop model order reduction techniques. In recent years, techniques based on deep recurrent neural networks have produced promising results for the modeling and simulation of complex spatiotemporal systems and offer large flexibility in model development as they can incorporate experimental and computational data. However, neural networks lack interpretability, which limits their utility and generalizability across complex systems. Here we propose a novel framework of Interpretable Learning Effective Dynamics (iLED) that offers comparable accuracy to state-of-the-art recurrent neural network-based approaches while providing the added benefit of interpretability. The iLED framework is motivated by Mori-Zwanzig and Koopman operator theory, which justifies the choice of the specific architecture. We demonstrate the effectiveness of the proposed framework in simulations of three benchmark multiscale systems. Our results show that the iLED framework can generate accurate predictions and obtain interpretable dynamics, making it a promising approach for solving high-dimensional multiscale systems.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
Meta-Learning for Airflow Simulations with Graph Neural Networks
Authors:
Wenzhuo Liu,
Mouadh Yagoubi,
Marc Schoenauer
Abstract:
The field of numerical simulation is of significant importance for the design and management of real-world systems, with partial differential equations (PDEs) being a commonly used mathematical modeling tool. However, solving PDEs remains still a challenge, as commonly used traditional numerical solvers often require high computational costs. As a result, data-driven methods leveraging machine lea…
▽ More
The field of numerical simulation is of significant importance for the design and management of real-world systems, with partial differential equations (PDEs) being a commonly used mathematical modeling tool. However, solving PDEs remains still a challenge, as commonly used traditional numerical solvers often require high computational costs. As a result, data-driven methods leveraging machine learning (more particularly Deep Learning) algorithms have been increasingly proposed to learn models that can predict solutions to complex PDEs, such as those arising in computational fluid dynamics (CFD). However, these methods are known to suffer from poor generalization performance on out-of-distribution (OoD) samples, highlighting the need for more efficient approaches. To this end, we present a meta-learning approach to enhance the performance of learned models on OoD samples. Specifically, we set the airflow simulation in CFD over various airfoils as a meta-learning problem, where each set of examples defined on a single airfoil shape is treated as a separate task. Through the use of model-agnostic meta-learning (MAML), we learn a meta-learner capable of adapting to new tasks, i.e., previously unseen airfoil shapes, using only a small amount of task-specific data. We experimentally demonstrate the efficiency of the proposed approach for improving the OoD generalization performance of learned models while maintaining efficiency.
△ Less
Submitted 18 June, 2023;
originally announced June 2023.
-
Continuous Methods : Adaptively intrusive reduced order model closure
Authors:
Emmanuel Menier,
Michele Alessandro Bucci,
Mouadh Yagoubi,
Lionel Mathelin,
Thibault Dairay,
Raphael Meunier,
Marc Schoenauer
Abstract:
Reduced order modeling methods are often used as a mean to reduce simulation costs in industrial applications. Despite their computational advantages, reduced order models (ROMs) often fail to accurately reproduce complex dynamics encountered in real life applications. To address this challenge, we leverage NeuralODEs to propose a novel ROM correction approach based on a time-continuous memory for…
▽ More
Reduced order modeling methods are often used as a mean to reduce simulation costs in industrial applications. Despite their computational advantages, reduced order models (ROMs) often fail to accurately reproduce complex dynamics encountered in real life applications. To address this challenge, we leverage NeuralODEs to propose a novel ROM correction approach based on a time-continuous memory formulation. Finally, experimental results show that our proposed method provides a high level of accuracy while retaining the low computational costs inherent to reduced models.
△ Less
Submitted 30 November, 2022;
originally announced November 2022.
-
CD-ROM: Complemented Deep-Reduced Order Model
Authors:
Emmanuel Menier,
Michele Alessandro Bucci,
Mouadh Yagoubi,
Lionel Mathelin,
Marc Schoenauer
Abstract:
Model order reduction through the POD-Galerkin method can lead to dramatic gains in terms of computational efficiency in solving physical problems. However, the applicability of the method to non linear high-dimensional dynamical systems such as the Navier-Stokes equations has been shown to be limited, producing inaccurate and sometimes unstable models. This paper proposes a deep learning based cl…
▽ More
Model order reduction through the POD-Galerkin method can lead to dramatic gains in terms of computational efficiency in solving physical problems. However, the applicability of the method to non linear high-dimensional dynamical systems such as the Navier-Stokes equations has been shown to be limited, producing inaccurate and sometimes unstable models. This paper proposes a deep learning based closure modeling approach for classical POD-Galerkin reduced order models (ROM). The proposed approach is theoretically grounded, using neural networks to approximate well studied operators. In contrast with most previous works, the present CD-ROM approach is based on an interpretable continuous memory formulation, derived from simple hypotheses on the behavior of partially observed dynamical systems. The final corrected models can hence be simulated using most classical time stepping schemes. The capabilities of the CD-ROM approach are demonstrated on two classical examples from Computational Fluid Dynamics, as well as a parametric case, the Kuramoto-Sivashinsky equation.
△ Less
Submitted 2 May, 2023; v1 submitted 22 February, 2022;
originally announced February 2022.
-
Anticipating contingengies in power grids using fast neural net screening
Authors:
Benjamin Donnot,
Isabelle Guyon,
Marc Schoenauer,
Antoine Marot,
Patrick Panciatici
Abstract:
We address the problem of maintaining high voltage power transmission networks in security at all time. This requires that power flowing through all lines remain below a certain nominal thermal limit above which lines might melt, break or cause other damages. Current practices include enforcing the deterministic "N-1" reliability criterion, namely anticipating exceeding of thermal limit for any e…
▽ More
We address the problem of maintaining high voltage power transmission networks in security at all time. This requires that power flowing through all lines remain below a certain nominal thermal limit above which lines might melt, break or cause other damages. Current practices include enforcing the deterministic "N-1" reliability criterion, namely anticipating exceeding of thermal limit for any eventual single line disconnection (whatever its cause may be) by running a slow, but accurate, physical grid simulator. New conceptual frameworks are calling for a probabilistic risk based security criterion and are in need of new methods to assess the risk. To tackle this difficult assessment, we address in this paper the problem of rapidly ranking higher order contingencies including all pairs of line disconnections, to better prioritize simulations. We present a novel method based on neural networks, which ranks "N-1" and "N-2" contingencies in decreasing order of presumed severity. We demonstrate on a classical benchmark problem that the residual risk of contingencies decreases dramatically compared to considering solely all "N-1" cases, at no additional computational cost. We evaluate that our method scales up to power grids of the size of the French high voltage power grid (over 1000 power lines).
△ Less
Submitted 3 May, 2018;
originally announced May 2018.
