-
Neural DDEs with Learnable Delays for Partially Observed Dynamical Systems
Authors:
Thibault Monsel,
Emmanuel Menier,
Onofrio Semeraro,
Lionel Mathelin,
Guillaume Charpiat
Abstract:
Many successful methods to learn dynamical systems from data have recently been introduced. Such methods often rely on the availability of the system's full state. However, this underlying hypothesis is rather restrictive as it is typically not confirmed in practice, leaving us with partially observed systems. Utilizing the Mori-Zwanzig (MZ) formalism from statistical physics, we demonstrate that…
▽ More
Many successful methods to learn dynamical systems from data have recently been introduced. Such methods often rely on the availability of the system's full state. However, this underlying hypothesis is rather restrictive as it is typically not confirmed in practice, leaving us with partially observed systems. Utilizing the Mori-Zwanzig (MZ) formalism from statistical physics, we demonstrate that Constant Lag Neural Delay Differential Equations (NDDEs) naturally serve as suitable models for partially observed states. In empirical evaluation, we show that such models outperform existing methods on both synthetic and experimental data.
△ Less
Submitted 3 October, 2024;
originally announced October 2024.
-
Continuous Methods : Adaptively intrusive reduced order model closure
Authors:
Emmanuel Menier,
Michele Alessandro Bucci,
Mouadh Yagoubi,
Lionel Mathelin,
Thibault Dairay,
Raphael Meunier,
Marc Schoenauer
Abstract:
Reduced order modeling methods are often used as a mean to reduce simulation costs in industrial applications. Despite their computational advantages, reduced order models (ROMs) often fail to accurately reproduce complex dynamics encountered in real life applications. To address this challenge, we leverage NeuralODEs to propose a novel ROM correction approach based on a time-continuous memory for…
▽ More
Reduced order modeling methods are often used as a mean to reduce simulation costs in industrial applications. Despite their computational advantages, reduced order models (ROMs) often fail to accurately reproduce complex dynamics encountered in real life applications. To address this challenge, we leverage NeuralODEs to propose a novel ROM correction approach based on a time-continuous memory formulation. Finally, experimental results show that our proposed method provides a high level of accuracy while retaining the low computational costs inherent to reduced models.
△ Less
Submitted 30 November, 2022;
originally announced November 2022.
-
CD-ROM: Complemented Deep-Reduced Order Model
Authors:
Emmanuel Menier,
Michele Alessandro Bucci,
Mouadh Yagoubi,
Lionel Mathelin,
Marc Schoenauer
Abstract:
Model order reduction through the POD-Galerkin method can lead to dramatic gains in terms of computational efficiency in solving physical problems. However, the applicability of the method to non linear high-dimensional dynamical systems such as the Navier-Stokes equations has been shown to be limited, producing inaccurate and sometimes unstable models. This paper proposes a deep learning based cl…
▽ More
Model order reduction through the POD-Galerkin method can lead to dramatic gains in terms of computational efficiency in solving physical problems. However, the applicability of the method to non linear high-dimensional dynamical systems such as the Navier-Stokes equations has been shown to be limited, producing inaccurate and sometimes unstable models. This paper proposes a deep learning based closure modeling approach for classical POD-Galerkin reduced order models (ROM). The proposed approach is theoretically grounded, using neural networks to approximate well studied operators. In contrast with most previous works, the present CD-ROM approach is based on an interpretable continuous memory formulation, derived from simple hypotheses on the behavior of partially observed dynamical systems. The final corrected models can hence be simulated using most classical time stepping schemes. The capabilities of the CD-ROM approach are demonstrated on two classical examples from Computational Fluid Dynamics, as well as a parametric case, the Kuramoto-Sivashinsky equation.
△ Less
Submitted 2 May, 2023; v1 submitted 22 February, 2022;
originally announced February 2022.
-
Coherent structure identification in turbulent channel flow using Latent Dirichlet Allocation
Authors:
Mohamed Frihat,
Bérengère Podvin,
Lionel Mathelin,
Yann Fraigneau,
François Yvon
Abstract:
Identification of coherent structures is an essential step to describe and model turbulence generation mechanisms in wall-bounded flows. To this end we present a clustering method based on Latent Dirichlet Allocation (LDA), a generative probabilistic model for collections of discrete data. The method is applied for structure identification to the instantaneous Reynolds stress in turbulent channel…
▽ More
Identification of coherent structures is an essential step to describe and model turbulence generation mechanisms in wall-bounded flows. To this end we present a clustering method based on Latent Dirichlet Allocation (LDA), a generative probabilistic model for collections of discrete data. The method is applied for structure identification to the instantaneous Reynolds stress in turbulent channel flow at moderate Reynolds number R τ = 590. LDA computes a robust flow description in terms of a hierarchy of vertically connected structure fragments, the characteristics of which scale with the wall distance, in agreement with the wall-attached eddy hypothesis of Townsend (1961). We show that the model can be used for field reconstruction with a complexity that can be compared with that of Proper Orthogonal Decomposition (POD). It can also be used to generate synthetic fields, the statistics of which mimic those of the original database. These findings highlight the potential of LDA for data analysis, compression and generation.
△ Less
Submitted 21 October, 2020; v1 submitted 20 May, 2020;
originally announced May 2020.
-
Control of chaotic systems by Deep Reinforcement Learning
Authors:
Michele Alessandro Bucci,
Onofrio Semeraro,
Alexandre Allauzen,
Guillaume Wisniewski,
Laurent Cordier,
Lionel Mathelin
Abstract:
Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control solutions and deep Neural Networks for approximating the value function and the control policy. Recent applications have shown that DRL may achieve superhuman perfo…
▽ More
Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control solutions and deep Neural Networks for approximating the value function and the control policy. Recent applications have shown that DRL may achieve superhuman performance in complex cognitive tasks.
In this work, we show that using restricted, localized actuations, partial knowledge of the state based on limited sensor measurements, and model-free DRL controllers, it is possible to stabilize the dynamics of the KS system around its unstable fixed solutions, here considered as target states. The robustness of the controllers is tested by considering several trajectories in the phase-space emanating from different initial conditions; we show that the DRL is always capable of driving and stabilizing the dynamics around the target states.
The complexity of the KS system, the possibility of defining the DRL control policies by solely relying on the local measurements of the system, and their efficiency in controlling its nonlinear dynamics pave the way for the application of RL methods in control of complex fluid systems such as turbulent boundary layers, turbulent mixers or multiphase flows.
△ Less
Submitted 16 June, 2019;
originally announced June 2019.
-
Shallow Neural Networks for Fluid Flow Reconstruction with Limited Sensors
Authors:
N. Benjamin Erichson,
Lionel Mathelin,
Zhewei Yao,
Steven L. Brunton,
Michael W. Mahoney,
J. Nathan Kutz
Abstract:
In many applications, it is important to reconstruct a fluid flow field, or some other high-dimensional state, from limited measurements and limited data. In this work, we propose a shallow neural network-based learning methodology for such fluid flow reconstruction. Our approach learns an end-to-end mapping between the sensor measurements and the high-dimensional fluid flow field, without any hea…
▽ More
In many applications, it is important to reconstruct a fluid flow field, or some other high-dimensional state, from limited measurements and limited data. In this work, we propose a shallow neural network-based learning methodology for such fluid flow reconstruction. Our approach learns an end-to-end mapping between the sensor measurements and the high-dimensional fluid flow field, without any heavy preprocessing on the raw data. No prior knowledge is assumed to be available, and the estimation method is purely data-driven. We demonstrate the performance on three examples in fluid mechanics and oceanography, showing that this modern data-driven approach outperforms traditional modal approximation techniques which are commonly used for flow reconstruction. Not only does the proposed method show superior performance characteristics, it can also produce a comparable level of performance with traditional methods in the area, using significantly fewer sensors. Thus, the mathematical architecture is ideal for emerging global monitoring technologies where measurement data are often limited.
△ Less
Submitted 27 December, 2020; v1 submitted 19 February, 2019;
originally announced February 2019.
-
Spatio-temporal Proper Orthogonal Decomposition of turbulent channel flow
Authors:
Srikanth Derebail Muralidhar,
Bérengère Podvin,
Lionel Mathelin,
Yann Fraigneau
Abstract:
An extension of Proper Orthogonal Decomposition is applied to the wall layer of a turbulent channel flow (Re τ = 590), so that empirical eigenfunctions are defined in both space and time. Due to the statistical symmetries of the flow, the igenfunctions are associated with individual wavenumbers and frequencies. Self-similarity of the dominant eigenfunctions, consistent with wall-attached structure…
▽ More
An extension of Proper Orthogonal Decomposition is applied to the wall layer of a turbulent channel flow (Re τ = 590), so that empirical eigenfunctions are defined in both space and time. Due to the statistical symmetries of the flow, the igenfunctions are associated with individual wavenumbers and frequencies. Self-similarity of the dominant eigenfunctions, consistent with wall-attached structures transferring energy into the core region, is established. The most energetic modes are characterized by a fundamental time scale in the range 200-300 viscous wall units. The full spatio-temporal decomposition provides a natural measure of the convection velocity of structures, with a characteristic value of 12 u τ in the wall layer. Finally, we show that the energy budget can be split into specific contributions for each mode, which provides a closed-form expression for nonlinear effects.
△ Less
Submitted 9 January, 2019; v1 submitted 3 May, 2018;
originally announced May 2018.
-
A statistical learning strategy for closed-loop control of fluid flows
Authors:
Florimond Guéniat,
Lionel Mathelin,
M. Yousuff Hussaini
Abstract:
This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model is derived, approximating the complex system's dynamics. A control strategy is then learned using reinforcement learning once rewards relevant with respect to t…
▽ More
This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model is derived, approximating the complex system's dynamics. A control strategy is then learned using reinforcement learning once rewards relevant with respect to the control objective are identified. This method is designed for experimental configurations, requiring no computations nor prior knowledge of the system, and enjoys intrinsic robustness. It is illustrated on two systems: the control of the transitions of a Lorenz 63 dynamical system, and the control of the drag of a cylinder flow. The method is shown to perform well.
△ Less
Submitted 11 April, 2016;
originally announced April 2016.