-
Invariant Consistent Dynamic Mode Decomposition
Authors:
Gowtham S Seenivasaharagavan,
Milan Korda,
Hassan Arbabi,
Igor Mezić
Abstract:
Any deterministic autonomous dynamical system may be globally linearized by its' Koopman operator. This object is typically infinite-dimensional and can be approximated by the so-called Dynamic Mode Decomposition (DMD). In DMD, the central idea is to preserve a fundamental property of the Koopman operator: linearity. This work augments DMD by preserving additional properties like functional relati…
▽ More
Any deterministic autonomous dynamical system may be globally linearized by its' Koopman operator. This object is typically infinite-dimensional and can be approximated by the so-called Dynamic Mode Decomposition (DMD). In DMD, the central idea is to preserve a fundamental property of the Koopman operator: linearity. This work augments DMD by preserving additional properties like functional relationships between observables and consistency along geometric invariants. The first set of constraints provides a framework for understanding DMD variants like Higher-order DMD and Affine DMD. The latter set guarantees the estimation of Koopman eigen-functions with eigen-value 1, whose level sets are known to delineate invariant sets. These benefits are realized with only a minimal increase in computational cost, primarily due to the linearity of constraints.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Clarifying the effect of mean subtraction on Dynamic Mode Decomposition
Authors:
Gowtham S Seenivasaharagavan,
Milan Korda,
Hassan Arbabi,
Igor Mezić
Abstract:
Any autonomous nonlinear dynamical system can be viewed as a superposition of infinitely many linear processes, through the so-called Koopman mode decomposition. Its data-driven approximation- Dynamic Mode Decomposition (DMD)- has been extensively developed and deployed across a plethora of fields. In this work, we study the effect of subtracting the temporal mean on the DMD approximation, for obs…
▽ More
Any autonomous nonlinear dynamical system can be viewed as a superposition of infinitely many linear processes, through the so-called Koopman mode decomposition. Its data-driven approximation- Dynamic Mode Decomposition (DMD)- has been extensively developed and deployed across a plethora of fields. In this work, we study the effect of subtracting the temporal mean on the DMD approximation, for observables possessing only a finite number of Koopman modes.
Pre-processing time-sequential training data by removing the temporal mean has been a point of contention in the Companion matrix formulation of DMD. This stems from the potential of said pre-processing to render DMD equivalent to a temporal Discrete Fourier Transform (DFT). We prove that this equivalence is impossible when the training data is linearly consistent and the order of the DMD model exceeds the number of Koopman modes. Since model order and training set size are synonymous in this variant of DMD, the parity of DMD and DFT can, therefore, be indicative of inadequate training data.
△ Less
Submitted 8 March, 2025; v1 submitted 8 May, 2021;
originally announced May 2021.
-
Coarse-grained and emergent distributed parameter systems from data
Authors:
Hassan Arbabi,
Felix P. Kemeth,
Tom Bertalan,
Ioannis Kevrekidis
Abstract:
We explore the derivation of distributed parameter system evolution laws (and in particular, partial differential operators and associated partial differential equations, PDEs) from spatiotemporal data. This is, of course, a classical identification problem; our focus here is on the use of manifold learning techniques (and, in particular, variations of Diffusion Maps) in conjunction with neural ne…
▽ More
We explore the derivation of distributed parameter system evolution laws (and in particular, partial differential operators and associated partial differential equations, PDEs) from spatiotemporal data. This is, of course, a classical identification problem; our focus here is on the use of manifold learning techniques (and, in particular, variations of Diffusion Maps) in conjunction with neural network learning algorithms that allow us to attempt this task when the dependent variables, and even the independent variables of the PDE are not known a priori and must be themselves derived from the data. The similarity measure used in Diffusion Maps for dependent coarse variable detection involves distances between local particle distribution observations; for independent variable detection we use distances between local short-time dynamics. We demonstrate each approach through an illustrative established PDE example. Such variable-free, emergent space identification algorithms connect naturally with equation-free multiscale computation tools.
△ Less
Submitted 16 November, 2020; v1 submitted 16 November, 2020;
originally announced November 2020.
-
Particles to Partial Differential Equations Parsimoniously
Authors:
Hassan Arbabi,
Ioannis Kevrekidis
Abstract:
Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at much coarser, meso- or macroscopic length scales. Discovering those coarse-grained effective PDEs can lead to considerable savings in computation-intensive tas…
▽ More
Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at much coarser, meso- or macroscopic length scales. Discovering those coarse-grained effective PDEs can lead to considerable savings in computation-intensive tasks like prediction or control. We propose a framework combining artificial neural networks with multiscale computation, in the form of equation-free numerics, for efficient discovery of such macro-scale PDEs directly from microscopic simulations. Gathering sufficient microscopic data for training neural networks can be computationally prohibitive; equation-free numerics enable a more parsimonious collection of training data by only operating in a sparse subset of the space-time domain. We also propose using a data-driven approach, based on manifold learning and unnormalized optimal transport of distributions, to identify macro-scale dependent variable(s) suitable for the data-driven discovery of said PDEs. This approach can corroborate physically motivated candidate variables, or introduce new data-driven variables, in terms of which the coarse-grained effective PDE can be formulated. We illustrate our approach by extracting coarse-grained evolution equations from particle-based simulations with a priori unknown macro-scale variable(s), while significantly reducing the requisite data collection computational effort.
△ Less
Submitted 9 November, 2020;
originally announced November 2020.
-
Linking Machine Learning with Multiscale Numerics: Data-Driven Discovery of Homogenized Equations
Authors:
Hassan Arbabi,
Judith E. Bunder,
Giovanni Samaey,
Anthony J. Roberts,
Ioannis G. Kevrekidis
Abstract:
The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential operators requires extensive spatiotemporal data. For learning coarse-scale PDEs from computational fine-scale simulation data, the training data collection process…
▽ More
The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential operators requires extensive spatiotemporal data. For learning coarse-scale PDEs from computational fine-scale simulation data, the training data collection process can be prohibitively expensive. We propose to transformatively facilitate this training data collection process by linking machine learning (here, neural networks) with modern multiscale scientific computation (here, equation-free numerics). These equation-free techniques operate over sparse collections of small, appropriately coupled, space-time subdomains ("patches"), parsimoniously producing the required macro-scale training data. Our illustrative example involves the discovery of effective homogenized equations in one and two dimensions, for problems with fine-scale material property variations. The approach holds promise towards making the discovery of accurate, macro-scale effective materials PDE models possible by efficiently summarizing the physics embodied in "the best" fine-scale simulation models available.
△ Less
Submitted 24 August, 2020;
originally announced August 2020.
-
Spectral analysis of mixing in 2D high-Reynolds flows
Authors:
Hassan Arbabi,
Igor Mezic
Abstract:
We use spectral analysis of Eulerian and Lagrangian dynamics to study the advective mixing in an incompressible 2D bounded cavity flow. A significant property of such a rotational flow at high Reynolds numbers is that mixing in its core is slower than wall-adjacent areas and corner eddies. We explain this property by considering the resonance between frequencies of unsteady motion -- captured by t…
▽ More
We use spectral analysis of Eulerian and Lagrangian dynamics to study the advective mixing in an incompressible 2D bounded cavity flow. A significant property of such a rotational flow at high Reynolds numbers is that mixing in its core is slower than wall-adjacent areas and corner eddies. We explain this property by considering the resonance between frequencies of unsteady motion -- captured by the Koopman spectral analysis of the velocity field -- and the circulation frequency of Lagrangian tracers in the mean flow. In high-Reynolds rotational 2D flows, the vorticity in the rotational core is uniformly distributed, which leads to uniform distribution of circulation periods in the mean flow, i.e., the kinematics in the core of mean flow is like rigid-body rotation. When this ``rigid" core is exposed to velocity fluctuations arising from bifurcations at high Reynolds, it shows more resilience toward resonance in Lagrangian motion and hence mixes more slowly compared to other areas. We also show how our qualitative resonance argument extends to chaotic flows where the classical tools of dynamical systems are not applicable.
△ Less
Submitted 31 March, 2020; v1 submitted 24 March, 2019;
originally announced March 2019.
-
Prandtl-Batchelor theorem for flows with quasi-periodic time dependence
Authors:
Hassan Arbabi,
Igor Mezić
Abstract:
The classical Prandtl-Batchelor theorem (Prandtl 1904; Batchelor 1956) states that in the regions of steady 2D flow where viscous forces are small and streamlines are closed, the vorticity is constant. In this paper, we extend this theorem to recirculating flows with quasi-periodic time dependence using ergodic and geometric analysis of Lagrangian dynamics. In particular, we show that 2D quasi-per…
▽ More
The classical Prandtl-Batchelor theorem (Prandtl 1904; Batchelor 1956) states that in the regions of steady 2D flow where viscous forces are small and streamlines are closed, the vorticity is constant. In this paper, we extend this theorem to recirculating flows with quasi-periodic time dependence using ergodic and geometric analysis of Lagrangian dynamics. In particular, we show that 2D quasi-periodic viscous flows, in the limit of zero viscosity, cannot converge to recirculating inviscid flows with non-uniform vorticity distribution. A corollary of this result is that if the vorticity contours form a family of closed curves in a quasi-periodic viscous flow, then at the limit of zero viscosity, vorticity is constant in the area enclosed by those curves at all times.
△ Less
Submitted 4 December, 2018; v1 submitted 28 August, 2018;
originally announced August 2018.
-
A data-driven Koopman model predictive control framework for nonlinear flows
Authors:
Hassan Arbabi,
Milan Korda,
Igor Mezic
Abstract:
The Koopman operator theory is an increasingly popular formalism of dynamical systems theory which enables analysis and prediction of the nonlinear dynamics from measurement data. Building on the recent development of the Koopman model predictive control framework (Korda and Mezic 2016), we propose a methodology for closed-loop feedback control of nonlinear flows in a fully data-driven and model-f…
▽ More
The Koopman operator theory is an increasingly popular formalism of dynamical systems theory which enables analysis and prediction of the nonlinear dynamics from measurement data. Building on the recent development of the Koopman model predictive control framework (Korda and Mezic 2016), we propose a methodology for closed-loop feedback control of nonlinear flows in a fully data-driven and model-free manner. In the first step, we compute a Koopman-linear representation of the control system using a variation of the extended dynamic mode decomposition algorithm and then we apply model predictive control to the constructed linear model. Our methodology handles both full-state and sparse measurement; in the latter case, it incorporates the delay-embedding of the available data into the identification and control processes. We illustrate the application of this methodology on the periodic Burgers' equation and the boundary control of a cavity flow governed by the two-dimensional incompressible Navier-Stokes equations. In both examples the proposed methodology is successful in accomplishing the control tasks with sub-millisecond computation time required for evaluation of the control input in closed-loop, thereby allowing for a real-time deployment.
△ Less
Submitted 6 June, 2018; v1 submitted 14 April, 2018;
originally announced April 2018.
-
Study of dynamics in post-transient flows using Koopman mode decomposition
Authors:
Hassan Arbabi,
Igor Mezić
Abstract:
The Koopman Mode Decomposition (KMD) is a data-analysis technique which is often used to extract the spatio-temporal patterns of complex flows. In this paper, we use KMD to study the dynamics of the lid-driven flow in a two-dimensional square cavity based on theorems related to the spectral theory of the Koopman operator. We adapt two algorithms, from the classical Fourier and power spectral analy…
▽ More
The Koopman Mode Decomposition (KMD) is a data-analysis technique which is often used to extract the spatio-temporal patterns of complex flows. In this paper, we use KMD to study the dynamics of the lid-driven flow in a two-dimensional square cavity based on theorems related to the spectral theory of the Koopman operator. We adapt two algorithms, from the classical Fourier and power spectral analysis, to compute the discrete and continuous spectrum of the Koopman operator for the post-transient flows. Properties of the Koopman operator spectrum are linked to the sequence of flow regimes occurring between $Re=10000$ and $Re=30000$, and changing the flow nature from steady to aperiodic. The Koopman eigenfunctions for different flow regimes, including flows with mixed spectra, are constructed using the assumption of ergodicity in the state space. The associated Koopman modes show remarkable robustness even as the temporal nature of the flow is changing substantially. We observe that KMD outperforms the Proper Orthogonal Decomposition in reconstruction of the flows with strong quasi-periodic components.c features are present in the flow.
△ Less
Submitted 6 December, 2017; v1 submitted 3 April, 2017;
originally announced April 2017.
