Showing 1–50 of 67 results for author: Iliescu, T

Defining Foundation Models for Computational Science: A Call for Clarity and Rigor

Authors: Youngsoo Choi, Siu Wun Cheung, Youngkyu Kim, Ping-Hsuan Tsai, Alejandro N. Diaz, Ivan Zanardi, Seung Whan Chung, Dylan Matthew Copeland, Coleman Kendrick, William Anderson, Traian Iliescu, Matthias Heinkenschloss

Abstract: The widespread success of foundation models in natural language processing and computer vision has inspired researchers to extend the concept to scientific machine learning and computational science. However, this position paper argues that as the term "foundation model" is an evolving concept, its application in computational science is increasingly used without a universally accepted definition,… ▽ More The widespread success of foundation models in natural language processing and computer vision has inspired researchers to extend the concept to scientific machine learning and computational science. However, this position paper argues that as the term "foundation model" is an evolving concept, its application in computational science is increasingly used without a universally accepted definition, potentially creating confusion and diluting its precise scientific meaning. In this paper, we address this gap by proposing a formal definition of foundation models in computational science, grounded in the core values of generality, reusability, and scalability. We articulate a set of essential and desirable characteristics that such models must exhibit, drawing parallels with traditional foundational methods, like the finite element and finite volume methods. Furthermore, we introduce the Data-Driven Finite Element Method (DD-FEM), a framework that fuses the modular structure of classical FEM with the representational power of data-driven learning. We demonstrate how DD-FEM addresses many of the key challenges in realizing foundation models for computational science, including scalability, adaptability, and physics consistency. By bridging traditional numerical methods with modern AI paradigms, this work provides a rigorous foundation for evaluating and developing novel approaches toward future foundation models in computational science. △ Less

Submitted 30 May, 2025; v1 submitted 28 May, 2025; originally announced May 2025.

Comments: 26 pages, 2 tables, 7 figures

Verifiability and Limit Consistency of Eddy Viscosity Large Eddy Simulation Reduced Order Models

Authors: Jorge Reyes, Ping-Hsuan Tsai, Ian Moore, Honghu Liu, Traian Iliescu

Abstract: Large eddy simulation reduced order models (LES-ROMs) are ROMs that leverage LES ideas (e.g., filtering and closure modeling) to construct accurate and efficient ROMs for convection-dominated (e.g., turbulent) flows. Eddy viscosity (EV) ROMs (e.g., Smagorinsky ROM (S-ROM)) are LES-ROMs whose closure model consists of a diffusion-like operator in which the viscosity depends on the ROM velocity. We… ▽ More Large eddy simulation reduced order models (LES-ROMs) are ROMs that leverage LES ideas (e.g., filtering and closure modeling) to construct accurate and efficient ROMs for convection-dominated (e.g., turbulent) flows. Eddy viscosity (EV) ROMs (e.g., Smagorinsky ROM (S-ROM)) are LES-ROMs whose closure model consists of a diffusion-like operator in which the viscosity depends on the ROM velocity. We propose the Ladyzhenskaya ROM (L-ROM), which is a generalization of the S-ROM. Furthermore, we prove two fundamental numerical analysis results for the new L-ROM and the classical S-ROM: (i) We prove the verifiability of the L-ROM and S-ROM, i.e, that the ROM error is bounded (up to a constant) by the ROM closure error. (ii) We introduce the concept of ROM limit consistency (in a discrete sense), and prove that the L-ROM and S-ROM are limit consistent, i.e., that as the ROM dimension approaches the rank of the snapshot matrix, $d$, and the ROM lengthscale goes to zero, the ROM solution converges to the \emph{``true solution"}, i.e., the solution of the $d$-dimensional ROM. Finally, we illustrate numerically the verifiability and limit consistency of the new L-ROM and S-ROM in two under-resolved convection-dominated problems that display sharp gradients: (i) the 1D Burgers equation with a small diffusion coefficient; and (ii) the 2D lid-driven cavity flow at Reynolds number $Re=15,000$. △ Less

Submitted 23 May, 2025; originally announced May 2025.

MSC Class: 65M15; 65M60; 76D05; 76F65

Symbolic Regression of Data-Driven Reduced Order Model Closures for Under-Resolved, Convection-Dominated Flows

Authors: Simone Manti, Ping-Hsuan Tsai, Alessandro Lucantonio, Traian Iliescu

Abstract: Data-driven closures correct the standard reduced order models (ROMs) to increase their accuracy in under-resolved, convection-dominated flows. There are two types of data-driven ROM closures in current use: (i) structural, with simple ansatzes (e.g., linear or quadratic); and (ii) machine learning-based, with neural network ansatzes. We propose a novel symbolic regression (SR) data-driven ROM clo… ▽ More Data-driven closures correct the standard reduced order models (ROMs) to increase their accuracy in under-resolved, convection-dominated flows. There are two types of data-driven ROM closures in current use: (i) structural, with simple ansatzes (e.g., linear or quadratic); and (ii) machine learning-based, with neural network ansatzes. We propose a novel symbolic regression (SR) data-driven ROM closure strategy, which combines the advantages of current approaches and eliminates their drawbacks. As a result, the new data-driven SR closures yield ROMs that are interpretable, parsimonious, accurate, generalizable, and robust. To compare the data-driven SR-ROM closures with the structural and machine learning-based ROM closures, we consider the data-driven variational multiscale ROM framework and two under-resolved, convection-dominated test problems: the flow past a cylinder and the lid-driven cavity flow at Reynolds numbers Re = 10000, 15000, and 20000. This numerical investigation shows that the new data-driven SR-ROM closures yield more accurate and robust ROMs than the structural and machine learning ROM closures. △ Less

Submitted 7 February, 2025; originally announced February 2025.

Data-driven Optimization for the Evolve-Filter-Relax regularization of convection-dominated flows

Authors: Anna Ivagnes, Maria Strazzullo, Michele Girfoglio, Traian Iliescu, Gianluigi Rozza

Abstract: Numerical stabilization techniques are often employed in under-resolved simulations of convection-dominated flows to improve accuracy and mitigate spurious oscillations. Specifically, the evolve--filter--relax (EFR) algorithm is a framework which consists in evolving the solution, applying a filtering step to remove high-frequency noise, and relaxing through a convex combination of filtered and or… ▽ More Numerical stabilization techniques are often employed in under-resolved simulations of convection-dominated flows to improve accuracy and mitigate spurious oscillations. Specifically, the evolve--filter--relax (EFR) algorithm is a framework which consists in evolving the solution, applying a filtering step to remove high-frequency noise, and relaxing through a convex combination of filtered and original solutions. The stability and accuracy of the EFR solution strongly depend on two parameters, the filter radius $δ$ and the relaxation parameter $χ$. Standard choices for these parameters are usually fixed in time, and related to the full order model setting, i.e., the grid size for $δ$ and the time step for $χ$. The key novelties with respect to the standard EFR approach are: (i) time-dependent parameters $δ(t)$ and $χ(t)$, and (ii) data-driven adaptive optimization of the parameters in time, considering a fully-resolved simulation as reference. In particular, we propose three different classes of optimized-EFR (Opt-EFR) strategies, aiming to optimize one or both parameters. The new Opt-EFR strategies are tested in the under-resolved simulation of a turbulent flow past a cylinder at $Re=1000$. The Opt-EFR proved to be more accurate than standard approaches by up to 99$\%$, while maintaining a similar computational time. In particular, the key new finding of our analysis is that such accuracy can be obtained only if the optimized objective function includes: (i) a global metric (as the kinetic energy), and (ii) spatial gradients' information. △ Less

Submitted 12 April, 2025; v1 submitted 7 January, 2025; originally announced January 2025.

Variational Multiscale Evolve and Filter Strategies for Convection-Dominated Flows

Authors: Maria Strazzullo, Francesco Ballarin, Traian Iliescu, Tomás Chacón Rebollo

Abstract: The evolve-filter (EF) model is a filter-based numerical stabilization for under-resolved convection-dominated flows. EF is a simple, modular, and effective strategy for both full-order models (FOMs) and reduced-order models (ROMs). It is well-known, however, that when the filter radius is too large, EF can be overdiffusive and yield inaccurate results. To alleviate this, EF is usually supplemente… ▽ More The evolve-filter (EF) model is a filter-based numerical stabilization for under-resolved convection-dominated flows. EF is a simple, modular, and effective strategy for both full-order models (FOMs) and reduced-order models (ROMs). It is well-known, however, that when the filter radius is too large, EF can be overdiffusive and yield inaccurate results. To alleviate this, EF is usually supplemented with a relaxation step. The relaxation parameter, however, is very sensitive with respect to the model parameters. In this paper, we propose a novel strategy to alleviate the EF overdiffusivity for a large filter radius. Specifically, we leverage the variational multiscale (VMS) framework to separate the large resolved scales from the small resolved scales in the evolved velocity, and we use the filtered small scales to correct the large scales. Furthermore, in the new VMS-EF strategy, we use two different ways to decompose the evolved velocity: the VMS Evolve-Filter-Filter-Correct (VMS-EFFC) and the VMS Evolve-Postprocess-Filter-Correct (VMS-EPFC) algorithms. The new VMS-based algorithms yield significantly more accurate results than the standard EF in both the FOM and the ROM simulations of a flow past a cylinder at Reynolds number Re = 1000. △ Less

Submitted 30 January, 2025; v1 submitted 21 November, 2024; originally announced November 2024.

A Priori Error Bounds and Parameter Scalings for the Time Relaxation Reduced Order Model

Authors: Jorge Reyes, Ping-Hsuan Tsai, Julia Novo, Traian Iliescu

Abstract: The a priori error analysis of reduced order models (ROMs) for fluids is relatively scarce. In this paper, we take a step in this direction and conduct numerical analysis of the recently introduced time relaxation ROM (TR-ROM), which uses spatial filtering to stabilize ROMs for convection-dominated flows. Specifically, we prove stability, an a priori error bound, and parameter scalings for the TR-… ▽ More The a priori error analysis of reduced order models (ROMs) for fluids is relatively scarce. In this paper, we take a step in this direction and conduct numerical analysis of the recently introduced time relaxation ROM (TR-ROM), which uses spatial filtering to stabilize ROMs for convection-dominated flows. Specifically, we prove stability, an a priori error bound, and parameter scalings for the TR-ROM. Our numerical investigation shows that the theoretical convergence rate and the parameter scalings with respect to ROM dimension and filter radius are recovered numerically. In addition, the parameter scaling can be used to extrapolate the time relaxation parameter to other ROM dimensions and filter radii. Moreover, the parameter scaling with respect to filter radius is also observed in the predictive regime. △ Less

Submitted 13 November, 2024; originally announced November 2024.

MSC Class: 65M12; 65M15; 65M60; 65M70; 76D05; 76F99

A Priori Error Bounds for the Approximate Deconvolution Leray Reduced Order Model

Authors: Ian Moore, Anna Sanfilippo, Francesco Ballarin, Traian Iliescu

Abstract: The approximate deconvolution Leray reduced order model (ADL-ROM) uses spatial filtering to increase the ROM stability, and approximate deconvolution to increase the ROM accuracy. In the under-resolved numerical simulation of convection-dominated flows, ADL-ROM was shown to be significantly more stable than the standard ROM, and more accurate than the Leray ROM. In this paper, we prove a priori er… ▽ More The approximate deconvolution Leray reduced order model (ADL-ROM) uses spatial filtering to increase the ROM stability, and approximate deconvolution to increase the ROM accuracy. In the under-resolved numerical simulation of convection-dominated flows, ADL-ROM was shown to be significantly more stable than the standard ROM, and more accurate than the Leray ROM. In this paper, we prove a priori error bounds for the approximate deconvolution operator and ADL-ROM. To our knowledge, these are the first numerical analysis results for approximate deconvolution in a ROM context. We illustrate these numerical analysis results in the numerical simulation of convection-dominated flows. △ Less

Submitted 3 October, 2024; originally announced October 2024.

A Priori Error Bounds for POD-ROMs for Fluids: A Brief Survey

Authors: Francesco Ballarin, Traian Iliescu

Abstract: Galerkin reduced order models (ROMs), e.g., based on proper orthogonal decomposition (POD) or reduced basis methods, have achieved significant success in the numerical simulation of fluid flows. The ROM numerical analysis, however, is still being developed. In this paper, we take a step in this direction and present a survey of a priori error bounds, with a particular focus on POD-based ROMs. Spec… ▽ More Galerkin reduced order models (ROMs), e.g., based on proper orthogonal decomposition (POD) or reduced basis methods, have achieved significant success in the numerical simulation of fluid flows. The ROM numerical analysis, however, is still being developed. In this paper, we take a step in this direction and present a survey of a priori error bounds, with a particular focus on POD-based ROMs. Specifically, we outline the main components of ROM a priori error bounds, emphasize their practical importance, and discuss significant contributions to a priori error bounds for ROMs for fluids. △ Less

Submitted 1 September, 2024; originally announced September 2024.

Bridging Large Eddy Simulation and Reduced Order Modeling of Convection-Dominated Flows through Spatial Filtering: Review and Perspectives

Authors: Annalisa Quaini, Omer San, Alessandro Veneziani, Traian Iliescu

Abstract: Reduced order models (ROMs) have achieved a lot of success in reducing the computational cost of traditional numerical methods across many disciplines. For convection-dominated (e.g., turbulent) flows, however, standard ROMs generally yield inaccurate results, usually affected by spurious oscillations. Thus, ROMs are usually equipped with numerical stabilization or closure models to account for th… ▽ More Reduced order models (ROMs) have achieved a lot of success in reducing the computational cost of traditional numerical methods across many disciplines. For convection-dominated (e.g., turbulent) flows, however, standard ROMs generally yield inaccurate results, usually affected by spurious oscillations. Thus, ROMs are usually equipped with numerical stabilization or closure models to account for the effect of the discarded modes. The literature on ROM closures and stabilizations is large and growing fast. In this paper, we focus on one particular type of ROM closures and stabilizations that are inspired by Large Eddy Simulation (LES). These ROMs, which we call LES-ROMs, are extremely easy to implement, very efficient, and accurate. Carefully tuned LES-ROMs can accurately capture the average physical quantities of interest in challenging convection-dominated flows in many applications. LES-ROM are constructed by leveraging spatial filtering, i.e., the same principle used to build classical LES models. This ensures a modeling consistency between LES-ROMs and the approaches that generated the data used to train them. It also ``bridges'' two distinct research fields (LES and ROMs), disconnected until now. This paper is a review of LES-ROMs. It starts with a description of a versatile LES strategy called evolve-filter-relax (EFR) that has been successfully used as a full order method. We then show how the EFR strategy, and spatial filtering in general, can be leveraged to construct LES-ROMs. Several applications of LES-ROMs are presented. Finally, we draw conclusions and outline several research directions and open questions in the LES-ROM development. While we do not claim this review to be comprehensive, we certainly hope it serves as a brief and friendly introduction to this exciting research area, which has a lot of potential in practical numerical simulation of convection-dominated flows. △ Less

Submitted 28 June, 2024; originally announced July 2024.

A Time-Relaxation Reduced Order Model for the Turbulent Channel Flow

Authors: Ping-Hsuan Tsai, Paul Fischer, Traian Iliescu

Abstract: Reg-ROMs are stabilization strategies that leverage spatial filtering to alleviate the spurious numerical oscillations generally displayed by the classical G-ROM in under-resolved numerical simulations of turbulent flows. In this paper, we propose a new Reg-ROM, the time-relaxation ROM (TR-ROM), which filters the marginally resolved scales. We compare the new TR-ROM with the two other Reg-ROMs in… ▽ More Reg-ROMs are stabilization strategies that leverage spatial filtering to alleviate the spurious numerical oscillations generally displayed by the classical G-ROM in under-resolved numerical simulations of turbulent flows. In this paper, we propose a new Reg-ROM, the time-relaxation ROM (TR-ROM), which filters the marginally resolved scales. We compare the new TR-ROM with the two other Reg-ROMs in current use, i.e., the L-ROM and the EFR-ROM, in the numerical simulation of the turbulent channel flow at $Re_τ = 180$ and $Re_τ = 395$ in both the reproduction and the predictive regimes. For each Reg-ROM, we investigate two different filters: (i) the differential filter (DF), and (ii) a new higher-order algebraic filter (HOAF). In our numerical investigation, we monitor the Reg-ROM performance for the ROM dimension, $N$, and the filter order. We also perform sensitivity studies of the three Reg-ROMs for the time interval, relaxation parameter, and filter radius. The numerical results yield the following conclusions: (i) All three Reg-ROMs are significantly more accurate than the G-ROM and (ii) more accurate than the ROM projection, representing the best theoretical approximation of the training data in the given ROM space. (iii) With the optimal parameter values, the TR-ROM is more accurate than the other two Reg-ROMs in all tests. (iv) For most $N$ values, DF yields the most accurate results for all three Reg-ROMs. (v) The optimal parameters trained in the reproduction regime are also optimal for the predictive regime for most $N$ values. (vi) All three Reg-ROMs are sensitive to the filter radius and the filter order, and the EFR-ROM and the TR-ROM are sensitive to the relaxation parameter. (vii) The optimal range for the filter radius and the effect of relaxation parameter are similar for the two $\rm Re_τ$ values. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: 46 pages, 19 figures, 2 tables

Approximate Deconvolution Leray Reduced Order Model for Convection-Dominated Flows

Authors: Anna Sanfilippo, Ian Moore, Francesco Ballarin, Traian Iliescu

Abstract: In this paper, we propose a novel ROM stabilization strategy for under-resolved convection-dominated flows, the approximate deconvolution Leray ROM (ADL-ROM). The new ADL-ROM introduces AD as a new means to increase the accuracy of the classical Leray ROM (L-ROM) without degrading its numerical stability. We also introduce two new AD ROM strategies: the Tikhonov and van Cittert methods. Our numeri… ▽ More In this paper, we propose a novel ROM stabilization strategy for under-resolved convection-dominated flows, the approximate deconvolution Leray ROM (ADL-ROM). The new ADL-ROM introduces AD as a new means to increase the accuracy of the classical Leray ROM (L-ROM) without degrading its numerical stability. We also introduce two new AD ROM strategies: the Tikhonov and van Cittert methods. Our numerical investigation for convection-dominated systems shows that, when the filter radius is relatively large, the new ADL-ROM is more accurate than the standard L-ROM. Furthermore, the new ADL-ROM is less sensitive with respect to model parameters than L-ROM. △ Less

Submitted 10 August, 2023; v1 submitted 20 July, 2023; originally announced July 2023.

Journal ref: Finite Elements in Analysis and Design, Volume 226, 15 November 2023, 104021

New Feedback Control and Adaptive Evolve-Filter-Relax Regularization for the Navier-Stokes Equations in the Convection-Dominated Regime

Authors: Maria Strazzullo, Francesco Ballarin, Traian Iliescu, Claudio Canuto

Abstract: We propose, analyze, and investigate numerically a novel feedback control strategy for high Reynolds number flows. For both the continuous and the discrete (finite element) settings, we prove that the new strategy yields accurate results for high Reynolds numbers that were not covered by current results. We also show that the new feedback control yields more accurate results than the current contr… ▽ More We propose, analyze, and investigate numerically a novel feedback control strategy for high Reynolds number flows. For both the continuous and the discrete (finite element) settings, we prove that the new strategy yields accurate results for high Reynolds numbers that were not covered by current results. We also show that the new feedback control yields more accurate results than the current control approaches in marginally-resolved numerical simulations of a two-dimensional flow past a circular cylinder at Reynolds numbers $Re=1000$. We note, however, that for realistic control parameters, the stabilizing effect of the new feedback control strategy is not sufficient in the convection-dominated regime. Our second contribution is the development of an adaptive evolve-filter-relax (aEFR) regularization that stabilizes marginally-resolved simulations in the convection-dominated regime and increases the accuracy of the new feedback control in realistic parameter settings. For the finite element setting, we prove that the novel feedback control equipped with the new aEFR method yields accurate results for high Reynolds numbers. Furthermore, our numerical investigation shows that the new strategy yields accurate results for reduced order models that dramatically decrease the size of the feedback control problem. △ Less

Submitted 2 July, 2023; originally announced July 2023.

Residual-based stabilized reduced-order models of the transient convection-diffusion-reaction equation obtained through discrete and continuous projection

Authors: Eric Parish, Masayuki Yano, Irina Tezaur, Traian Iliescu

Abstract: Galerkin and Petrov-Galerkin projection-based reduced-order models (ROMs) of transient partial differential equations are typically obtained by performing a dimension reduction and projection process that is defined at either the spatially continuous or spatially discrete level. In both cases, it is common to add stabilization to the resulting ROM to increase the stability and accuracy of the meth… ▽ More Galerkin and Petrov-Galerkin projection-based reduced-order models (ROMs) of transient partial differential equations are typically obtained by performing a dimension reduction and projection process that is defined at either the spatially continuous or spatially discrete level. In both cases, it is common to add stabilization to the resulting ROM to increase the stability and accuracy of the method; the addition of stabilization is particularly common for advection-dominated systems when the ROM is under-resolved. While these two approaches can be equivalent in certain settings, differing techniques have emerged in both contexts. This work outlines these two approaches within the setting of finite element method (FEM) discretizations (in which case a duality exists between the continuous and discrete levels) of the convection-diffusion-reaction equation, and compares residual-based stabilization techniques that have been developed in both contexts. In the spatially continuous case, we examine the Galerkin, streamline upwind Petrov-Galerkin (SUPG), Galerkin/least-squares (GLS), and adjoint (ADJ) stabilization methods. For the GLS and ADJ methods, we examine formulations constructed from both the "discretize-then-stabilize" technique and the space-time technique. In the spatially discrete case, we examine the Galerkin, least-squares Petrov-Galerkin (LSPG), and adjoint Petrov-Galerkin (APG) methods. We summarize existing analyses for these methods, and provide numerical experiments, which demonstrate that residual-based stabilized methods developed via continuous and discrete processes yield substantial improvements over standard Galerkin methods when the underlying FEM model is under-resolved. △ Less

Submitted 21 February, 2023; v1 submitted 18 February, 2023; originally announced February 2023.

Comments: 51 pages

A Two-Level Galerkin Reduced Order Model for the Steady Navier-Stokes Equations

Authors: Dylan Park, Changhong Mou, Honghu Liu, Adrian Sandu, Traian Iliescu

Abstract: We propose, analyze, and investigate numerically a novel two-level Galerkin reduced order model (2L-ROM) for the efficient and accurate numerical simulation of the steady Navier-Stokes equations. In the first step of the 2L-ROM, a relatively low-dimensional nonlinear system is solved. In the second step, the Navier-Stokes equations are linearized around the solution found in the first step, and a… ▽ More We propose, analyze, and investigate numerically a novel two-level Galerkin reduced order model (2L-ROM) for the efficient and accurate numerical simulation of the steady Navier-Stokes equations. In the first step of the 2L-ROM, a relatively low-dimensional nonlinear system is solved. In the second step, the Navier-Stokes equations are linearized around the solution found in the first step, and a higher-dimensional system for the linearized problem is solved. We prove an error bound for the new 2L-ROM and compare it to the standard one level ROM (1L-ROM) in the numerical simulation of the steady Burgers equation. The 2L-ROM significantly decreases (by a factor of $2$ and even $3$) the 1L-ROM computational cost, without compromising its numerical accuracy. △ Less

Submitted 23 November, 2022; originally announced November 2022.

An Energy-Based Lengthscale for Reduced Order Models of Turbulent Flows

Authors: Changhong Mou, Elia Merzari, Omer San, Traian Iliescu

Abstract: In this paper, we propose a novel reduced order model (ROM) lengthscale that is constructed by using energy distribution arguments. The new energy-based ROM lengthscale is fundamentally different from the current ROM lengthscales, which are built by using dimensional arguments. To assess the novel, energy-based ROM lengthscale, we compare it with a standard, dimensionality-based ROM lengthscale in… ▽ More In this paper, we propose a novel reduced order model (ROM) lengthscale that is constructed by using energy distribution arguments. The new energy-based ROM lengthscale is fundamentally different from the current ROM lengthscales, which are built by using dimensional arguments. To assess the novel, energy-based ROM lengthscale, we compare it with a standard, dimensionality-based ROM lengthscale in two fundamentally different types of models: (i) the mixing-length ROM (ML-ROM), which is a ROM closure model; and (ii) the evolve-filter-relax ROM (EFR-ROM), which is a regularized ROM. We test the four combinations (i.e., ML-ROM and EFR-ROM equipped with the energy-based and dimensionality-based lengthscales) in the numerical simulation of the turbulent channel flow at $Re_τ = 395$. The numerical investigation yields the following conclusions: (i) The new energy-based ROM lengthscale is significantly (almost two orders of magnitude) larger than the standard dimensionality-based ROM lengthscale. As a result, the energy-based lengthscale yields more stable ML-ROMs and EFR-ROMs than the dimensionality-based lengthscale. (ii) The energy-based lengthscale displays the correct asymptotic behavior with respect to the ROM dimension, whereas the dimensionality-based lengthscale does not. (iii) The energy-based lengthscale yields ML-ROMs and (when significant filtering is effected) EFR-ROMs whose parameters are less sensitive (i.e., more robust) than the parameters of the ML-ROMs and EFR-ROMs based on the dimensionality-based lengthscale. The novel energy-based lengthscale could enable the development of better scale-aware ROM strategies for flow-specific applications and is expected to have long term applications in nuclear reactor thermal-hydraulics. △ Less

Submitted 8 November, 2022; originally announced November 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2108.02254

Stochastic Data-Driven Variational Multiscale Reduced Order Models

Authors: Fei Lu, Changhong Mou, Honghu Liu, Traian Iliescu

Abstract: Trajectory-wise data-driven reduced order models (ROMs) tend to be sensitive to training data, and thus lack robustness. We propose to construct a robust stochastic ROM closure (S-ROM) from data consisting of multiple trajectories from random initial conditions. The S-ROM is a low-dimensional time series model for the coefficients of the dominating proper orthogonal decomposition (POD) modes infer… ▽ More Trajectory-wise data-driven reduced order models (ROMs) tend to be sensitive to training data, and thus lack robustness. We propose to construct a robust stochastic ROM closure (S-ROM) from data consisting of multiple trajectories from random initial conditions. The S-ROM is a low-dimensional time series model for the coefficients of the dominating proper orthogonal decomposition (POD) modes inferred from data. Thus, it achieves reduction both space and time, leading to simulations orders of magnitude faster than the full order model. We show that both the estimated POD modes and parameters in the S-ROM converge when the number of trajectories increases. Thus, the S-ROM is robust when the training data size increases. We demonstrate the S-ROM on a 1D Burgers equation with a viscosity $ν= 0.002$ and with random initial conditions. The numerical results verify the convergence. Furthermore, the S-ROM makes accurate trajectory-wise predictions from new initial conditions and with a prediction time far beyond the training range, and it quantifies the spread of uncertainties due to the unresolved scales. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Comments: 22 pages, 7 figures

Residual Data-Driven Variational Multiscale Reduced Order Models for Parameter Dependent Problems

Authors: Birgul Koc, Samuele Rubino, Tomás Chaón Rebollo, Traian Iliescu

Abstract: In this paper, we investigate the modeling of sub-scale components of proper orthogonal decomposition reduced order models (POD-ROMs) of convection-dominated flows. We propose ROM closure models that depend on the ROM residual. We illustrate the new residual-based data-driven ROM closure within the variational multiscale (VMS) framework and investigate it in the numerical simulation of a one-dimen… ▽ More In this paper, we investigate the modeling of sub-scale components of proper orthogonal decomposition reduced order models (POD-ROMs) of convection-dominated flows. We propose ROM closure models that depend on the ROM residual. We illustrate the new residual-based data-driven ROM closure within the variational multiscale (VMS) framework and investigate it in the numerical simulation of a one-dimensional parameter-dependent convection-dominated convection-diffusion problem. For comparison purposes, we also investigate a streamline-upwind Petrov-Galerkin (SUPG) ROM stabilization strategy and the standard Galerkin ROM (G-ROM). Our numerical investigation shows that the new residual-based data-driven VMS-ROM is more accurate than both the standard G-ROM and the SUPG-ROM. △ Less

Submitted 30 May, 2023; v1 submitted 29 July, 2022; originally announced August 2022.

Comments: 20 pages, 10 tables, 3 figures

Hybrid Data-Driven Closure Strategies for Reduced Order Modeling

Authors: Anna Ivagnes, Giovanni Stabile, Andrea Mola, Traian Iliescu, Gianluigi Rozza

Abstract: In this paper, we propose hybrid data-driven ROM closures for fluid flows. These new ROM closures combine two fundamentally different strategies: (i) purely data-driven ROM closures, both for the velocity and the pressure; and (ii) physically based, eddy viscosity data-driven closures, which model the energy transfer in the system. The first strategy consists in the addition of closure/correction… ▽ More In this paper, we propose hybrid data-driven ROM closures for fluid flows. These new ROM closures combine two fundamentally different strategies: (i) purely data-driven ROM closures, both for the velocity and the pressure; and (ii) physically based, eddy viscosity data-driven closures, which model the energy transfer in the system. The first strategy consists in the addition of closure/correction terms to the governing equations, which are built from the available data. The second strategy includes turbulence modeling by adding eddy viscosity terms, which are determined by using machine learning techniques. The two strategies are combined for the first time in this paper to investigate a two-dimensional flow past a circular cylinder at Re=50000. Our numerical results show that the hybrid data-driven ROM is more accurate than both the purely data-driven ROM and the eddy viscosity ROM. △ Less

Submitted 24 December, 2022; v1 submitted 21 July, 2022; originally announced July 2022.

Comments: arXiv admin note: text overlap with arXiv:2205.15118

Pressure Data-Driven Variational Multiscale Reduced Order Models

Authors: Anna Ivagnes, Giovanni Stabile, Andrea Mola, Traian Iliescu, Gianluigi Rozza

Abstract: In this paper, we develop data-driven closure/correction terms to increase the pressure and velocity accuracy of reduced order models (ROMs) for fluid flows. Specifically, we propose the first pressure-based data-driven variational multiscale ROM, in which we use the available data to construct closure/correction terms for both the momentum equation and the continuity equation. Our numerical inves… ▽ More In this paper, we develop data-driven closure/correction terms to increase the pressure and velocity accuracy of reduced order models (ROMs) for fluid flows. Specifically, we propose the first pressure-based data-driven variational multiscale ROM, in which we use the available data to construct closure/correction terms for both the momentum equation and the continuity equation. Our numerical investigation of the two-dimensional flow past a circular cylinder at Re=50000 in the marginally-resolved regime shows that the novel pressure data-driven variational multiscale ROM yields significantly more accurate velocity and pressure approximations than the standard ROM and, more importantly, than the original data-driven variational multiscale ROM (i.e., without pressure components). In particular, our numerical results show that adding the closure/correction term in the momentum equation significantly improves both the velocity and the pressure approximations, whereas adding the closure/correction term in the continuity equation improves only the pressure approximation. △ Less

Submitted 24 December, 2022; v1 submitted 30 May, 2022; originally announced May 2022.

Physics Guided Machine Learning for Variational Multiscale Reduced Order Modeling

Authors: Shady E. Ahmed, Omer San, Adil Rasheed, Traian Iliescu, Alessandro Veneziani

Abstract: We propose a new physics guided machine learning (PGML) paradigm that leverages the variational multiscale (VMS) framework and available data to dramatically increase the accuracy of reduced order models (ROMs) at a modest computational cost. The hierarchical structure of the ROM basis and the VMS framework enable a natural separation of the resolved and unresolved ROM spatial scales. Modern PGML… ▽ More We propose a new physics guided machine learning (PGML) paradigm that leverages the variational multiscale (VMS) framework and available data to dramatically increase the accuracy of reduced order models (ROMs) at a modest computational cost. The hierarchical structure of the ROM basis and the VMS framework enable a natural separation of the resolved and unresolved ROM spatial scales. Modern PGML algorithms are used to construct novel models for the interaction among the resolved and unresolved ROM scales. Specifically, the new framework builds ROM operators that are closest to the true interaction terms in the VMS framework. Finally, machine learning is used to reduce the projection error and further increase the ROM accuracy. Our numerical experiments for a two-dimensional vorticity transport problem show that the novel PGML-VMS-ROM paradigm maintains the low computational cost of current ROMs, while significantly increasing the ROM accuracy. △ Less

Submitted 24 May, 2022; originally announced May 2022.

An Efficient Data-Driven Multiscale Stochastic Reduced Order Modeling Framework for Complex Systems

Authors: Changhong Mou, Nan Chen, Traian Iliescu

Abstract: Suitable reduced order models (ROMs) are computationally efficient tools in characterizing key dynamical and statistical features of nature. In this paper, a systematic multiscale stochastic ROM framework is developed for complex systems with strong chaotic or turbulent behavior. The new ROMs are fundamentally different from the traditional Galerkin ROM (G-ROM) or those deterministic ROMs that aim… ▽ More Suitable reduced order models (ROMs) are computationally efficient tools in characterizing key dynamical and statistical features of nature. In this paper, a systematic multiscale stochastic ROM framework is developed for complex systems with strong chaotic or turbulent behavior. The new ROMs are fundamentally different from the traditional Galerkin ROM (G-ROM) or those deterministic ROMs that aim at minimizing the path-wise errors and applying mainly to laminar systems. Here, the new ROM focuses on recovering the large-scale dynamics to the maximum extent while it also exploits cheap but effective conditional linear functions as the closure terms to capture the statistical features of the medium-scale variables and its feedback to the large scales. In addition, physics constraints are incorporated into the new ROM. One unique feature of the resulting ROM is that it facilitates an efficient and accurate scheme for nonlinear data assimilation, the solution of which is provided by closed analytic formulae. Such an analytic solvable data assimilation solution significantly accelerates the computational efficiency and allows the new ROM to avoid many potential numerical and sampling issues in recovering the unobserved states from partial observations. The overall model calibration is efficient and systematic via explicit mathematical formulae. The new ROM framework is applied to complex nonlinear systems, in which the intrinsic turbulent behavior is either triggered by external random forcing or deterministic nonlinearity. It is shown that the new ROM significantly outperforms the G-ROM in both scenarios in terms of reproducing the dynamical and statistical features as well as recovering unobserved states via the associated efficient data assimilation scheme. △ Less

Submitted 21 March, 2022; originally announced March 2022.

MSC Class: 37N10; 65C20; 86A04; 62M10

Reduced Order Model Closures: A Brief Tutorial

Authors: William Snyder, Changhong Mou, Honghu Liu, Omer San, Raffaella De Vita, Traian Iliescu

Abstract: In this paper, we present a brief tutorial on reduced order model (ROM) closures. First, we carefully motivate the need for ROM closure modeling in under-resolved simulations. Then, we construct step by step the ROM closure model by extending the classical Galerkin framework to the spaces of resolved and unresolved scales. Finally, we develop the data-driven variational multiscale ROM closure and… ▽ More In this paper, we present a brief tutorial on reduced order model (ROM) closures. First, we carefully motivate the need for ROM closure modeling in under-resolved simulations. Then, we construct step by step the ROM closure model by extending the classical Galerkin framework to the spaces of resolved and unresolved scales. Finally, we develop the data-driven variational multiscale ROM closure and then we test it in fluid flow simulations. Our tutorial on ROM closures is structured as a sequence of questions and answers, and is aimed at first year graduate students and advanced undergraduate students. Our goal is not to explain the "how," but the "why." That is, we carefully explain the principles used to develop ROM closures, without focusing on particular approaches. Furthermore, we try to keep the technical details to a minimum and describe the general ideas in broad terms while citing appropriate references for details. △ Less

Submitted 28 February, 2022; originally announced February 2022.

Full and Reduced Order Model Consistency of the Nonlinearity Discretization in Incompressible Flows

Authors: Sean Ingimarson, Leo G. Rebholz, Traian Iliescu

Abstract: We investigate both theoretically and numerically the consistency between the nonlinear discretization in full order models (FOMs) and reduced order models (ROMs) for incompressible flows. To this end, we consider two cases: (i) FOM-ROM consistency, i.e., when we use the same nonlinearity discretization in the FOM and ROM; and (ii) FOM-ROM inconsistency, i.e., when we use different nonlinearity di… ▽ More We investigate both theoretically and numerically the consistency between the nonlinear discretization in full order models (FOMs) and reduced order models (ROMs) for incompressible flows. To this end, we consider two cases: (i) FOM-ROM consistency, i.e., when we use the same nonlinearity discretization in the FOM and ROM; and (ii) FOM-ROM inconsistency, i.e., when we use different nonlinearity discretizations in the FOM and ROM. Analytically, we prove that while the FOM-ROM consistency yields optimal error bounds, FOM-ROM inconsistency yields additional terms dependent on the FOM divergence error, which prevent the ROM from recovering the FOM as the number of modes increases. Computationally, we consider channel flow around a cylinder and Kelvin-Helmholtz instability, and show that FOM-ROM consistency yields significantly more accurate results than FOM-ROM inconsistency. △ Less

Submitted 6 September, 2022; v1 submitted 12 November, 2021; originally announced November 2021.

Nonlinear proper orthogonal decomposition for convection-dominated flows

Authors: Shady E. Ahmed, Omer San, Adil Rasheed, Traian Iliescu

Abstract: Autoencoder techniques find increasingly common use in reduced order modeling as a means to create a latent space. This reduced order representation offers a modular data-driven modeling approach for nonlinear dynamical systems when integrated with a time series predictive model. In this letter, we put forth a nonlinear proper orthogonal decomposition (POD) framework, which is an end-to-end Galerk… ▽ More Autoencoder techniques find increasingly common use in reduced order modeling as a means to create a latent space. This reduced order representation offers a modular data-driven modeling approach for nonlinear dynamical systems when integrated with a time series predictive model. In this letter, we put forth a nonlinear proper orthogonal decomposition (POD) framework, which is an end-to-end Galerkin-free model combining autoencoders with long short-term memory networks for dynamics. By eliminating the projection error due to the truncation of Galerkin models, a key enabler of the proposed nonintrusive approach is the kinematic construction of a nonlinear mapping between the full-rank expansion of the POD coefficients and the latent space where the dynamics evolve. We test our framework for model reduction of a convection-dominated system, which is generally challenging for reduced order models. Our approach not only improves the accuracy, but also significantly reduces the computational cost of training and testing. △ Less

Submitted 5 November, 2021; v1 submitted 15 October, 2021; originally announced October 2021.

Consistency of the Full and Reduced Order Models for Evolve-Filter-Relax Regularization of Convection-Dominated, Marginally-Resolved Flows

Authors: Maria Strazzullo, Michele Girfoglio, Francesco Ballarin, Traian Iliescu, Gianluigi Rozza

Abstract: Numerical stabilization is often used to eliminate (alleviate) the spurious oscillations generally produced by full order models (FOMs) in under-resolved or marginally-resolved simulations of convection-dominated flows. In this paper we investigate the role of numerical stabilization in reduced order models (ROMs) of convection-dominated, marginally-resolved flows. Specifically, we investigate the… ▽ More Numerical stabilization is often used to eliminate (alleviate) the spurious oscillations generally produced by full order models (FOMs) in under-resolved or marginally-resolved simulations of convection-dominated flows. In this paper we investigate the role of numerical stabilization in reduced order models (ROMs) of convection-dominated, marginally-resolved flows. Specifically, we investigate the FOM-ROM consistency, i.e., whether the numerical stabilization is beneficial both at the FOM and the ROM level. As a numerical stabilization strategy, we focus on the evolve-filter-relax (EFR) regularization algorithm, which centers around spatial filtering. To investigate the FOM-ROM consistency, we consider two ROM strategies: (i) the EFR-ROM, in which the EFR stabilization is used at the FOM level, but not at the ROM level; and (ii) the EFR-EFRROM, in which the EFR stabilization is used both at the FOM and at the ROM level. We compare the EFR-ROM with the EFR-EFRROM in the numerical simulation of a 2D flow past a circular cylinder in the convection-dominated, marginally-resolved regime. We also perform model reduction with respect to both time and Reynolds number. Our numerical investigation shows that the EFR-EFRROM is more accurate than the EFR-ROM, which suggests that FOM-ROM consistency is beneficial in convection-dominated, marginally-resolved flows. △ Less

Submitted 10 February, 2022; v1 submitted 11 October, 2021; originally announced October 2021.

Verifiability of the Data-Driven Variational Multiscale Reduced Order Model

Authors: Birgul Koc, Changhong Mou, Honghu Liu, Zhu Wang, Gianluigi Rozza, Traian Iliescu

Abstract: In this paper, we focus on the mathematical foundations of reduced order model (ROM) closures. First, we extend the verifiability concept from large eddy simulation to the ROM setting. Specifically, we call a ROM closure model verifiable if a small ROM closure model error (i.e., a small difference between the true ROM closure and the modeled ROM closure) implies a small ROM error. Second, we prove… ▽ More In this paper, we focus on the mathematical foundations of reduced order model (ROM) closures. First, we extend the verifiability concept from large eddy simulation to the ROM setting. Specifically, we call a ROM closure model verifiable if a small ROM closure model error (i.e., a small difference between the true ROM closure and the modeled ROM closure) implies a small ROM error. Second, we prove that a data-driven ROM closure (i.e., the data-driven variational multiscale ROM) is verifiable. Finally, we investigate the verifiability of the data-driven variational multiscale ROM in the numerical simulation of the one-dimensional Burgers equation and a two-dimensional flow past a circular cylinder at Reynolds numbers $Re=100$ and $Re=1000$. △ Less

Submitted 23 September, 2022; v1 submitted 10 August, 2021; originally announced August 2021.

MSC Class: 65M15; 65M60

A Numerical Investigation of the Lengthscale in the Mixing-Length Reduced Order Model of the Turbulent Channel Flow

Authors: Changhong Mou, Elia Merzari, Omer San, Traian Iliescu

Abstract: In this paper, we propose a novel reduced order model (ROM) lengthscale definition that is based on energy distribution arguments. This novel ROM lengthscale is fundamentally different from the current ROM lengthscales, which are generally based on dimensional arguments. As a first step in the assessment of the new, energy based ROM lengthscale, we compare it with a standard, dimensional based ROM… ▽ More In this paper, we propose a novel reduced order model (ROM) lengthscale definition that is based on energy distribution arguments. This novel ROM lengthscale is fundamentally different from the current ROM lengthscales, which are generally based on dimensional arguments. As a first step in the assessment of the new, energy based ROM lengthscale, we compare it with a standard, dimensional based ROM lengthscale in the mixing-length ROM (ML-ROM) simulation of the turbulent channel flow at $Re_τ = 395$. The numerical investigation shows that the energy based ROM lengthscale yields a significantly more stable ML-ROM than the dimensional based ROM lengthscale. The new energy based lengthscale definition could allow the development of scale-aware reduced order modeling strategies that are better suited for flow-specific applications. △ Less

Submitted 4 August, 2021; originally announced August 2021.

On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues

Authors: Shady E. Ahmed, Suraj Pawar, Omer San, Adil Rasheed, Traian Iliescu, Bernd R. Noack

Abstract: For over a century, reduced order models (ROMs) have been a fundamental discipline of theoretical fluid mechanics. Early examples include Galerkin models inspired by the Orr-Sommerfeld stability equation and numerous vortex models, of which the von Kármán vortex street is one of the most prominent. Subsequent ROMs typically relied on first principles, like mathematical Galerkin models, weakly nonl… ▽ More For over a century, reduced order models (ROMs) have been a fundamental discipline of theoretical fluid mechanics. Early examples include Galerkin models inspired by the Orr-Sommerfeld stability equation and numerous vortex models, of which the von Kármán vortex street is one of the most prominent. Subsequent ROMs typically relied on first principles, like mathematical Galerkin models, weakly nonlinear stability theory, and two- and three-dimensional vortex models. Aubry et al. [N. Aubry, P. Holmes, J. Lumley, and E. Stone, Journal of Fluid Mechanics, 192, 115-173 (1988)] pioneered data-driven proper orthogonal decomposition (POD) modeling. In early POD modeling, available data was used to build an optimal basis, which was then utilized in a classical Galerkin procedure to construct the ROM. But data has made a profound impact on ROMs beyond the Galerkin expansion. In this paper, we take a modest step and illustrate the impact of data-driven modeling on one significant ROM area. Specifically, we focus on ROM closures, which are correction terms that are added to classical ROMs in order to model the effect of the discarded ROM modes in under-resolved simulations. Through simple examples, we illustrate the main modeling principles used to construct classical ROMs, motivate and introduce modern ROM closures, and show how data-driven modeling, artificial intelligence, and machine learning have changed the standard ROM methodology over the last two decades. Finally, we outline our vision on how state-of-the-art data-driven modeling can continue to reshape the field of reduced order modeling. △ Less

Submitted 23 August, 2021; v1 submitted 28 June, 2021; originally announced June 2021.

Reduced Order Models for the Quasi-Geostrophic Equations: A Brief Survey

Authors: Changhong Mou, Zhu Wang, David R. Wells, Xuping Xie, Traian Iliescu

Abstract: Reduced order models (ROMs) are computational models whose dimension is significantly lower than those obtained through classical numerical discretizations (e.g., finite element, finite difference, finite volume, or spectral methods). Thus, ROMs have been used to accelerate numerical simulations of many query problems, e.g., uncertainty quantification, control, and shape optimization. Projection-b… ▽ More Reduced order models (ROMs) are computational models whose dimension is significantly lower than those obtained through classical numerical discretizations (e.g., finite element, finite difference, finite volume, or spectral methods). Thus, ROMs have been used to accelerate numerical simulations of many query problems, e.g., uncertainty quantification, control, and shape optimization. Projection-based ROMs have been particularly successful in the numerical simulation of fluid flows. In this brief survey, we summarize some recent ROM developments for the quasi-geostrophic equations (QGE) (also known as the barotropic vorticity equations), which are a simplified model for geophysical flows in which rotation plays a central role, such as wind-driven ocean circulation in mid-latitude ocean basins. Since the QGE represent a practical compromise between efficient numerical simulations of ocean flows and accurate representations of large scale ocean dynamics, these equations have often been used in the testing of new numerical methods for ocean flows. ROMs have also been tested on the QGE for various settings in order to understand their potential in efficient numerical simulations of ocean flows. In this paper, we survey the ROMs developed for the QGE in order to understand their potential in efficient numerical simulations of more complex ocean flows: We explain how classical numerical methods for the QGE are used to generate the ROM basis functions, we outline the main steps in the construction of projection-based ROMs (with a particular focus on the under-resolved regime, when the closure problem needs to be addressed), we illustrate the ROMs in the numerical simulation of the QGE for various settings, and we present several potential future research avenues in the ROM exploration of the QGE and more complex models of geophysical flows. △ Less

Submitted 2 December, 2020; v1 submitted 1 December, 2020; originally announced December 2020.

On Optimal Pointwise in Time Error Bounds and Difference Quotients for the Proper Orthogonal Decomposition

Authors: Birgul Koc, Samuele Rubino, Michael Schneier, John R. Singler, Traian Iliescu

Abstract: In this paper, we resolve several long standing issues dealing with optimal pointwise in time error bounds for proper orthogonal decomposition (POD) reduced order modeling of the heat equation. In particular, we study the role played by difference quotients (DQs) in obtaining reduced order model (ROM) error bounds that are optimal with respect to both the time discretization error and the ROM disc… ▽ More In this paper, we resolve several long standing issues dealing with optimal pointwise in time error bounds for proper orthogonal decomposition (POD) reduced order modeling of the heat equation. In particular, we study the role played by difference quotients (DQs) in obtaining reduced order model (ROM) error bounds that are optimal with respect to both the time discretization error and the ROM discretization error. When the DQs are not used, we prove that both the ROM projection error and the ROM error are suboptimal. When the DQs are used, we prove that both the ROM projection error and the ROM error are optimal. The numerical results for the heat equation support the theoretical results. △ Less

Submitted 7 October, 2020; originally announced October 2020.

A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates

Authors: Andrey A Popov, Changhong Mou, Traian Iliescu, Adrian Sandu

Abstract: This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities in the hierarchy of models represent control variates for the uncertainty in finer fidelities. Small ensembles of high fidelity model runs are complemented by la… ▽ More This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities in the hierarchy of models represent control variates for the uncertainty in finer fidelities. Small ensembles of high fidelity model runs are complemented by larger ensembles of cheaper, lower fidelity runs, to obtain much improved analyses at only small additional computational costs. We investigate the use of reduced order models as coarse fidelity control variates in the MFEnKF, and provide analyses to quantify the improvements over the traditional ensemble Kalman filters. We apply these ideas to perform data assimilation with a quasi-geostrophic test problem, using direct numerical simulation and a corresponding POD-Galerkin reduced order model. Numerical results show that the two-fidelity MFEnKF provides better analyses than existing EnKF algorithms at comparable or reduced computational costs. △ Less

Submitted 1 July, 2020; originally announced July 2020.

Report number: CSL-TR-20-2 MSC Class: 62F15

Data-Driven Variational Multiscale Reduced Order Models

Authors: Changhong Mou, Birgul Koc, Omer San, Leo G. Rebholz, Traian Iliescu

Abstract: We propose a new data-driven reduced order model (ROM) framework that centers around the hierarchical structure of the variational multiscale (VMS) methodology and utilizes data to increase the ROM accuracy at a modest computational cost. The VMS methodology is a natural fit for the hierarchical structure of the ROM basis: In the first step, we use the ROM projection to separate the scales into th… ▽ More We propose a new data-driven reduced order model (ROM) framework that centers around the hierarchical structure of the variational multiscale (VMS) methodology and utilizes data to increase the ROM accuracy at a modest computational cost. The VMS methodology is a natural fit for the hierarchical structure of the ROM basis: In the first step, we use the ROM projection to separate the scales into three categories: (i) resolved large scales, (ii) resolved small scales, and (iii) unresolved scales. In the second step, we explicitly identify the VMS-ROM closure terms, i.e., the terms representing the interactions among the three types of scales. In the third step, we use available data to model the VMS-ROM closure terms. Thus, instead of phenomenological models used in VMS for standard numerical discretizations (e.g., eddy viscosity models), we utilize available data to construct new structural VMS-ROM closure models. Specifically, we build ROM operators (vectors, matrices, and tensors) that are closest to the true ROM closure terms evaluated with the available data. We test the new data-driven VMS-ROM in the numerical simulation of four test cases: (i) the 1D Burgers equation with viscosity coefficient $ν= 10^{-3}$; (ii) a 2D flow past a circular cylinder at Reynolds numbers $Re=100$, $Re=500$, and $Re=1000$; (iii) the quasi-geostrophic equations at Reynolds number $Re=450$ and Rossby number $Ro=0.0036$; and (iv) a 2D flow over a backward facing step at Reynolds number $Re=1000$. The numerical results show that the data-driven VMS-ROM is significantly more accurate than standard ROMs. △ Less

Submitted 10 August, 2020; v1 submitted 15 February, 2020; originally announced February 2020.

A long short-term memory embedding for hybrid uplifted reduced order models

Authors: Shady E. Ahmed, Omer San, Adil Rasheed, Traian Iliescu

Abstract: In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model t… ▽ More In this paper, we introduce an uplifted reduced order modeling (UROM) approach through the integration of standard projection based methods with long short-term memory (LSTM) embedding. Our approach has three modeling layers or components. In the first layer, we utilize an intrusive projection approach to model dynamics represented by the largest modes. The second layer consists of an LSTM model to account for residuals beyond this truncation. This closure layer refers to the process of including the residual effect of the discarded modes into the dynamics of the largest scales. However, the feasibility of generating a low rank approximation tails off for higher Kolmogorov $n$-width systems due to the underlying nonlinear processes. The third uplifting layer, called super-resolution, addresses this limited representation issue by expanding the span into a larger number of modes utilizing the versatility of LSTM. Therefore, our model integrates a physics-based projection model with a memory embedded LSTM closure and an LSTM based super-resolution model. In several applications, we exploit the use of Grassmann manifold to construct UROM for unseen conditions. We performed numerical experiments by using the Burgers and Navier-Stokes equations with quadratic nonlinearity. Our results show robustness of the proposed approach in building reduced order models for parameterized systems and confirm the improved trade-off between accuracy and efficiency. △ Less

Submitted 13 December, 2019; originally announced December 2019.

Closure Learning for Nonlinear Model Reduction Using Deep Residual Neural Network

Authors: Xuping Xie, Clayton G. Webster, Traian Iliescu

Abstract: Developing accurate, efficient, and robust closure models is essential in the construction of reduced order models (ROMs) for realistic nonlinear systems, which generally require drastic ROM mode truncations. We propose a deep residual neural network (ResNet) closure learning framework for ROMs of nonlinear systems. The novel ResNet-ROM framework consists of two steps: (i) In the first step, we us… ▽ More Developing accurate, efficient, and robust closure models is essential in the construction of reduced order models (ROMs) for realistic nonlinear systems, which generally require drastic ROM mode truncations. We propose a deep residual neural network (ResNet) closure learning framework for ROMs of nonlinear systems. The novel ResNet-ROM framework consists of two steps: (i) In the first step, we use ROM projection to filter the given nonlinear PDE and construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the PDE nonlinearity). (ii) In the second step, we use ResNet to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved ROM modes. We emphasize that in the new ResNet-ROM framework, data is used only to complement classical physical modeling (i.e., only in the closure modeling component), not to completely replace it. We also note that the new ResNet-ROM is built on general ideas of spatial filtering and deep learning and is independent of (restrictive) phenomenological arguments, e.g., of eddy viscosity type. The numerical experiments for the 1D Burgers equation show that the ResNet-ROM is significantly more accurate than the standard projection ROM. The new ResNet-ROM is also more accurate and significantly more efficient than other modern ROM closure models. △ Less

Submitted 11 October, 2019; originally announced October 2019.

Data-Driven Correction Reduced Order Models for the Quasi-Geostrophic Equations: A Numerical Investigation

Authors: Changhong Mou, Honghu Liu, David R. Wells, Traian Iliescu

Abstract: This paper investigates the recently introduced data-driven correction reduced order model (DDC-ROM) in the numerical simulation of the quasi-geostrophic equations. The DDC-ROM uses available data to model the correction term that is generally used to represent the missing information in low-dimensional ROMs. Physical constraints are added to the DDC-ROM to create the constrained data-driven corre… ▽ More This paper investigates the recently introduced data-driven correction reduced order model (DDC-ROM) in the numerical simulation of the quasi-geostrophic equations. The DDC-ROM uses available data to model the correction term that is generally used to represent the missing information in low-dimensional ROMs. Physical constraints are added to the DDC-ROM to create the constrained data-driven correction reduced order model (CDDC-ROM) in order to further improve its accuracy and stability. Finally, the DDC-ROM is tested on time intervals that are longer than the time interval over which it was trained. The numerical investigation shows that, for low-dimensional ROMs, both the DDC-ROM and CDDC-ROM perform better than the standard Galerkin ROM (G-ROM) and the CDDC-ROM provides the best results. △ Less

Submitted 14 August, 2019; originally announced August 2019.

A non-intrusive reduced order modeling framework for quasi-geostrophic turbulence

Authors: Sk. Mashfiqur Rahman, Suraj Pawar, Omer San, Adil Rasheed, Traian Iliescu

Abstract: In this study, we present a non-intrusive reduced order modeling (ROM) framework for large-scale quasi-stationary systems. The framework proposed herein exploits the time series prediction capability of long short-term memory (LSTM) recurrent neural network such that: (i) in the training phase, the LSTM model is trained on the modal coefficients extracted from the high-resolution data using proper… ▽ More In this study, we present a non-intrusive reduced order modeling (ROM) framework for large-scale quasi-stationary systems. The framework proposed herein exploits the time series prediction capability of long short-term memory (LSTM) recurrent neural network such that: (i) in the training phase, the LSTM model is trained on the modal coefficients extracted from the high-resolution data using proper orthogonal decomposition (POD) transform, and (ii) in the testing phase, the trained model predicts the modal coefficients for the total time recursively based on the initial time history. To illustrate the predictive performance of the proposed framework, the mean flow fields and time series response of the field values are reconstructed from the predicted modal coefficients by using an inverse POD transform. As a representative benchmark test case, we consider a two-dimensional quasi-geostrophic (QG) ocean circulation model which, in general, displays an enormous range of fluctuating spatial and temporal scales. We first illustrate that the conventional Galerkin projection based ROM of such systems requires a high number of POD modes to obtain a stable flow physics. In addition, ROM-GP does not seem to capture the intermittent bursts appearing in the dynamics of the first few most energetic modes. However, the proposed non-intrusive ROM framework based on LSTM (ROM-LSTM) yields a stable solution even for a small number of POD modes. We also observe that the ROM-LSTM model is able to capture quasi-periodic intermittent bursts accurately, and yields a stable and accurate mean flow dynamics using the time history of a few previous time states, denoted as the lookback time-window in this paper. Our findings suggest that the proposed ROM framework is capable of predicting noisy nonlinear fluid flows in an extremely efficient way compared to the conventional projection based ROM. △ Less

Submitted 23 June, 2019; originally announced June 2019.

Journal ref: Phys. Rev. E 100, 053306 (2019)

Continuous Data Assimilation Reduced Order Models of Fluid Flow

Authors: Camille Zerfas, Leo G. Rebholz, Michael Schneier, Traian Iliescu

Abstract: We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve ac… ▽ More We propose, analyze, and test a novel continuous data assimilation reduced order model (DA-ROM) for simulating incompressible flows. While ROMs have a long history of success on certain problems with recurring dominant structures, they tend to lose accuracy on more complicated problems and over longer time intervals. Meanwhile, continuous data assimilation (DA) has recently been used to improve accuracy and, in particular, long time accuracy in fluid simulations by incorporating measurement data into the simulation. This paper synthesizes these two ideas, in an attempt to address inaccuracies in ROM by applying DA, especially over long time intervals and when only inaccurate snapshots are available. We prove that with a properly chosen nudging parameter, the proposed DA-ROM algorithm converges exponentially fast in time to the true solution, up to discretization and ROM truncation errors. Finally, we propose a strategy for nudging adaptively in time, by adjusting dissipation arising from the nudging term to better match true solution energy. Numerical tests confirm all results, and show that the DA-ROM strategy with adaptive nudging can be highly effective at providing long time accuracy in ROMs. △ Less

Submitted 10 March, 2019; originally announced March 2019.

An Artificial Compression Reduced Order Model

Authors: Victor DeCaria, Traian Iliescu, William Layton, Michael McLaughlin, Michael Schneier

Abstract: We propose a novel artificial compression, reduced order model (AC-ROM) for the numerical simulation of viscous incompressible fluid flows. The new AC-ROM provides approximations not only for velocity, but also for pressure, which is needed to calculate forces on bodies in the flow and to connect the simulation parameters with pressure data. The new AC-ROM does not require that the velocity-pressu… ▽ More We propose a novel artificial compression, reduced order model (AC-ROM) for the numerical simulation of viscous incompressible fluid flows. The new AC-ROM provides approximations not only for velocity, but also for pressure, which is needed to calculate forces on bodies in the flow and to connect the simulation parameters with pressure data. The new AC-ROM does not require that the velocity-pressure ROM spaces satisfy the inf-sup (Ladyzhenskaya-Babuska-Brezzi) condition and its basis functions are constructed from data that are not required to be weakly-divergence free. We prove error estimates for the reduced basis discretization of the AC-ROM. We also investigate numerically the new AC-ROM in the simulation of a two-dimensional flow between offset cylinders. △ Less

Submitted 24 February, 2019; originally announced February 2019.

Long-Time Reynolds Averaging of Reduced Order Models for Fluid Flows: Preliminary Results

Authors: Luigi C. Berselli, Traian Iliescu, Birgul Koc, Roger Lewandowski

Abstract: We perform a theoretical and numerical investigation of the time-average of energy exchange among modes of Reduced Order Models (ROMs) of fluid flows. We are interested in the statistical equilibrium problem, and especially in the possible forward and backward average transfer of energy among ROM basis functions (modes). We consider two types of ROM modes: eigenfunctions of the Stokes operator and… ▽ More We perform a theoretical and numerical investigation of the time-average of energy exchange among modes of Reduced Order Models (ROMs) of fluid flows. We are interested in the statistical equilibrium problem, and especially in the possible forward and backward average transfer of energy among ROM basis functions (modes). We consider two types of ROM modes: eigenfunctions of the Stokes operator and Proper Orthogonal Decomposition (POD) modes. We prove analytical results for both types of ROM modes and we highlight the differences between them. We also investigate numerically whether the time-average energy exchange between POD modes is positive. To this end, we utilize the one-dimensional Burgers equation as a simplified mathematical model, which is commonly used in ROM tests. The main conclusion of our numerical study is that, for long enough time intervals, the time-average energy exchange from low index POD modes to high index POD modes is positive, as predicted by our theoretical results. △ Less

Submitted 15 January, 2019; originally announced January 2019.

Comments: 20 pages, 1 figure, 9 tables

Nonintrusive Stabilization of Reduced Order Models for Uncertainty Quantification of Time-Dependent Convection-Dominated Flows

Authors: M. Gunzburger, T. Iliescu, M. Mohebujjaman, M. Schneier

Abstract: In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel high-order ROM differential filter and use it in conjunction with an evolve-filter-relax algorithm to attenuate the numerical oscillations of standard ROMs. We also ex… ▽ More In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel high-order ROM differential filter and use it in conjunction with an evolve-filter-relax algorithm to attenuate the numerical oscillations of standard ROMs. We also examine how stochastic collocation methods (SCMs) can be combined with the evolve-filter-relax algorithm for efficient UQ of fluid flows. We emphasize that the new stabilized SCM-ROM framework is nonintrusive and can be easily used in conjunction with legacy flow solvers. We test the new framework in the numerical simulation of a two-dimensional flow past a circular cylinder with a random viscosity that yields a random Reynolds number with mean $Re=100$. △ Less

Submitted 19 October, 2018; originally announced October 2018.

Comments: 22

MSC Class: 65M15; 65M60

Commutation Error in Reduced Order Modeling of Fluid Flows

Authors: Birgul Koc, Muhammad Mohebujjaman, Changhong Mou, Traian Iliescu

Abstract: For reduced order models (ROMs) of fluid flows, we investigate theoretically and computationally whether differentiation and ROM spatial filtering commute, i.e., whether the commutation error (CE) is nonzero. We study the CE for the Laplacian and two ROM filters: the ROM projection and the ROM differential filter. Furthermore, when the CE is nonzero, we investigate whether it has any significant e… ▽ More For reduced order models (ROMs) of fluid flows, we investigate theoretically and computationally whether differentiation and ROM spatial filtering commute, i.e., whether the commutation error (CE) is nonzero. We study the CE for the Laplacian and two ROM filters: the ROM projection and the ROM differential filter. Furthermore, when the CE is nonzero, we investigate whether it has any significant effect on ROMs that are constructed by using spatial filtering. As numerical tests, we use the Burgers equation with viscosities $ν=10^{-1}$ and $ν=10^{-3}$ and a 2D flow past a circular cylinder at Reynolds numbers $Re=1$ and $Re=100$. Our investigation shows that: (i) the CE exists, and (ii) the CE has a significant effect on ROM development for low Reynolds numbers, but not so much for higher Reynolds numbers. △ Less

Submitted 30 September, 2018; originally announced October 2018.

Comments: 22 pages, 1 figure

MSC Class: 65M60

Lagrangian Data-Driven Reduced Order Modeling of Finite Time Lyapunov Exponents

Authors: Xuping Xie, Peter J. Nolan, Shane D. Ross, Changhong Mou, Traian Iliescu

Abstract: There are two main strategies for improving the projection-based reduced order model (ROM) accuracy: (i) improving the ROM, i.e., adding new terms to the standard ROM; and (ii) improving the ROM basis, i.e., constructing ROM bases that yield more accurate ROMs. In this paper, we use the latter. We propose new Lagrangian inner products that we use together with Eulerian and Lagrangian data to const… ▽ More There are two main strategies for improving the projection-based reduced order model (ROM) accuracy: (i) improving the ROM, i.e., adding new terms to the standard ROM; and (ii) improving the ROM basis, i.e., constructing ROM bases that yield more accurate ROMs. In this paper, we use the latter. We propose new Lagrangian inner products that we use together with Eulerian and Lagrangian data to construct new Lagrangian ROMs. We show that the new Lagrangian ROMs are orders of magnitude more accurate than the standard Eulerian ROMs, i.e., ROMs that use standard Eulerian inner product and data to construct the ROM basis. Specifically, for the quasi-geostrophic equations, we show that the new Lagrangian ROMs are more accurate than the standard Eulerian ROMs in approximating not only Lagrangian fields (e.g., the finite time Lyapunov exponent (FTLE)), but also Eulerian fields (e.g., the streamfunction). We emphasize that the new Lagrangian ROMs do not employ any closure modeling to model the effect of discarded modes (which is standard procedure for low-dimensional ROMs of complex nonlinear systems). Thus, the dramatic increase in the new Lagrangian ROMs' accuracy is entirely due to the novel Lagrangian inner products used to build the Lagrangian ROM basis. △ Less

Submitted 18 June, 2020; v1 submitted 16 August, 2018; originally announced August 2018.

Journal ref: Fluids, 2020, 5(4), 189

Physically-Constrained Data-Driven, Filtered Reduced Order Modeling of Fluid Flows

Authors: M. Mohebujjaman, L. G. Rebholz, T. Iliescu

Abstract: In our earlier work, we proposed a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows, which can be formally written as \begin{equation*} \boxed{ \text{ DDF-ROM = Galerkin-ROM + Correction } } \end{equation*} The new DDF-ROM was constructed by using ROM spatial filtering and data-driven ROM closure modeling (for the Correction term) a… ▽ More In our earlier work, we proposed a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows, which can be formally written as \begin{equation*} \boxed{ \text{ DDF-ROM = Galerkin-ROM + Correction } } \end{equation*} The new DDF-ROM was constructed by using ROM spatial filtering and data-driven ROM closure modeling (for the Correction term) and was successfully tested in the numerical simulation of a 2D channel flow past a circular cylinder at Reynolds numbers $Re=100, Re=500$ and $Re=1000$. In this paper, we propose a {\it physically-constrained} DDF-ROM (CDDF-ROM), which aims at improving the physical accuracy of the DDF-ROM. The new physical constraints require that the CDDF-ROM operators satisfy the same type of physical laws (i.e., the nonlinear operator should conserve energy and the ROM closure term should be dissipative) as those satisfied by the fluid flow equations. To implement these physical constraints, in the data-driven modeling step of the DDF-ROM, we replace the unconstrained least squares problem with a constrained least squares problem. We perform a numerical investigation of the new CDDF-ROM and standard DDF-ROM for a 2D channel flow past a circular cylinder at Reynolds numbers $Re=100, Re=500$ and $Re=1000$. To this end, we consider a reproductive regime as well as a predictive (i.e., cross-validation) regime in which we use as little as $50\%$ of the original training data. The numerical investigation clearly shows that the new CDDF-ROM is significantly more accurate than the DDF-ROM in both regimes. △ Less

Submitted 30 May, 2018; originally announced June 2018.

Comments: arXiv admin note: text overlap with arXiv:1709.04362

A Leray regularized ensemble-proper orthogonal decomposition method for parameterized convection-dominated flows

Authors: Max Gunzburger, Traian Iliescu, Michael Schneier

Abstract: Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensem… ▽ More Partial differential equations (PDEs) are often dependent on input quantities which are inherently uncertain. To quantify this uncertainty, these PDEs must be solved over a large ensemble of parameters. Even for a single realization this can a computationally intensive process. In the case of flows governed by the Navier-Stokes equations, an efficient method has been devised for computing an ensemble of solutions. To further reduce the computational cost of this method, an ensemble proper orthogonal decomposition (POD) method was recently proposed. The main contribution of this work is the introduction of POD spatial filtering for ensemble-POD methods. The POD spatial filter makes possible the construction of the Leray ensemble-POD model, which is a regularized reduced order model for the numerical simulation of convection-dominated flows. The Leray ensemble-POD model employs the POD spatial filter to smooth (regularize) the convection term in the Navier-Stokes equations and greatly diminishes the numerical inaccuracies produced by the ensemble-POD method in the numerical simulation of convection-dominated flows. Specifically, for the numerical simulation of a convection-dominated two-dimensional flow between two offset cylinders, we show that the Leray ensemble-POD method yields accurate results, whereas the ensemble-POD is highly inaccurate. The second contribution of this work is a new numerical discretization of the variable viscosity ensemble algorithm in which the average viscosity is replaced with the maximum viscosity. It is shown that this new numerical discretization is significantly more stable than those in current use. Furthermore, error estimates for the novel Leray ensemble-POD algorithm with this new numerical discretization are also proven. △ Less

Submitted 23 October, 2017; v1 submitted 16 October, 2017; originally announced October 2017.

Comments: arXiv admin note: text overlap with arXiv:1709.06422

Data-Driven Filtered Reduced Order Modeling Of Fluid Flows

Authors: X. Xie, M. Mohebujjaman, L. G. Rebholz, T. Iliescu

Abstract: We propose a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows. The novel DDF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the nonlinearity in the given PDE). (ii) In the sec… ▽ More We propose a data-driven filtered reduced order model (DDF-ROM) framework for the numerical simulation of fluid flows. The novel DDF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the nonlinearity in the given PDE). (ii) In the second step, we use data-driven modeling to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved modes. To this end, we use a quadratic ansatz to model this interaction and close the filtered ROM. To find the new coefficients in the closed filtered ROM, we solve an optimization problem that minimizes the difference between the full order model data and our ansatz. We emphasize that the new DDF-ROM is built on general ideas of spatial filtering and optimization and is independent of (restrictive) phenomenological arguments. We investigate the DDF-ROM in the numerical simulation of a 2D channel flow past a circular cylinder at Reynolds number $Re=100$. The DDF-ROM is significantly more accurate than the standard projection ROM. Furthermore, the computational costs of the DDF-ROM and the standard projection ROM are similar, both costs being orders of magnitude lower than the computational cost of the full order model. We also compare the new DDF-ROM with modern ROM closure models in the numerical simulation of the 1D Burgers equation. The DDF-ROM is more accurate and significantly more efficient than these ROM closure models. △ Less

Submitted 11 September, 2017; originally announced September 2017.

Comments: arXiv admin note: substantial text overlap with arXiv:1702.06886

Spatial Filtering for Reduced Order Modeling

Authors: L. C. Berselli, D. Wells, X. Xie, T. Iliescu

Abstract: Spatial filtering has been central in the development of large eddy simulation reduced order models (LES-ROMs) and regularized reduced order models (Reg-ROMs), In this paper, we perform a numerical investigation of spatial filtering. To this end, we consider one of the simplest Reg-ROMs, the Leray ROM (L-ROM), which uses ROM spatial filtering to smooth the flow variables and decreases the amount o… ▽ More Spatial filtering has been central in the development of large eddy simulation reduced order models (LES-ROMs) and regularized reduced order models (Reg-ROMs), In this paper, we perform a numerical investigation of spatial filtering. To this end, we consider one of the simplest Reg-ROMs, the Leray ROM (L-ROM), which uses ROM spatial filtering to smooth the flow variables and decreases the amount of energy aliased to the lower index ROM basis functions. We also propose a new form of ROM differential filter and use it as a spatial filter for the L-ROM. We investigate the performance of this new form of ROM differential filter in the numerical simulation of a flow past a circular cylinder at a Reynolds number $Re=760$. △ Less

Submitted 13 July, 2017; originally announced July 2017.

Comments: 6 pages, 3 figures

MSC Class: 76F65; 76D05

Calibrated Filtered Reduced Order Modeling

Authors: X. Xie, M. Mohebujjaman, L. G. Rebholz, T. Iliescu

Abstract: We propose a calibrated filtered reduced order model (CF-ROM) framework for the numerical simulation of general nonlinear PDEs that are amenable to reduced order modeling. The novel CF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of… ▽ More We propose a calibrated filtered reduced order model (CF-ROM) framework for the numerical simulation of general nonlinear PDEs that are amenable to reduced order modeling. The novel CF-ROM framework consists of two steps: (i) In the first step, we use explicit ROM spatial filtering of the nonlinear PDE to construct a filtered ROM. This filtered ROM is low-dimensional, but is not closed (because of the nonlinearity in the given PDE). (ii) In the second step, we use a calibration procedure to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved modes. To this end, we use a linear or quadratic ansatz to model this interaction and close the filtered ROM. To find the new coefficients in the closed filtered ROM, we solve an optimization problem that minimizes the difference between the full order model data and our ansatz. Although we use a fluid dynamics setting to illustrate how to construct and use the CF-ROM framework, we emphasize that it is built on general ideas of spatial filtering and optimization and is independent of (restrictive) phenomenological arguments. Thus, the CF-ROM framework can be applied to a wide variety of PDEs. △ Less

Submitted 20 February, 2017; originally announced February 2017.

Numerical Analysis of the Leray Reduced Order Model

Authors: Xuping Xie, David Wells, Zhu Wang, Traian Iliescu

Abstract: Standard ROMs generally yield spurious numerical oscillations in the simulation of convection-dominated flows. Regularized ROMs use explicit ROM spatial filtering to decrease these spurious numerical oscillations. The Leray ROM is a recently introduced regularized ROM that utilizes explicit ROM spatial filtering of the convective term in the Navier-Stokes equations. This paper presents the numer… ▽ More Standard ROMs generally yield spurious numerical oscillations in the simulation of convection-dominated flows. Regularized ROMs use explicit ROM spatial filtering to decrease these spurious numerical oscillations. The Leray ROM is a recently introduced regularized ROM that utilizes explicit ROM spatial filtering of the convective term in the Navier-Stokes equations. This paper presents the numerical analysis of the finite element discretization of the Leray ROM. Error estimates for the ROM differential filter, which is the explicit ROM spatial filter used in the Leray ROM, are proved. These ROM filtering error estimates are then used to prove error estimates for the Leray ROM. Finally, both the ROM filtering error estimates and the Leray ROM error estimates are numerically investigated in the simulation of the two-dimensional Navier-Stokes equations with an analytic solution. △ Less

Submitted 16 February, 2017; originally announced February 2017.

Comments: arXiv admin note: text overlap with arXiv:1210.7389

Regularized Reduced Order Models for a Stochastic Burgers Equation

Authors: Traian Iliescu, Honghu Liu, Xuping Xie

Abstract: In this paper, we study the numerical stability of reduced order models for convection-dominated stochastic systems in a relatively simple setting: a stochastic Burgers equation with linear multiplicative noise. Our preliminary results suggest that, in a convection-dominated regime, standard reduced order models yield inaccurate results in the form of spurious numerical oscillations. To alleviate… ▽ More In this paper, we study the numerical stability of reduced order models for convection-dominated stochastic systems in a relatively simple setting: a stochastic Burgers equation with linear multiplicative noise. Our preliminary results suggest that, in a convection-dominated regime, standard reduced order models yield inaccurate results in the form of spurious numerical oscillations. To alleviate these oscillations, we use the Leray reduced order model, which increases the numerical stability of the standard model by smoothing (regularizing) the convective term with an explicit spatial filter. The Leray reduced order model yields significantly better results than the standard reduced order model and is more robust with respect to changes in the strength of the noise. △ Less

Submitted 4 January, 2017; originally announced January 2017.

Approximate Deconvolution Reduced Order Modeling

Authors: Xuping Xie, David Wells, Zhu Wang, Traian Iliescu

Abstract: This paper proposes a large eddy simulation reduced order model(LES-ROM) framework for the numerical simulation of realistic flows. In this LES-ROM framework, the proper orthogonal decomposition(POD) is used to define the ROM basis and a POD differential filter is used to define the large ROM structures. An approximate deconvolution(AD) approach is used to solve the ROM closure problem and develop… ▽ More This paper proposes a large eddy simulation reduced order model(LES-ROM) framework for the numerical simulation of realistic flows. In this LES-ROM framework, the proper orthogonal decomposition(POD) is used to define the ROM basis and a POD differential filter is used to define the large ROM structures. An approximate deconvolution(AD) approach is used to solve the ROM closure problem and develop a new AD-ROM. This AD-ROM is tested in the numerical simulation of the one-dimensional Burgers equation with a small diffusion coefficient(10^{-3}) △ Less

Submitted 9 October, 2015; originally announced October 2015.

Comments: 31pages