Showing 1–50 of 85 results for author: Chung, E T

MatExPre: A matrix exponential preconditioner for the high-frequency Helmholtz equation

Authors: Shubin Fu, Qing Huo Liu, Qiwei Zhan, Eric T. Chung, Changqing Ye

Abstract: In this article, we present a new preconditioner, MatExPre, for the high-frequency Helmholtz equation by leveraging the properties of matrix exponentials. Our approach begins by reformulating the Helmholtz equation into a Schrödinger-like equation and constructing a time-domain solver based on a fixed-point iteration. We then establish a rigorous connection between the time-domain solver and matri… ▽ More In this article, we present a new preconditioner, MatExPre, for the high-frequency Helmholtz equation by leveraging the properties of matrix exponentials. Our approach begins by reformulating the Helmholtz equation into a Schrödinger-like equation and constructing a time-domain solver based on a fixed-point iteration. We then establish a rigorous connection between the time-domain solver and matrix exponential integrators, which enables us to derive algebraic preconditioners that rely solely on sparse matrix-vector products. Spectral analysis and a detailed numerical implementation strategy, including performance improvements achieved through complex shifting, are discussed. Finally, numerical experiments on 2D and large-scale 3D homogeneous and inhomogeneous models, including benchmark seismic examples, substantiate the effectiveness and scalability of the proposed methods. △ Less

Submitted 4 June, 2025; originally announced June 2025.

MSC Class: 65M22; 65F08

A locking free multiscale method for linear elasticity in stress-displacement formulation with high contrast coefficients

Authors: Eric T. Chung, Changqing Ye, Xiang Zhong

Abstract: Achieving strongly symmetric stress approximations for linear elasticity problems in high-contrast media poses a significant computational challenge. Conventional methods often struggle with prohibitively high computational costs due to excessive degrees of freedom, limiting their practical applicability. To overcome this challenge, we introduce an efficient multiscale model reduction method and a… ▽ More Achieving strongly symmetric stress approximations for linear elasticity problems in high-contrast media poses a significant computational challenge. Conventional methods often struggle with prohibitively high computational costs due to excessive degrees of freedom, limiting their practical applicability. To overcome this challenge, we introduce an efficient multiscale model reduction method and a computationally inexpensive coarse-grid simulation technique for linear elasticity equations in highly heterogeneous, high-contrast media. We first utilize a stable stress-displacement mixed finite element method to discretize the linear elasticity problem and then present the construction of multiscale basis functions for the displacement and the stress. The mixed formulation offers several advantages such as direct stress computation without post-processing, local momentum conservation (ensuring physical consistency), and robustness against locking effects, even for nearly incompressible materials. Theoretical analysis confirms that our method is inf-sup stable and locking-free, with first-order convergence relative to the coarse mesh size. Notably, the convergence remains independent of contrast ratios as enlarging oversampling regions. Numerical experiments validate the method's effectiveness, demonstrating its superior performance even under extreme contrast conditions. △ Less

Submitted 24 April, 2025; originally announced April 2025.

Efficient numerical method for the Schrödinger equation with high-contrast potentials

Authors: Xingguang Jin, Liu Liu, Xiang Zhong, Eric T. Chung

Abstract: In this paper, we study the Schrödinger equation in the semiclassical regime and with multiscale potential function. We develop the so-called constraint energy minimization generalized multiscale finite element method (CEM-GMsFEM), in the framework of Crank-Nicolson (CN) discretization in time. The localized multiscale basis functions are constructed by addressing the spectral problem and a constr… ▽ More In this paper, we study the Schrödinger equation in the semiclassical regime and with multiscale potential function. We develop the so-called constraint energy minimization generalized multiscale finite element method (CEM-GMsFEM), in the framework of Crank-Nicolson (CN) discretization in time. The localized multiscale basis functions are constructed by addressing the spectral problem and a constrained energy minimization problem related to the Hamiltonian norm. A first-order convergence in the energy norm and second-order convergence in the $L^2$ norm for our numerical scheme are shown, with a relation between oversampling number in the CEM-GMsFEM method, spatial mesh size and the semiclassical parameter provided. Furthermore, we demonstrate the convergence of the proposed Crank-Nicolson CEM-GMsFEM scheme with $H/\sqrtΛ$ sufficiently small (where $H$ represents the coarse size and $Λ$ is the minimal eigenvalue associated with the eigenvector not included in the auxiliary space). Our error bound remains uniform with respect to $\varepsilon$ (where $0 < \varepsilon\ll 1$ is the Planck constant). Several numerical examples including 1D and 2D in space, with high-contrast potential are conducted to demonstrate the efficiency and accuracy of our proposed scheme. △ Less

Submitted 10 February, 2025; originally announced February 2025.

A robust solver for large-scale heat transfer topology optimization

Authors: Yingjie Zhou, Changqing Ye, Yucheng Liu, Shubin Fu, Eric T. Chung

Abstract: This paper presents a large-scale parallel solver, specifically designed to tackle the challenges of solving high-dimensional and high-contrast linear systems in heat transfer topology optimization. The solver incorporates an interpolation technique to accelerate convergence in high-resolution domains, along with a multiscale multigrid preconditioner to handle complex coefficient fields with signi… ▽ More This paper presents a large-scale parallel solver, specifically designed to tackle the challenges of solving high-dimensional and high-contrast linear systems in heat transfer topology optimization. The solver incorporates an interpolation technique to accelerate convergence in high-resolution domains, along with a multiscale multigrid preconditioner to handle complex coefficient fields with significant contrast. All modules of the optimization solver are implemented on a high performance computing cluster by the PETSc numerical library. Through a series of numerical investigations, we demonstrate the effectiveness of our approach in enhancing convergence and robustness during the optimization process, particularly in high-contrast scenarios with resolutions up to $1024^3$. Our performance results indicate that the proposed preconditioner achieves over $2\times$ speedup against the default algebraic multigrid in PETSc for high-contrast cases. △ Less

Submitted 13 January, 2025; v1 submitted 9 October, 2024; originally announced October 2024.

MSC Class: 65F10; 65N55; 65Y05; 80M50

Learning a generalized multiscale prolongation operator

Authors: Yucheng Liu, Shubin Fu, Yingjie Zhou, Changqing Ye, Eric T. Chung

Abstract: In this research, we address Darcy flow problems with random permeability using iterative solvers, enhanced by a two-grid preconditioner based on a generalized multiscale prolongation operator, which has been demonstrated to be stable for high contrast profiles. To circumvent the need for repeatedly solving spectral problems with varying coefficients, we harness deep learning techniques to expedit… ▽ More In this research, we address Darcy flow problems with random permeability using iterative solvers, enhanced by a two-grid preconditioner based on a generalized multiscale prolongation operator, which has been demonstrated to be stable for high contrast profiles. To circumvent the need for repeatedly solving spectral problems with varying coefficients, we harness deep learning techniques to expedite the construction of the generalized multiscale prolongation operator. Considering linear transformations on multiscale basis have no impact on the performance of the preconditioner, we devise a loss function by the coefficient-based distance between subspaces instead of the plain $l^2$-norm of the difference of the corresponding multiscale bases. We discover that leveraging the inherent symmetry in the local spectral problem can effectively accelerate the neural network training process. In scenarios where training data are limited, we utilize the Karhunen-Loève expansion to augment the dataset. Extensive numerical experiments with various types of random coefficient models are exhibited, showing that the proposed method can significantly reduce the time required to generate the prolongation operator while maintaining the original efficiency of the two-grid preconditioner. Notably, the neural network demonstrates strong generalization capabilities, as evidenced by its satisfactory performance on unseen random permeability fields. △ Less

Submitted 13 January, 2025; v1 submitted 9 October, 2024; originally announced October 2024.

MSC Class: 65F08; 65N55; 68T07

Constraint Energy Minimizing Generalized Multiscale Finite Element Method for Convection Diffusion Equations with Inhomogeneous Boundary Conditions

Authors: Po Chai Wong, Eric T. Chung, Changqing Ye, Lina Zhao

Abstract: In this paper, we develop the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) for convection-diffusion equations with inhomogeneous Dirichlet, Neumann and Robin boundary conditions, along with high-contrast coefficients. For time independent problems, boundary correctors $\mathcal{D}^m$ and $\mathcal{N}^{m}$ for Dirichlet, Neumann, and Robin conditions are de… ▽ More In this paper, we develop the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) for convection-diffusion equations with inhomogeneous Dirichlet, Neumann and Robin boundary conditions, along with high-contrast coefficients. For time independent problems, boundary correctors $\mathcal{D}^m$ and $\mathcal{N}^{m}$ for Dirichlet, Neumann, and Robin conditions are designed. For time dependent problems, a scheme to update the boundary correctors is formulated. Error analysis in both cases is given to show the first-order convergence in energy norm with respect to the coarse mesh size $H$ and second-order convergence in $L^2-$norm, as verified by numerical examples, with which different finite difference schemes are compared for temporal discretization. Nonlinear problems are also demonstrated in combination with Strang splitting. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Comments: 36 pages.11 figures. Submitted to Journal of Computational Mathematics

MSC Class: 65M12; 65M15; 65N30

Multiscale modeling for a class of high-contrast heterogeneous sign-changing problems

Authors: Changqing Ye, Xingguang Jin, Patrick Ciarlet Jr., Eric T. Chung

Abstract: The mathematical formulation of sign-changing problems involves a linear second-order partial differential equation in the divergence form, where the coefficient can assume positive and negative values in different subdomains. These problems find their physical background in negative-index metamaterials, either as inclusions embedded into common materials as the matrix or vice versa. In this paper… ▽ More The mathematical formulation of sign-changing problems involves a linear second-order partial differential equation in the divergence form, where the coefficient can assume positive and negative values in different subdomains. These problems find their physical background in negative-index metamaterials, either as inclusions embedded into common materials as the matrix or vice versa. In this paper, we propose a numerical method based on the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) specifically designed for sign-changing problems. The construction of auxiliary spaces in the original CEM-GMsFEM is tailored to accommodate the sign-changing setting. The numerical results demonstrate the effectiveness of the proposed method in handling sophisticated coefficient profiles and the robustness of coefficient contrast ratios. Under several technical assumptions and by applying the \texttt{T}-coercivity theory, we establish the inf-sup stability and provide an a priori error estimate for the proposed method. △ Less

Submitted 24 July, 2024; originally announced July 2024.

Robust Multiscale Methods for Helmholtz equations in high contrast heterogeneous media

Authors: Xingguang Jin, Changqing Ye, Eric T. Chung

Abstract: In this paper, we provide the constraint energy minimization generalized multiscale finite element method (CEM-GMsFEM) to solve Helmholtz equations in heterogeneous medium. This novel multiscale method is specifically designed to overcome problems related to pollution effect, high-contrast coefficients, and the loss of hermiticity of operators. We establish the inf-sup stability and give an a prio… ▽ More In this paper, we provide the constraint energy minimization generalized multiscale finite element method (CEM-GMsFEM) to solve Helmholtz equations in heterogeneous medium. This novel multiscale method is specifically designed to overcome problems related to pollution effect, high-contrast coefficients, and the loss of hermiticity of operators. We establish the inf-sup stability and give an a priori error estimate for this method under a number of established assumptions and resolution conditions. The theoretical results are validated by a set of numerical tests, which further show that the multiscale technique can effectively capture pertinent physical phenomena. △ Less

Submitted 8 July, 2024; v1 submitted 5 July, 2024; originally announced July 2024.

An iterative constraint energy minimizing generalized multiscale finite element method for contact problem

Authors: Zishang Li, Changqing Ye, Eric T. Chung

Abstract: This work presents an Iterative Constraint Energy Minimizing Generalized Multiscale Finite Element Method (ICEM-GMsFEM) for solving the contact problem with high contrast coefficients. The model problem can be characterized by a variational inequality, where we add a penalty term to convert this problem into a non-smooth and non-linear unconstrained minimizing problem. The characterization of the… ▽ More This work presents an Iterative Constraint Energy Minimizing Generalized Multiscale Finite Element Method (ICEM-GMsFEM) for solving the contact problem with high contrast coefficients. The model problem can be characterized by a variational inequality, where we add a penalty term to convert this problem into a non-smooth and non-linear unconstrained minimizing problem. The characterization of the minimizer satisfies the variational form of a mixed Dirilect-Neumann-Robin boundary value problem. So we apply CEM-GMsFEM iteratively and introduce special boundary correctors along with multiscale spaces to achieve an optimal convergence rate. Numerical results are conducted for different highly heterogeneous permeability fields, validating the fast convergence of the CEM-GMsFEM iteration in handling the contact boundary and illustrating the stability of the proposed method with different sets of parameters. We also prove the fast convergence of the proposed iterative CEM-GMsFEM method and provide an error estimate of the multiscale solution under a mild assumption. △ Less

Submitted 5 June, 2024; originally announced June 2024.

A fast cosine transformation accelerated method for predicting effective thermal conductivity

Authors: Changqing Ye, Shubin Fu, Eric T. Chung

Abstract: Predicting effective thermal conductivity by solving a Partial Differential Equation (PDE) defined on a high-resolution Representative Volume Element (RVE) is a computationally intensive task. In this paper, we tackle the task by proposing an efficient and implementation-friendly computational method that can fully leverage the computing power offered by hardware accelerators, namely, graphical pr… ▽ More Predicting effective thermal conductivity by solving a Partial Differential Equation (PDE) defined on a high-resolution Representative Volume Element (RVE) is a computationally intensive task. In this paper, we tackle the task by proposing an efficient and implementation-friendly computational method that can fully leverage the computing power offered by hardware accelerators, namely, graphical processing units (GPUs). We first employ the Two-Point Flux-Approximation scheme to discretize the PDE and then utilize the preconditioned conjugate gradient method to solve the resulting algebraic linear system. The construction of the preconditioner originates from FFT-based homogenization methods, and an engineered linear programming technique is utilized to determine the homogeneous reference parameters. The fundamental observation presented in this paper is that the preconditioner system can be effectively solved using multiple Fast Cosine Transformations (FCT) and parallel tridiagonal matrix solvers. Regarding the fact that default multiple FCTs are unavailable on the CUDA platform, we detail how to derive FCTs from FFTs with nearly optimal memory usage. Numerical experiments including the stability comparison with standard preconditioners are conducted for 3D RVEs. Our performance reports indicate that the proposed method can achieve a $5$-fold acceleration on the GPU platform over the pure CPU platform and solve the problems with $512^3$ degrees of freedom and reasonable contrast ratios in less than $30$ seconds. △ Less

Submitted 2 April, 2024; originally announced April 2024.

A robust two-level overlapping preconditioner for Darcy flow in high-contrast media

Authors: Changqing Ye, Shubin Fu, Eric T. Chung, Jizu Huang

Abstract: In this article, a two-level overlapping domain decomposition preconditioner is developed for solving linear algebraic systems obtained from simulating Darcy flow in high-contrast media. Our preconditioner starts at a mixed finite element method for discretizing the partial differential equation by Darcy's law with the no-flux boundary condition and is then followed by a velocity elimination techn… ▽ More In this article, a two-level overlapping domain decomposition preconditioner is developed for solving linear algebraic systems obtained from simulating Darcy flow in high-contrast media. Our preconditioner starts at a mixed finite element method for discretizing the partial differential equation by Darcy's law with the no-flux boundary condition and is then followed by a velocity elimination technique to yield a linear algebraic system with only unknowns of pressure. Then, our main objective is to design a robust and efficient domain decomposition preconditioner for this system, which is accomplished by engineering a multiscale coarse space that is capable of characterizing high-contrast features of the permeability field. A generalized eigenvalue problem is solved in each non-overlapping coarse element in a communication-free manner to form the global solver, which is accompanied by local solvers originated from additive Schwarz methods but with a non-Galerkin discretization to derive the two-level preconditioner. We provide a rigorous analysis that indicates that the condition number of the preconditioned system could be bounded above with several assumptions. Extensive numerical experiments with various types of three-dimensional high-contrast models are exhibited. In particular, we study the robustness against the contrast of the media as well as the influences of numbers of eigenfunctions, oversampling sizes, and subdomain partitions on the efficiency of the proposed preconditioner. Besides, strong and weak scalability performances are also examined. △ Less

Submitted 28 March, 2024; originally announced March 2024.

An efficient multiscale multigrid preconditioner for Darcy flow in high-contrast media

Authors: Changqing Ye, Shubin Fu, Eric T. Chung, Jizu Huang

Abstract: In this paper, we develop a multigrid preconditioner to solve Darcy flow in highly heterogeneous porous media. The key component of the preconditioner is to construct a sequence of nested subspaces $W_{\mathcal{L}}\subset W_{\mathcal{L}-1}\subset\cdots\subset W_1=W_h$. An appropriate spectral problem is defined in the space of $W_{i-1}$, then the eigenfunctions of the spectral problems are utilize… ▽ More In this paper, we develop a multigrid preconditioner to solve Darcy flow in highly heterogeneous porous media. The key component of the preconditioner is to construct a sequence of nested subspaces $W_{\mathcal{L}}\subset W_{\mathcal{L}-1}\subset\cdots\subset W_1=W_h$. An appropriate spectral problem is defined in the space of $W_{i-1}$, then the eigenfunctions of the spectral problems are utilized to form $W_i$. The preconditioner is applied to solve a positive semidefinite linear system which results from discretizing the Darcy flow equation with the lowest order Raviart-Thomas spaces and adopting a trapezoidal quadrature rule. Theoretical analysis and numerical investigations of this preconditioner will be presented. In particular, we will consider several typical highly heterogeneous permeability fields whose resolutions are up to $1024^3$ and examine the computational performance of the preconditioner in several aspects, such as strong scalability, weak scalability, and robustness against the contrast of the media. We also demonstrate an application of this preconditioner for solving a two-phase flow benchmark problem. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Convergence of the CEM-GMsFEM for compressible flow in highly heterogeneous media

Authors: Leonardo A. Poveda, Shubin Fu, Eric T. Chung, Lina Zhao

Abstract: This paper presents and analyses a Constraint Energy Minimization Generalized Multiscale Finite Element Method (CEM-GMsFEM) for solving single-phase non-linear compressible flows in highly heterogeneous media. The construction of CEM-GMsFEM hinges on two crucial steps: First, the auxiliary space is constructed by solving local spectral problems, where the basis functions corresponding to small eig… ▽ More This paper presents and analyses a Constraint Energy Minimization Generalized Multiscale Finite Element Method (CEM-GMsFEM) for solving single-phase non-linear compressible flows in highly heterogeneous media. The construction of CEM-GMsFEM hinges on two crucial steps: First, the auxiliary space is constructed by solving local spectral problems, where the basis functions corresponding to small eigenvalues are captured. Then the basis functions are obtained by solving local energy minimization problems over the oversampling domains using the auxiliary space. The basis functions have exponential decay outside the corresponding local oversampling regions. The convergence of the proposed method is provided, and we show that this convergence only depends on the coarse grid size and is independent of the heterogeneities. An online enrichment guided by \emph{a posteriori} error estimator is developed to enhance computational efficiency. Several numerical experiments on a three-dimensional case to confirm the theoretical findings are presented, illustrating the performance of the method and giving efficient and accurate numerical. △ Less

Submitted 30 March, 2023; originally announced March 2023.

MSC Class: 65M12; 65M60; 65M22

A multiscale method for inhomogeneous elastic problems with high contrast coefficients

Authors: Zhongqian Wang, Changqing Ye, Eric T. Chung

Abstract: In this paper, we develop the constrained energy minimizing generalized multiscale finite element method (CEM-GMsFEM) with mixed boundary conditions (Dirichlet and Neumann) for the elasticity equations in high contrast media. By a special treatment of mixed boundary conditions separately, and combining the construction of the relaxed and constraint version of the CEM-GMsFEM, we discover that the m… ▽ More In this paper, we develop the constrained energy minimizing generalized multiscale finite element method (CEM-GMsFEM) with mixed boundary conditions (Dirichlet and Neumann) for the elasticity equations in high contrast media. By a special treatment of mixed boundary conditions separately, and combining the construction of the relaxed and constraint version of the CEM-GMsFEM, we discover that the method offers some advantages such as the independence of the target region's contrast from precision, while the sizes of oversampling domains have a significant impact on numerical accuracy. Moreover, to our best knowledge, this is the first proof of the convergence of the CEM-GMsFEM with mixed boundary conditions for the elasticity equations given. Some numerical experiments are provided to demonstrate the method's performance. △ Less

Submitted 20 October, 2022; originally announced October 2022.

Comments: CEM-GMsFEM; mixed boundary conditions; high contrast media

Homogenization with quasistatic Tresca's friction law: qualitative and quantitative results

Authors: Changqing Ye, Eric T. Chung, Junzhi Cui

Abstract: Modeling of frictional contacts is crucial for investigating mechanical performances of composite materials under varying service environments. The paper considers a linear elasticity system with strongly heterogeneous coefficients and quasistatic Tresca friction law, and studies the homogenization theories under the frameworks of H-convergence and small $ε$-periodicity. The qualitative result is… ▽ More Modeling of frictional contacts is crucial for investigating mechanical performances of composite materials under varying service environments. The paper considers a linear elasticity system with strongly heterogeneous coefficients and quasistatic Tresca friction law, and studies the homogenization theories under the frameworks of H-convergence and small $ε$-periodicity. The qualitative result is based on H-convergence, which shows the original oscillating solutions will converge weakly to the homogenized solution, while our quantitative result provides an estimate of asymptotic errors in $H^1$-norm for the periodic homogenization. This paper also designs several numerical experiments to validate the convergence rates in the quantitative analysis. △ Less

Submitted 20 July, 2023; v1 submitted 20 April, 2022; originally announced April 2022.

MSC Class: 74Q05; 74Q10; 35J86

Constraint energy minimizing generalized multiscale finite element method for inhomogeneous boundary value problems with high contrast coefficients

Authors: Changqing Ye, Eric T. Chung

Abstract: In this article we develop the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for elliptic partial differential equations with inhomogeneous Dirichlet, Neumann, and Robin boundary conditions, and the high contrast property emerges from the coefficients of elliptic operators and Robin boundary conditions. By careful construction of multiscale bases of the CEM… ▽ More In this article we develop the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for elliptic partial differential equations with inhomogeneous Dirichlet, Neumann, and Robin boundary conditions, and the high contrast property emerges from the coefficients of elliptic operators and Robin boundary conditions. By careful construction of multiscale bases of the CEM-GMsFEM, we introduce two operators $\mathcal{D}^m$ and $\mathcal{N}^m$ which are used to handle inhomogeneous Dirichlet and Neumann boundary values and are also proved to converge independently of contrast ratios as enlarging oversampling regions. We provide a priori error estimate and show that oversampling layers are the key factor in controlling numerical errors. A series of experiments are conducted, and those results reflect the reliability of our methods even with high contrast ratios. △ Less

Submitted 13 January, 2022; originally announced January 2022.

MSC Class: 65M12; 65M15; 65N30

Numerical analysis of several FFT-based schemes for computational homogenization

Authors: Changqing Ye, Eric T. Chung

Abstract: We study the convergences of several FFT-based schemes that are widely applied in computational homogenization for deriving effective coefficients, and the term "convergence" here means the limiting behaviors as spatial resolutions going to infinity. Those schemes include Moulinec-Suquent's scheme [Comput Method Appl M, 157 (1998), pp. 69-94], Willot's scheme [Comptes Rendus Mécanique, 343 (2015),… ▽ More We study the convergences of several FFT-based schemes that are widely applied in computational homogenization for deriving effective coefficients, and the term "convergence" here means the limiting behaviors as spatial resolutions going to infinity. Those schemes include Moulinec-Suquent's scheme [Comput Method Appl M, 157 (1998), pp. 69-94], Willot's scheme [Comptes Rendus Mécanique, 343 (2015), pp. 232-245], and the FEM scheme [Int J Numer Meth Eng, 109 (2017), pp. 1461-1489]. Under some reasonable assumptions, we prove that the effective coefficients obtained by those schemes are all convergent to the theoretical ones. Moreover, for the FEM scheme, we can present several convergence rate estimates under additional regularity assumptions. △ Less

Submitted 5 January, 2022; originally announced January 2022.

MSC Class: 74Q05; 74Q15; 65N12

Mixed Generalized Multiscale Finite Element Method for Flow Problem in Thin Domains

Authors: Denis Spiridonov, Maria Vasilyeva, Min Wang, Eric T. Chung

Abstract: In this paper, we construct a class of Mixed Generalized Multiscale Finite Element Methods for the approximation on a coarse grid for an elliptic problem in thin two-dimensional domains. We consider the elliptic equation with homogeneous boundary conditions on the domain walls. For reference solution of the problem, we use a Mixed Finite Element Method on a fine grid that resolves complex geometry… ▽ More In this paper, we construct a class of Mixed Generalized Multiscale Finite Element Methods for the approximation on a coarse grid for an elliptic problem in thin two-dimensional domains. We consider the elliptic equation with homogeneous boundary conditions on the domain walls. For reference solution of the problem, we use a Mixed Finite Element Method on a fine grid that resolves complex geometry on the grid level. To construct a lower dimensional model, we use the Mixed Generalized Multiscale Finite Element Method, which is based on some multiscale basis functions for velocity fields. The construction of the basis functions is based on the local snapshot space that takes all possible flows on the interface between coarse cells into account. In order to reduce the size of the snapshot space and obtain the multiscale approximation, we solve a local spectral problem to identify dominant modes in the snapshot space. We present a convergence analysis of the presented multiscale method. Numerical results are presented for two-dimensional problems in three testing geometries along with the errors associated to different numbers of the multiscale basis functions used for the velocity field. Numerical investigations are conducted for problems with homogeneous and heterogeneous properties respectively. △ Less

Submitted 11 October, 2021; originally announced October 2021.

Contrast-independent partially explicit time discretizations for nonlinear multiscale problems

Authors: Eric T. Chung, Yalchin Efendiev, Wing Tat Leung, Wenyuan Li

Abstract: This work continues a line of works on developing partially explicit methods for multiscale problems. In our previous works, we have considered linear multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In these works, we have introduced contrast-independent partially explicit time discretizations for linear equations. The contrast-independent partiall… ▽ More This work continues a line of works on developing partially explicit methods for multiscale problems. In our previous works, we have considered linear multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In these works, we have introduced contrast-independent partially explicit time discretizations for linear equations. The contrast-independent partially explicit time discretization divides the spatial space into two components: contrast dependent (fast) and contrast independent (slow) spaces defined via multiscale space decomposition. Following this decomposition, temporal splitting is proposed that treats fast components implicitly and slow components explicitly. The space decomposition and temporal splitting are chosen such that it guarantees a stability and formulate a condition for the time stepping. This condition is formulated as a condition on slow spaces. In this paper, we extend this approach to nonlinear problems. We propose a splitting approach and derive a condition that guarantees stability. This condition requires some type of contrast-independent spaces for slow components of the solution. We present numerical results and show that the proposed methods provide results similar to implicit methods with the time step that is independent of the contrast. △ Less

Submitted 28 August, 2021; originally announced August 2021.

Comments: 24 pages, 27 figures

MSC Class: 65M22 (Primary); 65M55 (Secondary)

Learning Rays via Deep Neural Network in a Ray-based IPDG Method for High-Frequency Helmholtz Equations in Inhomogeneous Media

Authors: Tak Shing Au Yeung, Ka Chun Cheung, Eric T. Chung, Shubin Fu, Jianliang Qian

Abstract: We develop a deep learning approach to extract ray directions at discrete locations by analyzing highly oscillatory wave fields. A deep neural network is trained on a set of local plane-wave fields to predict ray directions at discrete locations. The resulting deep neural network is then applied to a reduced-frequency Helmholtz solution to extract the directions, which are further incorporated int… ▽ More We develop a deep learning approach to extract ray directions at discrete locations by analyzing highly oscillatory wave fields. A deep neural network is trained on a set of local plane-wave fields to predict ray directions at discrete locations. The resulting deep neural network is then applied to a reduced-frequency Helmholtz solution to extract the directions, which are further incorporated into a ray-based interior-penalty discontinuous Galerkin (IPDG) method to solve the Helmholtz equations at higher frequencies. In this way, we observe no apparent pollution effects in the resulting Helmholtz solutions in inhomogeneous media. Our 2D and 3D numerical results show that the proposed scheme is very efficient and yields highly accurate solutions. △ Less

Submitted 19 June, 2021; originally announced June 2021.

Comments: 30 pages

Contrast-independent partially explicit time discretizations for multiscale wave problems

Authors: Eric T. Chung, Yalchin Efendiev, Wing Tat Leung, Petr N. Vabishchevich

Abstract: In this work, we design and investigate contrast-independent partially explicit time discretizations for wave equations in heterogeneous high-contrast media. We consider multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In our previous work, we have introduced contrast-independent partially explicit time discretizations and applied to parabolic equat… ▽ More In this work, we design and investigate contrast-independent partially explicit time discretizations for wave equations in heterogeneous high-contrast media. We consider multiscale problems, where the spatial heterogeneities are at subgrid level and are not resolved. In our previous work, we have introduced contrast-independent partially explicit time discretizations and applied to parabolic equations. The main idea of contrast-independent partially explicit time discretization is to split the spatial space into two components: contrast dependent (fast) and contrast independent (slow) spaces defined via multiscale space decomposition. Using this decomposition, our goal is further appropriately to introduce time splitting such that the resulting scheme is stable and can guarantee contrast-independent discretization under some suitable (reasonable) conditions. In this paper, we propose contrast-independent partially explicitly scheme for wave equations. The splitting requires a careful design. We prove that the proposed splitting is unconditionally stable under some suitable conditions formulated for the second space (slow). This condition requires some type of non-contrast dependent space and is easier to satisfy in the "slow" space. We present numerical results and show that the proposed methods provide results similar to implicit methods with the time step that is independent of the contrast. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Contrast-independent partially explicit time discretizations for multiscale flow problems

Authors: Eric T. Chung, Yalchin Efendiev, Wing Tat Leung, Petr N. Vabishchevich

Abstract: Many multiscale problems have a high contrast, which is expressed as a very large ratio between the media properties. The contrast is known to introduce many challenges in the design of multiscale methods and domain decomposition approaches. These issues to some extend are analyzed in the design of spatial multiscale and domain decomposition approaches. However, some of these issues remain open fo… ▽ More Many multiscale problems have a high contrast, which is expressed as a very large ratio between the media properties. The contrast is known to introduce many challenges in the design of multiscale methods and domain decomposition approaches. These issues to some extend are analyzed in the design of spatial multiscale and domain decomposition approaches. However, some of these issues remain open for time dependent problems as the contrast affects the time scales, particularly, for explicit methods. For example, in parabolic equations, the time step is $dt=H^2/κ_{max}$, where $κ_{max}$ is the largest diffusivity. In this paper, we address this issue in the context of parabolic equation by designing a splitting algorithm. The proposed splitting algorithm treats dominant multiscale modes in the implicit fashion, while the rest in the explicit fashion. The unconditional stability of these algorithms require a special multiscale space design, which is the main purpose of the paper. We show that with an appropriate choice of multiscale spaces we can achieve an unconditional stability with respect to the contrast. This could provide computational savings as the time step in explicit methods is adversely affected by the contrast. We discuss some theoretical aspects of the proposed algorithms. Numerical results are presented. △ Less

Submitted 12 January, 2021; originally announced January 2021.

Multiscale dimension reduction for flow and transport problems in thin domain with reactive boundaries

Authors: Maria Vasilyeva, Valentin Alekseev, Eric T. Chung, Yalchin Efendiev

Abstract: In this paper, we consider flow and transport problems in thin domains. The mathematical model considered in the paper is described by a system of equations for velocity, pressure, and concentration, where the flow is described by the Stokes equations and the transport is described by an unsteady convection-diffusion equation with non-homogeneous boundary conditions on walls (reactive boundaries).… ▽ More In this paper, we consider flow and transport problems in thin domains. The mathematical model considered in the paper is described by a system of equations for velocity, pressure, and concentration, where the flow is described by the Stokes equations and the transport is described by an unsteady convection-diffusion equation with non-homogeneous boundary conditions on walls (reactive boundaries). We start with the finite element approximation of the problem on unstructured grids and use it as a reference solution for two and three-dimensional model problems. Fine grid approximation resolves complex geometries on the grid level and leads to a large discrete system of equations that is computationally expensive to solve. To reduce the size of the discrete systems, we develop a multiscale model reduction technique, where we construct local multiscale basis functions to generate a lower-dimensional model on a coarse grid. The proposed multiscale model reduction is based on the Discontinuous Galerkin Generalized Multiscale Finite Element Method (DG-GMsGEM). In DG-GMsFEM for flow problems, we start with constructing the snapshot space for each interface between coarse grid cells to capture possible flows. For the reduction of the snapshot space size, we perform a dimension reduction via a solution of the local spectral problem and use eigenvectors corresponding to the smallest eigenvalues as multiscale basis functions for the approximation on the coarse grid. For the transport problem, we construct multiscale basis functions for each interface between coarse grid cells and present additional basis functions to capture non-homogeneous boundary conditions on walls. Finally, we will present some numerical simulations for three test geometries for two and three-dimensional problems to demonstrate the method's performance. △ Less

Submitted 2 September, 2020; originally announced September 2020.

Explicit and Energy-Conserving Constraint Energy Minimizing Generalized Multiscale Discontinuous Galerkin Method for Wave Propagation in Heterogeneous Media

Authors: Siu Wun Cheung, Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

Abstract: In this work, we propose a local multiscale model reduction approach for the time-domain scalar wave equation in a heterogenous media. A fine mesh is used to capture the heterogeneities of the coefficient field, and the equation is solved globally on a coarse mesh in the discontinuous Galerkin discretization setting. The main idea of the model reduction approach is to extract dominant modes in loc… ▽ More In this work, we propose a local multiscale model reduction approach for the time-domain scalar wave equation in a heterogenous media. A fine mesh is used to capture the heterogeneities of the coefficient field, and the equation is solved globally on a coarse mesh in the discontinuous Galerkin discretization setting. The main idea of the model reduction approach is to extract dominant modes in local spectral problems for representation of important features, construct multiscale basis functions in coarse oversampled regions by constraint energy minimization problems, and perform a Petrov-Galerkin projection and a symmetrization onto the coarse grid. The method is expicit and energy conserving, and exhibits both coarse-mesh and spectral convergence, provided that the oversampling size is appropriately chosen. We study the stability and convergence of our method. We also present numerical results on the Marmousi model in order to test the performance of the method and verify the theoretical results. △ Less

Submitted 1 September, 2020; originally announced September 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:1909.12461

Generalized multiscale approximation of a multipoint flux mixed finite element method for Darcy-Forchheimer model

Authors: Zhengkang He, Eric T. Chung, Jie Chen, Zhangxin Chen

Abstract: In this paper, we propose a multiscale method for the Darcy-Forchheimer model in highly heterogeneous porous media. The problem is solved in the framework of generalized multiscale finite element methods (GMsFEM) combined with a multipoint flux mixed finite element (MFMFE) method. %In the MFMFE methods, appropriate mixed finite element spaces and suitable quadrature rules are employed, which allow… ▽ More In this paper, we propose a multiscale method for the Darcy-Forchheimer model in highly heterogeneous porous media. The problem is solved in the framework of generalized multiscale finite element methods (GMsFEM) combined with a multipoint flux mixed finite element (MFMFE) method. %In the MFMFE methods, appropriate mixed finite element spaces and suitable quadrature rules are employed, which allow for local velocity elimination and lead to a cell-centered system for the pressure. We consider the MFMFE method that utilizes the lowest order Brezzi-Douglas-Marini ($\textrm{BDM}_1$) mixed finite element spaces for the velocity and pressure approximation. The symmetric trapezoidal quadrature rule is employed for the integration of bilinear forms relating to the velocity variables so that the local velocity elimination is allowed and leads to a cell-centered system for the pressure. %on meshes composed of simplices and $h^2$-perturbed parallelograms. We construct multiscale space for the pressure and solve the problem on the coarse grid following the GMsFEM framework. In the offline stage, we construct local snapshot spaces and perform spectral decompositions to get the offline space with a smaller dimension. In the online stage, we use the Newton iterative algorithm to solve the nonlinear problem and obtain the offline solution, which reduces the iteration times greatly comparing to the standard Picard iteration. Based on the offline space and offline solution, we calculate online basis functions which contain important global information to enrich the multiscale space iteratively. The online basis functions are efficient and accurate to reduce relative errors substantially. Numerical examples are provided to highlight the performance of the proposed multiscale method. △ Less

Submitted 17 July, 2020; originally announced July 2020.

Adaptive generalized multiscale approximation of a mixed finite element method with velocity elimination

Authors: Zhengkang He, Eric T. Chung, Jie Chen, Zhangxin Chen

Abstract: In this paper, we propose offline and online adaptive enrichment algorithms for the generalized multiscale approximation of a mixed finite element method with velocity elimination to solve the subsurface flow problem in high-contrast and heterogeneous porous media. We give the theoretical analysis for the convergence of these two adaptive methods, which shows that sufficient initial basis function… ▽ More In this paper, we propose offline and online adaptive enrichment algorithms for the generalized multiscale approximation of a mixed finite element method with velocity elimination to solve the subsurface flow problem in high-contrast and heterogeneous porous media. We give the theoretical analysis for the convergence of these two adaptive methods, which shows that sufficient initial basis functions (belong to the offline space) leads to a faster convergence rate. A series of numerical examples are provided to highlight the performance of both these two adaptive methods and also validate the theoretical analysis. Both offline and online adaptive methods are effective that can reduce the relative error substantially. In addition, the online adaptive method generally performs better than the offline adaptive method as online basis functions contain important global information such as distant effects that cannot be captured by offline basis functions. The numerical results also show that with a suitable initial multiscale space that includes all offline basis functions corresponding to relative smaller eigenvalues of local spectral decompositions in the offline stage, the convergence rate of the online enrichment is independent of the permeability contrast. △ Less

Submitted 17 July, 2020; originally announced July 2020.

A deep learning based nonlinear upscaling method for transport equations

Authors: Tak Shing Au Yeung, Eric T. Chung, Simon See

Abstract: We will develop a nonlinear upscaling method for nonlinear transport equation. The proposed scheme gives a coarse scale equation for the cell average of the solution. In order to compute the parameters in the coarse scale equation, a local downscaling operator is constructed. This downscaling operation recovers fine scale properties using cell averages. This is achieved by solving the equation on… ▽ More We will develop a nonlinear upscaling method for nonlinear transport equation. The proposed scheme gives a coarse scale equation for the cell average of the solution. In order to compute the parameters in the coarse scale equation, a local downscaling operator is constructed. This downscaling operation recovers fine scale properties using cell averages. This is achieved by solving the equation on an oversampling region with the given cell average as constraint. Due to the nonlinearity, one needs to compute these downscaling operations on the fly and cannot pre-compute these quantities. In order to give an efficient downscaling operation, we apply a deep learning approach. We will use a deep neural network to approximate the downscaling operation. Our numerical results show that the proposed scheme can achieve a good accuracy and efficiency. △ Less

Submitted 7 July, 2020; originally announced July 2020.

Comments: 18 pages

Nonlocal multicontinua with Representative Volume Elements. Bridging separable and non-separable scales

Authors: Eric T. Chung, Y. Efendiev, Wing T. Leung, ans M. Vasilyeva

Abstract: Recently, several approaches for multiscale simulations for problems with high contrast and no scale separation are introduced. Among them is the nonlocal multicontinua (NLMC) method, which introduces multiple macroscopic variables in each computational grid. These approaches explore the entire coarse block resolution and one can obtain optimal convergence results independent of contrast and scale… ▽ More Recently, several approaches for multiscale simulations for problems with high contrast and no scale separation are introduced. Among them is the nonlocal multicontinua (NLMC) method, which introduces multiple macroscopic variables in each computational grid. These approaches explore the entire coarse block resolution and one can obtain optimal convergence results independent of contrast and scales. However, these approaches are not amenable to many multiscale simulations, where the subgrid effects are much smaller than the coarse-mesh resolution. For example, the molecular dynamics of shale gas occurs in much smaller length scales compared to the coarse-mesh size, which is of orders of meters. In this case, one can not explore the entire coarse-grid resolution in evaluating effective properties. In this paper, we merge the concepts of nonlocal multicontinua methods and Representative Volume Element (RVE) concepts to explore problems with extreme scale separation. The first step of this approach is to use sub-grid scale (sub to RVE) to write a large-scale macroscopic system. We call it intermediate scale macroscale system. In the next step, we couple this intermediate macroscale system to the simulation grid model, which are used in simulations. This is done using RVE concepts, where we relate intermediate macroscale variables to the macroscale variables defined on our simulation coarse grid. Our intermediate coarse model allows formulating macroscale variables correctly and coupling them to the simulation grid. We present the general concept of our approach and present details of single-phase flow. Some numerical results are presented. For nonlinear examples, we use machine learning techniques to compute macroscale parameters. △ Less

Submitted 22 January, 2020; originally announced January 2020.

Constraint Energy Minimizing Generalized Multiscale Discontinuous Galerkin Method

Authors: Siu Wun Cheung, Eric T. Chung, Wing Tat Leung

Abstract: Numerical simulation of flow problems and wave propagation in heterogeneous media has important applications in many engineering areas. However, numerical solutions on the fine grid are often prohibitively expensive, and multiscale model reduction techniques are introduced to efficiently solve for an accurate approximation on the coarse grid. In this paper, we propose an energy minimization based… ▽ More Numerical simulation of flow problems and wave propagation in heterogeneous media has important applications in many engineering areas. However, numerical solutions on the fine grid are often prohibitively expensive, and multiscale model reduction techniques are introduced to efficiently solve for an accurate approximation on the coarse grid. In this paper, we propose an energy minimization based multiscale model reduction approach in the discontinuous Galerkin discretization setting. The main idea of the method is to extract the non-decaying component in the high conductivity regions by identifying dominant modes with small eigenvalues of local spectral problems, and define multiscale basis functions in coarse oversampled regions by constraint energy minimization problems. The multiscale basis functions are in general discontinuous on the coarse grid and coupled by interior penalty discontinuous Galerkin formulation. The minimal degree of freedom in representing high-contrast features is achieved through the design of local spectral problems, which provides the most compressed local multiscale space. We analyze the method for solving Darcy flow problem and show that the convergence is linear in coarse mesh size and independent of the contrast, provided that the oversampling size is appropriately chosen. Numerical results are presented to show the performance of the method for simulation on flow problem and wave propagation in high-contrast heterogeneous media. △ Less

Submitted 26 September, 2019; originally announced September 2019.

Space-Time Nonlinear Upscaling Framework Using Non-local Multi-continuum Approach

Authors: Wing T. Leung, Eric T. Chung, Yalchin Efendiev, Maria Vasilyeva, Mary Wheeler

Abstract: In this paper, we develop a space-time upscaling framework that can be used for many challenging porous media applications without scale separation and high contrast. Our main focus is on nonlinear differential equations with multiscale coefficients. The framework is built on nonlinear nonlocal multi-continuum upscaling concept and significantly extends the results in the proceeding paper. Our a… ▽ More In this paper, we develop a space-time upscaling framework that can be used for many challenging porous media applications without scale separation and high contrast. Our main focus is on nonlinear differential equations with multiscale coefficients. The framework is built on nonlinear nonlocal multi-continuum upscaling concept and significantly extends the results in the proceeding paper. Our approach starts with a coarse space-time partition and identifies test functions for each partition, which plays a role of multi-continua. The test functions are defined via optimization and play a crucial role in nonlinear upscaling. In the second stage, we solve nonlinear local problems in oversampled regions with some constraints defined via test functions. These local solutions define a nonlinear map from macroscopic variables determined with the help of test functions to the fine-grid fields. This map can be thought as a downscaled map from macroscopic variables to the fine-grid solution. In the final stage, we seek macroscopic variables in the entire domain such that the downscaled field solves the global problem in a weak sense defined using the test functions. We present an analysis of our approach for an example nonlinear problem. Our unified framework plays an important role in designing various upscaled methods. Because local problems are directly related to the fine-grid problems, it simplifies the process of finding local solutions with appropriate constraints. Using machine learning (ML), we identify the complex map from macroscopic variables to fine-grid solution. We present numerical results for several porous media applications, including two-phase flow and transport. △ Less

Submitted 2 September, 2019; v1 submitted 15 August, 2019; originally announced August 2019.

Generalized Multiscale Finite Element Method for the poroelasticity problem in multicontinuum media

Authors: Aleksei Tyrylgin, Maria Vasilyeva, Denis Spiridonov, Eric T. Chung

Abstract: In this paper, we consider a poroelasticity problem in heterogeneous multicontinuum media that is widely used in simulations of the unconventional hydrocarbon reservoirs and geothermal fields. Mathematical model contains a coupled system of equations for pressures in each continuum and effective equation for displacement with volume force sources that are proportional to the sum of the pressure gr… ▽ More In this paper, we consider a poroelasticity problem in heterogeneous multicontinuum media that is widely used in simulations of the unconventional hydrocarbon reservoirs and geothermal fields. Mathematical model contains a coupled system of equations for pressures in each continuum and effective equation for displacement with volume force sources that are proportional to the sum of the pressure gradients for each continuum. To illustrate the idea of our approach, we consider a dual continuum background model with discrete fracture networks that can be generalized to a multicontinuum model for poroelasticity problem in complex heterogeneous media. We present a fine grid approximation based on the finite element method and Discrete Fracture Model (DFM) approach for two and three-dimensional formulations. The coarse grid approximation is constructed using the Generalized Multiscale Finite Element Method (GMsFEM), where we solve local spectral problems for construction of the multiscale basis functions for displacement and pressures in multicontinuum media. We present numerical results for the two and three dimensional model problems in heterogeneous fractured porous media. We investigate relative errors between reference fine grid solution and presented coarse grid approximation using GMsFEM with different numbers of multiscale basis functions. Our results indicate that the proposed method is able to give accurate solutions with few degrees of freedoms. △ Less

Submitted 6 August, 2019; originally announced August 2019.

Generalized Multiscale Finite Element method for multicontinua unsaturated flow problems in fractured porous media

Authors: Denis Spiridonov, Maria Vasilyeva, Eric T. Chung

Abstract: In this paper, we present a multiscale method for simulations of the multicontinua unsaturated flow problems in heterogeneous fractured porous media. The mathematical model is described by the system of Richards equations for each continuum that coupled by the specific transfer term. To illustrate the idea of our approach, we consider a dual continua background model with discrete fractures networ… ▽ More In this paper, we present a multiscale method for simulations of the multicontinua unsaturated flow problems in heterogeneous fractured porous media. The mathematical model is described by the system of Richards equations for each continuum that coupled by the specific transfer term. To illustrate the idea of our approach, we consider a dual continua background model with discrete fractures networks that generalized as a multicontinua model for unsaturated fluid flow in the complex heterogeneous porous media. We present fine grid approximation based on the finite element method and Discrete Fracture Model approach. In this model, we construct an unstructured fine grid that take into account a complex fracture geometries for two and three dimensional formulations. Due to construction of the unstructured grid, the fine grid approximation leads to the very large system of equations. For reduction of the discrete system size, we develop a multiscale method for coarse grid approximation of the coupled problem using Generalized Multiscale Finite Element Method. In this method, we construct a coupled multiscale basis functions that used to construct highly accurate coarse grid approximation. The multiscale method allowed us to capture detailed interactions between multiple continua. We investigate accuracy of the proposed method for the several test problems in two and three dimensional formulations. We present a comparison of the relative error for different number of basis functions and for adaptive approach. Numerical results illustrate that the presented method provide accurate solution of the unsaturated multicontinua problem on the coarse grid with huge reduction of the discrete system size. △ Less

Submitted 1 August, 2019; originally announced August 2019.

Learning macroscopic parameters in nonlinear multiscale simulations using nonlocal multicontinua upscaling techniques

Authors: Maria Vasilyeva, Wing T. Leung, Eric T. Chung, Yalchin Efendiev, Mary Wheeler

Abstract: In this work, we present a novel nonlocal nonlinear coarse grid approximation using a machine learning algorithm. We consider unsaturated and two-phase flow problems in heterogeneous and fractured porous media, where mathematical models are formulated as general multicontinuum models. We construct a fine grid approximation using the finite volume method and embedded discrete fracture model. Macros… ▽ More In this work, we present a novel nonlocal nonlinear coarse grid approximation using a machine learning algorithm. We consider unsaturated and two-phase flow problems in heterogeneous and fractured porous media, where mathematical models are formulated as general multicontinuum models. We construct a fine grid approximation using the finite volume method and embedded discrete fracture model. Macroscopic models for these complex nonlinear systems require nonlocal multicontinua approaches, which are developed in earlier works. These rigorous techniques require complex local computations, which involve solving local problems in oversampled regions subject to constraints. The solutions of these local problems can be replaced by solving original problem on a coarse (oversampled) region for many input parameters (boundary and source terms) and computing effective properties derived by nonlinear nonlocal multicontinua approaches. The effective properties depend on many variables (oversampled region and the number of continua), thus their calculations require some type of machine learning techniques. In this paper, our contribution is two fold. First, we present macroscopic models and discuss how to effectively compute macroscopic parameters using deep learning algorithms. The proposed method can be regarded as local machine learning and complements our earlier approaches on global machine learning. We consider a coarse grid approximation using two upscaling techniques with single phase upscaled transmissibilities and nonlocal nonlinear upscaled transmissibilities using a machine learning algorithm. We present results for two model problems in heterogeneous and fractured porous media and show that the presented method is highly accurate and provides fast coarse grid calculations. △ Less

Submitted 5 July, 2019; originally announced July 2019.

An analysis of the NLMC upscaling method for high contrast problems

Authors: Lina Zhao, Eric T. Chung

Abstract: In this paper we propose simple multiscale basis functions with constraint energy minimization to solve elliptic problems with high contrast medium. Our methodology is based on the recently developed non-local multicontinuum method (NLMC). The main ingredient of the method is the construction of suitable local basis functions with the capability of capturing multiscale features and non-local effec… ▽ More In this paper we propose simple multiscale basis functions with constraint energy minimization to solve elliptic problems with high contrast medium. Our methodology is based on the recently developed non-local multicontinuum method (NLMC). The main ingredient of the method is the construction of suitable local basis functions with the capability of capturing multiscale features and non-local effects. In our method, each coarse block is decomposed into various regions according to the contrast ratio, and we require that the contrast ratio should be relatively small within each region. The basis functions are constructed by solving a local problem defined on the oversampling domains and they have mean value one on the chosen region and zero mean otherwise. Numerical analysis shows that the resulting basis functions can be localizable and have a decay property. The convergence of the multiscale solution is also proved. Finally, some numerical experiments are carried out to illustrate the performances of the proposed method. They show that the proposed method can solve problem with high contrast medium efficiently. In particular, if the oversampling size is large enough, then we can achieve the desired error. △ Less

Submitted 24 April, 2019; originally announced April 2019.

Comments: 17 pages, 21 figures

Reduced-order Deep Learning for Flow Dynamics

Authors: Min Wang, Siu Wun Cheung, Wing Tat Leung, Eric T. Chung, Yalchin Efendiev, Mary Wheeler

Abstract: In this paper, we investigate neural networks applied to multiscale simulations and discuss a design of a novel deep neural network model reduction approach for multiscale problems. Due to the multiscale nature of the medium, the fine-grid resolution gives rise to a huge number of degrees of freedom. In practice, low-order models are derived to reduce the computational cost. In our paper, we use a… ▽ More In this paper, we investigate neural networks applied to multiscale simulations and discuss a design of a novel deep neural network model reduction approach for multiscale problems. Due to the multiscale nature of the medium, the fine-grid resolution gives rise to a huge number of degrees of freedom. In practice, low-order models are derived to reduce the computational cost. In our paper, we use a non-local multicontinuum (NLMC) approach, which represents the solution on a coarse grid [18]. Using multi-layer learning techniques, we formulate and learn input-output maps constructed with NLMC on a coarse grid. We study the features of the coarse-grid solutions that neural networks capture via relating the input-output optimization to $l_1$ minimization of PDE solutions. In proposed multi-layer networks, we can learn the forward operators in a reduced way without computing them as in POD like approaches. We present soft thresholding operators as activation function, which our studies show to have some advantages. With these activation functions, the neural network identifies and selects important multiscale features which are crucial in modeling the underlying flow. Using trained neural network approximation of the input-output map, we construct a reduced-order model for the solution approximation. We use multi-layer networks for the time stepping and reduced-order modeling, where at each time step the appropriate important modes are selected. For a class of nonlinear problems, we suggest an efficient strategy. Numerical examples are presented to examine the performance of our method. △ Less

Submitted 30 January, 2019; v1 submitted 29 January, 2019; originally announced January 2019.

Computational Multiscale Methods for Linear Poroelasticity with High Contrast

Authors: Shubin Fu, Robert Altmann, Eric T. Chung, Roland Maier, Daniel Peterseim, Sai-Mang Pun

Abstract: In this work, we employ the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) to solve the problem of linear heterogeneous poroelasticity with coefficients of high contrast. The proposed method makes use of the idea of energy minimization with suitable constraints in order to generate efficient basis functions for the displacement and the pressure. These basis… ▽ More In this work, we employ the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) to solve the problem of linear heterogeneous poroelasticity with coefficients of high contrast. The proposed method makes use of the idea of energy minimization with suitable constraints in order to generate efficient basis functions for the displacement and the pressure. These basis functions are constructed by solving a class of local auxiliary optimization problems based on eigenfunctions containing local information on the heterogeneity. Techniques of oversampling are adapted to enhance the computational performance. Convergence of first order is shown and illustrated by a number of numerical tests. △ Less

Submitted 10 December, 2018; originally announced December 2018.

Comments: 14 pages, 9 figures

Online basis construction for goal-oriented adaptivity in the Generalized Multiscale Finite Element Method

Authors: Eric T. Chung, Sara Pollock, Sai-Mang Pun

Abstract: In this research, we develop an online enrichment framework for goal-oriented adaptivity within the generalized multiscale finite element method for flow problems in heterogeneous media. The method for approximating the quantity of interest involves construction of residual-based primal and dual basis functions used to enrich the multiscale space at each stage of the adaptive algorithm. Three diff… ▽ More In this research, we develop an online enrichment framework for goal-oriented adaptivity within the generalized multiscale finite element method for flow problems in heterogeneous media. The method for approximating the quantity of interest involves construction of residual-based primal and dual basis functions used to enrich the multiscale space at each stage of the adaptive algorithm. Three different online enrichment strategies based on the primal-dual online basis construction are proposed: standard, primal-dual combined and primal-dual product based. Numerical experiments are performed to illustrate the efficiency of the proposed methods for high-contrast heterogeneous problems. △ Less

Submitted 18 March, 2019; v1 submitted 5 December, 2018; originally announced December 2018.

Comments: 22 pages, 7 figures

An adaptive dynamically low-dimensional approximation method for multiscale stochastic diffusion equations

Authors: Eric T. Chung, Sai-Mang Pun, Zhiwen Zhang

Abstract: In this paper, we propose a dynamically low-dimensional approximation method to solve a class of time-dependent multiscale stochastic diffusion equations. A dynamically bi-orthogonal (DyBO) method was developed to explore low-dimensional structures of stochastic partial differential equations (SPDEs) and solve them efficiently. However, when the SPDEs have multiscale features in physical space, th… ▽ More In this paper, we propose a dynamically low-dimensional approximation method to solve a class of time-dependent multiscale stochastic diffusion equations. A dynamically bi-orthogonal (DyBO) method was developed to explore low-dimensional structures of stochastic partial differential equations (SPDEs) and solve them efficiently. However, when the SPDEs have multiscale features in physical space, the original DyBO method becomes expensive. To address this issue, we construct multiscale basis functions within each coarse grid block for dimension reduction in the physical space. To further improve the accuracy, we also perform online procedure to construct online adaptive basis functions. In the stochastic space, we use the generalized polynomial chaos (gPC) basis functions to represent the stochastic part of the solutions. Numerical results are presented to demonstrate the efficiency of the proposed method in solving time-dependent PDEs with multiscale and random features. △ Less

Submitted 3 February, 2019; v1 submitted 4 December, 2018; originally announced December 2018.

Comments: 19 pages

Generalized Multiscale Multicontinuum Model for Fractured Vuggy Carbonate Reservoirs

Authors: Min Wang, Siu Wun Cheung, Eric T. Chung, Maria Vasilyeva, Yuhe Wang

Abstract: Simulating flow in a highly heterogeneous reservoir with multiscale characteristics could be considerably demanding. To tackle this problem, we propose a numerical scheme coupling the Generalized Multiscale Finite Element Method (GMsFEM) with a triple-continuum model aimed at a faster simulator framework that can explicitly represent the interactions among different continua. To further enrich the… ▽ More Simulating flow in a highly heterogeneous reservoir with multiscale characteristics could be considerably demanding. To tackle this problem, we propose a numerical scheme coupling the Generalized Multiscale Finite Element Method (GMsFEM) with a triple-continuum model aimed at a faster simulator framework that can explicitly represent the interactions among different continua. To further enrich the descriptive ability of our proposed model, we combine the Discrete Fracture Model (DFM) to model the local effects of discrete fractures. In the proposed model, GMsFEM, as an advanced model reduction technique, enables capturing the multiscale flow dynamics. This is accomplished by systematically generating an approximation space through solving a series of local snapshot and spectral problems. The resulting eigenfunctions can pass the local features to the global level when acting as basis functions in coarse problems. Our goal in this paper is to further improve the accuracy of flow simulation in complicated reservoirs especially for the case when multiple discrete fractures located in single coarse neighborhood and multiscale finite element methods fail. Together with a detailed description of the model, several numerical experiments are conducted to confirm the success of our proposed method. A rigid proof is also given in the aspect of numerical analysis. △ Less

Submitted 29 October, 2018; originally announced October 2018.

Prediction of Discretization of GMsFEM using Deep Learning

Authors: Min Wang, Siu Wun Cheung, Eric T. Chung, Yalchin Efendiev, Wing Tat Leung, Yating Wang

Abstract: In this paper, we propose a deep-learning-based approach to a class of multiscale problems. THe Generalized Multiscale Finite Element Method (GMsFEM) has been proven successful as a model reduction technique of flow problems in heterogeneous and high-contrast porous media. The key ingredients of GMsFEM include mutlsicale basis functions and coarse-scale parameters, which are obtained from solving… ▽ More In this paper, we propose a deep-learning-based approach to a class of multiscale problems. THe Generalized Multiscale Finite Element Method (GMsFEM) has been proven successful as a model reduction technique of flow problems in heterogeneous and high-contrast porous media. The key ingredients of GMsFEM include mutlsicale basis functions and coarse-scale parameters, which are obtained from solving local problems in each coarse neighborhood. Given a fixed medium, these quantities are precomputed by solving local problems in an offline stage, and result in a reduced-order model. However, these quantities have to be re-computed in case of varying media. The objective of our work is to make use of deep learning techniques to mimic the nonlinear relation between the permeability field and the GMsFEM discretizations, and use neural networks to perform fast computation of GMsFEM ingredients repeatedly for a class of media. We provide numerical experiments to investigate the predictive power of neural networks and the usefulness of the resultant multiscale model in solving channelized porous media flow problems. △ Less

Submitted 29 October, 2018; originally announced October 2018.

Online adaptive basis enrichment for mixed CEM-GMsFEM

Authors: Eric T. Chung, Sai-Mang Pun

Abstract: In this research, an online basis enrichment strategy for the constraint energy minimizing generalized multiscale finite element method in mixed formulation is proposed. The online approach is based on the technique of oversampling. One makes use of the information of residual and the data in the partial differential equation such as the source function. The analysis presented shows that the propo… ▽ More In this research, an online basis enrichment strategy for the constraint energy minimizing generalized multiscale finite element method in mixed formulation is proposed. The online approach is based on the technique of oversampling. One makes use of the information of residual and the data in the partial differential equation such as the source function. The analysis presented shows that the proposed online enrichment leads to a fast convergence from multiscale approximation to the fine-scale solution. The error reduction can be made sufficiently large by suitably selecting oversampling regions and the number of oversampling layers. Also, the convergence rate of the enrichment can be tuned by a user-defined parameter. Numerical results are provided to illustrate the efficiency of the proposed method. △ Less

Submitted 27 September, 2019; v1 submitted 25 October, 2018; originally announced October 2018.

Comments: 22 pages, 10 figures. Accepted by SIAM Multiscale Modeling and Simulation

MSC Class: 65N30

A three-level multi-continua upscaling method for flow problems in fractured porous media

Authors: Maria Vasilyeva, Eric T. Chung, Yalchin Efendiev, Aleksey Tyrylgin

Abstract: Traditional two level upscaling techniques suffer from a high offline cost when the coarse grid size is much larger than the fine grid size. Thus, multilevel methods are desirable for problems with complex heterogeneities and high contrast. In this paper, we propose a novel three-level upscaling method for flow problems in fractured porous media. Our method starts with a fine grid discretization f… ▽ More Traditional two level upscaling techniques suffer from a high offline cost when the coarse grid size is much larger than the fine grid size. Thus, multilevel methods are desirable for problems with complex heterogeneities and high contrast. In this paper, we propose a novel three-level upscaling method for flow problems in fractured porous media. Our method starts with a fine grid discretization for the system involving fractured porous media. In the next step, based on the fine grid model, we construct a nonlocal multi-continua upscaling (NLMC) method using an intermediate grid. The system resulting from NLMC gives solutions that have physical meaning. In order to enhance locality, the grid size of the intermediate grid needs to be relatively small, and this motivates using such an intermediate grid. However, the resulting NLMC upscaled system has a relatively large dimension. This motivates a further step of dimension reduction. In particular, we will apply the idea of the Generalized Multiscale Finite Element Method (GMsFEM) to the NLMC system to obtain a final reduced model. We present simulation results for a two-dimensional model problem with a large number of fractures using the proposed three-level method. △ Less

Submitted 3 October, 2018; originally announced October 2018.

Nonlinear nonlocal multicontinua upscaling framework and its applications

Authors: Wing T. Leung, Eric T. Chung, Yalchin Efendiev, Mary F. Wheeler

Abstract: In this paper, we discuss multiscale methods for nonlinear problems. The main idea of these approaches is to use local constraints and solve problems in oversampled regions for constructing macroscopic equations. These techniques are intended for problems without scale separation and high contrast, which often occur in applications. For linear problems, the local solutions with constraints are use… ▽ More In this paper, we discuss multiscale methods for nonlinear problems. The main idea of these approaches is to use local constraints and solve problems in oversampled regions for constructing macroscopic equations. These techniques are intended for problems without scale separation and high contrast, which often occur in applications. For linear problems, the local solutions with constraints are used as basis functions. This technique is called Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM). GMsFEM identifies macroscopic quantities based on rigorous analysis. In corresponding upscaling methods, the multiscale basis functions are selected such that the degrees of freedom have physical meanings, such as averages of the solution on each continuum. This paper extends the linear concepts to nonlinear problems, where the local problems are nonlinear. The main concept consists of: (1) identifying macroscopic quantities; (2) constructing appropriate oversampled local problems with coarse-grid constraints; (3) formulating macroscopic equations. We consider two types of approaches. In the first approach, the solutions of local problems are used as basis functions (in a linear fashion) to solve nonlinear problems. This approach is simple to implement; however, it lacks the nonlinear interpolation, which we present in our second approach. In this approach, the local solutions are used as a nonlinear forward map from local averages (constraints) of the solution in oversampling region. This local fine-grid solution is further used to formulate the coarse-grid problem. Both approaches are discussed on several examples and applied to single-phase and two-phase flow problems, which are challenging because of convection-dominated nature of the concentration equation. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Constraint Energy Minimizing Generalized Multiscale Finite Element Method for high-contrast linear elasticity problem

Authors: Shubin Fu, Eric T. Chung

Abstract: In this paper, we consider the offline and online Constraint Energy Minimizing Generalized Mul- tiscale Finite Element Method (CEM-GMsFEM) for high-contrast linear elasticity problem. Offline basis construction starts with an auxiliary multiscale space by solving local spectral problems. We select eigenfunctions that correspond to a few small eigenvalues to form the auxiliary space. Using the auxi… ▽ More In this paper, we consider the offline and online Constraint Energy Minimizing Generalized Mul- tiscale Finite Element Method (CEM-GMsFEM) for high-contrast linear elasticity problem. Offline basis construction starts with an auxiliary multiscale space by solving local spectral problems. We select eigenfunctions that correspond to a few small eigenvalues to form the auxiliary space. Using the auxiliary space, we solve a constraint energy minimization problem to construct offline multiscale spaces. The minimization problem is defined in the oversampling domain, which is larger than the target coarse block. To get a good approximation space, the oversampling domain should be large enough. We also propose a relaxed minimization problem to construct multiscale basis functions, which will yield more accurate and robust solution. To take into account the influence of input pa- rameters, such as source terms, we propose the construction of online multiscale basis and an adaptive enrichment algorithm. We provide extensive numerical experiments on 2D and 3D models to show the performance of the proposed method. △ Less

Submitted 11 September, 2018; originally announced September 2018.

Multiscale stabilization for convection diffusion equations with heterogeneous velocity and diffusion coefficients

Authors: Eric T. Chung, Yalchin Efendiev, Wing Tat Leung

Abstract: We present a new stabilization technique for multiscale convection diffusion problems. Stabilization for these problems has been a challenging task, especially for the case with high Peclet numbers. Our method is based on a constraint energy minimization idea and the discontinuous Petrov-Galerkin formulation. In particular, the test functions are constructed by minimizing an appropriate energy sub… ▽ More We present a new stabilization technique for multiscale convection diffusion problems. Stabilization for these problems has been a challenging task, especially for the case with high Peclet numbers. Our method is based on a constraint energy minimization idea and the discontinuous Petrov-Galerkin formulation. In particular, the test functions are constructed by minimizing an appropriate energy subject to certain orthogonality conditions, and are related to the trial space. The resulting test functions have a localization property, and can therefore be computed locally. We will prove the stability, and present several numerical results. Our numerical results confirm that our test space gives a good stability, in the sense that the solution error is close to the best approximation error. △ Less

Submitted 30 July, 2018; originally announced July 2018.

Constraint Energy Minimizing Generalized Multiscale Finite Element Method for dual continuum model

Authors: Siu Wun Cheung, Eric T. Chung, Yalchin Efendiev, Wing Tat Leung, Maria Vasilyeva

Abstract: The dual continuum model serves as a powerful tool in the modeling of subsurface applications. It allows a systematic coupling of various components of the solutions. The system is of multiscale nature as it involves high heterogeneous and high contrast coefficients. To numerically compute the solutions, some types of reduced order methods are necessary. We will develop and analyze a novel multisc… ▽ More The dual continuum model serves as a powerful tool in the modeling of subsurface applications. It allows a systematic coupling of various components of the solutions. The system is of multiscale nature as it involves high heterogeneous and high contrast coefficients. To numerically compute the solutions, some types of reduced order methods are necessary. We will develop and analyze a novel multiscale method based on the recent advances in multiscale finite element methods. Our method will compute multiple local multiscale basis functions per coarse region. The idea is based on some local spectral problems, which are important to identify high contrast channels, and an energy minimization principle. Using these concepts, we show that the basis functions are localized, even in the presence of high contrast long channels and fractures. In addition, we show that the convergence of the method depends only on the coarse mesh size. Finally, we present several numerical tests to show the performance. △ Less

Submitted 28 July, 2018; originally announced July 2018.

Deep Global Model Reduction Learning

Authors: Siu Wun Cheung, Eric T. Chung, Yalchin Efendiev, Eduardo Gildin, Yating Wang

Abstract: In this paper, we combine deep learning concepts and some proper orthogonal decomposition (POD) model reduction methods for predicting flow in heterogeneous porous media. Nonlinear flow dynamics is studied, where the dynamics is regarded as a multi-layer network. The solution at the current time step is regarded as a multi-layer network of the solution at the initial time and input parameters. As… ▽ More In this paper, we combine deep learning concepts and some proper orthogonal decomposition (POD) model reduction methods for predicting flow in heterogeneous porous media. Nonlinear flow dynamics is studied, where the dynamics is regarded as a multi-layer network. The solution at the current time step is regarded as a multi-layer network of the solution at the initial time and input parameters. As for input, we consider various sources, which include source terms (well rates), permeability fields, and initial conditions. We consider the flow dynamics, where the solution is known at some locations and the data is integrated to the flow dynamics by modifying the reduced-order model. This approach allows modifying the reduced-order formulation of the problem. Because of the small problem size, limited observed data can be handled. We consider enriching the observed data using the computational data in deep learning networks. The basis functions of the global reduced order model are selected such that the degrees of freedom represent the solution at observation points. This way, we can avoid learning basis functions, which can also be done using neural networks. We present numerical results, where we consider channelized permeability fields, where the network is constructed for various channel configurations. Our numerical results show that one can achieve a good approximation using forward feed maps based on multi-layer networks. △ Less

Submitted 24 July, 2018; originally announced July 2018.

A two-grid preconditioner with an adaptive coarse space for flow simulations in highly heterogeneous media

Authors: Yanfang Yang, Shubin Fu, Eric T. Chung

Abstract: In this paper, we consider flow simulation in highly heterogeneous media that has many practical applications in industry. To enhance mass conservation, we write the elliptic problem in a mixed formulation and introduce a robust two-grid preconditioner to seek the solution. We first need to transform the indefinite saddle problem to a positive definite problem by preprocessing steps. The precondit… ▽ More In this paper, we consider flow simulation in highly heterogeneous media that has many practical applications in industry. To enhance mass conservation, we write the elliptic problem in a mixed formulation and introduce a robust two-grid preconditioner to seek the solution. We first need to transform the indefinite saddle problem to a positive definite problem by preprocessing steps. The preconditioner consists of a local smoother and a coarse preconditioner. For the coarse preconditioner, we design an adaptive spectral coarse space motivated by the GMsFEM (Generalized Multiscale Finite Element Method). We test our preconditioner for both Darcy flow and two phase flow and transport simulation in highly heterogeneous porous media. Numerical results show that the proposed preconditioner is highly robust and efficient. △ Less

Submitted 18 July, 2018; originally announced July 2018.

Nonlocal multicontinua upscaling for multicontinua flow problems in fractured porous media

Authors: Maria Vasilyeva, Eric T. Chung, Siu Wun Cheung, Yating Wang, Georgy Prokopev

Abstract: Our goal of this paper is to develop a new upscaling method for multicontinua flow problems in fractured porous media. We consider a system of equations that describes flow phenomena with multiple flow variables defined on both matrix and fractures. To construct our upscaled model, we will apply the nonlocal multicontinua (NLMC) upscaling technique. The upscaled coefficients are obtained by using… ▽ More Our goal of this paper is to develop a new upscaling method for multicontinua flow problems in fractured porous media. We consider a system of equations that describes flow phenomena with multiple flow variables defined on both matrix and fractures. To construct our upscaled model, we will apply the nonlocal multicontinua (NLMC) upscaling technique. The upscaled coefficients are obtained by using some multiscale basis functions, which are solutions of local problems defined on oversampled regions. For each continuum within a target coarse element, we will solve a local problem defined on an oversampling region obtained by extending the target element by few coarse grid layers, with a set of constraints which enforce the local solution to have mean value one on the chosen continuum and zero mean otherwise. The resulting multiscale basis functions have been shown to have good approximation properties. To illustrate the idea of our approach, we will consider a dual continua background model consisting of discrete fractures in two space dimensions, that is, we consider a system with three continua. We will present several numerical examples, and they show that our method is able to capture the interaction between matrix continua and discrete fractures on the coarse grid efficiently. △ Less

Submitted 15 July, 2018; originally announced July 2018.

Comments: arXiv admin note: text overlap with arXiv:1805.09407

Online mixed multiscale finite element method with oversampling and its applications

Authors: Yanfang Yang, Shubin Fu, Eric T Chung

Abstract: In this paper, we consider an online basis enrichment mixed generalized multiscale method with oversampling, for solving flow problems in highly heterogeneous porous media. This is an exten- sion of the online mixed generalized multiscale method [6]. The multiscale online basis functions are computed by solving a Neumann problem in an over-sampled domain, instead of a standard neighborhood of a co… ▽ More In this paper, we consider an online basis enrichment mixed generalized multiscale method with oversampling, for solving flow problems in highly heterogeneous porous media. This is an exten- sion of the online mixed generalized multiscale method [6]. The multiscale online basis functions are computed by solving a Neumann problem in an over-sampled domain, instead of a standard neighborhood of a coarse face. We are motivated by the restricted domain decomposition method. Extensive numerical experiments are presented to demonstrate the performance of our methods for both steady-state flow, and two-phase flow and transport problems. △ Less

Submitted 2 July, 2018; originally announced July 2018.