-
A Malliavin Calculus Approach to Backward Stochastic Volterra Integral Equations
Authors:
Qian Lei,
Chi Seng Pun
Abstract:
In this paper, we establish existence, uniqueness, and regularity properties of the solutions to multi-dimensional backward stochastic Volterra integral equations (BSVIEs), whose (possibly random) generator reflects nonlinear dependence on both the solution process and the martingale integrand component of the adapted solutions, as well as their diagonal processes. The well-posedness results are d…
▽ More
In this paper, we establish existence, uniqueness, and regularity properties of the solutions to multi-dimensional backward stochastic Volterra integral equations (BSVIEs), whose (possibly random) generator reflects nonlinear dependence on both the solution process and the martingale integrand component of the adapted solutions, as well as their diagonal processes. The well-posedness results are developed with the use of Malliavin calculus, which renders a novel perspective in tackling with the challenging diagonal processes while contrasts with the existing methods. We also provide a probabilistic interpretation of the classical solutions to the counterpart semi-linear partial differential equations through the explicit adapted solutions of BSVIEs. Moreover, we formulate with BSVIEs to explicitly characterize dynamically optimal mean-variance portfolios for various stochastic investment opportunities, with the myopic investment and intertemporal hedging demands being identified as two diagonal processes of BSVIE solutions.
△ Less
Submitted 8 January, 2025; v1 submitted 26 December, 2024;
originally announced December 2024.
-
Dynamic Mean-Variance Asset Allocation in General Incomplete Markets A Nonlocal BSDE-based Feedback Control Approach
Authors:
Qian Lei,
Chi Seng Pun,
Jingxiang Tang
Abstract:
This paper studies dynamic mean-variance (MV) asset allocation problems in general incomplete markets. Besides of the conventional MV objective on portfolio's terminal wealth, our framework can accommodate running MV objectives with general (non-exponential) discounting factors while in general, any time-dependent preferences. We attempt the problem with a game-theoretic framework while decompose…
▽ More
This paper studies dynamic mean-variance (MV) asset allocation problems in general incomplete markets. Besides of the conventional MV objective on portfolio's terminal wealth, our framework can accommodate running MV objectives with general (non-exponential) discounting factors while in general, any time-dependent preferences. We attempt the problem with a game-theoretic framework while decompose the equilibrium control policies into two parts: the first part is a myopic strategy characterized by a linear Volterra integral equation of the second kind and the second part reveals the hedging demand governed by a system of nonlocal backward stochastic differential equations. We manage to establish the well-posedness of the solutions to the two aforementioned equations in tailored Bananch spaces by the fixed-point theorem. It allows us to devise a numerical scheme for solving for the equilibrium control policy with guarantee and to conclude that the dynamic (equilibrium) mean-variance policy in general settings is well-defined. Our probabilistic approach allows us to consider a board range of stochastic factor models, such as the Chan--Karolyi--Longstaff--Sanders (CKLS) model. For which, we verify all technical assumptions and provide a sound numerical scheme. Numerical examples are provided to illustrate our framework.
△ Less
Submitted 24 December, 2024;
originally announced December 2024.
-
Quantum Algorithms for the Pathwise Lasso
Authors:
Joao F. Doriguello,
Debbie Lim,
Chi Seng Pun,
Patrick Rebentrost,
Tushar Vaidya
Abstract:
We present a novel quantum high-dimensional linear regression algorithm with an $\ell_1$-penalty based on the classical LARS (Least Angle Regression) pathwise algorithm. Similarly to available classical algorithms for Lasso, our quantum algorithm provides the full regularisation path as the penalty term varies, but quadratically faster per iteration under specific conditions. A quadratic speedup o…
▽ More
We present a novel quantum high-dimensional linear regression algorithm with an $\ell_1$-penalty based on the classical LARS (Least Angle Regression) pathwise algorithm. Similarly to available classical algorithms for Lasso, our quantum algorithm provides the full regularisation path as the penalty term varies, but quadratically faster per iteration under specific conditions. A quadratic speedup on the number of features $d$ is possible by using the simple quantum minimum-finding subroutine from Dürr and Hoyer (arXiv'96) in order to obtain the joining time at each iteration. We then improve upon this simple quantum algorithm and obtain a quadratic speedup both in the number of features $d$ and the number of observations $n$ by using the approximate quantum minimum-finding subroutine from Chen and de Wolf (ICALP'23). In order to do so, we approximately compute the joining times to be searched over by the approximate quantum minimum-finding subroutine. As another main contribution, we prove, via an approximate version of the KKT conditions and a duality gap, that the LARS algorithm (and therefore our quantum algorithm) is robust to errors. This means that it still outputs a path that minimises the Lasso cost function up to a small error if the joining times are only approximately computed. Furthermore, we show that, when the observations are sampled from a Gaussian distribution, our quantum algorithm's complexity only depends polylogarithmically on $n$, exponentially better than the classical LARS algorithm, while keeping the quadratic improvement on $d$. Moreover, we propose a dequantised version of our quantum algorithm that also retains the polylogarithmic dependence on $n$, albeit presenting the linear scaling on $d$ from the standard LARS algorithm. Finally, we prove query lower bounds for classical and quantum Lasso algorithms.
△ Less
Submitted 20 March, 2025; v1 submitted 21 December, 2023;
originally announced December 2023.
-
Partially Explicit Generalized Multiscale Method for Poroelasticity Problem
Authors:
Xin Su,
Wing Tat Leung,
Wenyuan Li,
Sai-Mang Pun
Abstract:
We develop a partially explicit time discretization based on the framework of constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) for the problem of linear poroelasticity with high contrast. Firstly, dominant basis functions generated by the CEM-GMsFEM approach are used to capture important degrees of freedom and it is known to give contrast-independent convergen…
▽ More
We develop a partially explicit time discretization based on the framework of constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) for the problem of linear poroelasticity with high contrast. Firstly, dominant basis functions generated by the CEM-GMsFEM approach are used to capture important degrees of freedom and it is known to give contrast-independent convergence that scales with the mesh size. In typical situation, one has very few degrees of freedom in dominant basis functions. This part is treated implicitly. Secondly, we design and introduce an additional space in the complement space and these degrees are treated explicitly. We also investigate the CFL-type stability restriction for this problem, and the restriction for the time step is contrast independent.
△ Less
Submitted 24 October, 2023; v1 submitted 22 October, 2023;
originally announced October 2023.
-
On the Well-posedness of Hamilton-Jacobi-Bellman Equations of the Equilibrium Type
Authors:
Qian Lei,
Chi Seng Pun
Abstract:
This paper studies the well-posedness of a class of nonlocal parabolic partial differential equations (PDEs), or equivalently equilibrium Hamilton-Jacobi-Bellman equations, which has a strong tie with the characterization of the equilibrium strategies and the associated value functions for time-inconsistent stochastic control problems. Specifically, we consider nonlocality in both time and space,…
▽ More
This paper studies the well-posedness of a class of nonlocal parabolic partial differential equations (PDEs), or equivalently equilibrium Hamilton-Jacobi-Bellman equations, which has a strong tie with the characterization of the equilibrium strategies and the associated value functions for time-inconsistent stochastic control problems. Specifically, we consider nonlocality in both time and space, which allows for modelling of the stochastic control problems with initial-time-and-state dependent objective functionals. We leverage the method of continuity to show the global well-posedness within our proposed Banach space with our established Schauder prior estimate for the linearized nonlocal PDE. Then, we adopt a linearization method and Banach's fixed point arguments to show the local well-posedness of the nonlocal fully nonlinear case, while the global well-posedness is attainable provided that a very sharp a-priori estimate is available. On top of the well-posedness results, we also provide a probabilistic representation of the solutions to the nonlocal fully nonlinear PDEs and an estimate on the difference between the value functions of sophisticated and naïve controllers. Finally, we give a financial example of time inconsistency that is proven to be globally solvable.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
Robust Time-inconsistent Linear-Quadratic Stochastic Controls: A Stochastic Differential Game Approach
Authors:
Bingyan Han,
Chi Seng Pun,
Hoi Ying Wong
Abstract:
This paper studies robust time-inconsistent (TIC) linear-quadratic stochastic control problems, formulated by stochastic differential games. By a spike variation approach, we derive sufficient conditions for achieving the Nash equilibrium, which corresponds to a time-consistent (TC) robust policy, under mild technical assumptions. To illustrate our framework, we consider two scenarios of robust me…
▽ More
This paper studies robust time-inconsistent (TIC) linear-quadratic stochastic control problems, formulated by stochastic differential games. By a spike variation approach, we derive sufficient conditions for achieving the Nash equilibrium, which corresponds to a time-consistent (TC) robust policy, under mild technical assumptions. To illustrate our framework, we consider two scenarios of robust mean-variance analysis, namely with state- and control-dependent ambiguity aversion. We find numerically that with time inconsistency haunting the dynamic optimal controls, the ambiguity aversion enhances the effective risk aversion faster than the linear, implying that the ambiguity in the TIC cases is more impactful than that under the TC counterparts, e.g., expected utility maximization problems.
△ Less
Submitted 27 April, 2025; v1 submitted 29 June, 2023;
originally announced June 2023.
-
Fast Online Adaptive Enrichment for Poroelasticity with High Contrast
Authors:
Xin Su,
Sai-Mang Pun
Abstract:
In this work, we develop an online adaptive enrichment method within the framework of the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for solving the linear heterogeneous poroelasticity models with coefficients of high contrast. The proposed method makes use of information of residual-driven error indicators to enrich the multiscale spaces for both the di…
▽ More
In this work, we develop an online adaptive enrichment method within the framework of the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for solving the linear heterogeneous poroelasticity models with coefficients of high contrast. The proposed method makes use of information of residual-driven error indicators to enrich the multiscale spaces for both the displacement and the pressure variables in the model. Additional online basis functions are constructed in oversampled regions accordingly and are adaptively chosen to reduce the error the most. A complete theoretical analysis of the online enrichment algorithm is provided and justified by thorough numerical experiments.
△ Less
Submitted 13 April, 2023; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Nonlocal transport equations in multiscale media. Modeling, dememorization, and discretizations
Authors:
Yalchin Efendiev,
Wing Tat Leung,
Wenyuan Li,
Sai-Mang Pun,
Petr N. Vabishchevich
Abstract:
In this paper, we consider a class of convection-diffusion equations with memory effects. These equations arise as a result of homogenization or upscaling of linear transport equations in heterogeneous media and play an important role in many applications. First, we present a dememorization technique for these equations. We show that the convection-diffusion equations with memory effects can be wr…
▽ More
In this paper, we consider a class of convection-diffusion equations with memory effects. These equations arise as a result of homogenization or upscaling of linear transport equations in heterogeneous media and play an important role in many applications. First, we present a dememorization technique for these equations. We show that the convection-diffusion equations with memory effects can be written as a system of standard convection-diffusion-reaction equations. This allows removing the memory term and simplifying the computations. We consider a relation between dememorized equations and micro-scale equations, which do not contain memory terms. We note that dememorized equations differ from micro-scale equations and constitute a macroscopic model. Next, we consider both implicit and partially explicit methods. The latter is introduced for problems in multiscale media with high-contrast properties. Because of high contrast, explicit methods are restrictive and require time steps that are very small (scales as the inverse of the contrast). We show that, by appropriately decomposing the space, we can treat only a few degrees of freedom implicitly and the remaining degrees of freedom explicitly. We present a stability analysis. Numerical results are presented that confirm our theoretical findings of partially explicit schemes applied to dememorized systems of equations.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
Quasilinearization Methods for Nonlocal Fully-Nonlinear Parabolic Systems
Authors:
Qian Lei,
Chi Seng Pun
Abstract:
In this paper, we propose quasilinearization methods that convert nonlocal fully-nonlinear parabolic systems into the nonlocal quasilinear parabolic systems. The nonlocal parabolic systems serve as important mathematical tools for modelling the subgame perfect equilibrium solutions to time-inconsistent dynamic choice problems, which are motivated by the study of behavioral economics. Different typ…
▽ More
In this paper, we propose quasilinearization methods that convert nonlocal fully-nonlinear parabolic systems into the nonlocal quasilinear parabolic systems. The nonlocal parabolic systems serve as important mathematical tools for modelling the subgame perfect equilibrium solutions to time-inconsistent dynamic choice problems, which are motivated by the study of behavioral economics. Different types of nonlocal parabolic systems were studied but left behind the fully-nonlinear case and the connections among them. This paper shows the equivalence in solvability between nonlocal fully-nonlinear and the associated quasilinear systems, given their solutions are regular enough. Moreover, we establish the well-posedness results for the nonlocal quasilinear parabolic systems, so do that for the nonlocal fully-nonlinear parabolic systems. The quasilinear case alone is interesting in its own right from mathematical and modelling perspectives.
△ Less
Submitted 4 January, 2022;
originally announced January 2022.
-
Nonlocality, Nonlinearity, and Time Inconsistency in Stochastic Differential Games
Authors:
Qian Lei,
Chi Seng Pun
Abstract:
This paper proves the existence and uniqueness results (in the sense of maximally defined regularity) as well as the stability analysis for the solutions to a class of nonlocal fully-nonlinear parabolic systems, where the nonlocality stems from the flow feature (controlled by an external temporal parameter) of the systems. The derived mathematical results generalize the theory of stochastic differ…
▽ More
This paper proves the existence and uniqueness results (in the sense of maximally defined regularity) as well as the stability analysis for the solutions to a class of nonlocal fully-nonlinear parabolic systems, where the nonlocality stems from the flow feature (controlled by an external temporal parameter) of the systems. The derived mathematical results generalize the theory of stochastic differential games to incorporate with behavioral factors such as time-inconsistent preferences, which facilitate developments of many studies in financial economics including robust stochastic controls and games under relative performance concerns. Moreover, with the well-posedness results, we establish a general multidimensional Feynman--Kac formula in the presence of nonlocality (time inconsistency).
△ Less
Submitted 7 September, 2023; v1 submitted 29 December, 2021;
originally announced December 2021.
-
A Subgame Perfect Equilibrium Reinforcement Learning Approach to Time-inconsistent Problems
Authors:
Nixie S. Lesmana,
Chi Seng Pun
Abstract:
In this paper, we establish a subgame perfect equilibrium reinforcement learning (SPERL) framework for time-inconsistent (TIC) problems. In the context of RL, TIC problems are known to face two main challenges: the non-existence of natural recursive relationships between value functions at different time points and the violation of Bellman's principle of optimality that raises questions on the app…
▽ More
In this paper, we establish a subgame perfect equilibrium reinforcement learning (SPERL) framework for time-inconsistent (TIC) problems. In the context of RL, TIC problems are known to face two main challenges: the non-existence of natural recursive relationships between value functions at different time points and the violation of Bellman's principle of optimality that raises questions on the applicability of standard policy iteration algorithms for unprovable policy improvement theorems. We adapt an extended dynamic programming theory and propose a new class of algorithms, called backward policy iteration (BPI), that solves SPERL and addresses both challenges. To demonstrate the practical usage of BPI as a training framework, we adapt standard RL simulation methods and derive two BPI-based training algorithms. We examine our derived training frameworks on a mean-variance portfolio selection problem and evaluate some performance metrics including convergence and model identifiability.
△ Less
Submitted 27 October, 2021;
originally announced October 2021.
-
Nonlocal Fully Nonlinear Parabolic Differential Equations Arising in Time-Inconsistent Problems
Authors:
Qian Lei,
Chi Seng Pun
Abstract:
We prove the well-posedness results, i.e. existence, uniqueness, and stability, of the solutions to a class of nonlocal fully nonlinear parabolic partial differential equations (PDEs), where there is an external time parameter $t$ on top of the temporal and spatial variables $(s,y)$ and thus the problem could be considered as a flow of equations. The nonlocality comes from the dependence on the un…
▽ More
We prove the well-posedness results, i.e. existence, uniqueness, and stability, of the solutions to a class of nonlocal fully nonlinear parabolic partial differential equations (PDEs), where there is an external time parameter $t$ on top of the temporal and spatial variables $(s,y)$ and thus the problem could be considered as a flow of equations. The nonlocality comes from the dependence on the unknown function and its first- and second-order derivatives evaluated at not only the local point $(t,s,y)$ but also at the diagonal line of the time domain $(s,s,y)$. Such equations arise from time-inconsistent problems in game theory or behavioural economics, where the observations and preferences are (reference-)time-dependent. To address the open problem of the well-posedness of the corresponding nonlocal PDEs (or the time-inconsistent problems), we first study the linearized version of the nonlocal PDEs with an innovative construction of appropriate norms and Banach spaces and contraction mappings over which. With fixed-point arguments, we obtain the well-posedness of nonlocal linear PDEs and establish a Schauder-type prior estimate for the solutions. Then, by the linearization method, we analogously establish the well-posedness under the fully nonlinear case. Moreover, we reveal that the solution of a nonlocal fully nonlinear parabolic PDE is an adapted solution to a flow of second-order forward-backward stochastic differential equations.
△ Less
Submitted 8 October, 2021;
originally announced October 2021.
-
A Multiscale Method for the Heterogeneous Signorini Problem
Authors:
Xin Su,
Sai-Mang Pun
Abstract:
In this paper, we develop a multiscale method for solving the Signorini problem with a heterogeneous field. The Signorini problem is encountered in many applications, such as hydrostatics, thermics, and solid mechanics. It is well-known that numerically solving this problem requires a fine computational mesh, which can lead to a large number of degrees of freedom. The aim of this work is to develo…
▽ More
In this paper, we develop a multiscale method for solving the Signorini problem with a heterogeneous field. The Signorini problem is encountered in many applications, such as hydrostatics, thermics, and solid mechanics. It is well-known that numerically solving this problem requires a fine computational mesh, which can lead to a large number of degrees of freedom. The aim of this work is to develop a new hybrid multiscale method based on the framework of the generalized multiscale finite element method (GMsFEM). The construction of multiscale basis functions requires local spectral decomposition. Additional multiscale basis functions related to the contact boundary are required so that our method can handle the unilateral condition of the Signorini type naturally. A complete analysis of the proposed method is provided and a result of the spectral convergence is shown. Numerical results are provided to validate our theoretical findings.
△ Less
Submitted 27 September, 2021;
originally announced September 2021.
-
Space-time Non-local multi-continua upscaling for parabolic equations with moving channelized media
Authors:
Jiuhua Hu,
Wing Tat Leung,
Eric Chung,
Yalchin Efendiev,
Sai-Mang Pun
Abstract:
In this paper, we consider a parabolic problem with time-dependent heterogeneous coefficients. Many applied problems have coupled space and time heterogeneities. Their homogenization or upscaling requires cell problems that are formulated in space-time representative volumes for problems with scale separation. In problems without scale separation, local problems include multiple macroscopic variab…
▽ More
In this paper, we consider a parabolic problem with time-dependent heterogeneous coefficients. Many applied problems have coupled space and time heterogeneities. Their homogenization or upscaling requires cell problems that are formulated in space-time representative volumes for problems with scale separation. In problems without scale separation, local problems include multiple macroscopic variables and oversampled local problems, where these macroscopic parameters are computed. These approaches, called Non-local multi-continua, are proposed for problems with complex spatial heterogeneities in a number of previous papers. In this paper, we extend this approach for space-time heterogeneities, by identifying macroscopic parameters in space-time regions. Our proposed method space-time Non-local multi-continua (space-time NLMC) is an efficient numerical solver to deal with time-dependent heterogeneous coefficients. It provides a flexible and systematic way to construct multiscale basis functions to approximate the solution. These multiscale basis functions are constructed by solving a local energy minimization problems in the oversampled space-time regions such that these multiscale basis functions decay exponentially outside the oversampled domain. Unlike the classical time-stepping methods combined with full-discretization technique, our space-time NLMC efficiently constructs the multiscale basis functions in a space-time domain and can provide a computational savings compared to space-only approaches as we discuss in the paper. We present two numerical experiments, which show that the proposed approach can provide a good accuracy.
△ Less
Submitted 22 June, 2021;
originally announced June 2021.
-
Computational multiscale methods for parabolic wave approximations in heterogeneous media
Authors:
Eric Chung,
Yalchin Efendiev,
Sai-Mang Pun,
Zecheng Zhang
Abstract:
In this paper, we develop a computational multiscale to solve the parabolic wave approximation with heterogeneous and variable media. Parabolic wave approximation is a technique to approximate the full wave equation. One benefit of the method is that: one wave propagation direction can be taken as an evolution direction, and we then can discretize it using a classical scheme like Backward Euler. C…
▽ More
In this paper, we develop a computational multiscale to solve the parabolic wave approximation with heterogeneous and variable media. Parabolic wave approximation is a technique to approximate the full wave equation. One benefit of the method is that: one wave propagation direction can be taken as an evolution direction, and we then can discretize it using a classical scheme like Backward Euler. Consequently, we obtain a set of quasi-gas-dynamic (QGD) models with different heterogeneous permeability fields. Then, we employ constraint energy minimization generalized multiscale finite element method (CEM-GMsFEM) to perform spatial discretization for the problem. The resulting system can be solved by combining the central difference in time evolution. Due to the variable media, we apply the technique of proper orthogonal decomposition (POD) to further the dimension of the problem and solve the corresponding model problem in the POD space instead of in the whole multiscale space spanned by all possible multiscale basis functions. We prove the stability of the full discretization scheme and give the convergence analysis of the proposed approximation scheme. Numerical results verify the effectiveness of the proposed method.
△ Less
Submitted 6 April, 2021;
originally announced April 2021.
-
Online adaptive algorithm for Constraint Energy Minimizing Generalized Multiscale Discontinuous Galerkin Method
Authors:
Sai-Mang Pun,
Siu Wun Cheung
Abstract:
In this research, we propose an online basis enrichment strategy within the framework of a recently developed constraint energy minimizing generalized multiscale discontinuous Galerkin method (CEM-GMsDGM). Combining the technique of oversampling, one makes use of the information of the current residuals to adaptively construct basis functions in the online stage to reduce the error of multiscale a…
▽ More
In this research, we propose an online basis enrichment strategy within the framework of a recently developed constraint energy minimizing generalized multiscale discontinuous Galerkin method (CEM-GMsDGM). Combining the technique of oversampling, one makes use of the information of the current residuals to adaptively construct basis functions in the online stage to reduce the error of multiscale approximation. A complete analysis of the method is presented, which shows the proposed online enrichment leads to a fast convergence from multiscale approximation to the fine-scale solution. The error reduction can be made sufficiently large by suitably selecting oversampling regions and the number of oversampling layers. Further, the convergence rate of the enrichment algorithm depends on a factor of exponential decay regarding the number of oversampling layers and a user-defined parameter. Numerical results are provided to demonstrate the effectiveness and efficiency of the proposed online adaptive algorithm.
△ Less
Submitted 3 March, 2021;
originally announced March 2021.
-
Iterative Oversampling Technique for Constraint Energy Minimizing Generalized Multiscale Finite Element Method in the Mixed Formulation
Authors:
Siu Wun Cheung,
Eric Chung,
Yalchin Efendiev,
Wing Tat Leung,
Sai-Mang Pun
Abstract:
In this paper, we develop an iterative scheme to construct multiscale basis functions within the framework of the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for the mixed formulation. The iterative procedure starts with the construction of an energy minimizing snapshot space that can be used for approximating the solution of the model problem. A spectral…
▽ More
In this paper, we develop an iterative scheme to construct multiscale basis functions within the framework of the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for the mixed formulation. The iterative procedure starts with the construction of an energy minimizing snapshot space that can be used for approximating the solution of the model problem. A spectral decomposition is then performed on the snapshot space to form global multiscale space. Under this setting, each global multiscale basis function can be split into a non-decaying and a decaying parts. The non-decaying part of a global basis is localized and it is fixed during the iteration. Then, one can approximate the decaying part via a modified Richardson scheme with an appropriately defined preconditioner. Using this set of iterative-based multiscale basis functions, first-order convergence with respect to the coarse mesh size can be shown if sufficiently many times of iterations with regularization parameter being in an appropriate range are performed. Numerical results are presented to illustrate the effectiveness and efficiency of the proposed computational multiscale method.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Multi-agent Reinforcement Learning Accelerated MCMC on Multiscale Inversion Problem
Authors:
Eric Chung,
Yalchin Efendiev,
Wing Tat Leung,
Sai-Mang Pun,
Zecheng Zhang
Abstract:
In this work, we propose a multi-agent actor-critic reinforcement learning (RL) algorithm to accelerate the multi-level Monte Carlo Markov Chain (MCMC) sampling algorithms. The policies (actors) of the agents are used to generate the proposal in the MCMC steps; and the critic, which is centralized, is in charge of estimating the long term reward. We verify our proposed algorithm by solving an inve…
▽ More
In this work, we propose a multi-agent actor-critic reinforcement learning (RL) algorithm to accelerate the multi-level Monte Carlo Markov Chain (MCMC) sampling algorithms. The policies (actors) of the agents are used to generate the proposal in the MCMC steps; and the critic, which is centralized, is in charge of estimating the long term reward. We verify our proposed algorithm by solving an inverse problem with multiple scales. There are several difficulties in the implementation of this problem by using traditional MCMC sampling. Firstly, the computation of the posterior distribution involves evaluating the forward solver, which is very time consuming for a problem with heterogeneous. We hence propose to use the multi-level algorithm. More precisely, we use the generalized multiscale finite element method (GMsFEM) as the forward solver in evaluating a posterior distribution in the multi-level rejection procedure. Secondly, it is hard to find a function which can generate samplings which are meaningful. To solve this issue, we learn an RL policy as the proposal generator. Our experiments show that the proposed method significantly improves the sampling process
△ Less
Submitted 17 November, 2020;
originally announced November 2020.
-
Temporal Splitting algorithms for non-stationary multiscale problems
Authors:
Yalchin Efendiev,
Sai-Mang Pun,
Petr N. Vabishchevich
Abstract:
In this paper, we study temporal splitting algorithms for multiscale problems. The exact fine-grid spatial problems typically require some reduction in degrees of freedom. Multiscale algorithms are designed to represent the fine-scale details on a coarse grid and, thus, reduce the problems' size. When solving time-dependent problems, one can take advantage of the multiscale decomposition of the so…
▽ More
In this paper, we study temporal splitting algorithms for multiscale problems. The exact fine-grid spatial problems typically require some reduction in degrees of freedom. Multiscale algorithms are designed to represent the fine-scale details on a coarse grid and, thus, reduce the problems' size. When solving time-dependent problems, one can take advantage of the multiscale decomposition of the solution and perform temporal splitting by solving smaller-dimensional problems, which is studied in the paper. In the proposed approach, we consider the temporal splitting based on various low dimensional spatial approximations. Because a multiscale spatial splitting gives a "good" decomposition of the solution space, one can achieve an efficient implicit-explicit temporal discretization. We present a recently developed theoretical result in our earlier work and adopt it in this paper for multiscale problems. Numerical results are presented to demonstrate the efficiency of the proposed splitting algorithm.
△ Less
Submitted 16 March, 2021; v1 submitted 11 November, 2020;
originally announced November 2020.
-
A multi-stage deep learning based algorithm for multiscale modelreduction
Authors:
Eric Chung,
Wing Tat Leung,
Sai-Mang Pun,
Zecheng Zhang
Abstract:
In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and predicts the same reduced order model of the multiscale problem. The output of the previous stage will be combined with an intermediate layer for the current sta…
▽ More
In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and predicts the same reduced order model of the multiscale problem. The output of the previous stage will be combined with an intermediate layer for the current stage. We numerically show that using different reduced order models as inputs of each stage can improve the training and we propose several ways of adding different information into the systems. These methods include mathematical multiscale model reductions and network approaches; but we found that the mathematical approach is a systematical way of decoupling information and gives the best result. We finally verified our training methodology on a time dependent nonlinear problem and a steady state model
△ Less
Submitted 23 September, 2020;
originally announced September 2020.
-
Computational multiscale methods for quasi-gas dynamic equations
Authors:
Boris Chetverushkin,
Eric Chung,
Yalchin Efendiev,
Sai-Mang Pun,
Zecheng Zhang
Abstract:
In this paper, we consider the quasi-gas-dynamic (QGD) model in a multiscale environment. The model equations can be regarded as a hyperbolic regularization and are derived from kinetic equations. So far, the research on QGD models has been focused on problems with constant coefficients. In this paper, we investigate the QGD model in multiscale media, which can be used in porous media applications…
▽ More
In this paper, we consider the quasi-gas-dynamic (QGD) model in a multiscale environment. The model equations can be regarded as a hyperbolic regularization and are derived from kinetic equations. So far, the research on QGD models has been focused on problems with constant coefficients. In this paper, we investigate the QGD model in multiscale media, which can be used in porous media applications. This multiscale problem is interesting from a multiscale methodology point of view as the model problem has a hyperbolic multiscale term, and designing multiscale methods for hyperbolic equations is challenging. In the paper, we apply the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) combined with the leapfrog scheme in time to solve this problem. The CEM-GMsFEM provides a flexible and systematical framework to construct crucial multiscale basis functions for approximating the solution to the problem with reduced computational cost. With this approach of spatial discretization, we establish the stability of the fully discretized scheme under a relaxed version of the so-called CFL condition. Complete convergence analysis of the proposed method is presented. Numerical results are provided to illustrate and verify the theoretical findings.
△ Less
Submitted 31 August, 2020;
originally announced September 2020.
-
Convergence of the CEM-GMsFEM for Stokes flows in heterogeneous perforated domains
Authors:
Eric Chung,
Jiuhua Hu,
Sai-Mang Pun
Abstract:
In this paper, we consider the incompressible Stokes flow problem in a perforated domain and employ the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) to solve this problem. The proposed method provides a flexible and systematical approach to construct crucial divergence-free multiscale basis functions for approximating the displacement field. These basis fu…
▽ More
In this paper, we consider the incompressible Stokes flow problem in a perforated domain and employ the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) to solve this problem. The proposed method provides a flexible and systematical approach to construct crucial divergence-free multiscale basis functions for approximating the displacement field. These basis functions are constructed by solving a class of local energy minimization problems over the eigenspaces that contain local information on the heterogeneities. These multiscale basis functions are shown to have the property of exponential decay outside the corresponding local oversampling regions. By adapting the technique of oversampling, the spectral convergence of the method with error bounds related to the coarse mesh size is proved.
△ Less
Submitted 7 July, 2020;
originally announced July 2020.
-
Computational multiscale methods for first-order wave equation using mixed CEM-GMsFEM
Authors:
Eric Chung,
Sai-Mang Pun
Abstract:
In this paper, we consider a pressure-velocity formulation of the heterogeneous wave equation and employ the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) to solve this problem. The proposed method provides a flexible framework to construct crucial multiscale basis functions for approximating the pressure and velocity. These basis functions are constructed…
▽ More
In this paper, we consider a pressure-velocity formulation of the heterogeneous wave equation and employ the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) to solve this problem. The proposed method provides a flexible framework to construct crucial multiscale basis functions for approximating the pressure and velocity. These basis functions are constructed by solving a class of local auxiliary optimization problems over the eigenspaces that contain local information on the heterogeneity. Techniques of oversampling are adapted to enhance the computational performance. The first-order convergence of the proposed method is proved and illustrated by several numerical tests.
△ Less
Submitted 5 October, 2020; v1 submitted 18 September, 2019;
originally announced September 2019.
-
Computational Multiscale Methods for Linear Poroelasticity with High Contrast
Authors:
Shubin Fu,
Robert Altmann,
Eric T. Chung,
Roland Maier,
Daniel Peterseim,
Sai-Mang Pun
Abstract:
In this work, we employ the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) to solve the problem of linear heterogeneous poroelasticity with coefficients of high contrast. The proposed method makes use of the idea of energy minimization with suitable constraints in order to generate efficient basis functions for the displacement and the pressure. These basis…
▽ More
In this work, we employ the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) to solve the problem of linear heterogeneous poroelasticity with coefficients of high contrast. The proposed method makes use of the idea of energy minimization with suitable constraints in order to generate efficient basis functions for the displacement and the pressure. These basis functions are constructed by solving a class of local auxiliary optimization problems based on eigenfunctions containing local information on the heterogeneity. Techniques of oversampling are adapted to enhance the computational performance. Convergence of first order is shown and illustrated by a number of numerical tests.
△ Less
Submitted 10 December, 2018;
originally announced December 2018.
-
Online basis construction for goal-oriented adaptivity in the Generalized Multiscale Finite Element Method
Authors:
Eric T. Chung,
Sara Pollock,
Sai-Mang Pun
Abstract:
In this research, we develop an online enrichment framework for goal-oriented adaptivity within the generalized multiscale finite element method for flow problems in heterogeneous media. The method for approximating the quantity of interest involves construction of residual-based primal and dual basis functions used to enrich the multiscale space at each stage of the adaptive algorithm. Three diff…
▽ More
In this research, we develop an online enrichment framework for goal-oriented adaptivity within the generalized multiscale finite element method for flow problems in heterogeneous media. The method for approximating the quantity of interest involves construction of residual-based primal and dual basis functions used to enrich the multiscale space at each stage of the adaptive algorithm. Three different online enrichment strategies based on the primal-dual online basis construction are proposed: standard, primal-dual combined and primal-dual product based. Numerical experiments are performed to illustrate the efficiency of the proposed methods for high-contrast heterogeneous problems.
△ Less
Submitted 18 March, 2019; v1 submitted 5 December, 2018;
originally announced December 2018.
-
An adaptive dynamically low-dimensional approximation method for multiscale stochastic diffusion equations
Authors:
Eric T. Chung,
Sai-Mang Pun,
Zhiwen Zhang
Abstract:
In this paper, we propose a dynamically low-dimensional approximation method to solve a class of time-dependent multiscale stochastic diffusion equations. A dynamically bi-orthogonal (DyBO) method was developed to explore low-dimensional structures of stochastic partial differential equations (SPDEs) and solve them efficiently. However, when the SPDEs have multiscale features in physical space, th…
▽ More
In this paper, we propose a dynamically low-dimensional approximation method to solve a class of time-dependent multiscale stochastic diffusion equations. A dynamically bi-orthogonal (DyBO) method was developed to explore low-dimensional structures of stochastic partial differential equations (SPDEs) and solve them efficiently. However, when the SPDEs have multiscale features in physical space, the original DyBO method becomes expensive. To address this issue, we construct multiscale basis functions within each coarse grid block for dimension reduction in the physical space. To further improve the accuracy, we also perform online procedure to construct online adaptive basis functions. In the stochastic space, we use the generalized polynomial chaos (gPC) basis functions to represent the stochastic part of the solutions. Numerical results are presented to demonstrate the efficiency of the proposed method in solving time-dependent PDEs with multiscale and random features.
△ Less
Submitted 3 February, 2019; v1 submitted 4 December, 2018;
originally announced December 2018.
-
Persistent-Homology-based Machine Learning and its Applications -- A Survey
Authors:
Chi Seng Pun,
Kelin Xia,
Si Xian Lee
Abstract:
A suitable feature representation that can both preserve the data intrinsic information and reduce data complexity and dimensionality is key to the performance of machine learning models. Deeply rooted in algebraic topology, persistent homology (PH) provides a delicate balance between data simplification and intrinsic structure characterization, and has been applied to various areas successfully.…
▽ More
A suitable feature representation that can both preserve the data intrinsic information and reduce data complexity and dimensionality is key to the performance of machine learning models. Deeply rooted in algebraic topology, persistent homology (PH) provides a delicate balance between data simplification and intrinsic structure characterization, and has been applied to various areas successfully. However, the combination of PH and machine learning has been hindered greatly by three challenges, namely topological representation of data, PH-based distance measurements or metrics, and PH-based feature representation. With the development of topological data analysis, progresses have been made on all these three problems, but widely scattered in different literatures. In this paper, we provide a systematical review of PH and PH-based supervised and unsupervised models from a computational perspective. Our emphasizes are the recent development of mathematical models and tools, including PH softwares and PH-based functions, feature representations, kernels, and similarity models. Essentially, this paper can work as a roadmap for the practical application of PH-based machine learning tools. Further, we consider different topological feature representations in different machine learning models, and investigate their impacts on the protein secondary structure classification.
△ Less
Submitted 1 November, 2018;
originally announced November 2018.
-
Online adaptive basis enrichment for mixed CEM-GMsFEM
Authors:
Eric T. Chung,
Sai-Mang Pun
Abstract:
In this research, an online basis enrichment strategy for the constraint energy minimizing generalized multiscale finite element method in mixed formulation is proposed. The online approach is based on the technique of oversampling. One makes use of the information of residual and the data in the partial differential equation such as the source function. The analysis presented shows that the propo…
▽ More
In this research, an online basis enrichment strategy for the constraint energy minimizing generalized multiscale finite element method in mixed formulation is proposed. The online approach is based on the technique of oversampling. One makes use of the information of residual and the data in the partial differential equation such as the source function. The analysis presented shows that the proposed online enrichment leads to a fast convergence from multiscale approximation to the fine-scale solution. The error reduction can be made sufficiently large by suitably selecting oversampling regions and the number of oversampling layers. Also, the convergence rate of the enrichment can be tuned by a user-defined parameter. Numerical results are provided to illustrate the efficiency of the proposed method.
△ Less
Submitted 27 September, 2019; v1 submitted 25 October, 2018;
originally announced October 2018.
-
Computational multiscale methods for linear heterogeneous poroelasticity
Authors:
Robert Altmann,
Eric Chung,
Roland Maier,
Daniel Peterseim,
Sai-Mang Pun
Abstract:
We consider a strongly heterogeneous medium saturated by an incompressible viscous fluid as it appears in geomechanical modeling. This poroelasticity problem suffers from rapidly oscillating material parameters, which calls for a thorough numerical treatment. In this paper, we propose a method based on the local orthogonal decomposition technique and motivated by a similar approach used for linear…
▽ More
We consider a strongly heterogeneous medium saturated by an incompressible viscous fluid as it appears in geomechanical modeling. This poroelasticity problem suffers from rapidly oscillating material parameters, which calls for a thorough numerical treatment. In this paper, we propose a method based on the local orthogonal decomposition technique and motivated by a similar approach used for linear thermoelasticity. Therein, local corrector problems are constructed in line with the static equations, whereas we propose to consider the full system. This allows to benefit from the given saddle point structure and results in two decoupled corrector problems for the displacement and the pressure. We prove the optimal first-order convergence of this method and verify the result by numerical experiments.
△ Less
Submitted 22 December, 2018; v1 submitted 2 January, 2018;
originally announced January 2018.
