Showing 1–11 of 11 results for author: Muñoz-Matute, J

A Space-Time Discontinuous Petrov-Galerkin Finite Element Formulation for a Modified Schrödinger Equation for Laser Pulse Propagation in Waveguides

Authors: Ankit Chakraborty, Judit Munoz-Matute, Leszek Demkowicz, Jake Grosek

Abstract: In this article, we propose a modified nonlinear Schrödinger equation for modeling pulse propagation in optical waveguides. The proposed model bifurcates into a system of elliptic and hyperbolic equations depending on waveguide parameters. The proposed model leads to a stable first-order system of equations, distinguishing itself from the canonical nonlinear Schrödinger equation. We have employed… ▽ More In this article, we propose a modified nonlinear Schrödinger equation for modeling pulse propagation in optical waveguides. The proposed model bifurcates into a system of elliptic and hyperbolic equations depending on waveguide parameters. The proposed model leads to a stable first-order system of equations, distinguishing itself from the canonical nonlinear Schrödinger equation. We have employed the space-time discontinuous Petrov-Galerkin finite element method to discretize the first-order system of equations. We present a stability analysis for both the elliptic and hyperbolic systems of equations and demonstrate the stability of the proposed model through several numerical examples on space-time meshes. △ Less

Submitted 4 December, 2024; originally announced December 2024.

Report number: ODEN INSTITUTE REPORT -- 24-06

Regularity-Conforming Neural Networks (ReCoNNs) for solving Partial Differential Equations

Authors: Jamie M. Taylor, David Pardo, Judit Muñoz-Matute

Abstract: Whilst the Universal Approximation Theorem guarantees the existence of approximations to Sobolev functions -- the natural function spaces for PDEs -- by Neural Networks (NNs) of sufficient size, low-regularity solutions may lead to poor approximations in practice. For example, classical fully-connected feed-forward NNs fail to approximate continuous functions whose gradient is discontinuous when e… ▽ More Whilst the Universal Approximation Theorem guarantees the existence of approximations to Sobolev functions -- the natural function spaces for PDEs -- by Neural Networks (NNs) of sufficient size, low-regularity solutions may lead to poor approximations in practice. For example, classical fully-connected feed-forward NNs fail to approximate continuous functions whose gradient is discontinuous when employing strong formulations like in Physics Informed Neural Networks (PINNs). In this article, we propose the use of regularity-conforming neural networks, where a priori information on the regularity of solutions to PDEs can be employed to construct proper architectures. We illustrate the potential of such architectures via a two-dimensional (2D) transmission problem, where the solution may admit discontinuities in the gradient across interfaces, as well as power-like singularities at certain points. In particular, we formulate the weak transmission problem in a PINNs-like strong formulation with interface and continuity conditions. Such architectures are partially explainable; discontinuities are explicitly described, allowing the introduction of novel terms into the loss function. We demonstrate via several model problems in one and two dimensions the advantages of using regularity-conforming architectures in contrast to classical architectures. The ideas presented in this article easily extend to problems in higher dimensions. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Augmenting MRI scan data with real-time predictions of glioblastoma brain tumor evolution using faster exponential time integrators

Authors: Magdalena Pabisz, Judit Muñoz-Matute, Maciej Paszyński

Abstract: We present a MATLAB code for exponential integrators method simulating the glioblastoma tumor growth. It employs the Fisher-Kolmogorov diffusion-reaction tumor brain model with logistic growth. The input is the MRI scans of the human head and the initial tumor location. The simulation uses the finite difference formulation in space and the ultra-fast exponential integrators method in time. The out… ▽ More We present a MATLAB code for exponential integrators method simulating the glioblastoma tumor growth. It employs the Fisher-Kolmogorov diffusion-reaction tumor brain model with logistic growth. The input is the MRI scans of the human head and the initial tumor location. The simulation uses the finite difference formulation in space and the ultra-fast exponential integrators method in time. The output from the code is the input data for ParaView visualization. While there are many brain tumor simulation codes, our method's novelty lies in its implementation using exponential integrators. We propose a new algorithm for the fast computation of exponential integrators. Regarding execution time on a laptop with Win10, using MATLAB, with 11th Gen Intel(R) Core(TM) i5-11500H, 2.92 GHz, and 32 GB of RAM, the algorithm outperforms the state-of-the-art routines from [A. Al-Mohy, N. Higham, Computing the action of the matrix exponential, with an application to exponential integrators. SIAM Journal On Scientific Computing (33) 488-511 (2011)]. We also compare our method with an implicit, unconditionally stable Crank-Nicolson time integration scheme based on the finite difference method. We show that our method is two orders of magnitude faster than the Crank-Nicolson method with finite difference discretization in space on a laptop equipped with MATLAB. The brain tumor two-year future prediction using 128x128x128 computational grid and 100-time steps, built over the MRI scans of the human head, takes less than 10 minutes on the laptop. △ Less

Submitted 22 September, 2024; v1 submitted 3 February, 2024; originally announced February 2024.

Comments: 29 pages, 10 figures

MSC Class: 65: Numerical analysis ACM Class: G.1.8; G.1.10

Multistage DPG time-marching scheme for nonlinear problems

Authors: Judit Muñoz-Matute, Leszek Demkowicz

Abstract: In this article, we employ the construction of the time-marching Discontinuous Petrov-Galerkin (DPG) scheme we developed for linear problems to derive high-order multistage DPG methods for non-linear systems of ordinary differential equations. The methodology extends to abstract evolution equations in Banach spaces, including a class of nonlinear partial differential equations. We present three ne… ▽ More In this article, we employ the construction of the time-marching Discontinuous Petrov-Galerkin (DPG) scheme we developed for linear problems to derive high-order multistage DPG methods for non-linear systems of ordinary differential equations. The methodology extends to abstract evolution equations in Banach spaces, including a class of nonlinear partial differential equations. We present three nested multistage methods: the hybrid Euler method and the two- and three-stage DPG methods. We employ a linearization of the problem as in exponential Rosenbrock methods, so we need to compute exponential actions of the Jacobian that change from time steps. The key point of our construction is that one of the stages can be post-processed from another without an extra exponential step. Therefore, the class of methods we introduce is computationally cheaper than the classical exponential Rosenbrock methods. We provide a full convergence proof to show that the methods are second, third, and fourth-order accurate, respectively. We test the convergence in time of our methods on a 2D + time semi-linear partial differential equation after a semidiscretization in space. △ Less

Submitted 30 April, 2024; v1 submitted 31 August, 2023; originally announced September 2023.

Robust Variational Physics-Informed Neural Networks

Authors: Sergio Rojas, Paweł Maczuga, Judit Muñoz-Matute, David Pardo, Maciej Paszynski

Abstract: We introduce a Robust version of the Variational Physics-Informed Neural Networks method (RVPINNs). As in VPINNs, we define the quadratic loss functional in terms of a Petrov-Galerkin-type variational formulation of the PDE problem: the trial space is a (Deep) Neural Network (DNN) manifold, while the test space is a finite-dimensional vector space. Whereas the VPINN's loss depends upon the selecte… ▽ More We introduce a Robust version of the Variational Physics-Informed Neural Networks method (RVPINNs). As in VPINNs, we define the quadratic loss functional in terms of a Petrov-Galerkin-type variational formulation of the PDE problem: the trial space is a (Deep) Neural Network (DNN) manifold, while the test space is a finite-dimensional vector space. Whereas the VPINN's loss depends upon the selected basis functions of a given test space, herein, we minimize a loss based on the discrete dual norm of the residual. The main advantage of such a loss definition is that it provides a reliable and efficient estimator of the true error in the energy norm under the assumption of the existence of a local Fortin operator. We test the performance and robustness of our algorithm in several advection-diffusion problems. These numerical results perfectly align with our theoretical findings, showing that our estimates are sharp. △ Less

Submitted 5 March, 2024; v1 submitted 31 August, 2023; originally announced August 2023.

MSC Class: 65N12; 65N15; 65N22; 65N30; 65N50

A Deep Double Ritz Method (D$^2$RM) for solving Partial Differential Equations using Neural Networks

Authors: Carlos Uriarte, David Pardo, Ignacio Muga, Judit Muñoz-Matute

Abstract: Residual minimization is a widely used technique for solving Partial Differential Equations in variational form. It minimizes the dual norm of the residual, which naturally yields a saddle-point (min-max) problem over the so-called trial and test spaces. In the context of neural networks, we can address this min-max approach by employing one network to seek the trial minimum, while another network… ▽ More Residual minimization is a widely used technique for solving Partial Differential Equations in variational form. It minimizes the dual norm of the residual, which naturally yields a saddle-point (min-max) problem over the so-called trial and test spaces. In the context of neural networks, we can address this min-max approach by employing one network to seek the trial minimum, while another network seeks the test maximizers. However, the resulting method is numerically unstable as we approach the trial solution. To overcome this, we reformulate the residual minimization as an equivalent minimization of a Ritz functional fed by optimal test functions computed from another Ritz functional minimization. We call the resulting scheme the Deep Double Ritz Method (D$^2$RM), which combines two neural networks for approximating trial functions and optimal test functions along a nested double Ritz minimization strategy. Numerical results on different diffusion and convection problems support the robustness of our method, up to the approximation properties of the networks and the training capacity of the optimizers. △ Less

Submitted 18 January, 2023; v1 submitted 7 November, 2022; originally announced November 2022.

Comments: 28 pages

Exploiting Kronecker structure in exponential integrators: fast approximation of the action of $\varphi$-functions of matrices via quadrature

Authors: Matteo Croci, Judit Muñoz-Matute

Abstract: In this article, we propose an algorithm for approximating the action of $\varphi-$functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum structure, which arise from problems admitting a tensor product representation. The method is based on quadrature approximations of the integral form of the… ▽ More In this article, we propose an algorithm for approximating the action of $\varphi-$functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum structure, which arise from problems admitting a tensor product representation. The method is based on quadrature approximations of the integral form of the $\varphi-$functions combined with a scaling and modified squaring method. Owing to the Kronecker sum representation, only actions of 1D matrix exponentials are needed at each quadrature node and assembly of the full matrix can be avoided. Additionally, we derive \emph{a priori} bounds for the quadrature error, which show that, as expected by classical theory, the rate of convergence of our method is supergeometric. Guided by our analysis, we construct a fast and robust method for estimating the optimal scaling factor and number of quadrature nodes that minimizes the total cost for a prescribed error tolerance. We investigate the performance of our algorithm by solving several linear and semilinear time-dependent problems in 2D and 3D. The results show that our method is accurate and orders of magnitude faster than the current state-of-the-art. △ Less

Submitted 1 November, 2022; originally announced November 2022.

Comments: 20 pages, 3 figures, 7 tables

Alternating directions implicit higher-order finite element method for simulations of time-dependent electromagnetic wave propagation in non-regular biological tissues

Authors: Maciej Paszynski, Marcin Los, Judit Munoz-Matute

Abstract: We focus on non-stationary Maxwell equations defined on a regular patch of elements as considered in the isogeometric analysis (IGA). We apply the time-integration scheme following the ideas developed by the finite difference community [M. Hochbruck, T. Jahnke, R. Schnaubelt, Convergence of an ADI splitting for Maxwell's equations, Numerishe Mathematik, 2015] to derive a weak formulation resulting… ▽ More We focus on non-stationary Maxwell equations defined on a regular patch of elements as considered in the isogeometric analysis (IGA). We apply the time-integration scheme following the ideas developed by the finite difference community [M. Hochbruck, T. Jahnke, R. Schnaubelt, Convergence of an ADI splitting for Maxwell's equations, Numerishe Mathematik, 2015] to derive a weak formulation resulting in discretization with Kronecker product matrices. We take the tensor product structure of the computational patch of elements from the IGA framework as an advantage, allowing for linear computational cost factorization in every time step. We design our solver to target simulations of electromagnetic waves propagations in non-regular biological tissues. We show that the linear cost of the alternating direction solver is preserved when we arbitrarily vary material data coefficients across the computational domain. We verify the solver using the manufactured solution and the problem of propagation of electromagnetic waves on the human head. △ Less

Submitted 18 July, 2021; v1 submitted 11 March, 2021; originally announced March 2021.

Comments: arXiv admin note: text overlap with arXiv:2001.00178

Isogeometric Residual Minimization Method (iGRM) with Direction Splitting for Non-Stationary Advection-Diffusion Problems

Authors: Marcin Los, Judit Munoz-Matute, Ignacio Muga, Maciej Paszynski

Abstract: In this paper, we propose a novel computational implicit method, which we call Isogeometric Residual Minimization (iGRM) with direction splitting. The method mixes the benefits resulting from isogeometric analysis, implicit dynamics, residual minimization, and alternating direction solver. We utilize tensor product B-spline basis functions in space, implicit second order time integration schemes,… ▽ More In this paper, we propose a novel computational implicit method, which we call Isogeometric Residual Minimization (iGRM) with direction splitting. The method mixes the benefits resulting from isogeometric analysis, implicit dynamics, residual minimization, and alternating direction solver. We utilize tensor product B-spline basis functions in space, implicit second order time integration schemes, residual minimization in every time step, and we exploit Kronecker product structure of the matrix to employ linear computational cost alternating direction solver. We implement an implicit time integration scheme and apply, for each space-direction, a stabilized mixed method based on residual minimization. We show that the resulting system of linear equations has a Kronecker product structure, which results in a linear computational cost of the direct solver, even using implicit time integration schemes together with the stabilized mixed formulation. We test our method on three advection-diffusion computational examples, including model ``membrane'' problem, the circular wind problem, and the simulations modeling pollution propagating from a chimney. △ Less

Submitted 8 March, 2021; originally announced March 2021.

Comments: 30 pages, 15 figures

Journal ref: Computers & Mathematics with Applications Computers & Mathematics with Applications, Volume 79, Issue 2, 15 January 2020, Pages 213-229

Isogeometric Residual Minimization (iGRM) for Non-Stationary Stokes and Navier-Stokes Problems

Authors: Marcin Los, Ignacio Muga, Judit Munoz-Matute, Maciej Paszynski

Abstract: We show that it is possible to obtain a linear computational cost FEM-based solver for non-stationary Stokes and Navier-Stokes equations. Our method employs a technique developed by Guermond and Minev, which consists of singular perturbation plus a splitting scheme. While the time-integration schemes are implicit, we use finite elements to discretize the spatial counterparts. At each time-step, we… ▽ More We show that it is possible to obtain a linear computational cost FEM-based solver for non-stationary Stokes and Navier-Stokes equations. Our method employs a technique developed by Guermond and Minev, which consists of singular perturbation plus a splitting scheme. While the time-integration schemes are implicit, we use finite elements to discretize the spatial counterparts. At each time-step, we solve a PDE having weak-derivatives in one direction only (which allows for the linear computational cost), at the expense of handling strong second-order derivatives of the previous time step solution, on the right-hand side of these PDEs. This motivates the use of smooth functions such as B-splines. For high Reynolds numbers, some of these PDEs become unstable. To deal robustly with these instabilities, we propose to use a residual minimization technique. We test our method on problems having manufactured solutions, as well as on the cavity flow problem. △ Less

Submitted 16 December, 2020; v1 submitted 1 January, 2020; originally announced January 2020.

Comments: 27 pages, 11 figures

Journal ref: Computers & Mathematics with Applications, Available online 5 December 2020

Variational Formulations for Explicit Runge-Kutta Methods

Authors: Judit Muñoz-Matute, David Pardo, Victor M. Calo, Elisabete Alberdi

Abstract: Variational space-time formulations for Partial Differential Equations have been of great interest in the last decades. While it is known that implicit time marching schemes have variational structure, the Galerkin formulation of explicit methods in time remains elusive. In this work, we prove that the explicit Runge-Kutta methods can be expressed as discontinuous Petrov-Galerkin methods both in s… ▽ More Variational space-time formulations for Partial Differential Equations have been of great interest in the last decades. While it is known that implicit time marching schemes have variational structure, the Galerkin formulation of explicit methods in time remains elusive. In this work, we prove that the explicit Runge-Kutta methods can be expressed as discontinuous Petrov-Galerkin methods both in space and time. We build trial and test spaces for the linear diffusion equation that lead to one, two, and general stage explicit Runge-Kutta methods. This approach enables us to design explicit time-domain (goal-oriented) adaptive algorithms △ Less

Submitted 20 June, 2018; originally announced June 2018.