-
Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems
Authors:
Xiaoxuan Zhang,
Krishna Garikipati
Abstract:
Traditional, numerical discretization-based solvers of partial differential equations (PDEs) are fundamentally agnostic to domains, boundary conditions and coefficients. In contrast, machine learnt solvers have a limited generalizability across these elements of boundary value problems. This is strongly true in the case of surrogate models that are typically trained on direct numerical simulations…
▽ More
Traditional, numerical discretization-based solvers of partial differential equations (PDEs) are fundamentally agnostic to domains, boundary conditions and coefficients. In contrast, machine learnt solvers have a limited generalizability across these elements of boundary value problems. This is strongly true in the case of surrogate models that are typically trained on direct numerical simulations of PDEs applied to one specific boundary value problem. In a departure from this direct approach, the label-free machine learning of solvers is centered on a loss function that incorporates the PDE and boundary conditions in residual form. However, their generalization across boundary conditions is limited and they remain strongly domain-dependent. Here, we present a framework that generalizes across domains, boundary conditions and coefficients simultaneously with learning the PDE in weak form. Our work explores the ability of simple, convolutional neural network (CNN)-based encoder-decoder architectures to learn to solve a PDE in greater generality than its restriction to a particular boundary value problem. In this first communication, we consider the elliptic PDEs of Fickean diffusion, linear and nonlinear elasticity. Importantly, the learning happens independently of any labelled field data from either experiments or direct numerical solutions. Extensive results for these problem classes demonstrate the framework's ability to learn PDE solvers that generalize across hundreds of thousands of domains, boundary conditions and coefficients, including extrapolation beyond the learning regime. Once trained, the machine learning solvers are orders of magnitude faster than discretization-based solvers. We place our work in the context of recent continuous operator learning frameworks, and note extensions to transfer learning, active learning and reinforcement learning.
△ Less
Submitted 31 January, 2023; v1 submitted 29 December, 2022;
originally announced January 2023.
-
High Order Schemes for Gradient Flow with Respect to a Metric
Authors:
Saem Han,
Selim Esedoglu,
Krishna Garikipati
Abstract:
New criteria for energy stability of multi-step, multi-stage, and mixed schemes are introduced in the context of evolution equations that arise as gradient flow with respect to a metric. These criteria are used to exhibit second and third order consistent, energy stable schemes, which are then demonstrated on several partial differential equations that arise as gradient flow with respect to the 2-…
▽ More
New criteria for energy stability of multi-step, multi-stage, and mixed schemes are introduced in the context of evolution equations that arise as gradient flow with respect to a metric. These criteria are used to exhibit second and third order consistent, energy stable schemes, which are then demonstrated on several partial differential equations that arise as gradient flow with respect to the 2-Wasserstein metric.
△ Less
Submitted 5 October, 2023; v1 submitted 13 November, 2022;
originally announced November 2022.
-
A fourth-order phase-field fracture model: Formulation and numerical solution using a continuous/discontinuous Galerkin method
Authors:
Lampros Svolos,
Hashem M. Mourad,
Gianmarco Manzini,
Krishna Garikipati
Abstract:
Modeling crack initiation and propagation in brittle materials is of great importance to be able to predict sudden loss of load-carrying capacity and prevent catastrophic failure under severe dynamic loading conditions. Second-order phase-field fracture models have gained wide adoption given their ability to capture the formation of complex fracture patterns, e.g. via crack merging and branching,…
▽ More
Modeling crack initiation and propagation in brittle materials is of great importance to be able to predict sudden loss of load-carrying capacity and prevent catastrophic failure under severe dynamic loading conditions. Second-order phase-field fracture models have gained wide adoption given their ability to capture the formation of complex fracture patterns, e.g. via crack merging and branching, and their suitability for implementation within the context of the conventional finite element method. Higher-order phase-field models have also been proposed to increase the regularity of the exact solution and thus increase the spatial convergence rate of its numerical approximation. However, they require special numerical techniques to enforce the necessary continuity of the phase field solution. In this paper, we derive a fourth-order phase-field model of fracture in two independent ways; namely, from Hamilton's principle and from a higher-order micromechanics-based approach. The latter approach is novel, and provides a physical interpretation of the higher-order terms in the model. In addition, we propose a continuous/discontinuous Galerkin (C/DG) method for use in computing the approximate phase-field solution. This method employs Lagrange polynomial shape functions to guarantee $C^0$-continuity of the solution at inter-element boundaries, and enforces the required $C^1$ regularity with the aid of additional variational and interior penalty terms in the weak form. The phase-field equation is coupled with the momentum balance equation to model dynamic fracture problems in hyper-elastic materials. Two benchmark problems are presented to compare the numerical behavior of the C/DG method with mixed finite element methods.
△ Less
Submitted 13 May, 2022;
originally announced May 2022.
-
Numerical analysis of non-local calculus on finite weighted graphs, with application to reduced-order modelling of dynamical systems
Authors:
Matthew Duschenes,
Siddhartha Srivastava,
Krishna Garikipati
Abstract:
We present an approach to reduced-order modelling that builds off recent graph-theoretic work for representation, exploration, and analysis of computed states of physical systems (Banerjee et al., Comp. Meth. App. Mech. Eng., 351, 501-530, 2019). We extend a non-local calculus on finite weighted graphs to build such models by exploiting polynomial expansions and Taylor series. In the general frame…
▽ More
We present an approach to reduced-order modelling that builds off recent graph-theoretic work for representation, exploration, and analysis of computed states of physical systems (Banerjee et al., Comp. Meth. App. Mech. Eng., 351, 501-530, 2019). We extend a non-local calculus on finite weighted graphs to build such models by exploiting polynomial expansions and Taylor series. In the general framework for non-local calculus on graphs, the graph edge weights are intricately linked to the embedding of the graph, and consequently to the definition of the derivatives. In a previous communication (Duschenes and Garikipati, arXiv:2105.01740), we have shown that radially symmetric, continuous edge weights derived from, for example Gaussian functions, yield inconsistent results in the resulting non-local derivatives when compared against the corresponding local, differential derivative definitions. Taking inspiration from finite difference methods, we algorithmically compute edge weights, considering the embedding of the local neighborhood of each graph vertex. Given this procedure, we ensure the consistency of the non-local derivatives in this setting, a crucial requirement for numerical applications. We show that we can achieve any desired orders of accuracy of derivatives, in a chosen number of dimensions without symmetry assumptions in the underlying data. Finally, we present two example applications of extracting reduced-order models using this non-local calculus, in the form of ordinary differential equations from parabolic partial differential equations of progressively greater complexity.
△ Less
Submitted 4 May, 2022;
originally announced May 2022.
-
Reduced order models from computed states of physical systems using non-local calculus on finite weighted graphs
Authors:
Matthew Duschenes,
Krishna Garikipati
Abstract:
Partial differential equation-based numerical solution frameworks for initial and boundary value problems have attained a high degree of complexity. Applied to a wide range of physics with the ultimate goal of enabling engineering solutions, these approaches encompass a spectrum of spatiotemporal discretization techniques that leverage solver technology and high performance computing. While high-f…
▽ More
Partial differential equation-based numerical solution frameworks for initial and boundary value problems have attained a high degree of complexity. Applied to a wide range of physics with the ultimate goal of enabling engineering solutions, these approaches encompass a spectrum of spatiotemporal discretization techniques that leverage solver technology and high performance computing. While high-fidelity solutions can be achieved using these approaches, they come at a high computational expense and complexity. Systems with billions of solution unknowns are now routine. The expense and complexity do not lend themselves to typical engineering design and decision-making, which must instead rely on reduced-order models. Here we present an approach to reduced-order modelling that builds off of recent graph theoretic work for representation, exploration, and analysis on computed states of physical systems (Banerjee et al., Comp. Meth. App. Mech. Eng., 351, 501-530, 2019). We extend a non-local calculus on finite weighted graphs to build such models by exploiting first order dynamics, polynomial expansions, and Taylor series. Some aspects of the non-local calculus related to consistency of the models are explored. Details on the numerical implementations and the software library that has been developed for non-local calculus on graphs are described. Finally, we present examples of applications to various quantities of interest in mechano-chemical systems.
△ Less
Submitted 9 May, 2021; v1 submitted 28 April, 2021;
originally announced May 2021.
-
High order, semi-implicit, energy stable schemes for gradient flows
Authors:
Alexander Zaitzeff,
Selim Esedoglu,
Krishna Garikipati
Abstract:
We introduce a class of high order accurate, semi-implicit Runge-Kutta schemes in the general setting of evolution equations that arise as gradient flow for a cost function, possibly with respect to an inner product that depends on the solution, and we establish their energy stability. This class includes as a special case high order, unconditionally stable schemes obtained via convexity splitting…
▽ More
We introduce a class of high order accurate, semi-implicit Runge-Kutta schemes in the general setting of evolution equations that arise as gradient flow for a cost function, possibly with respect to an inner product that depends on the solution, and we establish their energy stability. This class includes as a special case high order, unconditionally stable schemes obtained via convexity splitting. The new schemes are demonstrated on a variety of gradient flows, including partial differential equations that are gradient flow with respect to the Wasserstein (mass transport) distance.
△ Less
Submitted 23 July, 2020;
originally announced July 2020.
-
Variational system identification of the partial differential equations governing microstructure evolution in materials: Inference over sparse and spatially unrelated data
Authors:
Z. Wang,
X. Huan,
K. Garikipati
Abstract:
Pattern formation is a widely observed phenomenon in diverse fields including materials physics, developmental biology and ecology, among many others. The physics underlying the patterns is specific to the mechanisms, and is encoded by partial differential equations (PDEs). With the aim of discovering hidden physics, we have previously presented a variational approach to identifying such systems o…
▽ More
Pattern formation is a widely observed phenomenon in diverse fields including materials physics, developmental biology and ecology, among many others. The physics underlying the patterns is specific to the mechanisms, and is encoded by partial differential equations (PDEs). With the aim of discovering hidden physics, we have previously presented a variational approach to identifying such systems of PDEs in the face of noisy data at varying fidelities (Computer Methods in Applied Mechanics and Engineering, 353:201-216, 2019). Here, we extend our variational system identification methods to address the challenges presented by image data on microstructures in materials physics. PDEs are formally posed as initial and boundary value problems over combinations of time intervals and spatial domains whose evolution is either fixed or can be tracked. However, the vast majority of microscopy techniques for evolving microstructure in a given material system deliver micrographs of pattern evolution over domains that bear no relation with each other at different time instants. The temporal resolution can rarely capture the fastest time scales that dominate the early dynamics, and noise abounds. Furthermore, data for evolution of the same phenomenon in a material system may well be obtained from different physical specimens. Against this backdrop of spatially unrelated, sparse and multi-source data, we exploit the variational framework to make judicious choices of weighting functions and identify PDE operators from the dynamics. A consistency condition arises for parsimonious inference of a minimal set of the spatial operators at steady state. It is complemented by a confirmation test that provides a sharp condition for acceptance of the inferred operators. The entire framework is demonstrated on synthetic data that reflect the characteristics of the experimental material microscopy images.
△ Less
Submitted 29 January, 2021; v1 submitted 11 January, 2020;
originally announced January 2020.
-
Second Order Threshold Dynamics Schemes for Two Phase Motion by Mean Curvature
Authors:
Alexander Zaitzeff,
Selim Esedoglu,
Krishna Garikipati
Abstract:
The threshold dynamics algorithm of Merriman, Bence, and Osher is only first order accurate in the two-phase setting. Its accuracy degrades further to half order in the multi-phase setting, a shortcoming it has in common with other related, more recent algorithms such as the equal surface tension version of the Voronoi implicit interface method. As a first, rigorous step in addressing this shortco…
▽ More
The threshold dynamics algorithm of Merriman, Bence, and Osher is only first order accurate in the two-phase setting. Its accuracy degrades further to half order in the multi-phase setting, a shortcoming it has in common with other related, more recent algorithms such as the equal surface tension version of the Voronoi implicit interface method. As a first, rigorous step in addressing this shortcoming, we present two different second order accurate versions of two-phase threshold dynamics. Unlike in previous efforts in this direction, we present careful consistency calculations for both of our algorithms. The first algorithm is consistent with its limit (motion by mean curvature) up to second order in any space dimension. The second achieves second order accuracy only in dimension two, but comes with a rigorous stability guarantee (unconditional energy stability) in any dimension -- a first for high order schemes of its type.
△ Less
Submitted 12 November, 2019;
originally announced November 2019.
-
Variational Extrapolation of Implicit Schemes for General Gradient Flows
Authors:
Alexander Zaitzeff,
Selim Esedoglu,
Krishna Garikipati
Abstract:
We introduce a class of unconditionally energy stable, high order accurate schemes for gradient flows in a very general setting. The new schemes are a high order analogue of the minimizing movements approach for generating a time discrete approximation to a gradient flow by solving a sequence of optimization problems. In particular, each step entails minimizing the associated energy of the gradien…
▽ More
We introduce a class of unconditionally energy stable, high order accurate schemes for gradient flows in a very general setting. The new schemes are a high order analogue of the minimizing movements approach for generating a time discrete approximation to a gradient flow by solving a sequence of optimization problems. In particular, each step entails minimizing the associated energy of the gradient flow plus a movement limiter term that is, in the classical context of steepest descent with respect to an inner product, simply quadratic. A variety of existing unconditionally stable numerical methods can be recognized as (typically just first order accurate in time) minimizing movement schemes for their associated evolution equations, already requiring the optimization of the energy plus a quadratic term at every time step. Therefore, our approach gives a painless way to extend these to high order accurate in time schemes while maintaining their unconditional stability. In this sense, it can be viewed as a variational analogue of Richardson extrapolation.
△ Less
Submitted 10 February, 2020; v1 submitted 27 August, 2019;
originally announced August 2019.
-
On the Voronoi Implicit Interface Method
Authors:
Alexander Zaitzeff,
Selim Esedoglu,
Krishna Garikipati
Abstract:
We present careful numerical convergence studies, using parameterized curves to reach very high resolutions in two dimensions, of a level set method for multiphase curvature motion known as the Voronoi implicit interface method. Our tests demonstrate that in the unequal, additive surface tension case, the Voronoi implicit interface method does not converge to the desired limit. We then present a v…
▽ More
We present careful numerical convergence studies, using parameterized curves to reach very high resolutions in two dimensions, of a level set method for multiphase curvature motion known as the Voronoi implicit interface method. Our tests demonstrate that in the unequal, additive surface tension case, the Voronoi implicit interface method does not converge to the desired limit. We then present a variant that maintains the spirit of the original algorithm, and appears to fix the non-convergence. As a bonus, the new variant extends the Voronoi implicit interface method to unequal mobilities.
△ Less
Submitted 21 May, 2019; v1 submitted 25 October, 2018;
originally announced October 2018.
-
Unconditionally stable, second-order schemes for gradient-regularized, non-convex, finite-strain elasticity modeling martensitic phase transformations
Authors:
Koki Sagiyama,
Krishna Garikipati
Abstract:
In the setting of continuum elasticity martensitic phase transformations are characterized by a non-convex free energy density function that possesses multiple wells in strain space and includes higher-order gradient terms for regularization. Metastable martensitic microstructures, defined as solutions that are local minimizers of the total free energy, are of interest and are obtained as steady s…
▽ More
In the setting of continuum elasticity martensitic phase transformations are characterized by a non-convex free energy density function that possesses multiple wells in strain space and includes higher-order gradient terms for regularization. Metastable martensitic microstructures, defined as solutions that are local minimizers of the total free energy, are of interest and are obtained as steady state solutions to the resulting transient formulation of Toupin's gradient elasticity at finite strain. This type of problem poses several numerical challenges including stiffness, the need for fine discretization to resolve microsstructures, and following solution branches. Stable and accurate time-integration schemes are essential to obtain meaningful solutions at reasonable computational cost. In this work we introduce two classes of unconditionally stable second-order time-integration schemes for gradient elasticity, each having relative advantages over the other. Numerical examples are shown highlighting these features.
△ Less
Submitted 20 April, 2018; v1 submitted 11 September, 2017;
originally announced September 2017.
-
A numerical study of branching and stability of solutions to three-dimensional martensitic phase transformations using gradient-regularized, non-convex, finite strain elasticity
Authors:
Koki Sagiyama,
Shiva Rudraraju,
Krishna Garikipati
Abstract:
In the setting of continuum elasticity, phase transformations involving martensitic variants are modeled by a free energy density function that is non-convex in strain space. Here, we adopt an existing mathematical model in which we regularize the non-convex free energy density function by higher-order gradient terms at finite strain and derive boundary value problems via the standard variational…
▽ More
In the setting of continuum elasticity, phase transformations involving martensitic variants are modeled by a free energy density function that is non-convex in strain space. Here, we adopt an existing mathematical model in which we regularize the non-convex free energy density function by higher-order gradient terms at finite strain and derive boundary value problems via the standard variational argument applied to the corresponding total free energy, inspired by Toupin's theory of gradient elasticity. These gradient terms are to preclude existence of arbitrarily fine microstructures, while still allowing for existence of multiple solution branches corresponding to local minima of the total free energy; these are classified as metastable solution branches. The goal of this work is to solve the boundary value problem numerically in three dimensions, observe solution branches, and assess stability of each branch by numerically evaluating the second variation of the total free energy. We also study how these microstructures evolve as the length-scale parameter, the coefficient of the strain gradient terms in the free energy, approaches zero.
△ Less
Submitted 20 April, 2018; v1 submitted 17 January, 2017;
originally announced January 2017.
-
A discontinuous Galerkin formulation for a strain gradient-dependent damage model
Authors:
G. N. Wells,
K. Garikipati,
L. Molari
Abstract:
The numerical solution of strain gradient-dependent continuum problems has been dogged by continuity demands on the basis functions. For most commonly accepted models, solutions using the finite element method demand $C^{1}$ continuity of the shape functions. Here, recent development in discontinuous Galerkin methods are explored and exploited for the solution of a prototype nonlinear strain gra…
▽ More
The numerical solution of strain gradient-dependent continuum problems has been dogged by continuity demands on the basis functions. For most commonly accepted models, solutions using the finite element method demand $C^{1}$ continuity of the shape functions. Here, recent development in discontinuous Galerkin methods are explored and exploited for the solution of a prototype nonlinear strain gradient dependent continuum model. A formulation is developed that allows the rigorous solution of a strain gradient damage model using standard $C^{0}$ shape functions. The formulation is tested in one-dimension for the simplest possible finite element formulation: piecewise linear displacement and constant (on elements) internal variable. Numerical results are shown to compare excellently with a benchmark solution. The results are remarkable given the simplicity of the proposed formulation.
△ Less
Submitted 1 December, 2003; v1 submitted 28 November, 2003;
originally announced December 2003.
