-
Fredholm integral equations for function approximation and the training of neural networks
Authors:
Patrick Gelß,
Aizhan Issagali,
Ralf Kornhuber
Abstract:
We present a novel and mathematically transparent approach to function approximation and the training of large, high-dimensional neural networks, based on the approximate least-squares solution of associated Fredholm integral equations of the first kind by Ritz-Galerkin discretization, Tikhonov regularization and tensor-train methods. Practical application to supervised learning problems of regres…
▽ More
We present a novel and mathematically transparent approach to function approximation and the training of large, high-dimensional neural networks, based on the approximate least-squares solution of associated Fredholm integral equations of the first kind by Ritz-Galerkin discretization, Tikhonov regularization and tensor-train methods. Practical application to supervised learning problems of regression and classification type confirm that the resulting algorithms are competitive with state-of-the-art neural network-based methods.
△ Less
Submitted 16 July, 2024; v1 submitted 9 March, 2023;
originally announced March 2023.
-
Numerical simulation of multiscale fault systems with rate- and state-dependent friction
Authors:
Carsten Gräser,
Ralf Kornhuber,
Joscha Podlesny
Abstract:
We consider the deformation of a geological structure with non-intersecting faults that can be represented by a layered system of viscoelastic bodies satisfying rate- and state-depending friction conditions along the common interfaces. We derive a mathematical model that contains classical Dieterich- and Ruina-type friction as special cases and accounts for possibly large tangential displacements.…
▽ More
We consider the deformation of a geological structure with non-intersecting faults that can be represented by a layered system of viscoelastic bodies satisfying rate- and state-depending friction conditions along the common interfaces. We derive a mathematical model that contains classical Dieterich- and Ruina-type friction as special cases and accounts for possibly large tangential displacements. Semi-discretization in time by a Newmark scheme leads to a coupled system of non-smooth, convex minimization problems for rate and state to be solved in each time step. Additional spatial discretization by a mortar method and piecewise constant finite elements allows for the decoupling of rate and state by a fixed point iteration and efficient algebraic solution of the rate problem by truncated non-smooth Newton methods. Numerical experiments with a spring slider and a layered multiscale system illustrate the behavior of our model as well as the efficiency and reliability of the numerical solver.
△ Less
Submitted 14 January, 2022; v1 submitted 27 October, 2021;
originally announced October 2021.
-
Free energy computation of particles with membrane-mediated interactions via Langevin dynamics
Authors:
Tobias Kies,
Carsten Gräser,
Luigi Delle Site,
Ralf Kornhuber
Abstract:
We apply well-established concepts of Langevin sampling to derive a new class of algorithms for the efficient computation of free energy differences of fluctuating particles embedded in a 'fast' membrane, i.e., a membrane that instantaneously adapts to varying particle positions. A geometric potential accounting for membrane-mediated particle interaction is derived in the framework of variational…
▽ More
We apply well-established concepts of Langevin sampling to derive a new class of algorithms for the efficient computation of free energy differences of fluctuating particles embedded in a 'fast' membrane, i.e., a membrane that instantaneously adapts to varying particle positions. A geometric potential accounting for membrane-mediated particle interaction is derived in the framework of variational hybrid models for particles in membranes. Recent explicit representations of the gradient of the geometric interaction potential allows to apply well-known gradient based Markov Chain Monte-Carlo (MCDC) methods such as Langevin-based sampling.
△ Less
Submitted 30 September, 2020;
originally announced September 2020.
-
Numerical Homogenization of Fractal Interface Problems
Authors:
Ralf Kornhuber,
Joscha Podlesny,
Harry Yserentant
Abstract:
We consider the numerical homogenization of a class of fractal elliptic interface problems inspired by related mechanical contact problems from the geosciences. A particular feature is that the solution space depends on the actual fractal geometry. Our main results concern the construction of projection operators with suitable stability and approximation properties. The existence of such projectio…
▽ More
We consider the numerical homogenization of a class of fractal elliptic interface problems inspired by related mechanical contact problems from the geosciences. A particular feature is that the solution space depends on the actual fractal geometry. Our main results concern the construction of projection operators with suitable stability and approximation properties. The existence of such projections then allows for the application of existing concepts from localized orthogonal decomposition (LOD) and successive subspace correction to construct first multiscale discretizations and iterative algebraic solvers with scale-independent convergence behavior for this class of problems.
△ Less
Submitted 22 July, 2020;
originally announced July 2020.
-
Fractal homogenization of multiscale interface problems
Authors:
Martin Heida,
Ralf Kornhuber,
Joscha Podlesny
Abstract:
Inspired by continuum mechanical contact problems with geological fault networks, we consider elliptic second order differential equations with jump conditions on a sequence of multiscale networks of interfaces with a finite number of non-separating scales. Our aim is to derive and analyze a description of the asymptotic limit of infinitely many scales in order to quantify the effect of resolving…
▽ More
Inspired by continuum mechanical contact problems with geological fault networks, we consider elliptic second order differential equations with jump conditions on a sequence of multiscale networks of interfaces with a finite number of non-separating scales. Our aim is to derive and analyze a description of the asymptotic limit of infinitely many scales in order to quantify the effect of resolving the network only up to some finite number of interfaces and to consider all further effects as homogeneous. As classical homogenization techniques are not suited for this kind of geometrical setting, we suggest a new concept, called fractal homogenization, to derive and analyze an asymptotic limit problem from a corresponding sequence of finite-scale interface problems. We provide an intuitive characterization of the corresponding fractal solution space in terms of generalized jumps and gradients together with continuous embeddings into L2 and Hs, s<1/2. We show existence and uniqueness of the solution of the asymptotic limit problem and exponential convergence of the approximating finite-scale solutions. Computational experiments involving a related numerical homogenization technique illustrate our theoretical findings.
△ Less
Submitted 27 September, 2019; v1 submitted 4 December, 2017;
originally announced December 2017.
-
A globally convergent filter-trust-region method for large deformation contact problems
Authors:
Jonathan Youett,
Oliver Sander,
Ralf Kornhuber
Abstract:
We present a globally convergent method for the solution of frictionless large deformation contact problems for hyperelastic materials. The discretisation uses the mortar method which is known to be more stable than node-to-segment approaches. The resulting non-convex constrained minimisation problems are solved using a filter-trust-region scheme, and we prove global convergence towards first-orde…
▽ More
We present a globally convergent method for the solution of frictionless large deformation contact problems for hyperelastic materials. The discretisation uses the mortar method which is known to be more stable than node-to-segment approaches. The resulting non-convex constrained minimisation problems are solved using a filter-trust-region scheme, and we prove global convergence towards first-order optimal points. The constrained Newton problems are solved robustly and efficiently using a Truncated Non-smooth Newton Multigrid (TNNMG) method with a Monotone Multigrid (MMG) linear correction step. For this we introduce a cheap basis transformation that decouples the contact constraints. Numerical experiments confirm the stability and efficiency of our approach.
△ Less
Submitted 4 August, 2017;
originally announced August 2017.
-
Evolving surface finite element methods for random advection-diffusion equations
Authors:
Ana Djurdjevac,
Charles M. Elliott,
Ralf Kornhuber,
Thomas Ranner
Abstract:
In this paper, we introduce and analyse a surface finite element discretization of advection-diffusion equations with uncertain coefficients on evolving hypersurfaces. After stating unique solvability of the resulting semi-discrete problem, we prove optimal error bounds for the semi-discrete solution and Monte Carlo samplings of its expectation in appropriate Bochner spaces. Our theoretical findin…
▽ More
In this paper, we introduce and analyse a surface finite element discretization of advection-diffusion equations with uncertain coefficients on evolving hypersurfaces. After stating unique solvability of the resulting semi-discrete problem, we prove optimal error bounds for the semi-discrete solution and Monte Carlo samplings of its expectation in appropriate Bochner spaces. Our theoretical findings are illustrated by numerical experiments in two and three space dimensions.
△ Less
Submitted 25 September, 2017; v1 submitted 23 February, 2017;
originally announced February 2017.
-
Adaptive Multilevel Monte Carlo Methods for Stochastic Variational Inequalities
Authors:
Ralf Kornhuber,
Evgenia Youett
Abstract:
While multilevel Monte Carlo (MLMC) methods for the numerical approximation of partial differential equations with random coefficients enjoy great popularity, combinations with spatial adaptivity seem to be rare. We present an adaptive MLMC finite element approach based on deterministic adaptive mesh refinement for the arising "pathwise" problems and outline a convergence theory in terms of desire…
▽ More
While multilevel Monte Carlo (MLMC) methods for the numerical approximation of partial differential equations with random coefficients enjoy great popularity, combinations with spatial adaptivity seem to be rare. We present an adaptive MLMC finite element approach based on deterministic adaptive mesh refinement for the arising "pathwise" problems and outline a convergence theory in terms of desired accuracy and required computational cost. Our theoretical and heuristic reasoning together with the efficiency of our new approach are confirmed by numerical experiments.
△ Less
Submitted 19 December, 2017; v1 submitted 18 November, 2016;
originally announced November 2016.
-
An analysis of a class of variational multiscale methods based on subspace decomposition
Authors:
Ralf Kornhuber,
Daniel Peterseim,
Harry Yserentant
Abstract:
Numerical homogenization tries to approximate the solutions of elliptic partial differential equations with strongly oscillating coefficients by functions from modified finite element spaces. We present in this paper a class of such methods that are very closely related to the method of Målqvist and Peterseim [Math. Comp. 83, 2014]. Like the method of Målqvist and Peterseim, these methods do not m…
▽ More
Numerical homogenization tries to approximate the solutions of elliptic partial differential equations with strongly oscillating coefficients by functions from modified finite element spaces. We present in this paper a class of such methods that are very closely related to the method of Målqvist and Peterseim [Math. Comp. 83, 2014]. Like the method of Målqvist and Peterseim, these methods do not make explicit or implicit use of a scale separation. Their compared to that in the work of Målqvist and Peterseim strongly simplified analysis is based on a reformulation of their method in terms of variational multiscale methods and on the theory of iterative methods, more precisely, of additive Schwarz or subspace decomposition methods.
△ Less
Submitted 21 January, 2018; v1 submitted 14 August, 2016;
originally announced August 2016.
-
Numerical approximation of multi-phase Penrose-Fife systems
Authors:
Carsten Gräser,
Max Kahnt,
Ralf Kornhuber
Abstract:
We consider a non-isothermal multi-phase field model. We subsequently discretize implicitly in time and with linear finite elements. The arising algebraic problem is formulated in two variables where one is the multi-phase field, and the other contains the inverse temperature field. We solve this saddle point problem numerically by a non-smooth Schur-Newton approach using truncated non-smooth Newt…
▽ More
We consider a non-isothermal multi-phase field model. We subsequently discretize implicitly in time and with linear finite elements. The arising algebraic problem is formulated in two variables where one is the multi-phase field, and the other contains the inverse temperature field. We solve this saddle point problem numerically by a non-smooth Schur-Newton approach using truncated non-smooth Newton multigrid methods. An application in grain growth as occurring in liquid phase crystallization of silicon is considered.
△ Less
Submitted 12 May, 2016;
originally announced May 2016.
-
A Variational Approach to Particles in Lipid Membranes
Authors:
Charles M. Elliott,
Carsten Gräser,
Graham Hobbs,
Ralf Kornhuber,
Maren-Wanda Wolf
Abstract:
A variety of models for the membrane-mediated interaction of particles in lipid membranes, mostly well-established in theoretical physics, is reviewed from a mathematical perspective. We provide mathematically consistent formulations in a variational framework, relate apparently different modelling approaches in terms of successive approximation, and investigate existence and uniqueness. Numerical…
▽ More
A variety of models for the membrane-mediated interaction of particles in lipid membranes, mostly well-established in theoretical physics, is reviewed from a mathematical perspective. We provide mathematically consistent formulations in a variational framework, relate apparently different modelling approaches in terms of successive approximation, and investigate existence and uniqueness. Numerical computations illustrate that the new variational formulations are directly accessible to effective numerical methods.
△ Less
Submitted 3 May, 2016; v1 submitted 8 December, 2015;
originally announced December 2015.