-
Discrete-to-continuum limits of semilinear stochastic evolution equations in Banach spaces
Authors:
Yves van Gennip,
Jonas Latz,
Joshua Willems
Abstract:
We study the convergence of semilinear parabolic stochastic evolution equations, posed on a sequence of Banach spaces approximating a limiting space and driven by additive white noise projected onto the former spaces. Under appropriate uniformity and convergence conditions on the linear operators, nonlinear drifts and initial data, we establish convergence of the associated mild solution processes…
▽ More
We study the convergence of semilinear parabolic stochastic evolution equations, posed on a sequence of Banach spaces approximating a limiting space and driven by additive white noise projected onto the former spaces. Under appropriate uniformity and convergence conditions on the linear operators, nonlinear drifts and initial data, we establish convergence of the associated mild solution processes when lifted to a common state space. Our framework is applied to the case where the limiting problem is a stochastic partial differential equation whose linear part is a generalized Whittle-Matérn operator on a manifold $\mathcal{M}$, discretized by a sequence of graphs constructed from a (random) point cloud. In this setting we obtain various discrete-to-continuum convergence results for solutions lifted to $L^q(\mathcal{M})$ for $q \in [2,\infty]$, one of which recovers the $L^\infty$-convergence of a finite-difference discretization of certain (fractional) stochastic Allen-Cahn equations.
△ Less
Submitted 10 June, 2025; v1 submitted 7 April, 2025;
originally announced April 2025.
-
Graph gradient flows : from discrete to continuum
Authors:
Yoshikazu Giga,
Yves van Gennip,
Jun Okamoto
Abstract:
This paper gives a framework to study a continuum limit of a gradient flow on a graph where the number of vertices increases in an appropriate way. As examples we prove the convergence of a discrete total variation flow and a discrete Allen--Cahn flow on discretised tori to their respective continuum limits.
This paper gives a framework to study a continuum limit of a gradient flow on a graph where the number of vertices increases in an appropriate way. As examples we prove the convergence of a discrete total variation flow and a discrete Allen--Cahn flow on discretised tori to their respective continuum limits.
△ Less
Submitted 7 November, 2022;
originally announced November 2022.
-
Classification and image processing with a semi-discrete scheme for fidelity forced Allen--Cahn on graphs
Authors:
Jeremy Budd,
Yves van Gennip,
Jonas Latz
Abstract:
This paper introduces a semi-discrete implicit Euler (SDIE) scheme for the Allen-Cahn equation (ACE) with fidelity forcing on graphs. Bertozzi and Flenner (2012) pioneered the use of this differential equation as a method for graph classification problems, such as semi-supervised learning and image segmentation. In Merkurjev, Kostić, and Bertozzi (2013), a Merriman-Bence-Osher (MBO) scheme with fi…
▽ More
This paper introduces a semi-discrete implicit Euler (SDIE) scheme for the Allen-Cahn equation (ACE) with fidelity forcing on graphs. Bertozzi and Flenner (2012) pioneered the use of this differential equation as a method for graph classification problems, such as semi-supervised learning and image segmentation. In Merkurjev, Kostić, and Bertozzi (2013), a Merriman-Bence-Osher (MBO) scheme with fidelity forcing was used instead, as the MBO scheme is heuristically similar to the ACE. This paper rigorously establishes the graph MBO scheme with fidelity forcing as a special case of an SDIE scheme for the graph ACE with fidelity forcing. This connection requires using the double-obstacle potential in the ACE, as was shown in Budd and Van Gennip (2020) for ACE without fidelity forcing. We also prove that solutions of the SDIE scheme converge to solutions of the graph ACE with fidelity forcing as the SDIE time step tends to zero.
Next, we develop the SDIE scheme as a classification algorithm. We also introduce some innovations into the algorithms for the SDIE and MBO schemes. For large graphs, we use a QR decomposition method to compute an eigendecomposition from a Nyström extension, which outperforms the method used in e.g. Bertozzi and Flenner (2012) in accuracy, stability, and speed. Moreover, we replace the Euler discretisation for the scheme's diffusion step by a computation based on the Strang formula for matrix exponentials. We apply this algorithm to a number of image segmentation problems, and compare the performance of the SDIE and MBO schemes. We find that whilst the general SDIE scheme does not perform better than the MBO special case at this task, our other innovations lead to a significantly better segmentation than that from previous literature. We also empirically quantify the uncertainty that this segmentation inherits from the randomness in the Nyström extension.
△ Less
Submitted 28 November, 2020; v1 submitted 27 October, 2020;
originally announced October 2020.
-
Mass-conserving diffusion-based dynamics on graphs
Authors:
Jeremy Budd,
Yves van Gennip
Abstract:
An emerging technique in image segmentation, semi-supervised learning, and general classification problems concerns the use of phase-separating flows defined on finite graphs. This technique was pioneered in Bertozzi and Flenner (2012), which used the Allen-Cahn flow on a graph, and was then extended in Merkurjev, Kostic and Bertozzi (2013) using instead the Merriman-Bence-Osher (MBO) scheme on a…
▽ More
An emerging technique in image segmentation, semi-supervised learning, and general classification problems concerns the use of phase-separating flows defined on finite graphs. This technique was pioneered in Bertozzi and Flenner (2012), which used the Allen-Cahn flow on a graph, and was then extended in Merkurjev, Kostic and Bertozzi (2013) using instead the Merriman-Bence-Osher (MBO) scheme on a graph. In previous work by the authors, Budd and Van Gennip (2019), we gave a theoretical justification for this use of the MBO scheme in place of Allen-Cahn flow, showing that the MBO scheme is a special case of a "semi-discrete" numerical scheme for Allen-Cahn flow.
In this paper, we extend this earlier work, showing that this link via the semi-discrete scheme is robust to passing to the mass-conserving case. Inspired by Rubinstein and Sternberg (1992), we define a mass-conserving Allen-Cahn equation on a graph. Then, with the help of the tools of convex optimisation, we show that our earlier machinery can be applied to derive the mass-conserving MBO scheme on a graph as a special case of a semi-discrete scheme for mass-conserving Allen-Cahn. We give a theoretical analysis of this flow and scheme, proving various desired properties like existence and uniqueness of the flow and convergence of the scheme, and also show that the semi-discrete scheme yields a choice function for solutions to the mass-conserving MBO scheme. Finally, we exhibit initial work towards extending to the multi-class case, which in future work we seek to connect to recent work on multi-class MBO in Jacobs, Merkurjev and Esedoglu (2018).
△ Less
Submitted 26 May, 2020;
originally announced May 2020.
-
Graph MBO as a semi-discrete implicit Euler scheme for graph Allen-Cahn flow
Authors:
Jeremy Budd,
Yves van Gennip
Abstract:
In recent years there has been an emerging interest in PDE-like flows defined on finite graphs, with applications in clustering and image segmentation. In particular for image segmentation and semi-supervised learning Bertozzi and Flenner (2012) developed an algorithm based on the Allen-Cahn gradient flow of a graph Ginzburg-Landau functional, and Merkurjev, Kostić and Bertozzi (2013) devised a va…
▽ More
In recent years there has been an emerging interest in PDE-like flows defined on finite graphs, with applications in clustering and image segmentation. In particular for image segmentation and semi-supervised learning Bertozzi and Flenner (2012) developed an algorithm based on the Allen-Cahn gradient flow of a graph Ginzburg-Landau functional, and Merkurjev, Kostić and Bertozzi (2013) devised a variant algorithm based instead on graph Merriman-Bence-Osher (MBO) dynamics. This work offers rigorous justification for this use of the MBO scheme in place of Allen-Cahn flow. First, we choose the double-obstacle potential for the Ginzburg-Landau functional, and derive well-posedness and regularity results for the resulting graph Allen-Cahn flow. Next, we exhibit a "semi-discrete" time-discretisation scheme for Allen-Cahn flow of which the MBO scheme is a special case. We investigate the long-time behaviour of this scheme, and prove its convergence to the Allen-Cahn trajectory as the time-step vanishes. Finally, following a question raised by Van Gennip, Guillen, Osting and Bertozzi (2014), we exhibit results towards proving a link between double-obstacle Allen-Cahn flow and mean curvature flow on graphs. We show some promising $Γ$-convergence results, and translate to the graph setting two comparison principles used by Chen and Elliott (1994) to prove the analogous link in the continuum.
△ Less
Submitted 19 October, 2020; v1 submitted 24 July, 2019;
originally announced July 2019.
-
Deep Limits of Residual Neural Networks
Authors:
Matthew Thorpe,
Yves van Gennip
Abstract:
Neural networks have been very successful in many applications; we often, however, lack a theoretical understanding of what the neural networks are actually learning. This problem emerges when trying to generalise to new data sets. The contribution of this paper is to show that, for the residual neural network model, the deep layer limit coincides with a parameter estimation problem for a nonlinea…
▽ More
Neural networks have been very successful in many applications; we often, however, lack a theoretical understanding of what the neural networks are actually learning. This problem emerges when trying to generalise to new data sets. The contribution of this paper is to show that, for the residual neural network model, the deep layer limit coincides with a parameter estimation problem for a nonlinear ordinary differential equation. In particular, whilst it is known that the residual neural network model is a discretisation of an ordinary differential equation, we show convergence in a variational sense. This implies that optimal parameters converge in the deep layer limit. This is a stronger statement than saying for a fixed parameter the residual neural network model converges (the latter does not in general imply the former). Our variational analysis provides a discrete-to-continuum $Γ$-convergence result for the objective function of the residual neural network training step to a variational problem constrained by a system of ordinary differential equations; this rigorously connects the discrete setting to a continuum problem.
△ Less
Submitted 21 November, 2022; v1 submitted 27 October, 2018;
originally announced October 2018.
-
An MBO scheme for minimizing the graph Ohta-Kawasaki functional
Authors:
Yves van Gennip
Abstract:
We study a graph based version of the Ohta-Kawasaki functional, which was originally introduced in a continuum setting to model pattern formation in diblock copolymer melts and has been studied extensively as a paradigmatic example of a variational model for pattern formation.
Graph based problems inspired by partial differential equations (PDEs) and varational methods have been the subject of m…
▽ More
We study a graph based version of the Ohta-Kawasaki functional, which was originally introduced in a continuum setting to model pattern formation in diblock copolymer melts and has been studied extensively as a paradigmatic example of a variational model for pattern formation.
Graph based problems inspired by partial differential equations (PDEs) and varational methods have been the subject of many recent papers in the mathematical literature, because of their applications in areas such as image processing and data classification. This paper extends the area of PDE inspired graph based problems to pattern forming models, while continuing in the tradition of recent papers in the field.
We introduce a mass conserving Merriman-Bence-Osher (MBO) scheme for minimizing the graph Ohta-Kawasaki functional with a mass constraint. We present three main results: (1) the Lyapunov functionals associated with this MBO scheme $Γ$-converge to the Ohta-Kawasaki functional (which includes the standard graph based MBO scheme and total variation as a special case); (2) there is a class of graphs on which the Ohta-Kawasaki MBO scheme corresponds to a standard MBO scheme on a transformed graph and for which generalized comparison principles hold; (3) this MBO scheme allows for the numerical computation of (approximate) minimizers of the graph Ohta-Kawasaki functional with a mass constraint.
△ Less
Submitted 13 November, 2017;
originally announced November 2017.
-
A Max-Cut approximation using a graph based MBO scheme
Authors:
Blaine Keetch,
Yves van Gennip
Abstract:
The Max-Cut problem is a well known combinatorial optimization problem. In this paper we describe a fast approximation method. Given a graph G, we want to find a cut whose size is maximal among all possible cuts. A cut is a partition of the vertex set of G into two disjoint subsets. For an unweighted graph, the size of the cut is the number of edges that have one vertex on either side of the parti…
▽ More
The Max-Cut problem is a well known combinatorial optimization problem. In this paper we describe a fast approximation method. Given a graph G, we want to find a cut whose size is maximal among all possible cuts. A cut is a partition of the vertex set of G into two disjoint subsets. For an unweighted graph, the size of the cut is the number of edges that have one vertex on either side of the partition; we also consider a weighted version of the problem where each edge contributes a nonnegative weight to the cut. We introduce the signless Ginzburg-Landau functional and prove that this functional Gamma-converges to a Max-Cut objective functional. We approximately minimize this functional using a graph based signless Merriman-Bence-Osher scheme, which uses a signless Laplacian. We show experimentally that on some classes of graphs the resulting algorithm produces more accurate maximum cut approximations than the current state-of-the-art approximation algorithm. One of our methods of minimizing the functional results in an algorithm with a time complexity of O(|E|), where |E| is the total number of edges on G.
△ Less
Submitted 18 March, 2019; v1 submitted 7 November, 2017;
originally announced November 2017.
-
Graph clustering, variational image segmentation methods and Hough transform scale detection for object measurement in images
Authors:
Luca Calatroni,
Yves van Gennip,
Carola-Bibiane Schönlieb,
Hannah Rowland,
Arjuna Flenner
Abstract:
We consider the problem of scale detection in images where a region of interest is present together with a measurement tool (e.g. a ruler). For the segmentation part, we focus on the graph based method by Flenner and Bertozzi which reinterprets classical continuous Ginzburg-Landau minimisation models in a totally discrete framework. To overcome the numerical difficulties due to the large size of t…
▽ More
We consider the problem of scale detection in images where a region of interest is present together with a measurement tool (e.g. a ruler). For the segmentation part, we focus on the graph based method by Flenner and Bertozzi which reinterprets classical continuous Ginzburg-Landau minimisation models in a totally discrete framework. To overcome the numerical difficulties due to the large size of the images considered we use matrix completion and splitting techniques. The scale on the measurement tool is detected via a Hough transform based algorithm. The method is then applied to some measurement tasks arising in real-world applications such as zoology, medicine and archaeology.
△ Less
Submitted 23 September, 2016; v1 submitted 27 February, 2016;
originally announced February 2016.
-
A Regularization Approach to Blind Deblurring and Denoising of QR Barcodes
Authors:
Yves van Gennip,
Prashant Athavale,
Jérôme Gilles,
Rustum Choksi
Abstract:
QR bar codes are prototypical images for which part of the image is a priori known (required patterns). Open source bar code readers, such as ZBar, are readily available. We exploit both these facts to provide and assess purely regularization-based methods for blind deblurring of QR bar codes in the presence of noise.
QR bar codes are prototypical images for which part of the image is a priori known (required patterns). Open source bar code readers, such as ZBar, are readily available. We exploit both these facts to provide and assess purely regularization-based methods for blind deblurring of QR bar codes in the presence of noise.
△ Less
Submitted 24 March, 2017; v1 submitted 23 October, 2014;
originally announced October 2014.
-
Mean curvature, threshold dynamics, and phase field theory on finite graphs
Authors:
Yves van Gennip,
Nestor Guillen,
Braxton Osting,
Andrea L. Bertozzi
Abstract:
In the continuum, close connections exist between mean curvature flow, the Allen-Cahn (AC) partial differential equation, and the Merriman-Bence-Osher (MBO) threshold dynamics scheme. Graph analogues of these processes have recently seen a rise in popularity as relaxations of NP-complete combinatorial problems, which demands deeper theoretical underpinnings of the graph processes. The aim of this…
▽ More
In the continuum, close connections exist between mean curvature flow, the Allen-Cahn (AC) partial differential equation, and the Merriman-Bence-Osher (MBO) threshold dynamics scheme. Graph analogues of these processes have recently seen a rise in popularity as relaxations of NP-complete combinatorial problems, which demands deeper theoretical underpinnings of the graph processes. The aim of this paper is to introduce these graph processes in the light of their continuum counterparts, provide some background, prove the first results connecting them, illustrate these processes with examples and identify open questions for future study. We derive a graph curvature from the graph cut function, the natural graph counterpart of total variation (perimeter). This derivation and the resulting curvature definition differ from those in earlier literature, where the continuum mean curvature is simply discretized, and bears many similarities to the continuum nonlocal curvature or nonlocal means formulation. This new graph curvature is not only relevant for graph MBO dynamics, but also appears in the variational formulation of a discrete time graph mean curvature flow. We prove estimates showing that the dynamics are trivial for both MBO and AC evolutions if the parameters (the time-step and diffuse interface scale, respectively) are sufficiently small (a phenomenon known as "freezing" or "pinning") and also that the dynamics for MBO are nontrivial if the time step is large enough. These bounds are in terms of graph quantities such as the spectrum of the graph Laplacian and the graph curvature. Adapting a Lyapunov functional for the continuum MBO scheme to graphs, we prove that the graph MBO scheme converges to a stationary state in a finite number of iterations. Variations on this scheme have recently become popular in the literature as ways to minimize (continuum) nonlocal total variation.
△ Less
Submitted 30 April, 2015; v1 submitted 28 June, 2013;
originally announced July 2013.
-
Gamma-convergence of graph Ginzburg-Landau functionals
Authors:
Yves van Gennip,
Andrea L. Bertozzi
Abstract:
We study Gamma-convergence of graph based Ginzburg-Landau functionals, both the limit for zero diffusive interface parameter epsilon->0 and the limit for infinite nodes in the graph m -> infinity. For general graphs we prove that in the limit epsilon -> 0 the graph cut objective function is recovered. We show that the continuum limit of this objective function on 4-regular graphs is related to the…
▽ More
We study Gamma-convergence of graph based Ginzburg-Landau functionals, both the limit for zero diffusive interface parameter epsilon->0 and the limit for infinite nodes in the graph m -> infinity. For general graphs we prove that in the limit epsilon -> 0 the graph cut objective function is recovered. We show that the continuum limit of this objective function on 4-regular graphs is related to the total variation seminorm and compare it with the limit of the discretized Ginzburg-Landau functional. For both functionals we also study the simultaneous limit epsilon -> 0 and m -> infinity, by expressing epsilon as a power of m and taking m -> infinity. Finally we investigate the continuum limit for a nonlocal means type functional on a completely connected graph.
△ Less
Submitted 3 May, 2018; v1 submitted 23 April, 2012;
originally announced April 2012.
-
Anisotropic Total Variation Regularized L^1-Approximation and Denoising/Deblurring of 2D Bar Codes
Authors:
Rustum Choksi,
Yves van Gennip,
Adam Oberman
Abstract:
We consider variations of the Rudin-Osher-Fatemi functional which are particularly well-suited to denoising and deblurring of 2D bar codes. These functionals consist of an anisotropic total variation favoring rectangles and a fidelity term which measure the L^1 distance to the signal, both with and without the presence of a deconvolution operator. Based upon the existence of a certain associated v…
▽ More
We consider variations of the Rudin-Osher-Fatemi functional which are particularly well-suited to denoising and deblurring of 2D bar codes. These functionals consist of an anisotropic total variation favoring rectangles and a fidelity term which measure the L^1 distance to the signal, both with and without the presence of a deconvolution operator. Based upon the existence of a certain associated vector field, we find necessary and sufficient conditions for a function to be a minimizer. We apply these results to 2D bar codes to find explicit regimes ---in terms of the fidelity parameter and smallest length scale of the bar codes--- for which a perfect bar code is recoverable via minimization of the functionals. Via a discretization reformulated as a linear program, we perform numerical experiments for all functionals demonstrating their denoising and deblurring capabilities.
△ Less
Submitted 29 March, 2017; v1 submitted 6 July, 2010;
originally announced July 2010.
-
Deblurring of One Dimensional Bar Codes via Total Variation Energy Minimisation
Authors:
Rustum Choksi,
Yves van Gennip
Abstract:
Using total variation based energy minimisation we address the recovery of a blurred (convoluted) one dimensional (1D) barcode. We consider functionals defined over all possible barcodes with fidelity to a convoluted signal of a barcode, and regularised by total variation. Our fidelity terms consist of the L^2 distance either directly to the measured signal or preceded by deconvolution. Key length…
▽ More
Using total variation based energy minimisation we address the recovery of a blurred (convoluted) one dimensional (1D) barcode. We consider functionals defined over all possible barcodes with fidelity to a convoluted signal of a barcode, and regularised by total variation. Our fidelity terms consist of the L^2 distance either directly to the measured signal or preceded by deconvolution. Key length scales and parameters are the X-dimension of the underlying barcode, the size of the supports of the convolution and deconvolution kernels, and the fidelity parameter. For all functionals, we establish regimes (sufficient conditions) wherein the underlying barcode is the unique minimiser. We also present some numerical experiments suggesting that these sufficient conditions are not optimal and the energy methods are quite robust for significant blurring.
△ Less
Submitted 9 July, 2010; v1 submitted 13 October, 2009;
originally announced October 2009.
-
The H^{-1}-norm of tubular neighbourhoods of curves
Authors:
Yves van Gennip,
Mark A. Peletier
Abstract:
We study the H^{-1}-norm of the function 1 on tubular neighbourhoods of curves in R^2. We take the limit of small thickness epsilon, and we prove two different asymptotic results. The first is an asymptotic development for a fixed curve in the limit epsilon to 0, containing contributions from the length of the curve (at order epsilon^3), the ends (epsilon^4), and the curvature (epsilon^5).
The…
▽ More
We study the H^{-1}-norm of the function 1 on tubular neighbourhoods of curves in R^2. We take the limit of small thickness epsilon, and we prove two different asymptotic results. The first is an asymptotic development for a fixed curve in the limit epsilon to 0, containing contributions from the length of the curve (at order epsilon^3), the ends (epsilon^4), and the curvature (epsilon^5).
The second result is a Gamma-convergence result, in which the central curve may vary along the sequence epsilon to 0. We prove that a rescaled version of the H^{-1}-norm, which focuses on the epsilon^5 curvature term, Gamma-converges to the L^2-norm of curvature. In addition, sequences along which the rescaled norm is bounded are compact in the W^{1,2} -topology.
Our main tools are the maximum principle for elliptic equations and the use of appropriate trial functions in the variational characterisation of the H^{-1}-norm. For the Gamma-convergence result we use the theory of systems of curves without transverse crossings to handle potential intersections in the limit.
△ Less
Submitted 14 August, 2009; v1 submitted 22 March, 2009;
originally announced March 2009.
-
Stability of monolayers and bilayers in a copolymer-homopolymer blend model
Authors:
Yves van Gennip,
Mark A. Peletier
Abstract:
We study the stability of layered structures in a variational model for diblock copolymer-homopolymer blends. The main step consists of calculating the first and second derivative of a sharp-interface Ohta-Kawasaki energy for straight mono- and bilayers. By developing the interface perturbations in a Fourier series we fully characterise the stability of the structures in terms of the energy para…
▽ More
We study the stability of layered structures in a variational model for diblock copolymer-homopolymer blends. The main step consists of calculating the first and second derivative of a sharp-interface Ohta-Kawasaki energy for straight mono- and bilayers. By developing the interface perturbations in a Fourier series we fully characterise the stability of the structures in terms of the energy parameters.
In the course of our computations we also give the Green's function for the Laplacian on a periodic strip and explain the heuristic method by which we found it.
△ Less
Submitted 7 September, 2009; v1 submitted 17 October, 2007;
originally announced October 2007.
