-
Towards Universal Mesh Movement Networks
Authors:
Mingrui Zhang,
Chunyang Wang,
Stephan Kramer,
Joseph G. Wallwork,
Siyi Li,
Jiancheng Liu,
Xiang Chen,
Matthew D. Piggott
Abstract:
Solving complex Partial Differential Equations (PDEs) accurately and efficiently is an essential and challenging problem in all scientific and engineering disciplines. Mesh movement methods provide the capability to improve the accuracy of the numerical solution without increasing the overall mesh degree of freedom count. Conventional sophisticated mesh movement methods are extremely expensive and…
▽ More
Solving complex Partial Differential Equations (PDEs) accurately and efficiently is an essential and challenging problem in all scientific and engineering disciplines. Mesh movement methods provide the capability to improve the accuracy of the numerical solution without increasing the overall mesh degree of freedom count. Conventional sophisticated mesh movement methods are extremely expensive and struggle to handle scenarios with complex boundary geometries. However, existing learning-based methods require re-training from scratch given a different PDE type or boundary geometry, which limits their applicability, and also often suffer from robustness issues in the form of inverted elements. In this paper, we introduce the Universal Mesh Movement Network (UM2N), which -- once trained -- can be applied in a non-intrusive, zero-shot manner to move meshes with different size distributions and structures, for solvers applicable to different PDE types and boundary geometries. UM2N consists of a Graph Transformer (GT) encoder for extracting features and a Graph Attention Network (GAT) based decoder for moving the mesh. We evaluate our method on advection and Navier-Stokes based examples, as well as a real-world tsunami simulation case. Our method outperforms existing learning-based mesh movement methods in terms of the benchmarks described above. In comparison to the conventional sophisticated Monge-Ampère PDE-solver based method, our approach not only significantly accelerates mesh movement, but also proves effective in scenarios where the conventional method fails. Our project page is at https://erizmr.github.io/UM2N/.
△ Less
Submitted 2 December, 2024; v1 submitted 29 June, 2024;
originally announced July 2024.
-
E2N: Error Estimation Networks for Goal-Oriented Mesh Adaptation
Authors:
Joseph G. Wallwork,
Jingyi Lu,
Mingrui Zhang,
Matthew D. Piggott
Abstract:
Given a partial differential equation (PDE), goal-oriented error estimation allows us to understand how errors in a diagnostic quantity of interest (QoI), or goal, occur and accumulate in a numerical approximation, for example using the finite element method. By decomposing the error estimates into contributions from individual elements, it is possible to formulate adaptation methods, which modify…
▽ More
Given a partial differential equation (PDE), goal-oriented error estimation allows us to understand how errors in a diagnostic quantity of interest (QoI), or goal, occur and accumulate in a numerical approximation, for example using the finite element method. By decomposing the error estimates into contributions from individual elements, it is possible to formulate adaptation methods, which modify the mesh with the objective of minimising the resulting QoI error. However, the standard error estimate formulation involves the true adjoint solution, which is unknown in practice. As such, it is common practice to approximate it with an 'enriched' approximation (e.g. in a higher order space or on a refined mesh). Doing so generally results in a significant increase in computational cost, which can be a bottleneck compromising the competitiveness of (goal-oriented) adaptive simulations. The central idea of this paper is to develop a "data-driven" goal-oriented mesh adaptation approach through the selective replacement of the expensive error estimation step with an appropriately configured and trained neural network. In doing so, the error estimator may be obtained without even constructing the enriched spaces. An element-by-element construction is employed here, whereby local values of various parameters related to the mesh geometry and underlying problem physics are taken as inputs, and the corresponding contribution to the error estimator is taken as output. We demonstrate that this approach is able to obtain the same accuracy with a reduced computational cost, for adaptive mesh test cases related to flow around tidal turbines, which interact via their downstream wakes, and where the overall power output of the farm is taken as the QoI. Moreover, we demonstrate that the element-by-element approach implies reasonably low training costs.
△ Less
Submitted 22 July, 2022;
originally announced July 2022.
-
Learning to Estimate and Refine Fluid Motion with Physical Dynamics
Authors:
Mingrui Zhang,
Jianhong Wang,
James Tlhomole,
Matthew D. Piggott
Abstract:
Extracting information on fluid motion directly from images is challenging. Fluid flow represents a complex dynamic system governed by the Navier-Stokes equations. General optical flow methods are typically designed for rigid body motion, and thus struggle if applied to fluid motion estimation directly. Further, optical flow methods only focus on two consecutive frames without utilising historical…
▽ More
Extracting information on fluid motion directly from images is challenging. Fluid flow represents a complex dynamic system governed by the Navier-Stokes equations. General optical flow methods are typically designed for rigid body motion, and thus struggle if applied to fluid motion estimation directly. Further, optical flow methods only focus on two consecutive frames without utilising historical temporal information, while the fluid motion (velocity field) can be considered a continuous trajectory constrained by time-dependent partial differential equations (PDEs). This discrepancy has the potential to induce physically inconsistent estimations. Here we propose an unsupervised learning based prediction-correction scheme for fluid flow estimation. An estimate is first given by a PDE-constrained optical flow predictor, which is then refined by a physical based corrector. The proposed approach outperforms optical flow methods and shows competitive results compared to existing supervised learning based methods on a benchmark dataset. Furthermore, the proposed approach can generalize to complex real-world fluid scenarios where ground truth information is effectively unknowable. Finally, experiments demonstrate that the physical corrector can refine flow estimates by mimicking the operator splitting method commonly utilised in fluid dynamical simulation.
△ Less
Submitted 22 June, 2022; v1 submitted 21 June, 2022;
originally announced June 2022.
-
M2N: Mesh Movement Networks for PDE Solvers
Authors:
Wenbin Song,
Mingrui Zhang,
Joseph G. Wallwork,
Junpeng Gao,
Zheng Tian,
Fanglei Sun,
Matthew D. Piggott,
Junqing Chen,
Zuoqiang Shi,
Xiang Chen,
Jun Wang
Abstract:
Mainstream numerical Partial Differential Equation (PDE) solvers require discretizing the physical domain using a mesh. Mesh movement methods aim to improve the accuracy of the numerical solution by increasing mesh resolution where the solution is not well-resolved, whilst reducing unnecessary resolution elsewhere. However, mesh movement methods, such as the Monge-Ampere method, require the soluti…
▽ More
Mainstream numerical Partial Differential Equation (PDE) solvers require discretizing the physical domain using a mesh. Mesh movement methods aim to improve the accuracy of the numerical solution by increasing mesh resolution where the solution is not well-resolved, whilst reducing unnecessary resolution elsewhere. However, mesh movement methods, such as the Monge-Ampere method, require the solution of auxiliary equations, which can be extremely expensive especially when the mesh is adapted frequently. In this paper, we propose to our best knowledge the first learning-based end-to-end mesh movement framework for PDE solvers. Key requirements of learning-based mesh movement methods are alleviating mesh tangling, boundary consistency, and generalization to mesh with different resolutions. To achieve these goals, we introduce the neural spline model and the graph attention network (GAT) into our models respectively. While the Neural-Spline based model provides more flexibility for large deformation, the GAT based model can handle domains with more complicated shapes and is better at performing delicate local deformation. We validate our methods on stationary and time-dependent, linear and non-linear equations, as well as regularly and irregularly shaped domains. Compared to the traditional Monge-Ampere method, our approach can greatly accelerate the mesh adaptation process, whilst achieving comparable numerical error reduction.
△ Less
Submitted 24 April, 2022;
originally announced April 2022.
-
Anisotropic mesh adaptation in Firedrake with PETSc DMPlex
Authors:
Nicolas Barral,
Matthew G. Knepley,
Michael Lange,
Matthew D. Piggott,
Gerard J. Gorman
Abstract:
Despite decades of research in this area, mesh adaptation capabilities are still rarely found in numerical simulation software. We postulate that the primary reason for this is lack of usability. Integrating mesh adaptation into existing software is difficult as non-trivial operators, such as error metrics and interpolation operators, are required, and integrating available adaptive remeshers is n…
▽ More
Despite decades of research in this area, mesh adaptation capabilities are still rarely found in numerical simulation software. We postulate that the primary reason for this is lack of usability. Integrating mesh adaptation into existing software is difficult as non-trivial operators, such as error metrics and interpolation operators, are required, and integrating available adaptive remeshers is not straightforward. Our approach presented here is to first integrate Pragmatic, an anisotropic mesh adaptation library, into DMPlex, a PETSc object that manages unstructured meshes and their interactions with PETSc's solvers and I/O routines. As PETSc is already widely used, this will make anisotropic mesh adaptation available to a much larger community. As a demonstration of this we describe the integration of anisotropic mesh adaptation into Firedrake, an automated Finite Element based system for the portable solution of partial differential equations which already uses PETSc solvers and I/O via DMPlex. We present a proof of concept of this integration with a three-dimensional advection test case.
△ Less
Submitted 31 October, 2016;
originally announced October 2016.
-
On the validity of tidal turbine array configurations obtained from steady-state adjoint optimisation
Authors:
Christian T. Jacobs,
Matthew D. Piggott,
Stephan C. Kramer,
Simon W. Funke
Abstract:
Extracting the optimal amount of power from an array of tidal turbines requires an intricate understanding of tidal dynamics and the effects of turbine placement on the local and regional scale flow. Numerical models have contributed significantly towards this understanding, and more recently, adjoint-based modelling has been employed to optimise the positioning of the turbines in an array in an a…
▽ More
Extracting the optimal amount of power from an array of tidal turbines requires an intricate understanding of tidal dynamics and the effects of turbine placement on the local and regional scale flow. Numerical models have contributed significantly towards this understanding, and more recently, adjoint-based modelling has been employed to optimise the positioning of the turbines in an array in an automated way and improve on simple, regular man-made configurations. Adjoint-based optimisation of high-resolution and ideally 3D transient models is generally a very computationally expensive problem. As a result, existing work on the adjoint optimisation of tidal turbine placement has been mostly limited to steady-state simulations in which very high, non-physical values of the background viscosity are required to ensure that a steady-state solution exists. However, such compromises may affect the reliability of the modelled turbines, their wakes and interactions, and thus bring into question the validity of the computed optimal turbine positions. This work considers a suite of idealised simulations of flow past tidal turbine arrays in a 2D channel. It compares four regular array configurations, detailed by Divett et al. (2013), with the configuration found through adjoint optimisation in a steady-state, high-viscosity setup. The optimised configuration produces considerably more power. The same configurations are then used to produce a suite of transient simulations that do not use constant high-viscosity, and instead use large eddy simulation (LES) to parameterise the resulting turbulent structures. It is shown that the LES simulations produce less power than that predicted by the constant high-viscosity runs. Nevertheless, they still follow the same trends in the power curve throughout time, with optimised layouts continuing to perform significantly better than simplified configurations.
△ Less
Submitted 29 January, 2016;
originally announced January 2016.
-
Design optimisation and resource assessment for tidal-stream renewable energy farms using a new continuous turbine approach
Authors:
Simon W. Funke,
Stephan C. Kramer,
Matthew D. Piggott
Abstract:
This paper presents a new approach for optimising the design of tidal stream turbine farms. In this approach, the turbine farm is represented by a turbine density function that specifies the number of turbines per unit area and an associated continuous locally-enhanced bottom friction field. The farm design question is formulated as a mathematical optimisation problem constrained by the shallow wa…
▽ More
This paper presents a new approach for optimising the design of tidal stream turbine farms. In this approach, the turbine farm is represented by a turbine density function that specifies the number of turbines per unit area and an associated continuous locally-enhanced bottom friction field. The farm design question is formulated as a mathematical optimisation problem constrained by the shallow water equations and solved with efficient, gradient-based optimisation methods. The resulting method is accurate, computationally efficient, allows complex installation constraints, and supports different goal quantities such as to maximise power or profit. The outputs of the optimisation are the optimal number of turbines, their location within the farm, the overall farm profit, the farm's power extraction, and the installation cost. We demonstrate the capabilities of the method on a validated numerical model of the Pentland Firth, Scotland. We optimise the design of four tidal farms simultaneously, as well as individually, and study how farms in close proximity may impact upon one another.
△ Less
Submitted 7 July, 2016; v1 submitted 21 July, 2015;
originally announced July 2015.
-
Hybrid global-local optimisation algorithms for the layout design of tidal turbine arrays
Authors:
George L. Barnett,
Simon W. Funke,
Matthew D. Piggott
Abstract:
Tidal stream power generation represents a promising source of renewable energy. In order to extract an economically useful amount of power, tens to hundreds of tidal turbines need to be placed within an array. The layout of these turbines can have a significant impact on the power extracted and hence on the viability of the site. Funke et al. formulated the question of the best turbine layout as…
▽ More
Tidal stream power generation represents a promising source of renewable energy. In order to extract an economically useful amount of power, tens to hundreds of tidal turbines need to be placed within an array. The layout of these turbines can have a significant impact on the power extracted and hence on the viability of the site. Funke et al. formulated the question of the best turbine layout as an optimisation problem constrained by the shallow water equations and solved it using a local, gradient-based optimisation algorithm. Given the local nature of this approach, the question arises of how optimal the layouts actually are. This becomes particularly important for scenarios with complex bathymetry and layout constraints, both of which typically introduce locally optimal layouts. Optimisation algorithms which find the global optima generally require orders of magnitude more iterations than local optimisation algorithms and are thus infeasible in combination with an expensive flow model. This paper presents an analytical wake model to act as an efficient proxy to the shallow water model. Based upon this, a hybrid global-local two-stage optimisation approach is presented in which turbine layouts are first optimised with the analytical wake model via a global optimisation algorithm, and further optimised with the shallow water model via a local gradient-based optimisation algorithm. This procedure is applied to a number of idealised cases and a more realistic case with complex bathymetry in the Pentland Firth, Scotland. It is shown that in cases where bathymetry is considered, the two-stage optimisation procedure is able to improve the power extracted from the array by as much as 25% compared to local optimisation for idealised scenarios and by as much as 12% for the more realistic Pentland Firth scenario whilst in many cases reducing the overall computation time by approximately 35%.
△ Less
Submitted 9 October, 2014;
originally announced October 2014.
-
Tidal turbine array optimisation using the adjoint approach
Authors:
S. W. Funke,
P. E. Farrell,
M. D. Piggott
Abstract:
Oceanic tides have the potential to yield a vast amount of renewable energy. Tidal stream generators are one of the key technologies for extracting and harnessing this potential. In order to extract an economically useful amount of power, hundreds of tidal turbines must typically be deployed in an array. This naturally leads to the question of how these turbines should be configured to extract the…
▽ More
Oceanic tides have the potential to yield a vast amount of renewable energy. Tidal stream generators are one of the key technologies for extracting and harnessing this potential. In order to extract an economically useful amount of power, hundreds of tidal turbines must typically be deployed in an array. This naturally leads to the question of how these turbines should be configured to extract the maximum possible power: the positioning and the individual tuning of the turbines could significantly influence the extracted power, and hence is of major economic interest. However, manual optimisation is difficult due to legal site constraints, nonlinear interactions of the turbine wakes, and the cubic dependence of the power on the flow speed. The novel contribution of this paper is the formulation of this problem as an optimisation problem constrained by a physical model, which is then solved using an efficient gradient-based optimisation algorithm. In each optimisation iteration, a two-dimensional finite element shallow water model predicts the flow and the performance of the current array configuration. The gradient of the power extracted with respect to the turbine positions and their tuning parameters is then computed in a fraction of the time taken for a flow solution by solving the associated adjoint equations. These equations propagate causality backwards through the computation, from the power extracted back to the turbine positions and the tuning parameters. This yields the gradient at a cost almost independent of the number of turbines, which is crucial for any practical application. The utility of the approach is demonstrated by optimising turbine arrays in four idealised scenarios and a more realistic case with up to 256 turbines in the Inner Sound of the Pentland Firth, Scotland.
△ Less
Submitted 12 October, 2013; v1 submitted 5 April, 2013;
originally announced April 2013.
