-
Semi-Implicit Neural Solver for Time-dependent Partial Differential Equations
Authors:
Suprosanna Shit,
Ivan Ezhov,
Leon Mächler,
Abinav R.,
Jana Lipkova,
Johannes C. Paetzold,
Florian Kofler,
Marie Piraud,
Bjoern H. Menze
Abstract:
Fast and accurate solutions of time-dependent partial differential equations (PDEs) are of pivotal interest to many research fields, including physics, engineering, and biology. Generally, implicit/semi-implicit schemes are preferred over explicit ones to improve stability and correctness. However, existing semi-implicit methods are usually iterative and employ a general-purpose solver, which may…
▽ More
Fast and accurate solutions of time-dependent partial differential equations (PDEs) are of pivotal interest to many research fields, including physics, engineering, and biology. Generally, implicit/semi-implicit schemes are preferred over explicit ones to improve stability and correctness. However, existing semi-implicit methods are usually iterative and employ a general-purpose solver, which may be sub-optimal for a specific class of PDEs. In this paper, we propose a neural solver to learn an optimal iterative scheme in a data-driven fashion for any class of PDEs. Specifically, we modify a single iteration of a semi-implicit solver using a deep neural network. We provide theoretical guarantees for the correctness and convergence of neural solvers analogous to conventional iterative solvers. In addition to the commonly used Dirichlet boundary condition, we adopt a diffuse domain approach to incorporate a diverse type of boundary conditions, e.g., Neumann. We show that the proposed neural solver can go beyond linear PDEs and applies to a class of non-linear PDEs, where the non-linear component is non-stiff. We demonstrate the efficacy of our method on 2D and 3D scenarios. To this end, we show how our model generalizes to parameter settings, which are different from training; and achieves faster convergence than semi-implicit schemes.
△ Less
Submitted 3 September, 2021;
originally announced September 2021.
-
Implicit Neural Solver for Time-dependent Linear PDEs with Convergence Guarantee
Authors:
Suprosanna Shit,
Abinav Ravi Venkatakrishnan,
Ivan Ezhov,
Jana Lipkova,
Marie Piraud,
Bjoern Menze
Abstract:
Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for better stability and correctness. The existing implicit schemes are usually iterative and employ a general-purpose solver which may be sub-optimal for a specifi…
▽ More
Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for better stability and correctness. The existing implicit schemes are usually iterative and employ a general-purpose solver which may be sub-optimal for a specific class of PDEs. In this paper, we propose a neural solver to learn an optimal iterative scheme for a class of PDEs, in a data-driven fashion. We attain this objective by modifying an iteration of an existing semi-implicit solver using a deep neural network. Further, we prove theoretically that our approach preserves the correctness and convergence guarantees provided by the existing iterative-solvers. We also demonstrate that our model generalizes to a different parameter setting than the one seen during training and achieves faster convergence compared to the semi-implicit schemes.
△ Less
Submitted 27 November, 2019; v1 submitted 8 October, 2019;
originally announced October 2019.
-
$S$-Leaping: An adaptive, accelerated stochastic simulation algorithm, bridging $τ$-leaping and $R$-leaping
Authors:
Jana Lipková,
Georgios Arampatzis,
Philippe Chatelain,
Bjoern Menze,
Petros Koumoutsakos
Abstract:
We propose the $S$-leaping algorithm for the acceleration of Gillespie's stochastic simulation algorithm that combines the advantages of the two main accelerated methods; the $τ$-leaping and $R$-leaping algorithms. These algorithms are known to be efficient under different conditions; the $τ$-leaping is efficient for non-stiff systems or systems with partial equilibrium, while the $R$-leaping perf…
▽ More
We propose the $S$-leaping algorithm for the acceleration of Gillespie's stochastic simulation algorithm that combines the advantages of the two main accelerated methods; the $τ$-leaping and $R$-leaping algorithms. These algorithms are known to be efficient under different conditions; the $τ$-leaping is efficient for non-stiff systems or systems with partial equilibrium, while the $R$-leaping performs better in stiff system thanks to an efficient sampling procedure. However, even a small change in a system's set up can critically affect the nature of the simulated system and thus reduce the efficiency of an accelerated algorithm. The proposed algorithm combines the efficient time step selection from the $τ$-leaping with the effective sampling procedure from the $R$-leaping algorithm. The $S$-leaping is shown to maintain its efficiency under different conditions and in the case of large and stiff systems or systems with fast dynamics, the $S$-leaping outperforms both methods. We demonstrate the performance and the accuracy of the $S$-leaping in comparison with the $τ$-leaping and $R$-leaping on a number of benchmark systems involving biological reaction networks.
△ Less
Submitted 29 June, 2018; v1 submitted 1 February, 2018;
originally announced February 2018.