Medical Image Registration using optimal control of a linear hyperbolic transport equation with a DG discretization
Authors:
Bastian Zapf,
Johannes Haubner,
Lukas Baumgärtner,
Stephan Schmidt
Abstract:
Patient specific brain mesh generation from MRI can be a time consuming task and require manual corrections, e.g., for meshing the ventricular system or defining subdomains. To address this issue, we consider an image registration approach. The idea is to use the registration of an input magnetic resonance image (MRI) to a respective target in order to obtain a new mesh from a template mesh. To ob…
▽ More
Patient specific brain mesh generation from MRI can be a time consuming task and require manual corrections, e.g., for meshing the ventricular system or defining subdomains. To address this issue, we consider an image registration approach. The idea is to use the registration of an input magnetic resonance image (MRI) to a respective target in order to obtain a new mesh from a template mesh. To obtain the transformation, we solve an optimization problem that is constrained by a linear hyperbolic transport equation. We use a higher-order discontinuous Galerkin finite element method for discretization and motivate the numerical upwind scheme and its limitations from the continuous weak space--time formulation of the transport equation. We present a numerical implementation that builds on the finite element packages FEniCS and dolfin-adjoint. To demonstrate the efficacy of the proposed approach, numerical results for the registration of an input to a target MRI of two distinct individuals are presented. Moreover, it is shown that the registration transforms a manually crafted input mesh into a new mesh for the target subject whilst preserving mesh quality. Challenges of the algorithm are discussed.
△ Less
Submitted 9 April, 2024; v1 submitted 4 May, 2023;
originally announced May 2023.
Investigating molecular transport in the human brain from MRI with physics-informed neural networks
Authors:
Bastian Zapf,
Johannes Haubner,
Miroslav Kuchta,
Geir Ringstad,
Per Kristian Eide,
Kent-Andre Mardal
Abstract:
In recent years, a plethora of methods combining deep neural networks and partial differential equations have been developed. A widely known and popular example are physics-informed neural networks. They solve forward and inverse problems involving partial differential equations in terms of a neural network training problem. We apply physics-informed neural networks as well as the finite element m…
▽ More
In recent years, a plethora of methods combining deep neural networks and partial differential equations have been developed. A widely known and popular example are physics-informed neural networks. They solve forward and inverse problems involving partial differential equations in terms of a neural network training problem. We apply physics-informed neural networks as well as the finite element method to estimate the diffusion coefficient governing the long term, i.e. over days, spread of molecules in the human brain from a novel magnetic resonance imaging technique. Synthetic testcases are created to demonstrate that the standard formulation of the physics-informed neural network faces challenges with noisy measurements in our application. Our numerical results demonstrate that the residual of the partial differential equation after training needs to be small in order to obtain accurate recovery of the diffusion coefficient. To achieve this, we apply several strategies such as tuning the weights and the norms used in the loss function as well as residual based adaptive refinement and exchange of residual training points. We find that the diffusion coefficient estimated with PINNs from magnetic resonance images becomes consistent with results from a finite element based approach when the residuum after training becomes small. The observations presented in this work are an important first step towards solving inverse problems on observations from large cohorts of patients in a semi-automated fashion with physics-informed neural networks.
△ Less
Submitted 1 July, 2022; v1 submitted 5 May, 2022;
originally announced May 2022.
