-
Individualizing Glioma Radiotherapy Planning by Optimization of Data and Physics-Informed Discrete Loss
Authors:
Michal Balcerak,
Jonas Weidner,
Petr Karnakov,
Ivan Ezhov,
Sergey Litvinov,
Petros Koumoutsakos,
Ray Zirui Zhang,
John S. Lowengrub,
Bene Wiestler,
Bjoern Menze
Abstract:
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to…
▽ More
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to target this invisible tumor growth. This "one size fits all" approach is derived from population studies and often fails to account for the nuances of individual patient conditions. We present the GliODIL framework, which infers the full spatial distribution of tumor cell concentration from available multi-modal imaging, leveraging a Fisher-Kolmogorov type physics model to describe tumor growth. This is achieved through the newly introduced method of Optimizing the Discrete Loss (ODIL), where both data and physics-based constraints are softly assimilated into the solution. Our test dataset comprises 152 glioblastoma patients with pre-treatment imaging and post-treatment follow-ups for tumor recurrence monitoring. By blending data-driven techniques with physics-based constraints, GliODIL enhances recurrence prediction in radiotherapy planning, challenging traditional uniform margins and strict adherence to the Fisher-Kolmogorov partial differential equation (PDE) model, which is adapted for complex cases.
△ Less
Submitted 14 April, 2024; v1 submitted 8 December, 2023;
originally announced December 2023.
-
Flow reconstruction by multiresolution optimization of a discrete loss with automatic differentiation
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We inco…
▽ More
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We incorporate this multigrid technique to the ODIL (Optimizing a DIscrete Loss) framework. The multiresolution ODIL (mODIL) accelerates by an order of magnitude the original formalism and improves the avoidance of local minima. Moreover, mODIL accommodates the use of automatic differentiation for calculating the gradients of the loss function, thus facilitating the implementation of the framework. We demonstrate the capabilities of mODIL on a variety of inverse and flow reconstruction problems: solution reconstruction for the Burgers equation, inferring conductivity from temperature measurements, and inferring the body shape from wake velocity measurements in three dimensions. We also provide a comparative study with the related, popular Physics-Informed Neural Networks (PINNs) method. We demonstrate that mODIL has three to five orders of magnitude lower computational cost than PINNs in benchmark problems including simple PDEs and lid-driven cavity problems. Our results suggest that mODIL is a very potent, fast and consistent method for solving inverse problems in fluid mechanics.
△ Less
Submitted 24 July, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Interpretable reduced-order modeling with time-scale separation
Authors:
Sebastian Kaltenbach,
Phaedon-Stelios Koutsourelakis,
Petros Koumoutsakos
Abstract:
Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction crucial. We propose such a data-driven scheme that automates the identification of the time-scales involved and can produce stable predictions forward in time as wel…
▽ More
Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction crucial. We propose such a data-driven scheme that automates the identification of the time-scales involved and can produce stable predictions forward in time as well as under different initial conditions not included in the training data. To this end, we combine a non-linear autoencoder architecture with a time-continuous model for the latent dynamics in the complex space. It readily allows for the inclusion of sparse and irregularly sampled training data. The learned, latent dynamics are interpretable and reveal the different temporal scales involved. We show that this data-driven scheme can automatically learn the independent processes that decompose a system of linear ODEs along the eigenvectors of the system's matrix. Apart from this, we demonstrate the applicability of the proposed framework in a hidden Markov Model and the (discretized) Kuramoto-Shivashinsky (KS) equation. Additionally, we propose a probabilistic version, which captures predictive uncertainties and further improves upon the results of the deterministic framework.
△ Less
Submitted 3 March, 2023;
originally announced March 2023.
-
Optimizing a DIscrete Loss (ODIL) to solve forward and inverse problems for partial differential equations using machine learning tools
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where n…
▽ More
We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where no sufficient data is available to form a well-posed initial-value problem. The framework is presented for mesh based discretizations of PDEs and inherits their accuracy, convergence, and conservation properties. It preserves the sparsity of the solutions and is readily applicable to inverse and ill-posed problems. It is applied to PDE-constrained optimization, optical flow, system identification, and data assimilation using gradient descent algorithms including those often deployed in machine learning. We compare ODIL with related approach that represents the solution with neural networks. We compare the two methodologies and demonstrate advantages of ODIL that include significantly higher convergence rates and several orders of magnitude lower computational cost. We evaluate the method on various linear and nonlinear partial differential equations including the Navier-Stokes equations for flow reconstruction problems.
△ Less
Submitted 9 May, 2022;
originally announced May 2022.
-
Remember and Forget Experience Replay for Multi-Agent Reinforcement Learning
Authors:
Pascal Weber,
Daniel Wälchli,
Mustafa Zeqiri,
Petros Koumoutsakos
Abstract:
We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging from the OpenAI Gym to complex fluid flows. In MARL, the dependencies between the agents are included in the state-value estimator and the environment dynamics…
▽ More
We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging from the OpenAI Gym to complex fluid flows. In MARL, the dependencies between the agents are included in the state-value estimator and the environment dynamics are modeled via the importance weights used by ReF-ER. In collaborative environments, we find the best performance when the value is estimated using individual rewards and we ignore the effects of other actions on the transition map. We benchmark the performance of ReF-ER MARL on the Stanford Intelligent Systems Laboratory (SISL) environments. We find that employing a single feed-forward neural network for the policy and the value function in ReF-ER MARL, outperforms state of the art algorithms that rely on complex neural network architectures.
△ Less
Submitted 2 September, 2022; v1 submitted 24 March, 2022;
originally announced March 2022.
-
Computing foaming flows across scales: from breaking waves to microfluidics
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage…
▽ More
Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage and rupture of the microscopic liquid films at their interface. We present a novel multilayer simulation framework (Multi-VOF) that advances the state of the art in simulation capabilities of foamy flows. The framework introduces a novel scheme for the distinct handling of multiple neighboring bubbles and a new regularization method that produces sharp interfaces and removes spurious fragments. Multi-VOF is verified and validated with experimental results and complemented with open source, efficient scalable software. We demonstrate capturing of bubble crystalline structures in realistic microfluidics devices and foamy flows involving tens of thousands of bubbles in a waterfall. The present multilayer framework extends the classical volume-of-fluid methodology and allows for unprecedented large scale, predictive simulations of flows with multiple interfaces.
△ Less
Submitted 2 March, 2021;
originally announced March 2021.
-
A hybrid particle volume-of-fluid method for curvature estimation in multiphase flows
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the inte…
▽ More
We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the interface. The proposed particle method is combined with the method of height functions at higher resolutions, and it is shown to outperform the current combinations of height functions and parabolic fitting. The algorithm is conceptually simple and straightforward to implement on new and existing software frameworks for multiphase flow simulations thus enhancing their capabilities in challenging flow problems. We evaluate the proposed hybrid method on a number of two- and three-dimensional benchmark flow problems and illustrate its capabilities on simulations of flows involving bubble coalescence and turbulent multiphase flows.
△ Less
Submitted 22 January, 2020; v1 submitted 1 June, 2019;
originally announced June 2019.
-
Bending models of lipid bilayer membranes: spontaneous curvature and area-difference elasticity
Authors:
Xin Bian,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We preset a computational study of bending models for the curvature elasticity of lipid bilayer membranes that are relevant for simulations of vesicles and red blood cells. We compute bending energy and forces on triangulated meshes and evaluate and extend four well established schemes for their approximation: Kantor and Nelson 1987, Phys. Rev. A 36, 4020, Jülicher 1996, J. Phys. II France 6, 1797…
▽ More
We preset a computational study of bending models for the curvature elasticity of lipid bilayer membranes that are relevant for simulations of vesicles and red blood cells. We compute bending energy and forces on triangulated meshes and evaluate and extend four well established schemes for their approximation: Kantor and Nelson 1987, Phys. Rev. A 36, 4020, Jülicher 1996, J. Phys. II France 6, 1797, Gompper and Kroll 1996, J. Phys. I France 6, 1305, and Meyer et. al. 2003 in Visualization and Mathematics III, Springer, p35, termed A, B, C, D. We present a comparative study of these four schemes on the minimal bending model and propose extensions for schemes B, C and D. These extensions incorporate the reference state and non-local energy to account for the spontaneous curvature, bilayer coupling, and area-difference elasticity models. Our results indicate that the proposed extensions enhance the models to account for shape transformation including budding/vesiculation as well as for non-axisymmetric shapes. We find that the extended scheme B is superior to the rest in terms of accuracy, and robustness as well as simplicity of implementation. We demonstrate the capabilities of this scheme on several benchmark problems including the budding-vesiculating process and the reproduction of the phase diagram of vesicles.
△ Less
Submitted 1 May, 2019;
originally announced May 2019.
-
$S$-Leaping: An adaptive, accelerated stochastic simulation algorithm, bridging $τ$-leaping and $R$-leaping
Authors:
Jana Lipková,
Georgios Arampatzis,
Philippe Chatelain,
Bjoern Menze,
Petros Koumoutsakos
Abstract:
We propose the $S$-leaping algorithm for the acceleration of Gillespie's stochastic simulation algorithm that combines the advantages of the two main accelerated methods; the $τ$-leaping and $R$-leaping algorithms. These algorithms are known to be efficient under different conditions; the $τ$-leaping is efficient for non-stiff systems or systems with partial equilibrium, while the $R$-leaping perf…
▽ More
We propose the $S$-leaping algorithm for the acceleration of Gillespie's stochastic simulation algorithm that combines the advantages of the two main accelerated methods; the $τ$-leaping and $R$-leaping algorithms. These algorithms are known to be efficient under different conditions; the $τ$-leaping is efficient for non-stiff systems or systems with partial equilibrium, while the $R$-leaping performs better in stiff system thanks to an efficient sampling procedure. However, even a small change in a system's set up can critically affect the nature of the simulated system and thus reduce the efficiency of an accelerated algorithm. The proposed algorithm combines the efficient time step selection from the $τ$-leaping with the effective sampling procedure from the $R$-leaping algorithm. The $S$-leaping is shown to maintain its efficiency under different conditions and in the case of large and stiff systems or systems with fast dynamics, the $S$-leaping outperforms both methods. We demonstrate the performance and the accuracy of the $S$-leaping in comparison with the $τ$-leaping and $R$-leaping on a number of benchmark systems involving biological reaction networks.
△ Less
Submitted 29 June, 2018; v1 submitted 1 February, 2018;
originally announced February 2018.
-
Optimal fidelity multi-level Monte Carlo for quantification of uncertainty in simulations of cloud cavitation collapse
Authors:
Jonas Šukys,
Ursula Rasthofer,
Fabian Wermelinger,
Panagiotis Hadjidoukas,
Petros Koumoutsakos
Abstract:
We quantify uncertainties in the location and magnitude of extreme pressure spots revealed from large scale multi-phase flow simulations of cloud cavitation collapse. We examine clouds containing 500 cavities and quantify uncertainties related to their initial spatial arrangement. The resulting 2000-dimensional space is sampled using a non-intrusive and computationally efficient Multi-Level Monte…
▽ More
We quantify uncertainties in the location and magnitude of extreme pressure spots revealed from large scale multi-phase flow simulations of cloud cavitation collapse. We examine clouds containing 500 cavities and quantify uncertainties related to their initial spatial arrangement. The resulting 2000-dimensional space is sampled using a non-intrusive and computationally efficient Multi-Level Monte Carlo (MLMC) methodology. We introduce novel optimal control variate coefficients to enhance the variance reduction in MLMC. The proposed optimal fidelity MLMC leads to more than two orders of magnitude speedup when compared to standard Monte Carlo methods. We identify large uncertainties in the location and magnitude of the peak pressure pulse and present its statistical correlations and joint probability density functions with the geometrical characteristics of the cloud. Characteristic properties of spatial cloud structure are identified as potential causes of significant uncertainties in exerted collapse pressures.
△ Less
Submitted 11 May, 2017;
originally announced May 2017.
-
Langevin Diffusion for Population Based Sampling with an Application in Bayesian Inference for Pharmacodynamics
Authors:
Georgios Arampatzis,
Daniel Wälchli,
Panagiotis Angelikopoulos,
Stephen Wu,
Panagiotis Hadjidoukas,
Petros Koumoutsakos
Abstract:
We propose an algorithm for the efficient and robust sampling of the posterior probability distribution in Bayesian inference problems. The algorithm combines the local search capabilities of the Manifold Metropolis Adjusted Langevin transition kernels with the advantages of global exploration by a population based sampling algorithm, the Transitional Markov Chain Monte Carlo (TMCMC). The Langevin…
▽ More
We propose an algorithm for the efficient and robust sampling of the posterior probability distribution in Bayesian inference problems. The algorithm combines the local search capabilities of the Manifold Metropolis Adjusted Langevin transition kernels with the advantages of global exploration by a population based sampling algorithm, the Transitional Markov Chain Monte Carlo (TMCMC). The Langevin diffusion process is determined by either the Hessian or the Fisher Information of the target distribution with appropriate modifications for non positive definiteness. The present methods is shown to be superior over other population based algorithms, in sampling probability distributions for which gradients are available and is shown to handle otherwise unidentifiable models. We demonstrate the capabilities and advantages of the method in computing the posterior distribution of the parameters in a Pharmacodynamics model, for glioma growth and its drug induced inhibition, using clinical data.
△ Less
Submitted 20 March, 2018; v1 submitted 18 October, 2016;
originally announced October 2016.
