-
Contactless Precision Steering of Particles in a Fluid inside a Cube with Rotating Walls
Authors:
Lucas Amoudruz,
Petr Karnakov,
Petros Koumoutsakos
Abstract:
Contactless manipulation of small objects is essential for biomedical and chemical applications, such as cell analysis, assisted fertilisation, and precision chemistry. Established methods, including optical, acoustic, and magnetic tweezers, are now complemented by flow control techniques that use flow-induced motion to enable precise and versatile manipulation. However, trapping multiple particle…
▽ More
Contactless manipulation of small objects is essential for biomedical and chemical applications, such as cell analysis, assisted fertilisation, and precision chemistry. Established methods, including optical, acoustic, and magnetic tweezers, are now complemented by flow control techniques that use flow-induced motion to enable precise and versatile manipulation. However, trapping multiple particles in fluid remains a challenge. This study introduces a novel control algorithm capable of steering multiple particles in flow. The system uses rotating disks to generate flow fields that transport particles to precise locations. Disk rotations are governed by a feedback control policy based on the Optimising a Discrete Loss (ODIL) framework, which combines fluid dynamics equations with path objectives into a single loss function. Our experiments, conducted in both simulations and with the physical device, demonstrate the capability of the approach to transport two beads simultaneously to predefined locations, advancing robust contactless particle manipulation for biomedical applications.
△ Less
Submitted 18 June, 2025;
originally announced June 2025.
-
Optimal Navigation in Microfluidics via the Optimization of a Discrete Loss
Authors:
Petr Karnakov,
Lucas Amoudruz,
Petros Koumoutsakos
Abstract:
Optimal path planning and control of microscopic devices navigating in fluid environments is essential for applications ranging from targeted drug delivery to environmental monitoring. These tasks are challenging due to the complexity of microdevice-flow interactions. We introduce a closed-loop control method that optimizes a discrete loss (ODIL) in terms of dynamics and path objectives. In compar…
▽ More
Optimal path planning and control of microscopic devices navigating in fluid environments is essential for applications ranging from targeted drug delivery to environmental monitoring. These tasks are challenging due to the complexity of microdevice-flow interactions. We introduce a closed-loop control method that optimizes a discrete loss (ODIL) in terms of dynamics and path objectives. In comparison with reinforcement learning, ODIL is more robust, up to three orders faster, and excels in high-dimensional action/state spaces, making it a powerful tool for navigating complex flow environments.
△ Less
Submitted 18 June, 2025;
originally announced June 2025.
-
Reinforcement Learning Closures for Underresolved Partial Differential Equations using Synthetic Data
Authors:
Lothar Heimbach,
Sebastian Kaltenbach,
Petr Karnakov,
Francis J. Alexander,
Petros Koumoutsakos
Abstract:
Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications remains prohibitively expensive because of the necessity of resolving a broad range of spatiotemporal scales. In turn, practitioners often rely on coarse-grained app…
▽ More
Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications remains prohibitively expensive because of the necessity of resolving a broad range of spatiotemporal scales. In turn, practitioners often rely on coarse-grained approximations of the original PDEs, trading off accuracy for reduced computational resources. To mitigate the loss of detail inherent in such approximations, closure models are employed to represent unresolved spatiotemporal interactions. We present a framework for developing closure models for PDEs using synthetic data acquired through the method of manufactured solutions. These data are used in conjunction with reinforcement learning to provide closures for coarse-grained PDEs. We illustrate the efficacy of our method using the one-dimensional and two-dimensional Burgers' equations and the two-dimensional advection equation. Moreover, we demonstrate that closure models trained for inhomogeneous PDEs can be effectively generalized to homogeneous PDEs. The results demonstrate the potential for developing accurate and computationally efficient closure models for systems with scarce data.
△ Less
Submitted 16 May, 2025;
originally announced May 2025.
-
Physics-Regularized Multi-Modal Image Assimilation for Brain Tumor Localization
Authors:
Michal Balcerak,
Tamaz Amiranashvili,
Andreas Wagner,
Jonas Weidner,
Petr Karnakov,
Johannes C. Paetzold,
Ivan Ezhov,
Petros Koumoutsakos,
Benedikt Wiestler,
Bjoern Menze
Abstract:
Physical models in the form of partial differential equations serve as important priors for many under-constrained problems. One such application is tumor treatment planning, which relies on accurately estimating the spatial distribution of tumor cells within a patient's anatomy. While medical imaging can detect the bulk of a tumor, it cannot capture the full extent of its spread, as low-concentra…
▽ More
Physical models in the form of partial differential equations serve as important priors for many under-constrained problems. One such application is tumor treatment planning, which relies on accurately estimating the spatial distribution of tumor cells within a patient's anatomy. While medical imaging can detect the bulk of a tumor, it cannot capture the full extent of its spread, as low-concentration tumor cells often remain undetectable, particularly in glioblastoma, the most common primary brain tumor. Machine learning approaches struggle to estimate the complete tumor cell distribution due to a lack of appropriate training data. Consequently, most existing methods rely on physics-based simulations to generate anatomically and physiologically plausible estimations. However, these approaches face challenges with complex and unknown initial conditions and are constrained by overly rigid physical models. In this work, we introduce a novel method that integrates data-driven and physics-based cost functions, akin to Physics-Informed Neural Networks (PINNs). However, our approach parametrizes the solution directly on a dynamic discrete mesh, allowing for the effective modeling of complex biomechanical behaviors. Specifically, we propose a unique discretization scheme that quantifies how well the learned spatiotemporal distributions of tumor and brain tissues adhere to their respective growth and elasticity equations. This quantification acts as a regularization term, offering greater flexibility and improved integration of patient data compared to existing models. We demonstrate enhanced coverage of tumor recurrence areas using real-world data from a patient cohort, highlighting the potential of our method to improve model-driven treatment planning for glioblastoma in clinical practice.
△ Less
Submitted 30 October, 2024; v1 submitted 30 September, 2024;
originally announced September 2024.
-
Data-driven shape inference in three-dimensional steady state supersonic flows using ODIL and JAX-Fluids
Authors:
Aaron B. Buhendwa,
Deniz A. Bezgin,
Petr Karnakov,
Nikolaus A. Adams,
Petros Koumoutsakos
Abstract:
We present a novel data- and first-principles-driven method for inferring the shape of a solid obstacle and its flow field in three-dimensional steady-state supersonic flows. The method combines the Optimizing a Discrete Loss (ODIL) technique with the automatically differentiable JAX-Fluids CFD solver to jointly reconstruct flow fields and obstacle shapes. ODIL minimizes the discrete residual of t…
▽ More
We present a novel data- and first-principles-driven method for inferring the shape of a solid obstacle and its flow field in three-dimensional steady-state supersonic flows. The method combines the Optimizing a Discrete Loss (ODIL) technique with the automatically differentiable JAX-Fluids CFD solver to jointly reconstruct flow fields and obstacle shapes. ODIL minimizes the discrete residual of the governing PDE via gradient descent-based algorithms and inherits the consistency and stability of the chosen numerical discretization. Discrete residuals and their gradients are computed using JAX-Fluids, which features nonlinear shock-capturing schemes and level-set-based immersed solid boundaries. We validate our method on synthetic data for challenging inverse problems, including shape inference of solid obstacles in 3D steady-state supersonic flows. In particular, we study flow around a cylinder, sphere, and ellipse. Two shape representations are investigated: (1) parametric, where the shape is described by a small set of parameters (e.g., radius of the cylinder or sphere) optimized jointly with the flow field, and (2) free-form, where the level-set function is optimized pointwise over the mesh without predefined shapes. For the parametric case, we provide a detailed comparison with Physics-Informed Neural Networks. We demonstrate that the combination of nonlinear shock-capturing discretization and level-set-based interface representation enables accurate inference of obstacle shapes and flow fields via the ODIL method. This approach opens new avenues for solving complex inverse problems in supersonic aerodynamics.
△ Less
Submitted 18 June, 2025; v1 submitted 19 August, 2024;
originally announced August 2024.
-
Individualizing Glioma Radiotherapy Planning by Optimization of Data and Physics-Informed Discrete Loss
Authors:
Michal Balcerak,
Jonas Weidner,
Petr Karnakov,
Ivan Ezhov,
Sergey Litvinov,
Petros Koumoutsakos,
Ray Zirui Zhang,
John S. Lowengrub,
Bene Wiestler,
Bjoern Menze
Abstract:
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to…
▽ More
Brain tumor growth is unique to each glioma patient and extends beyond what is visible in imaging scans, infiltrating surrounding brain tissue. Understanding these hidden patient-specific progressions is essential for effective therapies. Current treatment plans for brain tumors, such as radiotherapy, typically involve delineating a uniform margin around the visible tumor on pre-treatment scans to target this invisible tumor growth. This "one size fits all" approach is derived from population studies and often fails to account for the nuances of individual patient conditions. We present the GliODIL framework, which infers the full spatial distribution of tumor cell concentration from available multi-modal imaging, leveraging a Fisher-Kolmogorov type physics model to describe tumor growth. This is achieved through the newly introduced method of Optimizing the Discrete Loss (ODIL), where both data and physics-based constraints are softly assimilated into the solution. Our test dataset comprises 152 glioblastoma patients with pre-treatment imaging and post-treatment follow-ups for tumor recurrence monitoring. By blending data-driven techniques with physics-based constraints, GliODIL enhances recurrence prediction in radiotherapy planning, challenging traditional uniform margins and strict adherence to the Fisher-Kolmogorov partial differential equation (PDE) model, which is adapted for complex cases.
△ Less
Submitted 14 April, 2024; v1 submitted 8 December, 2023;
originally announced December 2023.
-
Flow reconstruction by multiresolution optimization of a discrete loss with automatic differentiation
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We inco…
▽ More
We present a potent computational method for the solution of inverse problems in fluid mechanics. We consider inverse problems formulated in terms of a deterministic loss function that can accommodate data and regularization terms. We introduce a multigrid decomposition technique that accelerates the convergence of gradient-based methods for optimization problems with parameters on a grid. We incorporate this multigrid technique to the ODIL (Optimizing a DIscrete Loss) framework. The multiresolution ODIL (mODIL) accelerates by an order of magnitude the original formalism and improves the avoidance of local minima. Moreover, mODIL accommodates the use of automatic differentiation for calculating the gradients of the loss function, thus facilitating the implementation of the framework. We demonstrate the capabilities of mODIL on a variety of inverse and flow reconstruction problems: solution reconstruction for the Burgers equation, inferring conductivity from temperature measurements, and inferring the body shape from wake velocity measurements in three dimensions. We also provide a comparative study with the related, popular Physics-Informed Neural Networks (PINNs) method. We demonstrate that mODIL has three to five orders of magnitude lower computational cost than PINNs in benchmark problems including simple PDEs and lid-driven cavity problems. Our results suggest that mODIL is a very potent, fast and consistent method for solving inverse problems in fluid mechanics.
△ Less
Submitted 24 July, 2023; v1 submitted 8 March, 2023;
originally announced March 2023.
-
Optimizing a DIscrete Loss (ODIL) to solve forward and inverse problems for partial differential equations using machine learning tools
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where n…
▽ More
We introduce the Optimizing a Discrete Loss (ODIL) framework for the numerical solution of Partial Differential Equations (PDE) using machine learning tools. The framework formulates numerical methods as a minimization of discrete residuals that are solved using gradient descent and Newton's methods. We demonstrate the value of this approach on equations that may have missing parameters or where no sufficient data is available to form a well-posed initial-value problem. The framework is presented for mesh based discretizations of PDEs and inherits their accuracy, convergence, and conservation properties. It preserves the sparsity of the solutions and is readily applicable to inverse and ill-posed problems. It is applied to PDE-constrained optimization, optical flow, system identification, and data assimilation using gradient descent algorithms including those often deployed in machine learning. We compare ODIL with related approach that represents the solution with neural networks. We compare the two methodologies and demonstrate advantages of ODIL that include significantly higher convergence rates and several orders of magnitude lower computational cost. We evaluate the method on various linear and nonlinear partial differential equations including the Navier-Stokes equations for flow reconstruction problems.
△ Less
Submitted 9 May, 2022;
originally announced May 2022.
-
Computing foaming flows across scales: from breaking waves to microfluidics
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage…
▽ More
Crashing ocean waves, cappuccino froths and microfluidic bubble crystals are examples of foamy flows. Foamy flows are critical in numerous natural and industrial processes and remain notoriously difficult to compute as they involve coupled, multiscale physical processes. Computations need to resolve the interactions of the bubbles with the fluid and complex boundaries, while capturing the drainage and rupture of the microscopic liquid films at their interface. We present a novel multilayer simulation framework (Multi-VOF) that advances the state of the art in simulation capabilities of foamy flows. The framework introduces a novel scheme for the distinct handling of multiple neighboring bubbles and a new regularization method that produces sharp interfaces and removes spurious fragments. Multi-VOF is verified and validated with experimental results and complemented with open source, efficient scalable software. We demonstrate capturing of bubble crystalline structures in realistic microfluidics devices and foamy flows involving tens of thousands of bubbles in a waterfall. The present multilayer framework extends the classical volume-of-fluid methodology and allows for unprecedented large scale, predictive simulations of flows with multiple interfaces.
△ Less
Submitted 2 March, 2021;
originally announced March 2021.
-
Korali: Efficient and Scalable Software Framework for Bayesian Uncertainty Quantification and Stochastic Optimization
Authors:
Sergio M. Martin,
Daniel Wälchli,
Georgios Arampatzis,
Athena E. Economides,
Petr Karnakov,
Petros Koumoutsakos
Abstract:
We present Korali, an open-source framework for large-scale Bayesian uncertainty quantification and stochastic optimization. The framework relies on non-intrusive sampling of complex multiphysics models and enables their exploitation for optimization and decision-making. In addition, its distributed sampling engine makes efficient use of massively-parallel architectures while introducing novel fau…
▽ More
We present Korali, an open-source framework for large-scale Bayesian uncertainty quantification and stochastic optimization. The framework relies on non-intrusive sampling of complex multiphysics models and enables their exploitation for optimization and decision-making. In addition, its distributed sampling engine makes efficient use of massively-parallel architectures while introducing novel fault tolerance and load balancing mechanisms. We demonstrate these features by interfacing Korali with existing high-performance software such as Aphros, Lammps (CPU-based), and Mirheo (GPU-based) and show efficient scaling for up to 512 nodes of the CSCS Piz Daint supercomputer. Finally, we present benchmarks demonstrating that Korali outperforms related state-of-the-art software frameworks.
△ Less
Submitted 11 March, 2021; v1 submitted 27 May, 2020;
originally announced May 2020.
-
Bubbles in Turbulent Flows: Data-driven, kinematic models with memory terms
Authors:
Zhong Yi Wan,
Petr Karnakov,
Petros Koumoutsakos,
Themistoklis P. Sapsis
Abstract:
We present data driven kinematic models for the motion of bubbles in high-Re turbulent fluid flows based on recurrent neural networks with long-short term memory enhancements. The models extend empirical relations, such as Maxey-Riley (MR) and its variants, whose applicability is limited when either the bubble size is large or the flow is very complex. The recurrent neural networks are trained on…
▽ More
We present data driven kinematic models for the motion of bubbles in high-Re turbulent fluid flows based on recurrent neural networks with long-short term memory enhancements. The models extend empirical relations, such as Maxey-Riley (MR) and its variants, whose applicability is limited when either the bubble size is large or the flow is very complex. The recurrent neural networks are trained on the trajectories of bubbles obtained by Direct Numerical Simulations (DNS) of the Navier Stokes equations for a two-component incompressible flow model. Long short term memory components exploit the time history of the flow field that the bubbles have encountered along their trajectories and the networks are further augmented by imposing rotational invariance to their structure. We first train and validate the formulated model using DNS data for a turbulent Taylor-Green vortex. Then we examine the model predictive capabilities and its generalization to Reynolds numbers that are different from those of the training data on benchmark problems, including a steady (Hill's spherical vortex) and an unsteady (Gaussian vortex ring) flow field. We find that the predictions of the developed model are significantly improved compared with those obtained by the MR equation. Our results indicate that data-driven models with history terms are well suited in capturing the trajectories of bubbles in turbulent flows.
△ Less
Submitted 4 October, 2019;
originally announced October 2019.
-
A hybrid particle volume-of-fluid method for curvature estimation in multiphase flows
Authors:
Petr Karnakov,
Sergey Litvinov,
Petros Koumoutsakos
Abstract:
We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the inte…
▽ More
We present a particle method for estimating the curvature of interfaces in volume-of-fluid simulations of multiphase flows. The method is well suited for under-resolved interfaces, and it is shown to be more accurate than the parabolic fitting that is employed in such cases. The curvature is computed from the equilibrium positions of particles constrained to circular arcs and attracted to the interface. The proposed particle method is combined with the method of height functions at higher resolutions, and it is shown to outperform the current combinations of height functions and parabolic fitting. The algorithm is conceptually simple and straightforward to implement on new and existing software frameworks for multiphase flow simulations thus enhancing their capabilities in challenging flow problems. We evaluate the proposed hybrid method on a number of two- and three-dimensional benchmark flow problems and illustrate its capabilities on simulations of flows involving bubble coalescence and turbulent multiphase flows.
△ Less
Submitted 22 January, 2020; v1 submitted 1 June, 2019;
originally announced June 2019.
-
A Computational Study of the Collapse of a Cloud with 12500 Gas Bubbles in a Liquid
Authors:
Ursula Rasthofer,
Fabian Wermelinger,
Petr Karnakov,
Jonas Šukys,
Petros Koumoutsakos
Abstract:
We investigate the process of cloud cavitation collapse through large-scale simulation of a cloud composed of 12500 gas bubbles. A finite volume scheme is used on a structured Cartesian grid to solve the Euler equations, and the bubbles are discretized by a diffuse interface method. We investigate the propagation of the collapse wave front through the cloud and provide comparisons to simplified mo…
▽ More
We investigate the process of cloud cavitation collapse through large-scale simulation of a cloud composed of 12500 gas bubbles. A finite volume scheme is used on a structured Cartesian grid to solve the Euler equations, and the bubbles are discretized by a diffuse interface method. We investigate the propagation of the collapse wave front through the cloud and provide comparisons to simplified models. We analyze the flow field to identify each bubble of the cloud and its associated microjet. We find that the oscillation frequency of the bubbles and the velocity magnitude of the microjets depend on the local strength of the collapse wave and hence on the radial position of the bubbles in the cloud. At the same time, the direction of the microjets is influenced by the distribution of the bubbles in its vicinity. Finally, an analysis of the pressure pulse spectrum shows that the pressure pulse rate is well captured by an exponential law.
△ Less
Submitted 30 April, 2018;
originally announced April 2018.
