-
Push-Forward Signed Distance Functions enable interpretable and robust continuous shape quantification
Authors:
Roua Rouatbi,
Juan Esteban Suarez,
Ivo F. Sbalzarini
Abstract:
We introduce the Push-Forward Signed Distance Morphometric (PF-SDM), a novel method for shape quantification in biomedical imaging that is continuous, interpretable, and invariant to shape-preserving transformations. PF-SDM effectively captures the geometric properties of shapes, including their topological skeletons and radial symmetries. This results in a robust and interpretable shape descripto…
▽ More
We introduce the Push-Forward Signed Distance Morphometric (PF-SDM), a novel method for shape quantification in biomedical imaging that is continuous, interpretable, and invariant to shape-preserving transformations. PF-SDM effectively captures the geometric properties of shapes, including their topological skeletons and radial symmetries. This results in a robust and interpretable shape descriptor that generalizes to capture temporal shape dynamics. Importantly, PF-SDM avoids certain issues of previous geometric morphometrics, like Elliptical Fourier Analysis and Generalized Procrustes Analysis, such as coefficient correlations and landmark choices. We present the PF-SDM theory, provide a practically computable algorithm, and benchmark it on synthetic data.
△ Less
Submitted 28 October, 2024;
originally announced October 2024.
-
Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks
Authors:
Suryanarayana Maddu,
Dominik Sturm,
Christian L. Müller,
Ivo F. Sbalzarini
Abstract:
We characterize and remedy a failure mode that may arise from multi-scale dynamics with scale imbalances during training of deep neural networks, such as Physics Informed Neural Networks (PINNs). PINNs are popular machine-learning templates that allow for seamless integration of physical equation models with data. Their training amounts to solving an optimization problem over a weighted sum of dat…
▽ More
We characterize and remedy a failure mode that may arise from multi-scale dynamics with scale imbalances during training of deep neural networks, such as Physics Informed Neural Networks (PINNs). PINNs are popular machine-learning templates that allow for seamless integration of physical equation models with data. Their training amounts to solving an optimization problem over a weighted sum of data-fidelity and equation-fidelity objectives. Conflicts between objectives can arise from scale imbalances, heteroscedasticity in the data, stiffness of the physical equation, or from catastrophic interference during sequential training. We explain the training pathology arising from this and propose a simple yet effective inverse-Dirichlet weighting strategy to alleviate the issue. We compare with Sobolev training of neural networks, providing the baseline of analytically $\boldsymbolε$-optimal training. We demonstrate the effectiveness of inverse-Dirichlet weighting in various applications, including a multi-scale model of active turbulence, where we show orders of magnitude improvement in accuracy and convergence over conventional PINN training. For inverse modeling using sequential training, we find that inverse-Dirichlet weighting protects a PINN against catastrophic forgetting.
△ Less
Submitted 2 July, 2021;
originally announced July 2021.
-
Letter to the Editor and Comments on: Intravital dynamic and correlative imaging reveals diffusion-dominated canalicular and flow-augmented ductular bile flux
Authors:
Lutz Brusch,
Yannis Kalaidzidis,
Kirstin Meyer,
Ivo F. Sbalzarini,
Marino Zerial
Abstract:
Bile, the central metabolic product of the liver, is secreted by hepatocytes into bile canaliculi (BC), tubular subcellular structures of 0.5-2 $μ$m diameter which are formed by the apical membranes of juxtaposed hepatocytes. BC interconnect to build a highly ramified 3D network that collects and transports bile towards larger interlobular bile ducts (IBD). The transport mechanism of bile is of fu…
▽ More
Bile, the central metabolic product of the liver, is secreted by hepatocytes into bile canaliculi (BC), tubular subcellular structures of 0.5-2 $μ$m diameter which are formed by the apical membranes of juxtaposed hepatocytes. BC interconnect to build a highly ramified 3D network that collects and transports bile towards larger interlobular bile ducts (IBD). The transport mechanism of bile is of fundamental interest and the current text-book model of "osmotic canalicular bile flow", i.e. enforced by osmotic water influx, has recently been quantitatively verified based on flux measurements and BC contractility (Meyer et al., 2017) but challenged in the article entitled "Intravital dynamic and correlative imaging reveals diffusion-dominated canalicular and flow-augmented ductular bile flux" (Vartak et al., 2020). We feel compelled to share a series of arguments that question the key conclusions of this study (Vartak et al., 2020), particularly because it risks to be misinterpreted and misleading for the field in view of potential clinical applications. We summarized the arguments in the following 8 points.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
Learning physically consistent mathematical models from data using group sparsity
Authors:
Suryanarayana Maddu,
Bevan L. Cheeseman,
Christian L. Müller,
Ivo F. Sbalzarini
Abstract:
We propose a statistical learning framework based on group-sparse regression that can be used to 1) enforce conservation laws, 2) ensure model equivalence, and 3) guarantee symmetries when learning or inferring differential-equation models from measurement data. Directly learning $\textit{interpretable}$ mathematical models from data has emerged as a valuable modeling approach. However, in areas l…
▽ More
We propose a statistical learning framework based on group-sparse regression that can be used to 1) enforce conservation laws, 2) ensure model equivalence, and 3) guarantee symmetries when learning or inferring differential-equation models from measurement data. Directly learning $\textit{interpretable}$ mathematical models from data has emerged as a valuable modeling approach. However, in areas like biology, high noise levels, sensor-induced correlations, and strong inter-system variability can render data-driven models nonsensical or physically inconsistent without additional constraints on the model structure. Hence, it is important to leverage $\textit{prior}$ knowledge from physical principles to learn "biologically plausible and physically consistent" models rather than models that simply fit the data best. We present a novel group Iterative Hard Thresholding (gIHT) algorithm and use stability selection to infer physically consistent models with minimal parameter tuning. We show several applications from systems biology that demonstrate the benefits of enforcing $\textit{priors}$ in data-driven modeling.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
A minimal model for spontaneous cell polarization and edge activity in oscillating, rotating and migrating cells
Authors:
Franck Raynaud,
Mark E. Ambuhl,
Chiara Gabella,
Alicia Bornert,
Ivo F. Sbalzarini,
Jean-Jacques Meister,
Alexander B. Verkhovsky
Abstract:
How the cells break symmetry and organize their edge activity to move directionally is a fun- damental question in cell biology. Physical models of cell motility commonly rely on gradients of regulatory factors and/or feedback from the motion itself to describe polarization of edge activity. Theses approaches, however, fail to explain cell behavior prior to the onset of polarization. Our analysis…
▽ More
How the cells break symmetry and organize their edge activity to move directionally is a fun- damental question in cell biology. Physical models of cell motility commonly rely on gradients of regulatory factors and/or feedback from the motion itself to describe polarization of edge activity. Theses approaches, however, fail to explain cell behavior prior to the onset of polarization. Our analysis using the model system of polarizing and moving fish epidermal keratocytes suggests a novel and simple principle of self-organization of cell activity in which local cell-edge dynamics depends on the distance from the cell center, but not on the orientation with respect to the front-back axis. We validate this principle with a stochastic model that faithfully reproduces a range of cell-migration behaviors. Our findings indicate that spontaneous polarization, persistent motion, and cell shape are emergent properties of the local cell-edge dynamics controlled by the distance from the cell center.
△ Less
Submitted 28 September, 2016;
originally announced September 2016.
-
A Method for Modeling Growth of Organs and Transplants Based on the General Growth Law: Application to the Liver in Dogs and Humans
Authors:
Yuri K. Shestopaloff,
Ivo F. Sbalzarini
Abstract:
Understanding biological phenomena requires a systemic approach that incorporates different mechanisms acting on different spatial and temporal scales, since in organisms the workings of all components, such as organelles, cells, and organs interrelate. This inherent interdependency between diverse biological mechanisms, both on the same and on different scales, provides the functioning of an orga…
▽ More
Understanding biological phenomena requires a systemic approach that incorporates different mechanisms acting on different spatial and temporal scales, since in organisms the workings of all components, such as organelles, cells, and organs interrelate. This inherent interdependency between diverse biological mechanisms, both on the same and on different scales, provides the functioning of an organism capable of maintaining homeostasis and physiological stability through numerous feedback loops. Thus, developing models of organisms and their constituents should be done within the overall systemic context of the studied phenomena. We introduce such a method for modeling growth and regeneration of livers at the organ scale, considering it a part of the overall multi-scale biochemical and biophysical processes of an organism. Our method is based on the earlier discovered general growth law, postulating that any biological growth process comprises a uniquely defined distribution of nutritional resources between maintenance needs and biomass production. Based on this law, we introduce a liver growth model that allows to accurately predicting the growth of liver transplants in dogs and liver grafts in humans. Using this model, we find quantitative growth characteristics, such as the time point when the transition period after surgery is over and the liver resumes normal growth, rates at which hepatocytes are involved in proliferation, etc. We then use the model to determine and quantify otherwise unobservable metabolic properties of livers.
△ Less
Submitted 9 September, 2015;
originally announced September 2015.
-
Particle methods enable fast and simple approximation of Sobolev gradients in image segmentation
Authors:
Ivo F. Sbalzarini,
Sophie Schneider,
Janick Cardinale
Abstract:
Bio-image analysis is challenging due to inhomogeneous intensity distributions and high levels of noise in the images. Bayesian inference provides a principled way for regularizing the problem using prior knowledge. A fundamental choice is how one measures "distances" between shapes in an image. It has been shown that the straightforward geometric L2 distance is degenerate and leads to pathologica…
▽ More
Bio-image analysis is challenging due to inhomogeneous intensity distributions and high levels of noise in the images. Bayesian inference provides a principled way for regularizing the problem using prior knowledge. A fundamental choice is how one measures "distances" between shapes in an image. It has been shown that the straightforward geometric L2 distance is degenerate and leads to pathological situations. This is avoided when using Sobolev gradients, rendering the segmentation problem less ill-posed. The high computational cost and implementation overhead of Sobolev gradients, however, have hampered practical applications. We show how particle methods as applied to image segmentation allow for a simple and computationally efficient implementation of Sobolev gradients. We show that the evaluation of Sobolev gradients amounts to particle-particle interactions along the contour in an image. We extend an existing particle-based segmentation algorithm to using Sobolev gradients. Using synthetic and real-world images, we benchmark the results for both 2D and 3D images using piecewise smooth and piecewise constant region models. The present particle approximation of Sobolev gradients is 2.8 to 10 times faster than the previous reference implementation, but retains the known favorable properties of Sobolev gradients. This speedup is achieved by using local particle-particle interactions instead of solving a global Poisson equation at each iteration. The computational time per iteration is higher for Sobolev gradients than for L2 gradients. Since Sobolev gradients precondition the optimization problem, however, a smaller number of overall iterations may be necessary for the algorithm to converge, which can in some cases amortize the higher per-iteration cost.
△ Less
Submitted 2 March, 2014;
originally announced March 2014.
-
Global parameter identification of stochastic reaction networks from single trajectories
Authors:
Christian L. Muller,
Rajesh Ramaswamy,
Ivo F. Sbalzarini
Abstract:
We consider the problem of inferring the unknown parameters of a stochastic biochemical network model from a single measured time-course of the concentration of some of the involved species. Such measurements are available, e.g., from live-cell fluorescence microscopy in image-based systems biology. In addition, fluctuation time-courses from, e.g., fluorescence correlation spectroscopy provide add…
▽ More
We consider the problem of inferring the unknown parameters of a stochastic biochemical network model from a single measured time-course of the concentration of some of the involved species. Such measurements are available, e.g., from live-cell fluorescence microscopy in image-based systems biology. In addition, fluctuation time-courses from, e.g., fluorescence correlation spectroscopy provide additional information about the system dynamics that can be used to more robustly infer parameters than when considering only mean concentrations. Estimating model parameters from a single experimental trajectory enables single-cell measurements and quantification of cell--cell variability. We propose a novel combination of an adaptive Monte Carlo sampler, called Gaussian Adaptation, and efficient exact stochastic simulation algorithms that allows parameter identification from single stochastic trajectories. We benchmark the proposed method on a linear and a non-linear reaction network at steady state and during transient phases. In addition, we demonstrate that the present method also provides an ellipsoidal volume estimate of the viable part of parameter space and is able to estimate the physical volume of the compartment in which the observed reactions take place.
△ Less
Submitted 21 November, 2011;
originally announced November 2011.
-
A new class of highly efficient exact stochastic simulation algorithms for chemical reaction networks
Authors:
Rajesh Ramaswamy,
Nélido González-Segredo,
Ivo F. Sbalzarini
Abstract:
We introduce an alternative formulation of the exact stochastic simulation algorithm (SSA) for sampling trajectories of the chemical master equation for a well-stirred system of coupled chemical reactions. Our formulation is based on factored-out, partial reaction propensities. This novel exact SSA, called the partial propensity direct method (PDM), is highly efficient and has a computational co…
▽ More
We introduce an alternative formulation of the exact stochastic simulation algorithm (SSA) for sampling trajectories of the chemical master equation for a well-stirred system of coupled chemical reactions. Our formulation is based on factored-out, partial reaction propensities. This novel exact SSA, called the partial propensity direct method (PDM), is highly efficient and has a computational cost that scales at most linearly with the number of chemical species, irrespective of the degree of coupling of the reaction network. In addition, we propose a sorting variant, SPDM, which is especially efficient for multiscale reaction networks.
△ Less
Submitted 10 June, 2009;
originally announced June 2009.