-
BayVel: A Bayesian Framework for RNA Velocity Estimation in Single-Cell Transcriptomics
Authors:
Elena Sabbioni,
Enrico Bibbona,
Gianluca Mastrantonio,
Guido Sanguinetti
Abstract:
RNA velocity is a model of gene expression dynamics designed to analyze single-cell RNA sequencing (scRNA-seq) data, and it has recently gained significant attention. However, despite its popularity, the model has raised several concerns, primarily related to three issues: its heavy dependence on data preprocessing, the need for post-processing of the results, and the limitations of the underlying…
▽ More
RNA velocity is a model of gene expression dynamics designed to analyze single-cell RNA sequencing (scRNA-seq) data, and it has recently gained significant attention. However, despite its popularity, the model has raised several concerns, primarily related to three issues: its heavy dependence on data preprocessing, the need for post-processing of the results, and the limitations of the underlying statistical methodology. Current approaches, such as scVelo, suffer from notable statistical shortcomings. These include identifiability problems, reliance on heuristic preprocessing steps, and the absence of uncertainty quantification. To address these limitations, we propose BayVel, a Bayesian hierarchical model that directly models raw count data. BayVel resolves identifiability issues and provides posterior distributions for all parameters, including the RNA velocities themselves, without the need for any post processing. We evaluate BayVel's performance using simulated datasets. While scVelo fails to accurately reconstruct parameters, even when data are simulated directly from the model assumptions, BayVel demonstrates strong accuracy and robustness. This highlights BayVel as a statistically rigorous and reliable framework for studying transcriptional dynamics in the context of RNA velocity modeling. When applied to a real dataset of pancreatic epithelial cells previously analyzed with scVelo, BayVel does not replicate their findings, which appears to be strongly influenced by the postprocessing, supporting concerns raised in other studies about the reliability of scVelo.
△ Less
Submitted 5 May, 2025;
originally announced May 2025.
-
Attacks on Online Learners: a Teacher-Student Analysis
Authors:
Riccardo Giuseppe Margiotta,
Sebastian Goldt,
Guido Sanguinetti
Abstract:
Machine learning models are famously vulnerable to adversarial attacks: small ad-hoc perturbations of the data that can catastrophically alter the model predictions. While a large literature has studied the case of test-time attacks on pre-trained models, the important case of attacks in an online learning setting has received little attention so far. In this work, we use a control-theoretical per…
▽ More
Machine learning models are famously vulnerable to adversarial attacks: small ad-hoc perturbations of the data that can catastrophically alter the model predictions. While a large literature has studied the case of test-time attacks on pre-trained models, the important case of attacks in an online learning setting has received little attention so far. In this work, we use a control-theoretical perspective to study the scenario where an attacker may perturb data labels to manipulate the learning dynamics of an online learner. We perform a theoretical analysis of the problem in a teacher-student setup, considering different attack strategies, and obtaining analytical results for the steady state of simple linear learners. These results enable us to prove that a discontinuous transition in the learner's accuracy occurs when the attack strength exceeds a critical threshold. We then study empirically attacks on learners with complex architectures using real data, confirming the insights of our theoretical analysis. Our findings show that greedy attacks can be extremely efficient, especially when data stream in small batches.
△ Less
Submitted 29 October, 2023; v1 submitted 18 May, 2023;
originally announced May 2023.
-
Resilience of Bayesian Layer-Wise Explanations under Adversarial Attacks
Authors:
Ginevra Carbone,
Guido Sanguinetti,
Luca Bortolussi
Abstract:
We consider the problem of the stability of saliency-based explanations of Neural Network predictions under adversarial attacks in a classification task. Saliency interpretations of deterministic Neural Networks are remarkably brittle even when the attacks fail, i.e. for attacks that do not change the classification label. We empirically show that interpretations provided by Bayesian Neural Networ…
▽ More
We consider the problem of the stability of saliency-based explanations of Neural Network predictions under adversarial attacks in a classification task. Saliency interpretations of deterministic Neural Networks are remarkably brittle even when the attacks fail, i.e. for attacks that do not change the classification label. We empirically show that interpretations provided by Bayesian Neural Networks are considerably more stable under adversarial perturbations of the inputs and even under direct attacks to the explanations. By leveraging recent results, we also provide a theoretical explanation of this result in terms of the geometry of the data manifold. Additionally, we discuss the stability of the interpretations of high level representations of the inputs in the internal layers of a Network. Our results demonstrate that Bayesian methods, in addition to being more robust to adversarial attacks, have the potential to provide more stable and interpretable assessments of Neural Network predictions.
△ Less
Submitted 5 May, 2022; v1 submitted 22 February, 2021;
originally announced February 2021.
-
Systematic errors in estimates of $R_t$ from symptomatic cases in the presence of observation bias
Authors:
Guido Sanguinetti
Abstract:
We consider the problem of estimating the reproduction number $R_t$ of an epidemic for populations where the probability of detection of cases depends on a known covariate. We argue that in such cases the normal empirical estimator can fail when the prevalence of cases among groups changes with time. We propose a Bayesian strategy to resolve the problem, as well as a simple solution in the case of…
▽ More
We consider the problem of estimating the reproduction number $R_t$ of an epidemic for populations where the probability of detection of cases depends on a known covariate. We argue that in such cases the normal empirical estimator can fail when the prevalence of cases among groups changes with time. We propose a Bayesian strategy to resolve the problem, as well as a simple solution in the case of large number of cases. We illustrate the issue and its solution on a simple yet realistic simulation study, and discuss the general relevance of the issue to the current covid19 pandemic.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
Robustness of Bayesian Neural Networks to Gradient-Based Attacks
Authors:
Ginevra Carbone,
Matthew Wicker,
Luca Laurenti,
Andrea Patane,
Luca Bortolussi,
Guido Sanguinetti
Abstract:
Vulnerability to adversarial attacks is one of the principal hurdles to the adoption of deep learning in safety-critical applications. Despite significant efforts, both practical and theoretical, the problem remains open. In this paper, we analyse the geometry of adversarial attacks in the large-data, overparametrized limit for Bayesian Neural Networks (BNNs). We show that, in the limit, vulnerabi…
▽ More
Vulnerability to adversarial attacks is one of the principal hurdles to the adoption of deep learning in safety-critical applications. Despite significant efforts, both practical and theoretical, the problem remains open. In this paper, we analyse the geometry of adversarial attacks in the large-data, overparametrized limit for Bayesian Neural Networks (BNNs). We show that, in the limit, vulnerability to gradient-based attacks arises as a result of degeneracy in the data distribution, i.e., when the data lies on a lower-dimensional submanifold of the ambient space. As a direct consequence, we demonstrate that in the limit BNN posteriors are robust to gradient-based adversarial attacks. Experimental results on the MNIST and Fashion MNIST datasets with BNNs trained with Hamiltonian Monte Carlo and Variational Inference support this line of argument, showing that BNNs can display both high accuracy and robustness to gradient based adversarial attacks.
△ Less
Submitted 24 June, 2020; v1 submitted 11 February, 2020;
originally announced February 2020.
-
Geometric fluid approximation for general continuous-time Markov chains
Authors:
Michalis Michaelides,
Jane Hillston,
Guido Sanguinetti
Abstract:
Fluid approximations have seen great success in approximating the macro-scale behaviour of Markov systems with a large number of discrete states. However, these methods rely on the continuous-time Markov chain (CTMC) having a particular population structure which suggests a natural continuous state-space endowed with a dynamics for the approximating process. We construct here a general method base…
▽ More
Fluid approximations have seen great success in approximating the macro-scale behaviour of Markov systems with a large number of discrete states. However, these methods rely on the continuous-time Markov chain (CTMC) having a particular population structure which suggests a natural continuous state-space endowed with a dynamics for the approximating process. We construct here a general method based on spectral analysis of the transition matrix of the CTMC, without the need for a population structure. Specifically, we use the popular manifold learning method of diffusion maps to analyse the transition matrix as the operator of a hidden continuous process. An embedding of states in a continuous space is recovered, and the space is endowed with a drift vector field inferred via Gaussian process regression. In this manner, we construct an ODE whose solution approximates the evolution of the CTMC mean, mapped onto the continuous space (known as the fluid limit).
△ Less
Submitted 27 October, 2019; v1 submitted 31 January, 2019;
originally announced January 2019.
-
Intrinsic Geometric Vulnerability of High-Dimensional Artificial Intelligence
Authors:
Luca Bortolussi,
Guido Sanguinetti
Abstract:
The success of modern Artificial Intelligence (AI) technologies depends critically on the ability to learn non-linear functional dependencies from large, high dimensional data sets. Despite recent high-profile successes, empirical evidence indicates that the high predictive performance is often paired with low robustness, making AI systems potentially vulnerable to adversarial attacks. In this rep…
▽ More
The success of modern Artificial Intelligence (AI) technologies depends critically on the ability to learn non-linear functional dependencies from large, high dimensional data sets. Despite recent high-profile successes, empirical evidence indicates that the high predictive performance is often paired with low robustness, making AI systems potentially vulnerable to adversarial attacks. In this report, we provide a simple intuitive argument suggesting that high performance and vulnerability are intrinsically coupled, and largely dependent on the geometry of typical, high-dimensional data sets. Our work highlights a major potential pitfall of modern AI systems, and suggests practical research directions to ameliorate the problem.
△ Less
Submitted 24 January, 2019; v1 submitted 8 November, 2018;
originally announced November 2018.
-
Efficient Low-Order Approximation of First-Passage Time Distributions
Authors:
David Schnoerr,
Botond Cseke,
Ramon Grima,
Guido Sanguinetti
Abstract:
We consider the problem of computing first-passage time distributions for reaction processes modelled by master equations. We show that this generally intractable class of problems is equivalent to a sequential Bayesian inference problem for an auxiliary observation process. The solution can be approximated efficiently by solving a closed set of coupled ordinary differential equations (for the low…
▽ More
We consider the problem of computing first-passage time distributions for reaction processes modelled by master equations. We show that this generally intractable class of problems is equivalent to a sequential Bayesian inference problem for an auxiliary observation process. The solution can be approximated efficiently by solving a closed set of coupled ordinary differential equations (for the low-order moments of the process) whose size scales with the number of species. We apply it to an epidemic model and a trimerisation process, and show good agreement with stochastic simulations.
△ Less
Submitted 1 November, 2017; v1 submitted 1 June, 2017;
originally announced June 2017.
-
Approximation and inference methods for stochastic biochemical kinetics - a tutorial review
Authors:
David Schnoerr,
Guido Sanguinetti,
Ramon Grima
Abstract:
Stochastic fluctuations of molecule numbers are ubiquitous in biological systems. Important examples include gene expression and enzymatic processes in living cells. Such systems are typically modelled as chemical reaction networks whose dynamics are governed by the Chemical Master Equation. Despite its simple structure, no analytic solutions to the Chemical Master Equation are known for most syst…
▽ More
Stochastic fluctuations of molecule numbers are ubiquitous in biological systems. Important examples include gene expression and enzymatic processes in living cells. Such systems are typically modelled as chemical reaction networks whose dynamics are governed by the Chemical Master Equation. Despite its simple structure, no analytic solutions to the Chemical Master Equation are known for most systems. Moreover, stochastic simulations are computationally expensive, making systematic analysis and statistical inference a challenging task. Consequently, significant effort has been spent in recent decades on the development of efficient approximation and inference methods. This article gives an introduction to basic modelling concepts as well as an overview of state of the art methods. First, we motivate and introduce deterministic and stochastic methods for modelling chemical networks, and give an overview of simulation and exact solution methods. Next, we discuss several approximation methods, including the chemical Langevin equation, the system size expansion, moment closure approximations, time-scale separation approximations and hybrid methods. We discuss their various properties and review recent advances and remaining challenges for these methods. We present a comparison of several of these methods by means of a numerical case study and highlight some of their respective advantages and disadvantages. Finally, we discuss the problem of inference from experimental data in the Bayesian framework and review recent methods developed the literature. In summary, this review gives a self-contained introduction to modelling, approximations and inference methods for stochastic chemical kinetics.
△ Less
Submitted 12 January, 2017; v1 submitted 23 August, 2016;
originally announced August 2016.
-
Property-driven State-Space Coarsening for Continuous Time Markov Chains
Authors:
Michalis Michaelides,
Dimitrios Milios,
Jane Hillston,
Guido Sanguinetti
Abstract:
Dynamical systems with large state-spaces are often expensive to thoroughly explore experimentally. Coarse-graining methods aim to define simpler systems which are more amenable to analysis and exploration; most current methods, however, focus on a priori state aggregation based on similarities in transition rates, which is not necessarily reflected in similar behaviours at the level of trajectori…
▽ More
Dynamical systems with large state-spaces are often expensive to thoroughly explore experimentally. Coarse-graining methods aim to define simpler systems which are more amenable to analysis and exploration; most current methods, however, focus on a priori state aggregation based on similarities in transition rates, which is not necessarily reflected in similar behaviours at the level of trajectories. We propose a way to coarsen the state-space of a system which optimally preserves the satisfaction of a set of logical specifications about the system's trajectories. Our approach is based on Gaussian Process emulation and Multi-Dimensional Scaling, a dimensionality reduction technique which optimally preserves distances in non-Euclidean spaces. We show how to obtain low-dimensional visualisations of the system's state-space from the perspective of properties' satisfaction, and how to define macro-states which behave coherently with respect to the specifications. Our approach is illustrated on a non-trivial running example, showing promising performance and high computational efficiency.
△ Less
Submitted 29 October, 2016; v1 submitted 3 June, 2016;
originally announced June 2016.
-
Matching models across abstraction levels with Gaussian Processes
Authors:
Giulio Caravagna,
Luca Bortolussi,
Guido Sanguinetti
Abstract:
Biological systems are often modelled at different levels of abstraction depending on the particular aims/resources of a study. Such different models often provide qualitatively concordant predictions over specific parametrisations, but it is generally unclear whether model predictions are quantitatively in agreement, and whether such agreement holds for different parametrisations. Here we present…
▽ More
Biological systems are often modelled at different levels of abstraction depending on the particular aims/resources of a study. Such different models often provide qualitatively concordant predictions over specific parametrisations, but it is generally unclear whether model predictions are quantitatively in agreement, and whether such agreement holds for different parametrisations. Here we present a generally applicable statistical machine learning methodology to automatically reconcile the predictions of different models across abstraction levels. Our approach is based on defining a correction map, a random function which modifies the output of a model in order to match the statistics of the output of a different model of the same system. We use two biological examples to give a proof-of-principle demonstration of the methodology, and discuss its advantages and potential further applications.
△ Less
Submitted 7 May, 2016;
originally announced May 2016.
-
Cox process representation and inference for stochastic reaction-diffusion processes
Authors:
David Schnoerr,
Ramon Grima,
Guido Sanguinetti
Abstract:
Complex behaviour in many systems arises from the stochastic interactions of spatially distributed particles or agents. Stochastic reaction-diffusion processes are widely used to model such behaviour in disciplines ranging from biology to the social sciences, yet they are notoriously difficult to simulate and calibrate to observational data. Here we use ideas from statistical physics and machine l…
▽ More
Complex behaviour in many systems arises from the stochastic interactions of spatially distributed particles or agents. Stochastic reaction-diffusion processes are widely used to model such behaviour in disciplines ranging from biology to the social sciences, yet they are notoriously difficult to simulate and calibrate to observational data. Here we use ideas from statistical physics and machine learning to provide a solution to the inverse problem of learning a stochastic reaction-diffusion process from data. Our solution relies on a non-trivial connection between stochastic reaction-diffusion processes and spatio-temporal Cox processes, a well-studied class of models from computational statistics. This connection leads to an efficient and flexible algorithm for parameter inference and model selection. Our approach shows excellent accuracy on numeric and real data examples from systems biology and epidemiology. Our work provides both insights into spatio-temporal stochastic systems, and a practical solution to a long-standing problem in computational modelling.
△ Less
Submitted 22 August, 2016; v1 submitted 8 January, 2016;
originally announced January 2016.
-
Expectation propagation for continuous time stochastic processes
Authors:
Botond Cseke,
David Schnoerr,
Manfred Opper,
Guido Sanguinetti
Abstract:
We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive approximations to the posterior distributions of single time marginals using variational approximate inference. We then show how the approximation can be extende…
▽ More
We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive approximations to the posterior distributions of single time marginals using variational approximate inference. We then show how the approximation can be extended to a wide class of discrete-state Markov jump pro- cesses by making use of the chemical Langevin equation. Our empirical results show that the proposed method is computationally efficient and provides good approximations for these classes of inverse problems.
△ Less
Submitted 28 June, 2016; v1 submitted 18 December, 2015;
originally announced December 2015.
-
Unbiased Bayesian Inference for Population Markov Jump Processes via Random Truncations
Authors:
Anastasis Georgoulas,
Jane Hillston,
Guido Sanguinetti
Abstract:
We consider continuous time Markovian processes where populations of individual agents interact stochastically according to kinetic rules. Despite the increasing prominence of such models in fields ranging from biology to smart cities, Bayesian inference for such systems remains challenging, as these are continuous time, discrete state systems with potentially infinite state-space. Here we propose…
▽ More
We consider continuous time Markovian processes where populations of individual agents interact stochastically according to kinetic rules. Despite the increasing prominence of such models in fields ranging from biology to smart cities, Bayesian inference for such systems remains challenging, as these are continuous time, discrete state systems with potentially infinite state-space. Here we propose a novel efficient algorithm for joint state / parameter posterior sampling in population Markov Jump processes. We introduce a class of pseudo-marginal sampling algorithms based on a random truncation method which enables a principled treatment of infinite state spaces. Extensive evaluation on a number of benchmark models shows that this approach achieves considerable savings compared to state of the art methods, retaining accuracy and fast convergence. We also present results on a synthetic biology data set showing the potential for practical usefulness of our work.
△ Less
Submitted 13 May, 2016; v1 submitted 28 September, 2015;
originally announced September 2015.
-
A Bayesian approach for structure learning in oscillating regulatory networks
Authors:
D Trejo,
AJ Millar,
G Sanguinetti
Abstract:
Oscillations lie at the core of many biological processes, from the cell cycle, to circadian oscillations and developmental processes. Time-keeping mechanisms are essential to enable organisms to adapt to varying conditions in environmental cycles, from day/night to seasonal. Transcriptional regulatory networks are one of the mechanisms behind these biological oscillations. However, while identify…
▽ More
Oscillations lie at the core of many biological processes, from the cell cycle, to circadian oscillations and developmental processes. Time-keeping mechanisms are essential to enable organisms to adapt to varying conditions in environmental cycles, from day/night to seasonal. Transcriptional regulatory networks are one of the mechanisms behind these biological oscillations. However, while identifying cyclically expressed genes from time series measurements is relatively easy, determining the structure of the interaction network underpinning the oscillation is a far more challenging problem. Here, we explicitly leverage the oscillatory nature of the transcriptional signals and present a method for reconstructing network interactions tailored to this special but important class of genetic circuits. Our method is based on projecting the signal onto a set of oscillatory basis functions using a Discrete Fourier Transform. We build a Bayesian Hierarchical model within a frequency domain linear model in order to enforce sparsity and incorporate prior knowledge about the network structure. Experiments on real and simulated data show that the method can lead to substantial improvements over competing approaches if the oscillatory assumption is met, and remains competitive also in cases it is not.
△ Less
Submitted 24 April, 2015;
originally announced April 2015.
-
Factored expectation propagation for input-output FHMM models in systems biology
Authors:
Botond Cseke,
Guido Sanguinetti
Abstract:
We consider the problem of joint modelling of metabolic signals and gene expression in systems biology applications. We propose an approach based on input-output factorial hidden Markov models and propose a structured variational inference approach to infer the structure and states of the model. We start from the classical free form structured variational mean field approach and use a expectation…
▽ More
We consider the problem of joint modelling of metabolic signals and gene expression in systems biology applications. We propose an approach based on input-output factorial hidden Markov models and propose a structured variational inference approach to infer the structure and states of the model. We start from the classical free form structured variational mean field approach and use a expectation propagation to approximate the expectations needed in the variational loop. We show that this corresponds to a factored expectation constrained approximate inference. We validate our model through extensive simulations and demonstrate its applicability on a real world bacterial data set.
△ Less
Submitted 17 May, 2013;
originally announced May 2013.
-
Sparse Approximate Inference for Spatio-Temporal Point Process Models
Authors:
Botond Cseke,
Andrew Zammit Mangion,
Tom Heskes,
Guido Sanguinetti
Abstract:
Spatio-temporal point process models play a central role in the analysis of spatially distributed systems in several disciplines. Yet, scalable inference remains computa- tionally challenging both due to the high resolution modelling generally required and the analytically intractable likelihood function. Here, we exploit the sparsity structure typical of (spatially) discretised log-Gaussian Cox p…
▽ More
Spatio-temporal point process models play a central role in the analysis of spatially distributed systems in several disciplines. Yet, scalable inference remains computa- tionally challenging both due to the high resolution modelling generally required and the analytically intractable likelihood function. Here, we exploit the sparsity structure typical of (spatially) discretised log-Gaussian Cox process models by using approximate message-passing algorithms. The proposed algorithms scale well with the state dimension and the length of the temporal horizon with moderate loss in distributional accuracy. They hence provide a flexible and faster alternative to both non-linear filtering-smoothing type algorithms and to approaches that implement the Laplace method or expectation propagation on (block) sparse latent Gaussian models. We infer the parameters of the latent Gaussian model using a structured variational Bayes approach. We demonstrate the proposed framework on simulation studies with both Gaussian and point-process observations and use it to reconstruct the conflict intensity and dynamics in Afghanistan from the WikiLeaks Afghan War Diary.
△ Less
Submitted 6 July, 2015; v1 submitted 17 May, 2013;
originally announced May 2013.
