-
Parameter Estimation in ODE Models with Certified Polynomial System Solving
Authors:
Alexander Demin,
Alexey Ovchinnikov,
Fabrice Rouillier
Abstract:
We consider dynamical models given by rational ODE systems. Parameter estimation is an important and challenging task of recovering parameter values from observed data. Recently, a method based on differential algebra and rational interpolation was proposed to express parameter estimation in terms of polynomial system solving. Typically, polynomial system solving is a bottleneck, hence the choice…
▽ More
We consider dynamical models given by rational ODE systems. Parameter estimation is an important and challenging task of recovering parameter values from observed data. Recently, a method based on differential algebra and rational interpolation was proposed to express parameter estimation in terms of polynomial system solving. Typically, polynomial system solving is a bottleneck, hence the choice of the polynomial solver is crucial. In this contribution, we compare two polynomial system solvers applied to parameter estimation: homotopy continuation solver from HomotopyContinuation.jl and our new implementation of a certified solver based on rational univariate representation (RUR) and real root isolation. We show how the new RUR solver can tackle examples that are out of reach for the homotopy methods and vice versa.
△ Less
Submitted 24 April, 2025;
originally announced April 2025.
-
Time-efficient filtering of polarimetric data by checking physical realizability of experimental Mueller matrices
Authors:
Tatiana Novikova,
Alexey Ovchinnikov,
Gleb Pogudin,
Jessica C. Ramella-Roman
Abstract:
Imaging Mueller polarimetry has already proved its potential for metrology, remote sensing and biomedicine. The real-time applications of this modality require both video rate image acquisition and fast data post-processing algorithms. First, one must check the physical realizability of the experimental Mueller matrices in order to filter out non-physical data, i.e. to test the positive semi-defin…
▽ More
Imaging Mueller polarimetry has already proved its potential for metrology, remote sensing and biomedicine. The real-time applications of this modality require both video rate image acquisition and fast data post-processing algorithms. First, one must check the physical realizability of the experimental Mueller matrices in order to filter out non-physical data, i.e. to test the positive semi-definiteness of the 4x4 Hermitian coherency matrix calculated from the elements of the corresponding Mueller matrix pixel-wise. For this purpose, we compared the execution time for the calculations of i) eigenvalues, ii) Cholesky decomposition, iii) Sylvester's criterion, and iv) coefficients of the characteristic polynomial of the Hermitian coherency matrix using two different approaches, all calculated for the experimental Mueller matrix images (600 pixels x 700 pixels) of mouse uterine cervix. The calculations were performed using C++ and Julia programming languages. Our results showed the superiority of the algorithm iv), in particular, the version based on the simplification via Pauli matrices, in terms of execution time for our dataset, over other algorithms. The sequential implementation of the latter algorithm on a single core already satisfies the requirements of real-time polarimetric imaging in various domains. This can be further amplified by the proposed parallelization (for example, we achieve a 5-fold speed up on 6 cores).
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
Algebraic identifiability of partial differential equation models
Authors:
Helen Byrne,
Heather Harrington,
Alexey Ovchinnikov,
Gleb Pogudin,
Hamid Rahkooy,
Pedro Soto
Abstract:
Differential equation models are crucial to scientific processes. The values of model parameters are important for analyzing the behaviour of solutions. A parameter is called globally identifiable if its value can be uniquely determined from the input and output functions. To determine if a parameter estimation problem is well-posed for a given model, one must check if the model parameters are glo…
▽ More
Differential equation models are crucial to scientific processes. The values of model parameters are important for analyzing the behaviour of solutions. A parameter is called globally identifiable if its value can be uniquely determined from the input and output functions. To determine if a parameter estimation problem is well-posed for a given model, one must check if the model parameters are globally identifiable. This problem has been intensively studied for ordinary differential equation models, with theory and several efficient algorithms and software packages developed. A comprehensive theory of algebraic identifiability for PDEs has hitherto not been developed due to the complexity of initial and boundary conditions. Here, we provide theory and algorithms, based on differential algebra, for testing identifiability of polynomial PDE models. We showcase this approach on PDE models arising in the sciences.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
Symbolic-numeric algorithm for parameter estimation in discrete-time models with $\exp$
Authors:
Yosef Berman,
Joshua Forrest,
Matthew Grote,
Alexey Ovchinnikov,
Sonia Rueda
Abstract:
Dynamic models describe phenomena across scientific disciplines, yet to make these models useful in application the unknown parameter values of the models must be determined. Discrete-time dynamic models are widely used to model biological processes, but it is often difficult to determine these parameters. In this paper, we propose a symbolic-numeric approach for parameter estimation in discrete-t…
▽ More
Dynamic models describe phenomena across scientific disciplines, yet to make these models useful in application the unknown parameter values of the models must be determined. Discrete-time dynamic models are widely used to model biological processes, but it is often difficult to determine these parameters. In this paper, we propose a symbolic-numeric approach for parameter estimation in discrete-time models that involve univariate non-algebraic (locally) analytic functions such as exp. We illustrate the performance (precision) of our approach by applying our approach to two archetypal discrete-time models in biology (the flour beetle 'LPA' model and discrete Lotka-Volterra competition model). Unlike optimization-based methods, our algorithm guarantees to find all solutions of the parameter values up to a specified precision given time-series data for the measured variables provided that there are finitely many parameter values that fit the data and that the used polynomial system solver can find all roots of the associated polynomial system with interval coefficients.
△ Less
Submitted 5 October, 2024; v1 submitted 29 January, 2024;
originally announced January 2024.
-
Algorithm for globally identifiable reparametrizations of ODEs
Authors:
Sebastian Falkensteiner,
Alexey Ovchinnikov,
J. Rafael Sendra
Abstract:
Structural global parameter identifiability indicates whether one can determine a parameter's value in an ODE model from given inputs and outputs. If a given model has parameters for which there is exactly one value, such parameters are called globally identifiable. Given an ODE model involving not globally identifiable parameters, first we transform the system into one with locally identifiable p…
▽ More
Structural global parameter identifiability indicates whether one can determine a parameter's value in an ODE model from given inputs and outputs. If a given model has parameters for which there is exactly one value, such parameters are called globally identifiable. Given an ODE model involving not globally identifiable parameters, first we transform the system into one with locally identifiable parameters. As a main contribution of this paper, then we present a procedure for replacing, if possible, the ODE model with an equivalent one that has globally identifiable parameters. We first derive this as an algorithm for one-dimensional ODE models and then reuse this approach for higher-dimensional models.
△ Less
Submitted 5 October, 2024; v1 submitted 1 January, 2024;
originally announced January 2024.
-
Algorithm to find new identifiable reparametrizations of parametric rational ODE models
Authors:
Nicolette Meshkat,
Alexey Ovchinnikov,
Thomas Scanlon
Abstract:
Structural identifiability concerns the question of which unknown parameters of a model can be recovered from (perfect) input-output data. If all of the parameters of a model can be recovered from data, the model is said to be identifiable. However, in many models, there are parameters that can take on an infinite number of values but yield the same input-output data. In this case, those parameter…
▽ More
Structural identifiability concerns the question of which unknown parameters of a model can be recovered from (perfect) input-output data. If all of the parameters of a model can be recovered from data, the model is said to be identifiable. However, in many models, there are parameters that can take on an infinite number of values but yield the same input-output data. In this case, those parameters and the model are called unidentifiable. The question is then what to do with an unidentifiable model. One can try to add more input-output data or decrease the number of unknown parameters, if experimentally feasible, or try to find a reparametrization to make the model identifiable. In this paper, we take the latter approach. While existing approaches to find identifiable reparametrizations were limited to scaling reparametrizations or were not guaranteed to find a globally identifiable reparametrization even if it exists, we significantly broaden the class of models for which we can find a globally identifiable model with the same input-output behavior as the original one. We also prove that, for linear models, a globally identifiable reparametrization always exists and show that, for a certain class of linear compartmental models, with and without inputs, an explicit reparametrization formula exists. We illustrate our method on several examples and provide detailed analysis in supplementary material on github.
△ Less
Submitted 10 June, 2025; v1 submitted 4 October, 2023;
originally announced October 2023.
-
Identifiable specializations for ODE models
Authors:
Alexey Ovchinnikov,
Anand Pillay,
Gleb Pogudin,
Thomas Scanlon
Abstract:
The parameter identifiability problem for a dynamical system is to determine whether the parameters of the system can be found from data for the outputs of the system. Verifying whether the parameters are identifiable is a necessary first step before a meaningful parameter estimation can take place. Non-identifiability occurs in practical models. To reparametrize a model to achieve identifiability…
▽ More
The parameter identifiability problem for a dynamical system is to determine whether the parameters of the system can be found from data for the outputs of the system. Verifying whether the parameters are identifiable is a necessary first step before a meaningful parameter estimation can take place. Non-identifiability occurs in practical models. To reparametrize a model to achieve identifiability is a challenge. The existing approaches have been shown to be useful for many important examples. However, these approaches are either limited to linear models and scaling parametrizations or are not guaranteed to find a reparametrization even if it exists. In the present paper, we prove that there always exists a locally identifiable model with the same input-output behaviour as the original one obtained from a given one by a partial specialization of the parameters. As an extra feature of our approach, the resulting (at least) locally identifiable reparameterization has the same shape: the monomials in the new state variables in the new model are formed in the same way as in the original model. Furthermore, we give a sufficient observability condition for the existence of a state space transformation from the original model to the new one. Our proof is constructive and can be translated to an algorithm, which we illustrate by several examples.
△ Less
Submitted 10 June, 2025; v1 submitted 30 August, 2023;
originally announced August 2023.
-
Web-based Structural Identifiability Analyzer
Authors:
Ilia Ilmer,
Alexey Ovchinnikov,
Gleb Pogudin
Abstract:
Parameter identifiability describes whether, for a given differential model, one can determine parameter values from model equations. Knowing global or local identifiability properties allows construction of better practical experiments to identify parameters from experimental data. In this work, we present a web-based software tool that allows to answer specific identifiability queries. Concretel…
▽ More
Parameter identifiability describes whether, for a given differential model, one can determine parameter values from model equations. Knowing global or local identifiability properties allows construction of better practical experiments to identify parameters from experimental data. In this work, we present a web-based software tool that allows to answer specific identifiability queries. Concretely, our toolbox can determine identifiability of individual parameters of the model and also provide all functions of parameters that are identifiable (also called identifiable combinations) from single or multiple experiments. The program is freely available at https://maple.cloud/app/6509768948056064.
△ Less
Submitted 28 June, 2021;
originally announced June 2021.
-
Multi-experiment parameter identifiability of ODEs and model theory
Authors:
Alexey Ovchinnikov,
Anand Pillay,
Gleb Pogudin,
Thomas Scanlon
Abstract:
Structural identifiability is a property of an ODE model with parameters that allows for the parameters to be determined from continuous noise-free data. This is a natural prerequisite for practical identifiability. Conducting multiple independent experiments could make more parameters or functions of parameters identifiable, which is a desirable property to have. How many experiments are sufficie…
▽ More
Structural identifiability is a property of an ODE model with parameters that allows for the parameters to be determined from continuous noise-free data. This is a natural prerequisite for practical identifiability. Conducting multiple independent experiments could make more parameters or functions of parameters identifiable, which is a desirable property to have. How many experiments are sufficient? In the present paper, we provide an algorithm to determine the exact number of experiments for multi-experiment local identifiability and obtain an upper bound that is off at most by one for the number of experiments for multi-experiment global identifiability.
Interestingly, the main theoretical ingredient of the algorithm has been discovered and proved using model theory (in the sense of mathematical logic). We hope that this unexpected connection will stimulate interactions between applied algebra and model theory, and we provide a short introduction to model theory in the context of parameter identifiability. As another related application of model theory in this area, we construct a nonlinear ODE system with one output such that single-experiment and multiple-experiment identifiability are different for the system. This contrasts with recent results about single-output linear systems.
We also present a Monte Carlo randomized version of the algorithm with a polynomial arithmetic complexity. Implementation of the algorithm is provided and its performance is demonstrated on several examples. The source code is available at https://github.com/pogudingleb/ExperimentsBound.
△ Less
Submitted 17 August, 2021; v1 submitted 21 November, 2020;
originally announced November 2020.
-
Parameter identifiability and input-output equations
Authors:
Alexey Ovchinnikov,
Gleb Pogudin,
Peter Thompson
Abstract:
Structural parameter identifiability is a property of a differential model with parameters that allows for the parameters to be determined from the model equations in the absence of noise. One of the standard approaches to assessing this problem is via input-output equations and, in particular, characteristic sets of differential ideals. The precise relation between identifiability and input-outpu…
▽ More
Structural parameter identifiability is a property of a differential model with parameters that allows for the parameters to be determined from the model equations in the absence of noise. One of the standard approaches to assessing this problem is via input-output equations and, in particular, characteristic sets of differential ideals. The precise relation between identifiability and input-output identifiability is subtle. The goal of this note is to clarify this relation. The main results are:
1) identifiability implies input-output identifiability;
2) these notions coincide if the model does not have rational first integrals;
3) the field of input-output identifiable functions is generated by the coefficients of a "minimal" characteristic set of the corresponding differential ideal.
We expect that some of these facts may be known to the experts in the area, but we are not aware of any articles in which these facts are stated precisely and rigorously proved.
△ Less
Submitted 27 December, 2020; v1 submitted 27 July, 2020;
originally announced July 2020.
-
CLUE: Exact maximal reduction of kinetic models by constrained lumping of differential equations
Authors:
Alexey Ovchinnikov,
Isabel Cristina Pérez Verona,
Gleb Pogudin,
Mirco Tribastone
Abstract:
Motivation: Detailed mechanistic models of biological processes can pose significant challenges for analysis and parameter estimations due to the large number of equations used to track the dynamics of all distinct configurations in which each involved biochemical species can be found. Model reduction can help tame such complexity by providing a lower-dimensional model in which each macro-variable…
▽ More
Motivation: Detailed mechanistic models of biological processes can pose significant challenges for analysis and parameter estimations due to the large number of equations used to track the dynamics of all distinct configurations in which each involved biochemical species can be found. Model reduction can help tame such complexity by providing a lower-dimensional model in which each macro-variable can be directly related to the original variables.
Results: We present CLUE, an algorithm for exact model reduction of systems of polynomial differential equations by constrained linear lumping. It computes the smallest dimensional reduction as a linear mapping of the state space such that the reduced model preserves the dynamics of user-specified linear combinations of the original variables. Even though CLUE works with nonlinear differential equations, it is based on linear algebra tools, which makes it applicable to high-dimensional models. Using case studies from the literature, we show how CLUE can substantially lower model dimensionality and help extract biologically intelligible insights from the reduction.
Availability: An implementation of the algorithm and relevant resources to replicate the experiments herein reported are freely available for download at https://github.com/pogudingleb/CLUE.
Supplementary information: enclosed.
△ Less
Submitted 14 December, 2020; v1 submitted 24 April, 2020;
originally announced April 2020.
-
Computing all identifiable functions of parameters for ODE models
Authors:
Alexey Ovchinnikov,
Anand Pillay,
Gleb Pogudin,
Thomas Scanlon
Abstract:
Parameter identifiability is a structural property of an ODE model for recovering the values of parameters from the data (i.e., from the input and output variables). This property is a prerequisite for meaningful parameter identification in practice. In the presence of nonidentifiability, it is important to find all functions of the parameters that are identifiable. The existing algorithms check w…
▽ More
Parameter identifiability is a structural property of an ODE model for recovering the values of parameters from the data (i.e., from the input and output variables). This property is a prerequisite for meaningful parameter identification in practice. In the presence of nonidentifiability, it is important to find all functions of the parameters that are identifiable. The existing algorithms check whether a given function of parameters is identifiable or, under the solvability condition, find all identifiable functions. However, this solvability condition is not always satisfied, which presents a challenge. Our first main result is an algorithm that computes all identifiable functions without any additional assumptions, which is the first such algorithm as far as we know. Our second main result concerns the identifiability from multiple experiments (with generically different inputs and initial conditions among the experiments). For this problem, we prove that the set of functions identifiable from multiple experiments is what would actually be computed by input-output equation-based algorithms (whether or not the solvability condition is fulfilled), which was not known before. We give an algorithm that not only finds these functions but also provides an upper bound for the number of experiments to be performed to identify these functions. We provide an implementation of the presented algorithms.
△ Less
Submitted 3 June, 2021; v1 submitted 16 April, 2020;
originally announced April 2020.
-
Input-output equations and identifiability of linear ODE models
Authors:
Alexey Ovchinnikov,
Gleb Pogudin,
Peter Thompson
Abstract:
Structural identifiability is a property of a differential model with parameters that allows for the parameters to be determined from the model equations in the absence of noise. The method of input-output equations is one method for verifying structural identifiability. This method stands out in its importance because the additional insights it provides can be used to analyze and improve models.…
▽ More
Structural identifiability is a property of a differential model with parameters that allows for the parameters to be determined from the model equations in the absence of noise. The method of input-output equations is one method for verifying structural identifiability. This method stands out in its importance because the additional insights it provides can be used to analyze and improve models. However, its complete theoretical grounds and applicability are still to be established. A subtlety and key for this method to work correctly is knowing whether the coefficients of these equations are identifiable.
In this paper, to address this, we prove identifiability of the coefficients of input-output equations for types of differential models that often appear in practice, such as linear models with one output and linear compartment models in which, from each compartment, one can reach either a leak or an input. This shows that checking identifiability via input-output equations for these models is legitimate and, as we prove, that the field of identifiable functions is generated by the coefficients of the input-output equations. Finally, we exploit a connection between input-output equations and the transfer function matrix to show that, for a linear compartment model with an input and strongly connected graph, the field of all identifiable functions is generated by the coefficients of the transfer function matrix even if the initial conditions are generic.
△ Less
Submitted 27 January, 2022; v1 submitted 9 October, 2019;
originally announced October 2019.
-
SIAN: software for structural identifiability analysis of ODE models
Authors:
Hoon Hong,
Alexey Ovchinnikov,
Gleb Pogudin,
Chee Yap
Abstract:
Biological processes are often modeled by ordinary differential equations with unknown parameters. The unknown parameters are usually estimated from experimental data. In some cases, due to the structure of the model, this estimation problem does not have a unique solution even in the case of continuous noise-free data. It is therefore desirable to check the uniqueness a priori before carrying out…
▽ More
Biological processes are often modeled by ordinary differential equations with unknown parameters. The unknown parameters are usually estimated from experimental data. In some cases, due to the structure of the model, this estimation problem does not have a unique solution even in the case of continuous noise-free data. It is therefore desirable to check the uniqueness a priori before carrying out actual experiments. We present a new software SIAN (Structural Identifiability ANalyser) that does this. Our software can tackle problems that could not be tackled by previously developed packages.
△ Less
Submitted 25 December, 2018;
originally announced December 2018.