Showing 1–42 of 42 results for author: Bortz, M

Learning Structured Population Models from Data with WSINDy

Authors: Rainey Lyons, Vanja Dukic, David M. Bortz

Abstract: In the context of population dynamics, identifying effective model features, such as fecundity and mortality rates, is generally a complex and computationally intensive process, especially when the dynamics are heterogeneous across the population. In this work, we propose a Weak form Scientific Machine Learning-based method for selecting appropriate model ingredients from a library of scientifical… ▽ More In the context of population dynamics, identifying effective model features, such as fecundity and mortality rates, is generally a complex and computationally intensive process, especially when the dynamics are heterogeneous across the population. In this work, we propose a Weak form Scientific Machine Learning-based method for selecting appropriate model ingredients from a library of scientifically feasible functions used to model structured populations. This method uses extensions of the Weak form Sparse Identification of Nonlinear Dynamics (WSINDy) method to select the best-fitting ingredients from noisy time-series histogram data. This extension includes learning heterogeneous dynamics and also learning the boundary process of the model directly from the data. We additionally provide a cross-validation method which helps fine tune the recovered boundary process to the data. Several test cases are considered, demonstrating the method's performance for different previously studied models, including age and size-structured models. Through these examples, we examine both the advantages and limitations of the method, with a particular focus on the distinguishability of terms in the library. △ Less

Submitted 30 June, 2025; originally announced June 2025.

An equation-based batch distillation simulation to evaluate the effect of multiplicities in thermodynamic activity coefficients

Authors: Jennifer Werner, Jochen Schmid, Lorenz T. Biegler, Michael Bortz

Abstract: In this paper, we investigate the influence of multiplicities in activity coefficients on batch distillation processes. In order to do so, we develop a rigorous simulation of batch distillation processes based on the MESH equations. In particular, we propose a novel index reduction method to transform the original index-$2$ system into a well-posed differential-algebraic system of index $1$. With… ▽ More In this paper, we investigate the influence of multiplicities in activity coefficients on batch distillation processes. In order to do so, we develop a rigorous simulation of batch distillation processes based on the MESH equations. In particular, we propose a novel index reduction method to transform the original index-$2$ system into a well-posed differential-algebraic system of index $1$. With the help of this simulation, we then explore whether the alternative NRTL parameters, which yield indistinguishable activity coefficients and VLE diagrams when compared to the reference data, can produce distinguishable profiles in dynamic simulations. As it turns out, this can happen in general and we explain the reasons behind the dynamic distinguishability. △ Less

Submitted 26 June, 2025; originally announced June 2025.

Comments: 56 pages, 27 figures

Pareto-optimal treatment of uncertainties in model-based process design and operation

Authors: Jan Schwientek, Katrin Teichert, Jan Schröder, Johannes Höller, Norbert Asprion, Pascal Schäfer, Martin Wlotzka, Michael Bortz

Abstract: Model-based process design and operation involves here-and-now and wait-and-see decisions. Here-and-now decisions include design variables like the size of heat exchangers or the height of distillation columns, whereas wait-and-see decisions are directed towards operational variables like reflux and split ratios. In this contribution, we describe how to deal with these different types of decisions… ▽ More Model-based process design and operation involves here-and-now and wait-and-see decisions. Here-and-now decisions include design variables like the size of heat exchangers or the height of distillation columns, whereas wait-and-see decisions are directed towards operational variables like reflux and split ratios. In this contribution, we describe how to deal with these different types of decisions in a multicriteria framework, offering an adjustability for the wait-and-see variables while at the same time respecting optimality guarantees on process KPIs. △ Less

Submitted 25 March, 2025; originally announced March 2025.

Comments: 12 pages, 5 figures, to be published in Chemie Ingenieur Technik

Cubature-based uncertainty estimation for nonlinear regression models

Authors: Martin Bubel, Jochen Schmid, Maximilian Carmesin, Volodymyr Kozachynskyi, Erik Esche, Michael Bortz

Abstract: Calibrating model parameters to measured data by minimizing loss functions is an important step in obtaining realistic predictions from model-based approaches, e.g., for process optimization. This is applicable to both knowledge-driven and data-driven model setups. Due to measurement errors, the calibrated model parameters also carry uncertainty. In this contribution, we use cubature formulas base… ▽ More Calibrating model parameters to measured data by minimizing loss functions is an important step in obtaining realistic predictions from model-based approaches, e.g., for process optimization. This is applicable to both knowledge-driven and data-driven model setups. Due to measurement errors, the calibrated model parameters also carry uncertainty. In this contribution, we use cubature formulas based on sparse grids to calculate the variance of the regression results. The number of cubature points is close to the theoretical minimum required for a given level of exactness. We present exact benchmark results, which we also compare to other cubatures. This scheme is then applied to estimate the prediction uncertainty of the NRTL model, calibrated to observations from different experimental designs. △ Less

Submitted 13 September, 2024; originally announced September 2024.

Comments: 44 pages, 21 figures

The Weak Form Is Stronger Than You Think

Authors: Daniel A. Messenger, April Tran, Vanja Dukic, David M. Bortz

Abstract: The weak form is a ubiquitous, well-studied, and widely-utilized mathematical tool in modern computational and applied mathematics. In this work we provide a survey of both the history and recent developments for several fields in which the weak form can play a critical role. In particular, we highlight several recent advances in weak form versions of equation learning, parameter estimation, and c… ▽ More The weak form is a ubiquitous, well-studied, and widely-utilized mathematical tool in modern computational and applied mathematics. In this work we provide a survey of both the history and recent developments for several fields in which the weak form can play a critical role. In particular, we highlight several recent advances in weak form versions of equation learning, parameter estimation, and coarse graining, which offer surprising noise robustness, accuracy, and computational efficiency. We note that this manuscript is a companion piece to our October 2024 SIAM News article of the same name. Here we provide more detailed explanations of mathematical developments as well as a more complete list of references. Lastly, we note that the software with which to reproduce the results in this manuscript is also available on our group's GitHub website https://github.com/MathBioCU . △ Less

Submitted 10 September, 2024; originally announced September 2024.

MSC Class: 26A33; 35D30; 62FXX; 62JXX; 65L09; 65M32; 68Q32;

Physics-informed active learning with simultaneous weak-form latent space dynamics identification

Authors: Xiaolong He, April Tran, David M. Bortz, Youngsoo Choi

Abstract: The parametric greedy latent space dynamics identification (gLaSDI) framework has demonstrated promising potential for accurate and efficient modeling of high-dimensional nonlinear physical systems. However, it remains challenging to handle noisy data. To enhance robustness against noise, we incorporate the weak-form estimation of nonlinear dynamics (WENDy) into gLaSDI. In the proposed weak-form g… ▽ More The parametric greedy latent space dynamics identification (gLaSDI) framework has demonstrated promising potential for accurate and efficient modeling of high-dimensional nonlinear physical systems. However, it remains challenging to handle noisy data. To enhance robustness against noise, we incorporate the weak-form estimation of nonlinear dynamics (WENDy) into gLaSDI. In the proposed weak-form gLaSDI (WgLaSDI) framework, an autoencoder and WENDy are trained simultaneously to discover intrinsic nonlinear latent-space dynamics of high-dimensional data. Compared to the standard sparse identification of nonlinear dynamics (SINDy) employed in gLaSDI, WENDy enables variance reduction and robust latent space discovery, therefore leading to more accurate and efficient reduced-order modeling. Furthermore, the greedy physics-informed active learning in WgLaSDI enables adaptive sampling of optimal training data on the fly for enhanced modeling accuracy. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including viscous and inviscid Burgers' equations, time-dependent radial advection, and the Vlasov equation for plasma physics. With data that contains 5-10% Gaussian white noise, WgLaSDI outperforms gLaSDI by orders of magnitude, achieving 1-7% relative errors. Compared with the high-fidelity models, WgLaSDI achieves 121 to 1,779x speed-up. △ Less

Submitted 20 July, 2024; v1 submitted 29 June, 2024; originally announced July 2024.

Journal ref: International Journal for Numerical Methods in Engineering 126, no. 1 (2025): e7634

Adaptive discretization algorithms for locally optimal experimental design

Authors: Jochen Schmid, Philipp Seufert, Michael Bortz

Abstract: We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish novel termination, convergence, and convergence rate results for the proposed algorithms. In particular, we prove a sublinear convergence rate result under very gen… ▽ More We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish novel termination, convergence, and convergence rate results for the proposed algorithms. In particular, we prove a sublinear convergence rate result under very general assumptions on the design criterion and, most notably, a linear convergence result under the additional assumption that the design criterion is strongly convex and the design space is finite. Additionally, we prove the finite termination at approximately optimal designs, including upper bounds on the number of iterations until termination. And finally, we illustrate the practical use of the proposed algorithms by means of two application examples from chemical engineering: one with a stationary model and one with a dynamic model. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 42 pages

A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling

Authors: Christophe Bonneville, Xiaolong He, April Tran, Jun Sur Park, William Fries, Daniel A. Messenger, Siu Wun Cheung, Yeonjong Shin, David M. Bortz, Debojyoti Ghosh, Jiun-Shyan Chen, Jonathan Belof, Youngsoo Choi

Abstract: Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressi… ▽ More Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressing some limitations of traditional ROM methods, especially for advection dominated systems. In this chapter, we focus on a particular framework known as Latent Space Dynamics Identification (LaSDI), which transforms the high-fidelity data, governed by a PDE, to simpler and low-dimensional latent-space data, governed by ordinary differential equations (ODEs). These ODEs can be learned and subsequently interpolated to make ROM predictions. Each building block of LaSDI can be easily modulated depending on the application, which makes the LaSDI framework highly flexible. In particular, we present strategies to enforce the laws of thermodynamics into LaSDI models (tLaSDI), enhance robustness in the presence of noise through the weak form (WLaSDI), select high-fidelity training data efficiently through active learning (gLaSDI, GPLaSDI), and quantify the ROM prediction uncertainty through Gaussian processes (GPLaSDI). We demonstrate the performance of different LaSDI approaches on Burgers equation, a non-linear heat conduction problem, and a plasma physics problem, showing that LaSDI algorithms can achieve relative errors of less than a few percent and up to thousands of times speed-ups. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Sequential optimal experimental design for vapor-liquid equilibrium modeling

Authors: Martin Bubel, Jochen Schmid, Volodymyr Kozachynskyi, Erik Esche, Michael Bortz

Abstract: We propose a general methodology of sequential locally optimal design of experiments for explicit or implicit nonlinear models, as they abound in chemical engineering and, in particular, in vapor-liquid equilibrium modeling. As a sequential design method, our method iteratively alternates between performing experiments, updating parameter estimates, and computing new experiments. Specifically, our… ▽ More We propose a general methodology of sequential locally optimal design of experiments for explicit or implicit nonlinear models, as they abound in chemical engineering and, in particular, in vapor-liquid equilibrium modeling. As a sequential design method, our method iteratively alternates between performing experiments, updating parameter estimates, and computing new experiments. Specifically, our sequential design method computes a whole batch of new experiments in each iteration and this batch of new experiments is designed in a two-stage locally optimal manner. In essence, this means that in every iteration the combined information content of the newly proposed experiments and of the already performed experiments is maximized. In order to solve these two-stage locally optimal design problems, a recent and efficient adaptive discretization algorithm is used. We demonstrate the benefits of the proposed methodology on the example of of the parameter estimation for the non-random two-liquid model for narrow azeotropic vapor-liquid equilibria. As it turns out, our sequential optimal design method requires substantially fewer experiments than traditional factorial design to achieve the same model precision and prediction quality. Consequently, our method can contribute to a substantially reduced experimental effort in vapor-liquid equilibrium modeling and beyond. △ Less

Submitted 14 March, 2024; originally announced March 2024.

Comments: 30 pages, 8 figures

A Decomposition Method for the Hybrid Quantum-Classical Solution of the Number Partitioning Problem

Authors: Zongji Li, Tobias Seidel, Michael Bortz, Raoul Heese

Abstract: Current quantum computers can only solve optimization problems of a very limited size. For larger problems, decomposition methods are required in which the original problem is broken down into several smaller sub-problems. These are then solved on the quantum computer and their solutions are merged into a final solution for the original problem. Often, these decomposition methods do not take the s… ▽ More Current quantum computers can only solve optimization problems of a very limited size. For larger problems, decomposition methods are required in which the original problem is broken down into several smaller sub-problems. These are then solved on the quantum computer and their solutions are merged into a final solution for the original problem. Often, these decomposition methods do not take the specific problem structure into account. In this paper, we present a tailored method using a divide-and-conquer strategy to solve the number partitioning problem (NPP) with a large number of variables. The idea is to perform a specialized decomposition into smaller NPPs, which can be solved on a quantum computer, and then recombine the results into another small auxiliary NPP. Solving this auxiliary problem yields an approximate solution of the original larger problem. We experimentally verify that our method allows to solve NPPs with over a thousand variables using a D-Wave quantum annealer. △ Less

Submitted 14 December, 2023; originally announced December 2023.

Comments: 12 pages, 3 figures, 1 table

Weak-Form Latent Space Dynamics Identification

Authors: April Tran, Xiaolong He, Daniel A. Messenger, Youngsoo Choi, David M. Bortz

Abstract: Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based vers… ▽ More Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based version WLaSDI (Weak-form Latent Space Dynamics Identification). WLaSDI first compresses data, then projects onto the test functions and learns the local latent space models. Notably, WLaSDI demonstrates significantly enhanced robustness to noise. With WLaSDI, the local latent space is obtained using weak-form equation learning techniques. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form guarantees a robust and precise latent space recovery, hence allowing for a fast, robust, and accurate simulation. We demonstrate the efficacy of WLaSDI vs. LaSDI on several common benchmark examples including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in the case of 1D inviscid Burgers' simulations with the addition of up to 100% Gaussian white noise, the relative error remains consistently below 6% for WLaSDI, while it can exceed 10,000% for LaSDI. Similarly, for radial advection simulations, the relative errors stay below 15% for WLaSDI, in stark contrast to the potential errors of up to 10,000% with LaSDI. Moreover, speedups of several orders of magnitude can be obtained with WLaSDI. For example applying WLaSDI to 1D Burgers' yields a 140X speedup compared to the corresponding full order model. Python code to reproduce the results in this work is available at (https://github.com/MathBioCU/PyWSINDy_ODE) and (https://github.com/MathBioCU/PyWLaSDI). △ Less

Submitted 20 November, 2023; originally announced November 2023.

Comments: 21 pages, 15 figures

Continuous Synthesis of Diazo Acetonitrile: From Experiments to Physical and Grey-Box Modeling

Authors: Marco Baldan, Sebastian Blauth, Dušan Bošković, Christian Leithäuser, Alexander Mendl, Ligia Radulescu, Maud Schwarzer, Heinrich Wegner, Michael Bortz

Abstract: Diazo compounds are gathering interest for their potential in promoting greener synthesis routes. We investigate, at a lab-scale, the continuous synthesis of diazo acetonitrile (DAN) using a micro-structured flow reactor and a flow reaction calorimeter. Data concerning DAN formation in the former, and relative to reaction heat and gas flow rate in the latter, are collected. We present both a physi… ▽ More Diazo compounds are gathering interest for their potential in promoting greener synthesis routes. We investigate, at a lab-scale, the continuous synthesis of diazo acetonitrile (DAN) using a micro-structured flow reactor and a flow reaction calorimeter. Data concerning DAN formation in the former, and relative to reaction heat and gas flow rate in the latter, are collected. We present both a physical and a grey-box simulation model, both of which are calibrated to our measurements. Both models provide valuable insights into the DAN synthesis. The grey-box approach is useful to incorporate the complex chemical reaction pathways for DAN synthesis and decomposition that are currently hard to address with the physical model. △ Less

Submitted 13 October, 2023; originally announced October 2023.

Journal ref: Chemie Ingenieur Technik 96(5) 2024

Coarse-Graining Hamiltonian Systems Using WSINDy

Authors: Daniel A. Messenger, Joshua W. Burby, David M. Bortz

Abstract: The Weak-form Sparse Identification of Nonlinear Dynamics algorithm (WSINDy) has been demonstrated to offer coarse-graining capabilities in the context of interacting particle systems (https://doi.org/10.1016/j.physd.2022.133406). In this work we extend this capability to the problem of coarse-graining Hamiltonian dynamics which possess approximate symmetries associated with timescale separation.… ▽ More The Weak-form Sparse Identification of Nonlinear Dynamics algorithm (WSINDy) has been demonstrated to offer coarse-graining capabilities in the context of interacting particle systems (https://doi.org/10.1016/j.physd.2022.133406). In this work we extend this capability to the problem of coarse-graining Hamiltonian dynamics which possess approximate symmetries associated with timescale separation. Such approximate symmetries often lead to the existence of a Hamiltonian system of reduced dimension that may be used to efficiently capture the dynamics of the symmetry-invariant dependent variables. Deriving such reduced systems, or approximating them numerically, is an ongoing challenge. We demonstrate that WSINDy can successfully identify this reduced Hamiltonian system in the presence of large intrinsic perturbations while remaining robust to extrinsic noise. This is significant in part due to the nontrivial means by which such systems are derived analytically. WSINDy also naturally preserves the Hamiltonian structure by restricting to a trial basis of Hamiltonian vector fields. The methodology is computational efficient, often requiring only a single trajectory to learn the global reduced Hamiltonian, and avoiding forward solves in the learning process. Using nearly-periodic Hamiltonian systems as a prototypical class of systems with approximate symmetries, we show that WSINDy robustly identifies the correct leading-order system, with dimension reduced by at least two, upon observation of the relevant degrees of freedom. We also provide a contribution to averaging theory by proving that first-order averaging at the level of vector fields preserves Hamiltonian structure in nearly-periodic Hamiltonian systems. We provide physically relevant examples, namely coupled oscillator dynamics, the Hénon-Heiles system for stellar motion within a galaxy, and the dynamics of charged particles. △ Less

Submitted 29 November, 2023; v1 submitted 9 October, 2023; originally announced October 2023.

Multi-Criteria Shape Optimization of Flow Fields for Electrochemical Cells

Authors: Sebastian Blauth, Marco Baldan, Sebastian Osterroth, Christian Leithäuser, Ulf-Peter Apfel, Julian Kleinhaus, Kevinjeorkios Pellumbi, Daniel Siegmund, Konrad Steiner, Michael Bortz

Abstract: We consider the shape optimization of flow fields for electrochemical cells. Our goal is to improve the cell by modifying the shape of its flow field. To do so, we introduce simulation models of the flow field with and without the porous transport layer. The latter is less detailed and used for shape optimization, whereas the former is used to validate our obtained results. We propose three object… ▽ More We consider the shape optimization of flow fields for electrochemical cells. Our goal is to improve the cell by modifying the shape of its flow field. To do so, we introduce simulation models of the flow field with and without the porous transport layer. The latter is less detailed and used for shape optimization, whereas the former is used to validate our obtained results. We propose three objective functions based on the uniformity of the flow and residence time as well as the wall shear stress. After considering the respective optimization problems separately, we use techniques from multi-criteria optimization to treat the conflicting objective functions systematically. Our results highlight the potential of our approach for generating novel flow field designs for electrochemical cells. △ Less

Submitted 27 September, 2023; v1 submitted 25 September, 2023; originally announced September 2023.

Journal ref: Chemie Ingenieur Technik 96(5) 2024

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-form Estimation of Nonlinear Dynamics

Authors: David M. Bortz, Daniel A. Messenger, Vanja Dukic

Abstract: We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conv… ▽ More We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of C-infinity bump functions of varying support sizes. We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at (https://github.com/MathBioCU/WENDy). △ Less

Submitted 8 April, 2023; v1 submitted 26 February, 2023; originally announced February 2023.

Comments: 28 pages, 16 figures

MSC Class: 35D30; 62FXX; 62JXX; 65L09; 65M32; 92-08

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

Authors: Daniel A. Messenger, David M. Bortz

Abstract: In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models which includes the Navier-Stokes equations and the Kuramoto-Sivashinsky equation. W… ▽ More In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models which includes the Navier-Stokes equations and the Kuramoto-Sivashinsky equation. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that in general the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level is above some critical threshold and the nonlinearities exhibit sufficiently fast growth. We derive explicit bounds on the critical noise threshold in the case of Gaussian white noise and provide an explicit characterization of these spurious terms in the case of trigonometric and/or polynomial model nonlinearities. However, a silver lining to this negative result is that if the data is suitably denoised (a simple moving average filter is sufficient), then we recover unconditional asymptotic consistency on the class of models with locally-Lipschitz nonlinearities. Altogether, our results reveal several important aspects of weak-form equation learning which may be used to improve future algorithms. We demonstrate our results numerically using the Lorenz system, the cubic oscillator, a viscous Burgers growth model, and a Kuramoto-Sivashinsky-type higher-order PDE. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Computing T-optimal designs via nested semi-infinite programming and twofold adaptive discretization

Authors: David Mogalle, Philipp Seufert, Jan Schwientek, Michael Bortz, Karl-Heinz Küfer

Abstract: Modeling real processes often results in several suitable models. In order to be able to distinguish, or discriminate, which model best represents a phenomenon, one is interested, e.g., in so-called T-optimal designs. These consist of the (design) points from a generally continuous design space at which the models deviate most from each other, under the condition that they are best fitted to those… ▽ More Modeling real processes often results in several suitable models. In order to be able to distinguish, or discriminate, which model best represents a phenomenon, one is interested, e.g., in so-called T-optimal designs. These consist of the (design) points from a generally continuous design space at which the models deviate most from each other, under the condition that they are best fitted to those points. Thus, the T-criterion represents a bi-level optimization problem, which can be transferred into a semi-infinite one, but whose solution is very unstable or time consuming for non-linear models and non-convex lower- and upper-level problems. If one considers only a finite number of possible design points, a numerically well tractable linear semi-infinite optimization problem arises. Since this is only an approximation of the original model discrimination problem, we propose an algorithm which alternately and adaptively refines discretizations of the parameter as well as of the design space and, thus, solves a sequence of LSIPs. We prove convergence of our method and its subroutine and show on the basis of discrimination tasks from process engineering that our approach is stable and can outperform the known methods. △ Less

Submitted 29 August, 2022; originally announced August 2022.

Comments: 24 pages, 2 figures

MSC Class: 65K05; 90C26; 90C30; 90C34; 90C47

Asymptotic Analysis of a General Multi-Structured Population Model

Authors: Sabina L. Altus, Jeffrey C. Cameron, David M. Bortz

Abstract: Structured populations are ubiquitous across the biological sciences. Mathematical models of these populations allow us to understand how individual physiological traits drive the overall dynamics in aggregate. For example, linear age- or age-and-size-structured models establish constraints on individual growth under which the age- or age-and-size- distribution stabilizes, even as the population c… ▽ More Structured populations are ubiquitous across the biological sciences. Mathematical models of these populations allow us to understand how individual physiological traits drive the overall dynamics in aggregate. For example, linear age- or age-and-size-structured models establish constraints on individual growth under which the age- or age-and-size- distribution stabilizes, even as the population continues to grow without bound. However, individuals in real-world populations exhibit far more structural features than simply age and size. Notably, cyanobacteria contain carboxysome organelles which are central to carbon fixation and can be older (if inherited from parent cells) or younger (if created after division) than the enveloping cell. Motivated by a desire to understand how carboxysome age impacts growth at the colony level, we develop a multi-structured model which allows for an arbitrary (but finite) number of structure variables. We then derive and solve the renewal equation for cell division to obtain an asymptotic solution, and show that, under certain conditions, a stable structural distribution is reached. △ Less

Submitted 22 April, 2022; originally announced April 2022.

MSC Class: 35A30; 47D06; 92D25

Online Weak-form Sparse Identification of Partial Differential Equations

Authors: Daniel A. Messenger, Emiliano Dall'Anese, David M. Bortz

Abstract: This paper presents an online algorithm for identification of partial differential equations (PDEs) based on the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy). The algorithm is online in a sense that if performs the identification task by processing solution snapshots that arrive sequentially. The core of the method combines a weak-form discretization of candidate PDEs w… ▽ More This paper presents an online algorithm for identification of partial differential equations (PDEs) based on the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy). The algorithm is online in a sense that if performs the identification task by processing solution snapshots that arrive sequentially. The core of the method combines a weak-form discretization of candidate PDEs with an online proximal gradient descent approach to the sparse regression problem. In particular, we do not regularize the $\ell_0$-pseudo-norm, instead finding that directly applying its proximal operator (which corresponds to a hard thresholding) leads to efficient online system identification from noisy data. We demonstrate the success of the method on the Kuramoto-Sivashinsky equation, the nonlinear wave equation with time-varying wavespeed, and the linear wave equation, in one, two, and three spatial dimensions, respectively. In particular, our examples show that the method is capable of identifying and tracking systems with coefficients that vary abruptly in time, and offers a streaming alternative to problems in higher dimensions. △ Less

Submitted 8 March, 2022; originally announced March 2022.

Comments: 21 pages, 4 figures

MSC Class: 62J07; 68T05; 93-10

Learning Mean-Field Equations from Particle Data Using WSINDy

Authors: Daniel A. Messenger, David M. Bortz

Abstract: We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic noise. In particular, we use concepts from mean-field theory of IPS in combination with the weak-form sparse identification of nonlinear dynamics algorithm (WSIND… ▽ More We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic noise. In particular, we use concepts from mean-field theory of IPS in combination with the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) to provide a fast and reliable system identification scheme for recovering the governing stochastic differential equations for an IPS when the number of particles per experiment $N$ is on the order of several thousand and the number of experiments $M$ is less than 100. This is in contrast to existing work showing that system identification for $N$ less than 100 and $M$ on the order of several thousand is feasible using strong-form methods. We prove that under some standard regularity assumptions the scheme converges with rate $\mathcal{O}(N^{-1/2})$ in the ordinary least squares setting and we demonstrate the convergence rate numerically on several systems in one and two spatial dimensions. Our examples include a canonical problem from homogenization theory (as a first step towards learning coarse-grained models), the dynamics of an attractive-repulsive swarm, and the IPS description of the parabolic-elliptic Keller-Segel model for chemotaxis. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Analytical singular value decomposition for a class of stoichiometry matrices

Authors: Jacqueline M. Wentz, David M. Bortz

Abstract: We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction-diffusion system on a one dimensional domain. The domain has two subregions which share a single common boundary. Each of the subregions is further partitioned into a finite number of compartments. Chemical reactions can occur within a compartment, whereas diffusion is represented a… ▽ More We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction-diffusion system on a one dimensional domain. The domain has two subregions which share a single common boundary. Each of the subregions is further partitioned into a finite number of compartments. Chemical reactions can occur within a compartment, whereas diffusion is represented as movement between adjacent compartments. Inspired by biology, we study both 1) the case where the reactions on each side of the boundary are different and only certain species diffuse across the boundary as well as 2) the case with spatially homogenous reactions and diffusion. We write the stoichiometry matrix for these two classes of systems using a Kronecker product formulation. For the first scenario, we apply linear perturbation theory to derive an approximate singular value decomposition in the limit as diffusion becomes much faster than reactions. For the second scenario, we derive an exact analytical singular value decomposition for all relative diffusion and reaction time scales. By writing the stoichiometry matrix using Kronecker products, we show that the singular vectors and values can also be written concisely using Kronecker products. Ultimately, we find that the singular value decomposition of the reaction-diffusion stoichiometry matrix depends on the singular value decompositions of smaller matrices. These smaller matrices represent modified versions of the reaction-only stoichiometry matrices and the analytically known diffusion-only stoichiometry matrix. Our results provide a mathematical framework that can be used to study complex biochemical systems with metabolic compartments. MATLAB code for calculating the SVD equations is available at \url{www.github.com/MathBioCU/ReacDiffStoicSVD}. △ Less

Submitted 27 April, 2021; originally announced April 2021.

Two-phase approaches to optimal model-based design of experiments: how many experiments and which ones?

Authors: Charlie Vanaret, Philipp Seufert, Jan Schwientek, Gleb Karpov, Gleb Ryzhakov, Ivan Oseledets, Norbert Asprion, Michael Bortz

Abstract: Model-based experimental design is attracting increasing attention in chemical process engineering. Typically, an iterative procedure is pursued: an approximate model is devised, prescribed experiments are then performed and the resulting data is exploited to refine the model. To help to reduce the cost of trial-and-error approaches, strategies for model-based design of experiments suggest experim… ▽ More Model-based experimental design is attracting increasing attention in chemical process engineering. Typically, an iterative procedure is pursued: an approximate model is devised, prescribed experiments are then performed and the resulting data is exploited to refine the model. To help to reduce the cost of trial-and-error approaches, strategies for model-based design of experiments suggest experimental points where the expected gain in information for the model is the largest. It requires the resolution of a large nonlinear, generally nonconvex, optimization problem, whose solution may greatly depend on the starting point. We present two discretization strategies that can assist the experimenter in setting the number of relevant experiments and performing an optimal selection, and we compare them against two pattern-based strategies that are independent of the problem. The validity of the approaches is demonstrated on an academic example and two test problems from chemical engineering including a vapor liquid equilibrium and reaction kinetics. △ Less

Submitted 22 January, 2021; originally announced January 2021.

Journal ref: Computers & Chemical Engineering, Volume 146, March 2021, 107218

An Adaptive Algorithm based on High-Dimensional Function Approximation to obtain Optimal Designs

Authors: Philipp Seufert, Jan Schwientek, Michael Bortz

Abstract: Algorithms which compute locally optimal continuous designs often rely on a finite design space or on repeatedly solving a complex non-linear program. Both methods require extensive evaluations of the Jacobian Df of the underlying model. These evaluations present a heavy computational burden. Based on the Kiefer-Wolfowitz Equivalence Theorem we present a novel design of experiments algorithm which… ▽ More Algorithms which compute locally optimal continuous designs often rely on a finite design space or on repeatedly solving a complex non-linear program. Both methods require extensive evaluations of the Jacobian Df of the underlying model. These evaluations present a heavy computational burden. Based on the Kiefer-Wolfowitz Equivalence Theorem we present a novel design of experiments algorithm which computes optimal designs in a continuous design space. For this iterative algorithm we combine an adaptive Bayes-like sampling scheme with Gaussian process regression to approximate the directional derivative of the design criterion. The approximation allows us to adaptively select new design points on which to evaluate the model. The adaptive selection of the algorithm requires significantly less evaluations of Df and reduces the runtime of the computations. We show the viability of the new algorithm on two examples from chemical engineering. △ Less

Submitted 15 January, 2021; originally announced January 2021.

Weak SINDy For Partial Differential Equations

Authors: Daniel A. Messenger, David M. Bortz

Abstract: Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data (Brunton et al., PNAS, '16; Rudy et al., Sci. Adv. '17). Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy)… ▽ More Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data (Brunton et al., PNAS, '16; Rudy et al., Sci. Adv. '17). Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy) framework introduced in (arXiv:2005.04339) to the setting of partial differential equations (PDEs). The elimination of pointwise derivative approximations via the weak form enables effective machine-precision recovery of model coefficients from noise-free data (i.e. below the tolerance of the simulation scheme) as well as robust identification of PDEs in the large noise regime (with signal-to-noise ratio approaching one in many well-known cases). This is accomplished by discretizing a convolutional weak form of the PDE and exploiting separability of test functions for efficient model identification using the Fast Fourier Transform. The resulting WSINDy algorithm for PDEs has a worst-case computational complexity of $\mathcal{O}(N^{D+1}\log(N))$ for datasets with $N$ points in each of $D+1$ dimensions (i.e. $\mathcal{O}(\log(N))$ operations per datapoint). Furthermore, our Fourier-based implementation reveals a connection between robustness to noise and the spectra of test functions, which we utilize in an \textit{a priori} selection algorithm for test functions. Finally, we introduce a learning algorithm for the threshold in sequential-thresholding least-squares (STLS) that enables model identification from large libraries, and we utilize scale-invariance at the continuum level to identify PDEs from poorly-scaled datasets. We demonstrate WSINDy's robustness, speed and accuracy on several challenging PDEs. △ Less

Submitted 21 December, 2020; v1 submitted 6 July, 2020; originally announced July 2020.

Comments: Code used in this manuscript is publicly available on GitHub at https://github.com/dm973/WSINDy PDE

Weak SINDy: Galerkin-Based Data-Driven Model Selection

Authors: Daniel A. Messenger, David M. Bortz

Abstract: We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative approximations with linear transformations and a variance reduction technique. Our approach improves on the standard SINDy algorithm by orders of magnitude. We fir… ▽ More We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative approximations with linear transformations and a variance reduction technique. Our approach improves on the standard SINDy algorithm by orders of magnitude. We first show that in the noise-free regime, this so-called Weak SINDy (WSINDy) framework is capable of recovering the dynamic coefficients to very high accuracy, with the number of significant digits equal to the tolerance of the data simulation scheme. Next we show that the weak form naturally accounts for white noise by identifying the correct nonlinearities with coefficient error scaling favorably with the signal-to-noise ratio while significantly reducing the size of linear systems in the algorithm. In doing so, we combine the ease of implementation of the SINDy algorithm with the natural noise-reduction of integration to arrive at a more robust and user-friendly method of sparse recovery that correctly identifies systems in both small-noise and large-noise regimes. △ Less

Submitted 3 July, 2020; v1 submitted 8 May, 2020; originally announced May 2020.

Comments: Added link to code on Github

Simulation and optimal control of the Williams-Otto process using Pyomo

Authors: Jochen Schmid, Katrin Teichert, Moncef Chioua, Thorsten Schindler, Michael Bortz

Abstract: We illustrate the advantages the high-level open-source software package Pyomo has in rapidly setting up and solving dynamic simulation and optimization problems. In order to do so, we use the example of the Williams-Otto process. We show how to simulate the process dynamics using the collocation method and the IPOPT solver provided by Pyomo. We also discuss waste minimization and yield maximizati… ▽ More We illustrate the advantages the high-level open-source software package Pyomo has in rapidly setting up and solving dynamic simulation and optimization problems. In order to do so, we use the example of the Williams-Otto process. We show how to simulate the process dynamics using the collocation method and the IPOPT solver provided by Pyomo. We also discuss waste minimization and yield maximization as two examplary process optimization problems. And finally, we present and compare two approaches to setpoint tracking: one based on proportional-integral feedback control and one based on optimal open-loop control. △ Less

Submitted 16 April, 2020; originally announced April 2020.

Comments: 19 pages, 10 figures

Competitive Exclusion in a DAE Model for Microbial Electrolysis Cells

Authors: Harry J. Dudley, Zhiyong Jason Ren, David M. Bortz

Abstract: Microbial electrolysis cells (MECs) employ electroactive bacteria to perform extracellular electron transfer, enabling hydrogen generation from biodegradable substrates. In previous work, we developed and analyzed a differential-algebraic equation (DAE) model for MECs. The model resembles a chemostat with ordinary differential equations (ODEs) for concentrations of substrate, microorganisms, and a… ▽ More Microbial electrolysis cells (MECs) employ electroactive bacteria to perform extracellular electron transfer, enabling hydrogen generation from biodegradable substrates. In previous work, we developed and analyzed a differential-algebraic equation (DAE) model for MECs. The model resembles a chemostat with ordinary differential equations (ODEs) for concentrations of substrate, microorganisms, and an extracellular mediator involved in electron transfer. There is also an algebraic constraint for electric current and hydrogen production. Our goal is to determine the outcome of competition between methanogenic archaea and electroactive bacteria, because only the latter contribute to electric current and resulting hydrogen production. We investigate asymptotic stability in two industrially relevant versions of the model. An important aspect of chemostats models is the principle of competitive exclusion -- only microbes which grow at the lowest substrate concentration will survive as $t\to\infty$. We show that if methanogens grow at the lowest substrate concentration, then the equilibrium corresponding to competitive exclusion by methanogens is globally asymptotically stable. The analogous result for electroactive bacteria is not necessarily true. We show that local asymptotic stability of exclusion by electroactive bacteria is not guaranteed, even in a simplified version of the model. In this case, even if electroactive bacteria can grow at the lowest substrate concentration, a few additional conditions are required to guarantee local asymptotic stability. We also provide numerical simulations supporting these arguments. Our results suggest operating conditions that are most conducive to success of electroactive bacteria and the resulting current and hydrogen production in MECs. This will help identify when methane production or electricity and hydrogen production are favored. △ Less

Submitted 6 July, 2020; v1 submitted 5 June, 2019; originally announced June 2019.

Boundedness of a class of discretized reaction-diffusion systems

Authors: Jacqueline M. Wentz, David M. Bortz

Abstract: Although the spatially continuous version of the reaction-diffusion equation has been well studied, in some instances a spatially-discretized representation provides a more realistic approximation of biological processes. Indeed, mathematically the discretized and continuous systems can lead to different predictions of biological dynamics. It is well known in the continuous case that the incorpora… ▽ More Although the spatially continuous version of the reaction-diffusion equation has been well studied, in some instances a spatially-discretized representation provides a more realistic approximation of biological processes. Indeed, mathematically the discretized and continuous systems can lead to different predictions of biological dynamics. It is well known in the continuous case that the incorporation of diffusion can cause diffusion-driven blow-up with respect to the $L^{\infty}$ norm. However, this does not imply diffusion-driven blow-up will occur in the discretized version of the system. For example, in a continuous reaction-diffusion system with Dirichlet boundary conditions and nonnegative solutions, diffusion-driven blow up occurs even when the total species concentration is non-increasing. For systems that instead have homogeneous Neumann boundary conditions, it is currently unknown whether this deviation between the continuous and discretized system can occur. Therefore, it is worth examining the discretized system independently of the continuous system. Since no criteria exist for the boundedness of the discretized system, the focus of this paper is to determine sufficient conditions to guarantee the system with diffusion remains bounded for all time. We consider reaction-diffusion systems on a 1D domain with homogeneous Neumann boundary conditions and non-negative initial data and solutions. We define a Lyapunov-like function and show that its existence guarantees that the discretized reaction-diffusion system is bounded. These results are considered in the context of three example systems for which Lyapunov-like functions can and cannot be found. △ Less

Submitted 14 February, 2020; v1 submitted 22 March, 2019; originally announced March 2019.

MSC Class: 34C11; 35K57; 37B25; 37F99; 65N40

The Influence of Numerical Error on an Inverse Problem Methodology in PDE Models

Authors: John T. Nardini, D. M. Bortz

Abstract: The inverse problem methodology is a commonly-used framework in the sciences for parameter estimation and inference. It is typically performed by fitting a mathematical model to noisy experimental data. There are two significant sources of error in the process: 1.\ Noise from the measurement and collection of experimental data and 2.\ numerical error in approximating the true solution to the mathe… ▽ More The inverse problem methodology is a commonly-used framework in the sciences for parameter estimation and inference. It is typically performed by fitting a mathematical model to noisy experimental data. There are two significant sources of error in the process: 1.\ Noise from the measurement and collection of experimental data and 2.\ numerical error in approximating the true solution to the mathematical model. Little attention has been paid to how this second source of error alters the results of an inverse problem. As a first step towards a better understanding of this problem, we present a modeling and simulation study using a simple advection-driven PDE model. We present both analytical and computational results concerning how the different sources of error impact the least squares cost function as well as parameter estimation and uncertainty quantification. We investigate residual patterns to derive an autocorrelative statistical model that can improve parameter estimation and confidence interval computation for first order methods. Building on the results of our investigation, we provide guidelines for practitioners to determine when numerical or experimental error is the main source of error in their inference, along with suggestions of how to efficiently improve their results. △ Less

Submitted 15 July, 2018; originally announced July 2018.

Comments: 43 pages, 9 Figures, IOP format

A Posteriori Error Analysis of Fluid-Stucture Interactions: Time Dependent Error

Authors: Jay A. Stotsky, David M. Bortz

Abstract: A posteriori error analysis is a technique to quantify the error in particular simulations of a numerical approximation method. In this article, we use such an approach to analyze how various error components propagate in certain moving boundary problems. We study quasi-steady state simulations where slowly moving boundaries remain in mechanical equilibrium with a surrounding fluid. Such problems… ▽ More A posteriori error analysis is a technique to quantify the error in particular simulations of a numerical approximation method. In this article, we use such an approach to analyze how various error components propagate in certain moving boundary problems. We study quasi-steady state simulations where slowly moving boundaries remain in mechanical equilibrium with a surrounding fluid. Such problems can be numerically approximated with the Method of Regularized Stokelets(MRS), a popular method used for studying viscous fluid-structure interactions, especially in biological applications. Our approach to monitoring the regularization error of the MRS is novel, along with the derivation of linearized adjoint equations to the governing equations of the MRS with a elastic elements. Our main numerical results provide a clear illustration of how the error evolves over time in several MRS simulations. △ Less

Submitted 9 July, 2018; originally announced July 2018.

Comments: 14 pages, 6 figures

MSC Class: 65L99

On the existence of non-trivial steady-state size-distributions for a class of flocculation equations

Authors: Inom Mirzaev, David M. Bortz

Abstract: Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of floc size distribution in an aqueous environment. Our work provides a unified treatment for… ▽ More Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of floc size distribution in an aqueous environment. Our work provides a unified treatment for many size-structured models in the environmental, industrial, medical, and marine engineering literature. In particular, the mathematical model considered in this work accounts for basic biological phenomena in a population of microorganisms including growth, death, sedimentation, predation, surface erosion, renewal, fragmentation and aggregation. The central objective of this work is to prove existence of positive steady states of this generalized flocculation model. Using results from fixed point theory we derive conditions for the existence of continuous, non-trivial stationary solutions. We further develop a numerical scheme based on spectral collocation method to approximate these positive stationary solutions. We explore the stationary solutions of the model for various biologically relevant parameters and give valuable insights for the efficient removal of suspended particles. △ Less

Submitted 23 April, 2018; v1 submitted 30 March, 2018; originally announced April 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1507.07127

Sensitivity and Bifurcation Analysis of a DAE Model for a Microbial Electrolysis Cell

Authors: Harry J. Dudley, Lu Lu, Zhiyong Jason Ren, David M. Bortz

Abstract: Microbial electrolysis cells (MECs) are a promising new technology for producing hydrogen cheaply, efficiently, and sustainably. However, to scale up this technology, we need a better understanding of the processes in the devices. In this effort, we present a differential-algebraic equation (DAE) model of a microbial electrolysis cell with an algebraic constraint on current. We then perform sensit… ▽ More Microbial electrolysis cells (MECs) are a promising new technology for producing hydrogen cheaply, efficiently, and sustainably. However, to scale up this technology, we need a better understanding of the processes in the devices. In this effort, we present a differential-algebraic equation (DAE) model of a microbial electrolysis cell with an algebraic constraint on current. We then perform sensitivity and bifurcation analysis for the DAE system. The model can be applied either to batch-cycle MECs or to continuous-flow MECs. We conduct differential-algebraic sensitivity analysis after fitting simulations to current density data for a batch-cycle MEC. The sensitivity analysis suggests which parameters have the greatest influence on the current density at particular times during the experiment. In particular, growth and consumption parameters for exoelectrogenic bacteria have a strong effect prior to the peak current density. An alternative strategy to maximizing peak current density is maintaining a long term stable equilibrium with non-zero current density in a continuous-flow MEC. We characterize the minimum dilution rate required for a stable nonzero current equilibrium and demonstrate transcritical bifurcations in the dilution rate parameter that exchange stability between several curves of equilibria. Specifically, increasing the dilution rate transitions the system through three regimes where the stable equilibrium exhibits (i) competitive exclusion by methanogens, (ii) coexistence, and (iii) competitive exclusion by exolectrogens. Positive long term current production is only feasible in the final two regimes. These results suggest how to modify system parameters to increase peak current density in a batch-cycle MEC or to increase the long term current density equilibrium value in a continuous-flow MEC. △ Less

Submitted 17 February, 2018; originally announced February 2018.

MSC Class: 37N25; 92C40

Investigation of a Structured Fisher's Equation with Applications in Biochemistry

Authors: John T. Nardini, D. M. Bortz

Abstract: Recent biological research has sought to understand how biochemical signaling pathways, such as the mitogen-activated protein kinase (MAPK) family, influence the migration of a population of cells during wound healing. Fisher's Equation has been used extensively to model experimental wound healing assays due to its simple nature and known traveling wave solutions. This partial differential equatio… ▽ More Recent biological research has sought to understand how biochemical signaling pathways, such as the mitogen-activated protein kinase (MAPK) family, influence the migration of a population of cells during wound healing. Fisher's Equation has been used extensively to model experimental wound healing assays due to its simple nature and known traveling wave solutions. This partial differential equation with independent variables of time and space cannot account for the effects of biochemical activity on wound healing, however. To this end, we derive a structured Fisher's Equation with independent variables of time, space, and biochemical pathway activity level and prove the existence of a self-similar traveling wave solution to this equation. We also consider a more complicated model with different phenotypes based on MAPK activation and numerically investigate how various temporal patterns of biochemical activity can lead to increased and decreased rates of population migration. △ Less

Submitted 15 December, 2016; originally announced December 2016.

Comments: 28 pages, 8 figures

A numerical framework for computing steady states of size-structured population models and their stability

Authors: Inom Mirzaev, David M. Bortz

Abstract: Structured population models are a class of general evolution equations which are widely used in the study of biological systems. Many theoretical methods are available for establishing existence and stability of steady states of general evolution equations. However, except for very special cases, finding an analytical form of stationary solutions for evolution equations is a challenging task. In… ▽ More Structured population models are a class of general evolution equations which are widely used in the study of biological systems. Many theoretical methods are available for establishing existence and stability of steady states of general evolution equations. However, except for very special cases, finding an analytical form of stationary solutions for evolution equations is a challenging task. In the present paper, we develop a numerical framework for computing approximations to stationary solutions of general evolution equations, which can also be used to produce existence and stability regions for steady states. In particular, we use the Trotter-Kato Theorem to approximate the infinitesimal generator of an evolution equation on a finite dimensional space, which in turn reduces the evolution equation into a system of ordinary differential equations. Consequently, we approximate and study the asymptotic behavior of stationary solutions. We illustrate the convergence of our numerical framework by applying it to a linear Sinko-Streifer structured population model for which the exact form of the steady state is known. To further illustrate the utility of our approach, we apply our framework to nonlinear population balance equation, which is an extension of well-known Smoluchowksi coagulation-fragmentation model to biological populations. We also demonstrate that our numerical framework can be used to gain insight about the theoretical stability of the stationary solutions of the evolution equations. Furthermore, the open source Python program that we have developed for our numerical simulations is freely available from our Github repository (github.com/MathBioCU). △ Less

Submitted 22 February, 2016; originally announced February 2016.

Inverse Problems for a Class of Conditional Probability Measure-Dependent Evolution Equations

Authors: David M. Bortz, Erin C. Byrne, Inom Mirzaev

Abstract: We investigate the inverse problem of identifying a conditional probability measure in a measure-dependent dynamical system. We provide existence and well-posedness results and outline a discretization scheme for approximating a measure. For this scheme, we prove general method stability. The work is motivated by Partial Differential Equation (PDE) models of flocculation for which the shape of t… ▽ More We investigate the inverse problem of identifying a conditional probability measure in a measure-dependent dynamical system. We provide existence and well-posedness results and outline a discretization scheme for approximating a measure. For this scheme, we prove general method stability. The work is motivated by Partial Differential Equation (PDE) models of flocculation for which the shape of the post-fragmentation conditional probability measure greatly impacts the solution dynamics. To illustrate our methodology, we apply the theory to a particular PDE model that arises in the study of population dynamics for flocculating bacterial aggregates in suspension, and provide numerical evidence for the utility of the approach. △ Less

Submitted 5 October, 2015; originally announced October 2015.

Stability of steady states for a class of flocculation equations with growth and removal

Authors: Inom Mirzaev, David M. Bortz

Abstract: Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of flocs in an aqueous environment. Our work provides a unified treatment for many size-struct… ▽ More Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of flocs in an aqueous environment. Our work provides a unified treatment for many size-structured models in the environmental, industrial, medical, and marine engineering literature. In particular, our model accounts for basic biological phenomena in a population of microorganisms including growth, death, sedimentation, predation, renewal, fragmentation and aggregation. Our central goal in this paper is to rigorously investigate the long-term behavior of this generalized flocculation model. Using results from fixed point theory we derive conditions for the existence of continuous, non-trivial stationary solutions. We further apply the principle of linearized stability and semigroup compactness arguments to provide sufficient conditions for local exponential stability of stationary solutions as well as sufficient conditions for instability. Abstract. The end results of this analytical development are relatively simple inequality-criteria which thus allows for the rapid evaluation of the existence and stability of a non-trivial stationary solution. To our knowledge, this work is the first to derive precise existence and stability criteria for such a generalized model. Lastly, we also provide an illustrating application of this criteria to several flocculation models. △ Less

Submitted 25 July, 2015; originally announced July 2015.

Variable Viscosity and Density Biofilm Simulations using an Immersed Boundary Method, Part II: Experimental Validation and the Heterogeneous Rheology-IBM

Authors: Jay A. Stotsky, Jason F. Hammond, Leonid Pavlovsky, Elizabeth J. Stewart, John G. Younger, Michael J. Solomon, David M. Bortz

Abstract: The goal of this work is to develop a numerical simulation that accurately captures the biomechanical response of bacterial biofilms and their associated extracellular matrix (ECM). In this, the second of a two-part effort, the primary focus is on formally presenting the heterogeneous rheology Immersed Boundary Method (hrIBM) and validating our model against experimental results. With this extensi… ▽ More The goal of this work is to develop a numerical simulation that accurately captures the biomechanical response of bacterial biofilms and their associated extracellular matrix (ECM). In this, the second of a two-part effort, the primary focus is on formally presenting the heterogeneous rheology Immersed Boundary Method (hrIBM) and validating our model against experimental results. With this extension of the Immersed Bounadry Method (IBM), we use the techniques originally developed in Part I, (Hammond et al. (2014) ) to treat the biofilm as a viscoelastic fluid possessing variable rheological properties anchored to a set of moving locations (i.e., the bacteria locations). We validate our modeling approach from Part I by comparing dynamic moduli and compliance moduli computed from our model to data from mechanical characterization experiments on Staphylococcus epidermidis biofilms. The experimental setup is described in Pavlovsky et al. (2013) in which biofilms are grown and tested in a parallel plate rheometer. Matlab code used to produce results in this paper will be available at https://github.com/MathBioCU/BiofilmSim. △ Less

Submitted 29 April, 2015; v1 submitted 27 April, 2015; originally announced April 2015.

Comments: 26 pages, 8 figures, 6 tables

MSC Class: 65N22; 74F10; 65M06

Criteria for linearized stability for a size-structured population model

Authors: Inom Mirzaev, David M. Bortz

Abstract: We consider a size-structured aggregation and growth model of phytoplankton community proposed by Ackleh and Fitzpatrick [2]. The model accounts for basic biological phenomena in phytoplankton community such as growth, gravitational sedimentation, predation by zooplankton, fecundity, and aggregation. Our primary goal in this paper is to investigate the long-term behavior of the proposed aggregatio… ▽ More We consider a size-structured aggregation and growth model of phytoplankton community proposed by Ackleh and Fitzpatrick [2]. The model accounts for basic biological phenomena in phytoplankton community such as growth, gravitational sedimentation, predation by zooplankton, fecundity, and aggregation. Our primary goal in this paper is to investigate the long-term behavior of the proposed aggregation and growth model. Particularly, using the well-known principle of linearized stability and semigroup compactness arguments, we provide sufficient conditions for local exponential asymptotic stability of zero solution as well as sufficient conditions for instability. We express these conditions in the form of an easy to compute characteristic function, which depends on the functional relationship between growth, sedimentation and fecundity. Our results can be used to predict long-term phytoplankton dynamic △ Less

Submitted 9 February, 2015; originally announced February 2015.

Analytical Equilibrium Solutions of Biochemical Systems with Synthesis and Degradation

Authors: Inom Mirzaev, David Matthew Bortz

Abstract: Analyzing qualitative behaviors of biochemical reactions using its associated network structure has proven useful in diverse branches of biology. As an extension of our previous work, we introduce a graph-based framework to calculate steady state solutions of biochemical reaction networks with synthesis and degradation. Our approach is based on a labeled directed graph $G$ and the associated syste… ▽ More Analyzing qualitative behaviors of biochemical reactions using its associated network structure has proven useful in diverse branches of biology. As an extension of our previous work, we introduce a graph-based framework to calculate steady state solutions of biochemical reaction networks with synthesis and degradation. Our approach is based on a labeled directed graph $G$ and the associated system of linear non-homogeneous differential equations with first order degradation and zeroth order synthesis. We also present a theorem which provides necessary and sufficient conditions for the dynamics to engender a unique stable steady state. Although the dynamics are linear, one can apply this framework to nonlinear systems by encoding nonlinearity into the edge labels. We answer open question from our previous work concerning the non-positiveness of the elements in the inverse of a perturbed Laplacian matrix. Moreover, we provide a graph theoretical framework for the computation of the inverse of a such matrix. This also completes our previous framework and makes it purely graph theoretical. Lately, we demonstrate the utility of this framework by applying it to a mathematical model of insulin secretion through ion channels and glucose metabolism in pancreatic $β$-cells. △ Less

Submitted 25 April, 2014; originally announced April 2014.

Comments: 28 pages

Numerical simulation of solutions and moments of the smoluchowski coagulation equation

Authors: Dustin D. Keck, David M. Bortz

Abstract: Researchers have employed variations of the Smoluchowski coagulation equation to model a wide variety of both organic and inorganic phenomena and with relatively few known analytical solutions, numerical solutions play an important role in studying this equation. In this article, we consider numerical approximations, focusing on how different discretization schemes impact the accuracy of approxima… ▽ More Researchers have employed variations of the Smoluchowski coagulation equation to model a wide variety of both organic and inorganic phenomena and with relatively few known analytical solutions, numerical solutions play an important role in studying this equation. In this article, we consider numerical approximations, focusing on how different discretization schemes impact the accuracy of approximate solution moments. Pursuing the eventual goal of comparing simulated solutions to experimental data, we must carefully choose the numerical method most appropriate to the type of data we attain. Within this context, we compare and contrast the accuracy and computational cost of a finite element approach and a finite volume-based scheme. Our study provides theoretical and numerical evidence that the finite element approach achieves much more accuracy when the system aggregates slowly, and it does so with much less computation cost. Conversely, the finite volume method is slightly more accurate approximating the zeroth moment when the system aggregates quickly and is much more accurate approximating the first moment in general. Lastly, our study also provides numerical evidence that the finite element method (conventionally considered first order) actually belongs to a class of discontinuous Galerkin methods that exhibit superconvergence, or second order in our case. △ Less

Submitted 27 December, 2013; originally announced December 2013.

Spatially Heterogeneous Biofilm Simulations using an Immersed Boundary Method with Lagrangian Nodes Defined by Bacterial Locations

Authors: Jason F. Hammond, Elizabeth J. Stewart, John G. Younger, Michael J. Solomon, David M. Bortz

Abstract: In this work we consider how surface-adherent bacterial biofilm communities respond in flowing systems. We simulate the fluid-structure interaction and separation process using the immersed boundary method. In these simulations we model and simulate different density and viscosity values of the biofilm than that of the surrounding fluid. The simulation also includes breakable springs connecting th… ▽ More In this work we consider how surface-adherent bacterial biofilm communities respond in flowing systems. We simulate the fluid-structure interaction and separation process using the immersed boundary method. In these simulations we model and simulate different density and viscosity values of the biofilm than that of the surrounding fluid. The simulation also includes breakable springs connecting the bacteria in the biofilm. This allows the inclusion of erosion and detachment into the simulation. We use the incompressible Navier-Stokes (N-S) equations to describe the motion of the flowing fluid. We discretize the fluid equations using finite differences and use a geometric multigrid method to solve the resulting equations at each time step. The use of multigrid is necessary because of the dramatically different densities and viscosities between the biofilm and the surrounding fluid. We investigate and simulate the model in both two and three dimensions. Our method differs from previous attempts of using IBM for modeling biofilm/flow interactions in the following ways: the density and viscosity of the biofilm can differ from the surrounding fluid, and the Lagrangian node locations correspond to experimentally measured bacterial cell locations from 3D images taken of Staphylococcus epidermidis in a biofilm. △ Less

Submitted 14 February, 2013; originally announced February 2013.

Comments: 43 pages, 18 figures, 9 tables

Propagation of fronts in the Fisher-Kolmogorov equation with spatially varying diffusion

Authors: Christopher W. Curtis, David M. Bortz

Abstract: The propagation of fronts in the Fisher-Kolmogorov equation with spatially varying diffusion coefficients is studied. Using coordinate changes, WKB approximations, and multiple scales analysis, we provide an analytic framework that describes propagation of the front up to the minimum of the diffusion coefficient. We also present results showing the behavior of the front after it passes the minimum… ▽ More The propagation of fronts in the Fisher-Kolmogorov equation with spatially varying diffusion coefficients is studied. Using coordinate changes, WKB approximations, and multiple scales analysis, we provide an analytic framework that describes propagation of the front up to the minimum of the diffusion coefficient. We also present results showing the behavior of the front after it passes the minimum. In each case, we show that standard traveling coordinate frames do not properly describe front propagation. Lastly, we provide numerical simulations to support our analysis and to show, that around the minimum, the motion of the front is arrested on asymptotically significant timescales. △ Less

Submitted 16 September, 2012; v1 submitted 4 July, 2012; originally announced July 2012.

Comments: 8 pages, 5 figures

MSC Class: 35K57; 35C07