-
Manifold learning for parameter reduction
Authors:
Alexander Holiday,
Mahdi Kooshkbaghi,
Juan M. Bello-Rivas,
C. William Gear,
Antonios Zagaris,
Ioannis G. Kevrekidis
Abstract:
Large scale dynamical systems (e.g. many nonlinear coupled differential equations) can often be summarized in terms of only a few state variables (a few equations), a trait that reduces complexity and facilitates exploration of behavioral aspects of otherwise intractable models. High model dimensionality and complexity makes symbolic, pen--and--paper model reduction tedious and impractical, a diff…
▽ More
Large scale dynamical systems (e.g. many nonlinear coupled differential equations) can often be summarized in terms of only a few state variables (a few equations), a trait that reduces complexity and facilitates exploration of behavioral aspects of otherwise intractable models. High model dimensionality and complexity makes symbolic, pen--and--paper model reduction tedious and impractical, a difficulty addressed by recently developed frameworks that computerize reduction. Symbolic work has the benefit, however, of identifying both reduced state variables and parameter combinations that matter most (effective parameters, "inputs"); whereas current computational reduction schemes leave the parameter reduction aspect mostly unaddressed. As the interest in mapping out and optimizing complex input--output relations keeps growing, it becomes clear that combating the curse of dimensionality also requires efficient schemes for input space exploration and reduction. Here, we explore systematic, data-driven parameter reduction by means of effective parameter identification, starting from current nonlinear manifold-learning techniques enabling state space reduction. Our approach aspires to extend the data-driven determination of effective state variables with the data-driven discovery of effective model parameters, and thus to accelerate the exploration of high-dimensional parameter spaces associated with complex models.
△ Less
Submitted 11 November, 2018; v1 submitted 22 July, 2018;
originally announced July 2018.
-
Data-Driven Reduction for Multiscale Stochastic Dynamical Systems
Authors:
Carmeline J. Dsilva,
Ronen Talmon,
C. William Gear,
Ronald R. Coifman,
Ioannis G. Kevrekidis
Abstract:
Multiple time scale stochastic dynamical systems are ubiquitous in science and engineering, and the reduction of such systems and their models to only their slow components is often essential for scientific computation and further analysis. Rather than being available in the form of an explicit analytical model, often such systems can only be observed as a data set which exhibits dynamics on sever…
▽ More
Multiple time scale stochastic dynamical systems are ubiquitous in science and engineering, and the reduction of such systems and their models to only their slow components is often essential for scientific computation and further analysis. Rather than being available in the form of an explicit analytical model, often such systems can only be observed as a data set which exhibits dynamics on several time scales. We will focus on applying and adapting data mining and manifold learning techniques to detect the slow components in such multiscale data. Traditional data mining methods are based on metrics (and thus, geometries) which are not informed of the multiscale nature of the underlying system dynamics; such methods cannot successfully recover the slow variables. Here, we present an approach which utilizes both the local geometry and the local dynamics within the data set through a metric which is both insensitive to the fast variables and more general than simple statistical averaging. Our analysis of the approach provides conditions for successfully recovering the underlying slow variables, as well as an empirical protocol guiding the selection of the method parameters.
△ Less
Submitted 21 January, 2015;
originally announced January 2015.
-
On the acceleration of spatially distributed agent-based computations: a patch dynamics scheme
Authors:
Ping Liu,
Giovanni Samaey,
C. William Gear,
Ioannis G. Kevrekidis
Abstract:
In recent years, individual-based/agent-based modeling has been applied to study a wide range of applications, ranging from engineering problems to phenomena in sociology, economics and biology. Simulating such agent-based models over extended spatiotemporal domains can be prohibitively expensive due to stochasticity and the presence of multiple scales. Nevertheless, many agent-based problems exhi…
▽ More
In recent years, individual-based/agent-based modeling has been applied to study a wide range of applications, ranging from engineering problems to phenomena in sociology, economics and biology. Simulating such agent-based models over extended spatiotemporal domains can be prohibitively expensive due to stochasticity and the presence of multiple scales. Nevertheless, many agent-based problems exhibit smooth behavior in space and time on a macroscopic scale, suggesting that a useful coarse-grained continuum model could be obtained. For such problems, the equation-free framework [16-18] can significantly reduce the computational cost. Patch dynamics is an essential component of this framework. This scheme is designed to perform numerical simulations of an unavailable macroscopic equation on macroscopic time and length scales; it uses appropriately initialized simulations of the fine-scale agent-based model in a number of small "patches", which cover only a fraction of the spatiotemporal domain. In this work, we construct a finite-volume-inspired conservative patch dynamics scheme and apply it to a financial market agent-based model based on the work of Omurtag and Sirovich [22]. We first apply our patch dynamics scheme to a continuum approximation of the agent-based model, to study its performance and analyze its accuracy. We then apply the scheme to the agent-based model itself. Our computational experiments indicate that here, typically, the patch dynamics-based simulation requires only 20% of the full agent-based simulation in space, and need occur over only 10% of the temporal domain.
△ Less
Submitted 28 April, 2014;
originally announced April 2014.
-
Reduced models in chemical kinetics via nonlinear data-mining
Authors:
Eliodoro Chiavazzo,
C. William Gear,
Carmeline J. Dsilva,
Neta Rabin,
Ioannis G. Kevrekidis
Abstract:
The adoption of detailed mechanisms for chemical kinetics often poses two types of severe challenges: First, the number of degrees of freedom is large; and second, the dynamics is characterized by widely disparate time scales. As a result, reactive flow solvers with detailed chemistry often become intractable even for large clusters of CPUs, especially when dealing with direct numerical simulation…
▽ More
The adoption of detailed mechanisms for chemical kinetics often poses two types of severe challenges: First, the number of degrees of freedom is large; and second, the dynamics is characterized by widely disparate time scales. As a result, reactive flow solvers with detailed chemistry often become intractable even for large clusters of CPUs, especially when dealing with direct numerical simulation (DNS) of turbulent combustion problems. This has motivated the development of several techniques for reducing the complexity of such kinetics models, where eventually only a few variables are considered in the development of the simplified model. Unfortunately, no generally applicable a priori recipe for selecting suitable parameterizations of the reduced model is available, and the choice of slow variables often relies upon intuition and experience. We present an automated approach to this task, consisting of three main steps. First, the low dimensional manifold of slow motions is (approximately) sampled by brief simulations of the detailed model, starting from a rich enough ensemble of admissible initial conditions. Second, a global parameterization of the manifold is obtained through the Diffusion Map (DMAP) approach, which has recently emerged as a powerful tool in data analysis/machine learning. Finally, a simplified model is constructed and solved on the fly in terms of the above reduced (slow) variables. Clearly, closing this latter model requires nontrivial interpolation calculations, enabling restriction (mapping from the full ambient space to the reduced one) and lifting (mapping from the reduced space to the ambient one). This is a key step in our approach, and a variety of interpolation schemes are reported and compared. The scope of the proposed procedure is presented and discussed by means of an illustrative combustion example.
△ Less
Submitted 25 July, 2013;
originally announced July 2013.
-
Parameterization of non-linear manifolds
Authors:
C. W. Gear
Abstract:
In this report we consider the parameterization of low-dimensional manifolds that are specified (approximately) by a set of points very close to the manifold in the original high-dimensional space. Our objective is to obtain a parameterization that is (1-1) and non singular (in the sense that the Jacobian of the map between the manifold and the parameter space is bounded and non singular).
In this report we consider the parameterization of low-dimensional manifolds that are specified (approximately) by a set of points very close to the manifold in the original high-dimensional space. Our objective is to obtain a parameterization that is (1-1) and non singular (in the sense that the Jacobian of the map between the manifold and the parameter space is bounded and non singular).
△ Less
Submitted 8 April, 2013; v1 submitted 26 August, 2012;
originally announced August 2012.
-
Manifold learning techniques and model reduction applied to dissipative PDEs
Authors:
Benjamin E. Sonday,
Amit Singer,
C. William Gear,
Ioannis G. Kevrekidis
Abstract:
We link nonlinear manifold learning techniques for data analysis/compression with model reduction techniques for evolution equations with time scale separation. In particular, we demonstrate a `"nonlinear extension" of the POD-Galerkin approach to obtaining reduced dynamic models of dissipative evolution equations. The approach is illustrated through a reaction-diffusion PDE, and the performance o…
▽ More
We link nonlinear manifold learning techniques for data analysis/compression with model reduction techniques for evolution equations with time scale separation. In particular, we demonstrate a `"nonlinear extension" of the POD-Galerkin approach to obtaining reduced dynamic models of dissipative evolution equations. The approach is illustrated through a reaction-diffusion PDE, and the performance of different simulators on the full and the reduced models is compared. We also discuss the relation of this nonlinear extension with the so-called "nonlinear Galerkin" methods developed in the context of Approximate Inertial Manifolds.
△ Less
Submitted 23 November, 2010;
originally announced November 2010.
-
Analysis and Computation of a Discrete KdV-Burgers Type Equation with Fast Dispersion and Slow Diffusion
Authors:
Zvi Artstein,
C. William Gear,
Ioannis G. Kevrekidis,
Marshall Slemrod,
Edriss S. Titi
Abstract:
The long time behavior of the dynamics of a fast-slow system of ordinary differential equations is examined. The system is derived from a spatial discretization of a Korteweg-de Vries-Burgers type equation, with fast dispersion and slow diffusion. The discretization is based on a model developed by Goodman and Lax, that is composed of a fast system drifted by a slow forcing term. A natural split…
▽ More
The long time behavior of the dynamics of a fast-slow system of ordinary differential equations is examined. The system is derived from a spatial discretization of a Korteweg-de Vries-Burgers type equation, with fast dispersion and slow diffusion. The discretization is based on a model developed by Goodman and Lax, that is composed of a fast system drifted by a slow forcing term. A natural split to fast and slow state variables is, however, not available. Our approach views the limit behavior as an invariant measure of the fast motion drifted by the slow component, where the known constants of motion of the fast system are employed as slowly evolving observables; averaging equations for the latter lead to computation of characteristic features of the motion. Such computations are presented in the paper.
△ Less
Submitted 19 August, 2009;
originally announced August 2009.
-
Analysis of the accuracy and convergence of equation-free projection to a slow manifold
Authors:
A. Zagaris,
C. W. Gear,
T. J. Kaper,
I. G. Kevrekidis
Abstract:
In [C.W. Gear, T.J. Kaper, I.G. Kevrekidis, and A. Zagaris, Projecting to a Slow Manifold: Singularly Perturbed Systems and Legacy Codes, SIAM J. Appl. Dyn. Syst. 4 (2005) 711-732], we developed a class of iterative algorithms within the context of equation-free methods to approximate low-dimensional, attracting, slow manifolds in systems of differential equations with multiple time scales. For…
▽ More
In [C.W. Gear, T.J. Kaper, I.G. Kevrekidis, and A. Zagaris, Projecting to a Slow Manifold: Singularly Perturbed Systems and Legacy Codes, SIAM J. Appl. Dyn. Syst. 4 (2005) 711-732], we developed a class of iterative algorithms within the context of equation-free methods to approximate low-dimensional, attracting, slow manifolds in systems of differential equations with multiple time scales. For user-specified values of a finite number of the observables, the m-th member of the class of algorithms (m = 0, 1, ...) finds iteratively an approximation of the appropriate zero of the (m+1)-st time derivative of the remaining variables and uses this root to approximate the location of the point on the slow manifold corresponding to these values of the observables. This article is the first of two articles in which the accuracy and convergence of the iterative algorithms are analyzed. Here, we work directly with explicit fast--slow systems, in which there is an explicit small parameter, epsilon, measuring the separation of time scales. We show that, for each m = 0, 1, ..., the fixed point of the iterative algorithm approximates the slow manifold up to and including terms of O(epsilon^m). Moreover, for each m, we identify explicitly the conditions under which the m-th iterative algorithm converges to this fixed point. Finally, we show that when the iteration is unstable (or converges slowly) it may be stabilized (or its convergence may be accelerated) by application of the Recursive Projection Method. Alternatively, the Newton-Krylov Generalized Minimal Residual Method may be used. In the subsequent article, we will consider the accuracy and convergence of the iterative algorithms for a broader class of systems-in which there need not be an explicit small parameter-to which the algorithms also apply.
△ Less
Submitted 11 July, 2007;
originally announced July 2007.
-
Projective and Coarse Projective Integration for Problems with Continuous Symmetries
Authors:
Michail E. Kavousanakis,
Radek Erban,
Andreas G. Boudouvis,
C. William Gear,
Ioannis G. Kevrekidis
Abstract:
Temporal integration of equations possessing continuous symmetries (e.g. systems with translational invariance associated with traveling solutions and scale invariance associated with self-similar solutions) in a ``co-evolving'' frame (i.e. a frame which is co-traveling, co-collapsing or co-exploding with the evolving solution) leads to improved accuracy because of the smaller time derivative in…
▽ More
Temporal integration of equations possessing continuous symmetries (e.g. systems with translational invariance associated with traveling solutions and scale invariance associated with self-similar solutions) in a ``co-evolving'' frame (i.e. a frame which is co-traveling, co-collapsing or co-exploding with the evolving solution) leads to improved accuracy because of the smaller time derivative in the new spatial frame. The slower time behavior permits the use of {\it projective} and {\it coarse projective} integration with longer projective steps in the computation of the time evolution of partial differential equations and multiscale systems, respectively. These methods are also demonstrated to be effective for systems which only approximately or asymptotically possess continuous symmetries. The ideas of projective integration in a co-evolving frame are illustrated on the one-dimensional, translationally invariant Nagumo partial differential equation (PDE). A corresponding kinetic Monte Carlo model, motivated from the Nagumo kinetics, is used to illustrate the coarse-grained method. A simple, one-dimensional diffusion problem is used to illustrate the scale invariant case. The efficiency of projective integration in the co-evolving frame for both the macroscopic diffusion PDE and for a random-walker particle based model is again demonstrated.
△ Less
Submitted 4 August, 2006;
originally announced August 2006.
