-
Machine-learning prediction of tipping with applications to the Atlantic Meridional Overturning Circulation
Authors:
Shirin Panahi,
Ling-Wei Kong,
Mohammadamin Moradi,
Zheng-Meng Zhai,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
Anticipating a tipping point, a transition from one stable steady state to another, is a problem of broad relevance due to the ubiquity of the phenomenon in diverse fields. The steady-state nature of the dynamics about a tipping point makes its prediction significantly more challenging than predicting other types of critical transitions from oscillatory or chaotic dynamics. Exploiting the benefits…
▽ More
Anticipating a tipping point, a transition from one stable steady state to another, is a problem of broad relevance due to the ubiquity of the phenomenon in diverse fields. The steady-state nature of the dynamics about a tipping point makes its prediction significantly more challenging than predicting other types of critical transitions from oscillatory or chaotic dynamics. Exploiting the benefits of noise, we develop a general data-driven and machine-learning approach to predicting potential future tipping in nonautonomous dynamical systems and validate the framework using examples from different fields. As an application, we address the problem of predicting the potential collapse of the Atlantic Meridional Overturning Circulation (AMOC), possibly driven by climate-induced changes in the freshwater input to the North Atlantic. Our predictions based on synthetic and currently available empirical data place a potential collapse window spanning from 2040 to 2065, in consistency with the results in the current literature.
△ Less
Submitted 17 October, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Machine-learning parameter tracking with partial state observation
Authors:
Zheng-Meng Zhai,
Mohammadamin Moradi,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control. Existing machine-learning methods require full state observation of the underlying system and tacitly assume adiabatic changes in the parameter. Formulating an inverse problem and exploiting reservoir computing,…
▽ More
Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control. Existing machine-learning methods require full state observation of the underlying system and tacitly assume adiabatic changes in the parameter. Formulating an inverse problem and exploiting reservoir computing, we develop a model-free and fully data-driven framework to accurately track time-varying parameters from partial state observation in real time. In particular, with training data from a subset of the dynamical variables of the system for a small number of known parameter values, the framework is able to accurately predict the parameter variations in time. Low- and high-dimensional, Markovian and non-Markovian nonlinear dynamical systems are used to demonstrate the power of the machine-learning based parameter-tracking framework. Pertinent issues affecting the tracking performance are addressed.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Physical Constraint Embedded Neural Networks for inference and noise regulation
Authors:
Gregory Barber,
Mulugeta A. Haile,
Tzikang Chen
Abstract:
Neural networks often require large amounts of data to generalize and can be ill-suited for modeling small and noisy experimental datasets. Standard network architectures trained on scarce and noisy data will return predictions that violate the underlying physics. In this paper, we present methods for embedding even--odd symmetries and conservation laws in neural networks and propose novel extensi…
▽ More
Neural networks often require large amounts of data to generalize and can be ill-suited for modeling small and noisy experimental datasets. Standard network architectures trained on scarce and noisy data will return predictions that violate the underlying physics. In this paper, we present methods for embedding even--odd symmetries and conservation laws in neural networks and propose novel extensions and use cases for physical constraint embedded neural networks. We design an even--odd decomposition architecture for disentangling a neural network parameterized function into its even and odd components and demonstrate that it can accurately infer symmetries without prior knowledge. We highlight the noise resilient properties of physical constraint embedded neural networks and demonstrate their utility as physics-informed noise regulators. Here we employed a conservation of energy constraint embedded network as a physics-informed noise regulator for a symbolic regression task. We showed that our approach returns a symbolic representation of the neural network parameterized function that aligns well with the underlying physics while outperforming a baseline symbolic regression approach.
△ Less
Submitted 19 May, 2021;
originally announced May 2021.
-
TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks
Authors:
Levi D. McClenny,
Mulugeta A. Haile,
Ulisses M. Braga-Neto
Abstract:
Physics-Informed Neural Networks promise to revolutionize science and engineering practice, by introducing domain-aware deep machine learning models into scientific computation. Several software suites have emerged to make the implementation and usage of these architectures available to the research and industry communities. Here we introduce\linebreak TensorDiffEq, built on Tensorflow 2.x, which…
▽ More
Physics-Informed Neural Networks promise to revolutionize science and engineering practice, by introducing domain-aware deep machine learning models into scientific computation. Several software suites have emerged to make the implementation and usage of these architectures available to the research and industry communities. Here we introduce\linebreak TensorDiffEq, built on Tensorflow 2.x, which presents an intuitive Keras-like interface for problem domain definition, model definition, and solution of forward and inverse problems using physics-aware deep learning methods. TensorDiffEq takes full advantage of Tensorflow 2.x infrastructure for deployment on multiple GPUs, allowing the implementation of large high-dimensional and complex models. Simultaneously, TensorDiffEq supports the Keras API for custom neural network architecture definitions. In the case of smaller or simpler models, the package allows for rapid deployment on smaller-scale CPU platforms with negligible changes to the implementation scripts. We demonstrate the basic usage and capabilities of TensorDiffEq in solving forward, inverse, and data assimilation problems of varying sizes and levels of complexity. The source code is available at https://github.com/tensordiffeq.
△ Less
Submitted 29 March, 2021;
originally announced March 2021.
-
Joint Parameter Discovery and Generative Modeling of Dynamic Systems
Authors:
Gregory Barber,
Mulugeta A. Haile,
Tzikang Chen
Abstract:
Given an unknown dynamic system such as a coupled harmonic oscillator with $n$ springs and point masses. We are often interested in gaining insights into its physical parameters, i.e. stiffnesses and masses, by observing trajectories of motion. How do we achieve this from video frames or time-series data and without the knowledge of the dynamics model? We present a neural framework for estimating…
▽ More
Given an unknown dynamic system such as a coupled harmonic oscillator with $n$ springs and point masses. We are often interested in gaining insights into its physical parameters, i.e. stiffnesses and masses, by observing trajectories of motion. How do we achieve this from video frames or time-series data and without the knowledge of the dynamics model? We present a neural framework for estimating physical parameters in a manner consistent with the underlying physics. The neural framework uses a deep latent variable model to disentangle the system physical parameters from canonical coordinate observations. It then returns a Hamiltonian parameterization that generalizes well with respect to the discovered physical parameters. We tested our framework with simple harmonic oscillators, $n=1$, and noisy observations and show that it discovers the underlying system parameters and generalizes well with respect to these discovered parameters. Our model also extrapolates the dynamics of the system beyond the training interval and outperforms a non-physically constrained baseline model. Our source code and datasets can be found at this URL: https://github.com/gbarber94/ConSciNet.
△ Less
Submitted 19 March, 2021;
originally announced March 2021.
-
Two-dimensional electrochemical model for mixed conductors: a study of ceria
Authors:
Francesco Ciucci,
William C. Chueh,
Sossina M. Haile,
David G. Goodwin
Abstract:
A two-dimensional small bias model has been developed for a patterned metal current collector $|$ mixed oxygen ion and electronic conductor (MIEC) $|$ patterned metal current collector electrochemical cell in a symmetric gas environment. Specifically, we compute the electrochemical potential distributions of oxygen vacancies and electrons in the bulk and near the surface for…
▽ More
A two-dimensional small bias model has been developed for a patterned metal current collector $|$ mixed oxygen ion and electronic conductor (MIEC) $|$ patterned metal current collector electrochemical cell in a symmetric gas environment. Specifically, we compute the electrochemical potential distributions of oxygen vacancies and electrons in the bulk and near the surface for $\text{Pt} | \text{Sm}_{0.15}\text{Ce}_{0.85}\text{O}_{1.925} | \text{Pt}$ symmetric cell in a $\text{H}_2-\text{H}_2\text{O}-\text{Ar}$ (reducing) atmosphere from 500 to $650^o C$. Using a two-dimensional finite-element model, we show that two types of electronic current exist within the cell: an in-plane drift-diffusion current that flows between the gas $|$ ceria chemical reaction site and the metal current collector, and a cross-plane current that flows between the two metal electrodes on the opposite side of the cell. By fitting the surface reaction constant $\tilde k_f^0$ to experimental electrode resistance values while fixing material properties such as bulk ionic and electronic equilibrium defect concentrations and mobilities, we are able to separate the electrode polarization into the surface reaction component and the in-plane electron drift-diffusion component. We show that for mixed conductors with a low electronic conductivity (a function of oxygen partial pressure) or a high surface reaction rate constant, the in-plane electron drift-diffusion resistance can become rate-limiting in the electrode reaction.
△ Less
Submitted 18 March, 2009;
originally announced March 2009.
