-
Unsupervised learning for anticipating critical transitions
Authors:
Shirin Panahi,
Ling-Wei Kong,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
For anticipating critical transitions in complex dynamical systems, the recent approach of parameter-driven reservoir computing requires explicit knowledge of the bifurcation parameter. We articulate a framework combining a variational autoencoder (VAE) and reservoir computing to address this challenge. In particular, the driving factor is detected from time series using the VAE in an unsupervised…
▽ More
For anticipating critical transitions in complex dynamical systems, the recent approach of parameter-driven reservoir computing requires explicit knowledge of the bifurcation parameter. We articulate a framework combining a variational autoencoder (VAE) and reservoir computing to address this challenge. In particular, the driving factor is detected from time series using the VAE in an unsupervised-learning fashion and the extracted information is then used as the parameter input to the reservoir computer for anticipating the critical transition. We demonstrate the power of the unsupervised learning scheme using prototypical dynamical systems including the spatiotemporal Kuramoto-Sivashinsky system. The scheme can also be extended to scenarios where the target system is driven by several independent parameters or with partial state observations.
△ Less
Submitted 2 January, 2025;
originally announced January 2025.
-
Learning to learn ecosystems from limited data -- a meta-learning approach
Authors:
Zheng-Meng Zhai,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
A fundamental challenge in developing data-driven approaches to ecological systems for tasks such as state estimation and prediction is the paucity of the observational or measurement data. For example, modern machine-learning techniques such as deep learning or reservoir computing typically require a large quantity of data. Leveraging synthetic data from paradigmatic nonlinear but non-ecological…
▽ More
A fundamental challenge in developing data-driven approaches to ecological systems for tasks such as state estimation and prediction is the paucity of the observational or measurement data. For example, modern machine-learning techniques such as deep learning or reservoir computing typically require a large quantity of data. Leveraging synthetic data from paradigmatic nonlinear but non-ecological dynamical systems, we develop a meta-learning framework with time-delayed feedforward neural networks to predict the long-term behaviors of ecological systems as characterized by their attractors. We show that the framework is capable of accurately reconstructing the ``dynamical climate'' of the ecological system with limited data. Three benchmark population models in ecology, namely the Hastings-Powell model, a three-species food chain, and the Lotka-Volterra system, are used to demonstrate the performance of the meta-learning based prediction framework. In all cases, enhanced accuracy and robustness are achieved using five to seven times less training data as compared with the corresponding machine-learning method trained solely from the ecosystem data. A number of issues affecting the prediction performance are addressed.
△ Less
Submitted 2 October, 2024;
originally announced October 2024.
-
Machine-learning prediction of tipping with applications to the Atlantic Meridional Overturning Circulation
Authors:
Shirin Panahi,
Ling-Wei Kong,
Mohammadamin Moradi,
Zheng-Meng Zhai,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
Anticipating a tipping point, a transition from one stable steady state to another, is a problem of broad relevance due to the ubiquity of the phenomenon in diverse fields. The steady-state nature of the dynamics about a tipping point makes its prediction significantly more challenging than predicting other types of critical transitions from oscillatory or chaotic dynamics. Exploiting the benefits…
▽ More
Anticipating a tipping point, a transition from one stable steady state to another, is a problem of broad relevance due to the ubiquity of the phenomenon in diverse fields. The steady-state nature of the dynamics about a tipping point makes its prediction significantly more challenging than predicting other types of critical transitions from oscillatory or chaotic dynamics. Exploiting the benefits of noise, we develop a general data-driven and machine-learning approach to predicting potential future tipping in nonautonomous dynamical systems and validate the framework using examples from different fields. As an application, we address the problem of predicting the potential collapse of the Atlantic Meridional Overturning Circulation (AMOC), possibly driven by climate-induced changes in the freshwater input to the North Atlantic. Our predictions based on synthetic and currently available empirical data place a potential collapse window spanning from 2040 to 2065, in consistency with the results in the current literature.
△ Less
Submitted 17 October, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Machine-learning parameter tracking with partial state observation
Authors:
Zheng-Meng Zhai,
Mohammadamin Moradi,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control. Existing machine-learning methods require full state observation of the underlying system and tacitly assume adiabatic changes in the parameter. Formulating an inverse problem and exploiting reservoir computing,…
▽ More
Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control. Existing machine-learning methods require full state observation of the underlying system and tacitly assume adiabatic changes in the parameter. Formulating an inverse problem and exploiting reservoir computing, we develop a model-free and fully data-driven framework to accurately track time-varying parameters from partial state observation in real time. In particular, with training data from a subset of the dynamical variables of the system for a small number of known parameter values, the framework is able to accurately predict the parameter variations in time. Low- and high-dimensional, Markovian and non-Markovian nonlinear dynamical systems are used to demonstrate the power of the machine-learning based parameter-tracking framework. Pertinent issues affecting the tracking performance are addressed.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Model-free tracking control of complex dynamical trajectories with machine learning
Authors:
Zheng-Meng Zhai,
Mohammadamin Moradi,
Ling-Wei Kong,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
Nonlinear tracking control enabling a dynamical system to track a desired trajectory is fundamental to robotics, serving a wide range of civil and defense applications. In control engineering, designing tracking control requires complete knowledge of the system model and equations. We develop a model-free, machine-learning framework to control a two-arm robotic manipulator using only partially obs…
▽ More
Nonlinear tracking control enabling a dynamical system to track a desired trajectory is fundamental to robotics, serving a wide range of civil and defense applications. In control engineering, designing tracking control requires complete knowledge of the system model and equations. We develop a model-free, machine-learning framework to control a two-arm robotic manipulator using only partially observed states, where the controller is realized by reservoir computing. Stochastic input is exploited for training, which consists of the observed partial state vector as the first and its immediate future as the second component so that the neural machine regards the latter as the future state of the former. In the testing (deployment) phase, the immediate-future component is replaced by the desired observational vector from the reference trajectory. We demonstrate the effectiveness of the control framework using a variety of periodic and chaotic signals, and establish its robustness against measurement noise, disturbances, and uncertainties.
△ Less
Submitted 20 September, 2023;
originally announced September 2023.
-
Digital twins of nonlinear dynamical systems
Authors:
Ling-Wei Kong,
Yang Weng,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
We articulate the design imperatives for machine-learning based digital twins for nonlinear dynamical systems subject to external driving, which can be used to monitor the ``health'' of the target system and anticipate its future collapse. We demonstrate that, with single or parallel reservoir computing configurations, the digital twins are capable of challenging forecasting and monitoring tasks.…
▽ More
We articulate the design imperatives for machine-learning based digital twins for nonlinear dynamical systems subject to external driving, which can be used to monitor the ``health'' of the target system and anticipate its future collapse. We demonstrate that, with single or parallel reservoir computing configurations, the digital twins are capable of challenging forecasting and monitoring tasks. Employing prototypical systems from climate, optics and ecology, we show that the digital twins can extrapolate the dynamics of the target system to certain parameter regimes never experienced before, make continual forecasting/monitoring with sparse real-time updates under non-stationary external driving, infer hidden variables and accurately predict their dynamical evolution, adapt to different forms of external driving, and extrapolate the global bifurcation behaviors to systems of some different sizes. These features make our digital twins appealing in significant applications such as monitoring the health of critical systems and forecasting their potential collapse induced by environmental changes.
△ Less
Submitted 5 October, 2022;
originally announced October 2022.
-
A Model for Multi-Agent Heterogeneous Interaction Problems
Authors:
Christopher D. Hsu,
Mulugeta A. Haile,
Pratik Chaudhari
Abstract:
We introduce a model for multi-agent interaction problems to understand how a heterogeneous team of agents should organize its resources to tackle a heterogeneous team of attackers. This model is inspired by how the human immune system tackles a diverse set of pathogens. The key property of this model is a ``cross-reactivity'' kernel which enables a particular defender type to respond strongly to…
▽ More
We introduce a model for multi-agent interaction problems to understand how a heterogeneous team of agents should organize its resources to tackle a heterogeneous team of attackers. This model is inspired by how the human immune system tackles a diverse set of pathogens. The key property of this model is a ``cross-reactivity'' kernel which enables a particular defender type to respond strongly to some attacker types but weakly to a few different types of attackers. We show how due to such cross-reactivity, the defender team can optimally counteract a heterogeneous attacker team using very few types of defender agents, and thereby minimize its resources. We study this model in different settings to characterize a set of guiding principles for control problems with heterogeneous teams of agents, e.g., sensitivity of the harm to sub-optimal defender distributions, and competition between defenders gives near-optimal behavior using decentralized computation of the control. We also compare this model with existing approaches including reinforcement-learned policies, perimeter defense, and coverage control.
△ Less
Submitted 19 September, 2024; v1 submitted 2 August, 2022;
originally announced August 2022.
-
Underwater Acoustic Communication Channel Modeling using Reservoir Computing
Authors:
Oluwaseyi Onasami,
Ming Feng,
Hao Xu,
Mulugeta Haile,
Lijun Qian
Abstract:
Underwater acoustic (UWA) communications have been widely used but greatly impaired due to the complicated nature of the underwater environment. In order to improve UWA communications, modeling and understanding the UWA channel is indispensable. However, there exist many challenges due to the high uncertainties of the underwater environment and the lack of real-world measurement data. In this work…
▽ More
Underwater acoustic (UWA) communications have been widely used but greatly impaired due to the complicated nature of the underwater environment. In order to improve UWA communications, modeling and understanding the UWA channel is indispensable. However, there exist many challenges due to the high uncertainties of the underwater environment and the lack of real-world measurement data. In this work, the capability of reservoir computing and deep learning has been explored for modeling the UWA communication channel accurately using real underwater data collected from a water tank with disturbance and from Lake Tahoe. We leverage the capability of reservoir computing for modeling dynamical systems and provided a data-driven approach to modeling the UWA channel using Echo State Network (ESN). In addition, the potential application of transfer learning to reservoir computing has been examined. Experimental results show that ESN is able to model chaotic UWA channels with better performance compared to popular deep learning models in terms of mean absolute percentage error (MAPE), specifically, ESN has outperformed deep neural network by 2% and as much as 40% in benign and chaotic UWA respectively.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Implicit Particle Filtering via a Bank of Nonlinear Kalman Filters
Authors:
Iman Askari,
Mulugeta A. Haile,
Xuemin Tu,
Huazhen Fang
Abstract:
The implicit particle filter seeks to mitigate particle degeneracy by identifying particles in the target distribution's high-probability regions. This study is motivated by the need to enhance computational tractability in implementing this approach. We investigate the connection of the particle update step in the implicit particle filter with that of the Kalman filter and then formulate a novel…
▽ More
The implicit particle filter seeks to mitigate particle degeneracy by identifying particles in the target distribution's high-probability regions. This study is motivated by the need to enhance computational tractability in implementing this approach. We investigate the connection of the particle update step in the implicit particle filter with that of the Kalman filter and then formulate a novel realization of the implicit particle filter based on a bank of nonlinear Kalman filters. This realization is more amenable and efficient computationally.
△ Less
Submitted 6 June, 2023; v1 submitted 9 May, 2022;
originally announced May 2022.
-
Physical Constraint Embedded Neural Networks for inference and noise regulation
Authors:
Gregory Barber,
Mulugeta A. Haile,
Tzikang Chen
Abstract:
Neural networks often require large amounts of data to generalize and can be ill-suited for modeling small and noisy experimental datasets. Standard network architectures trained on scarce and noisy data will return predictions that violate the underlying physics. In this paper, we present methods for embedding even--odd symmetries and conservation laws in neural networks and propose novel extensi…
▽ More
Neural networks often require large amounts of data to generalize and can be ill-suited for modeling small and noisy experimental datasets. Standard network architectures trained on scarce and noisy data will return predictions that violate the underlying physics. In this paper, we present methods for embedding even--odd symmetries and conservation laws in neural networks and propose novel extensions and use cases for physical constraint embedded neural networks. We design an even--odd decomposition architecture for disentangling a neural network parameterized function into its even and odd components and demonstrate that it can accurately infer symmetries without prior knowledge. We highlight the noise resilient properties of physical constraint embedded neural networks and demonstrate their utility as physics-informed noise regulators. Here we employed a conservation of energy constraint embedded network as a physics-informed noise regulator for a symbolic regression task. We showed that our approach returns a symbolic representation of the neural network parameterized function that aligns well with the underlying physics while outperforming a baseline symbolic regression approach.
△ Less
Submitted 19 May, 2021;
originally announced May 2021.
-
TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks
Authors:
Levi D. McClenny,
Mulugeta A. Haile,
Ulisses M. Braga-Neto
Abstract:
Physics-Informed Neural Networks promise to revolutionize science and engineering practice, by introducing domain-aware deep machine learning models into scientific computation. Several software suites have emerged to make the implementation and usage of these architectures available to the research and industry communities. Here we introduce\linebreak TensorDiffEq, built on Tensorflow 2.x, which…
▽ More
Physics-Informed Neural Networks promise to revolutionize science and engineering practice, by introducing domain-aware deep machine learning models into scientific computation. Several software suites have emerged to make the implementation and usage of these architectures available to the research and industry communities. Here we introduce\linebreak TensorDiffEq, built on Tensorflow 2.x, which presents an intuitive Keras-like interface for problem domain definition, model definition, and solution of forward and inverse problems using physics-aware deep learning methods. TensorDiffEq takes full advantage of Tensorflow 2.x infrastructure for deployment on multiple GPUs, allowing the implementation of large high-dimensional and complex models. Simultaneously, TensorDiffEq supports the Keras API for custom neural network architecture definitions. In the case of smaller or simpler models, the package allows for rapid deployment on smaller-scale CPU platforms with negligible changes to the implementation scripts. We demonstrate the basic usage and capabilities of TensorDiffEq in solving forward, inverse, and data assimilation problems of varying sizes and levels of complexity. The source code is available at https://github.com/tensordiffeq.
△ Less
Submitted 29 March, 2021;
originally announced March 2021.
-
Joint Parameter Discovery and Generative Modeling of Dynamic Systems
Authors:
Gregory Barber,
Mulugeta A. Haile,
Tzikang Chen
Abstract:
Given an unknown dynamic system such as a coupled harmonic oscillator with $n$ springs and point masses. We are often interested in gaining insights into its physical parameters, i.e. stiffnesses and masses, by observing trajectories of motion. How do we achieve this from video frames or time-series data and without the knowledge of the dynamics model? We present a neural framework for estimating…
▽ More
Given an unknown dynamic system such as a coupled harmonic oscillator with $n$ springs and point masses. We are often interested in gaining insights into its physical parameters, i.e. stiffnesses and masses, by observing trajectories of motion. How do we achieve this from video frames or time-series data and without the knowledge of the dynamics model? We present a neural framework for estimating physical parameters in a manner consistent with the underlying physics. The neural framework uses a deep latent variable model to disentangle the system physical parameters from canonical coordinate observations. It then returns a Hamiltonian parameterization that generalizes well with respect to the discovered physical parameters. We tested our framework with simple harmonic oscillators, $n=1$, and noisy observations and show that it discovers the underlying system parameters and generalizes well with respect to these discovered parameters. Our model also extrapolates the dynamics of the system beyond the training interval and outperforms a non-physically constrained baseline model. Our source code and datasets can be found at this URL: https://github.com/gbarber94/ConSciNet.
△ Less
Submitted 19 March, 2021;
originally announced March 2021.
-
Tomography of time-dependent quantum spin networks with machine learning
Authors:
Chen-Di Han,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
Interacting spin networks are fundamental to quantum computing. Data-based tomography of time-independent spin networks has been achieved, but an open challenge is to ascertain the structures of time-dependent spin networks using time series measurements taken locally from a small subset of the spins. Physically, the dynamical evolution of a spin network under time-dependent driving or perturbatio…
▽ More
Interacting spin networks are fundamental to quantum computing. Data-based tomography of time-independent spin networks has been achieved, but an open challenge is to ascertain the structures of time-dependent spin networks using time series measurements taken locally from a small subset of the spins. Physically, the dynamical evolution of a spin network under time-dependent driving or perturbation is described by the Heisenberg equation of motion. Motivated by this basic fact, we articulate a physics-enhanced machine learning framework whose core is Heisenberg neural networks. In particular, we develop a deep learning algorithm according to some physics motivated loss function based on the Heisenberg equation, which "forces" the neural network to follow the quantum evolution of the spin variables. We demonstrate that, from local measurements, not only the local Hamiltonian can be recovered but the Hamiltonian reflecting the interacting structure of the whole system can also be faithfully reconstructed. We test our Heisenberg neural machine on spin networks of a variety of structures. In the extreme case where measurements are taken from only one spin, the achieved tomography fidelity values can reach about 90%. The developed machine learning framework is applicable to any time-dependent systems whose quantum dynamical evolution is governed by the Heisenberg equation of motion.
△ Less
Submitted 15 March, 2021;
originally announced March 2021.
-
Adaptable Hamiltonian neural networks
Authors:
Chen-Di Han,
Bryan Glaz,
Mulugeta Haile,
Ying-Cheng Lai
Abstract:
The rapid growth of research in exploiting machine learning to predict chaotic systems has revived a recent interest in Hamiltonian Neural Networks (HNNs) with physical constraints defined by the Hamilton's equations of motion, which represent a major class of physics-enhanced neural networks. We introduce a class of HNNs capable of adaptable prediction of nonlinear physical systems: by training t…
▽ More
The rapid growth of research in exploiting machine learning to predict chaotic systems has revived a recent interest in Hamiltonian Neural Networks (HNNs) with physical constraints defined by the Hamilton's equations of motion, which represent a major class of physics-enhanced neural networks. We introduce a class of HNNs capable of adaptable prediction of nonlinear physical systems: by training the neural network based on time series from a small number of bifurcation-parameter values of the target Hamiltonian system, the HNN can predict the dynamical states at other parameter values, where the network has not been exposed to any information about the system at these parameter values. The architecture of the HNN differs from the previous ones in that we incorporate an input parameter channel, rendering the HNN parameter--cognizant. We demonstrate, using paradigmatic Hamiltonian systems, that training the HNN using time series from as few as four parameter values bestows the neural machine with the ability to predict the state of the target system in an entire parameter interval. Utilizing the ensemble maximum Lyapunov exponent and the alignment index as indicators, we show that our parameter-cognizant HNN can successfully predict the route of transition to chaos. Physics-enhanced machine learning is a forefront area of research, and our adaptable HNNs provide an approach to understanding machine learning with broad applications.
△ Less
Submitted 25 February, 2021;
originally announced February 2021.
-
Type of Leibniz Rule on Riemann-Liouville Variable-Order Fractional Integral and Derivative Operator
Authors:
Dagnachew Jenber,
Mollalign Haile
Abstract:
In this paper, types of Leibniz Rule for Riemann-Liouville Variable-Order fractional integral and derivative Operator is developed. The product rule, quotient rule, and chain rule formulas for both integral and differential operators are established. In particular, there are four types of product rule formulas: Product rule type-I, Product rule type-II, Product rule type-III, and Product rule type…
▽ More
In this paper, types of Leibniz Rule for Riemann-Liouville Variable-Order fractional integral and derivative Operator is developed. The product rule, quotient rule, and chain rule formulas for both integral and differential operators are established. In particular, there are four types of product rule formulas: Product rule type-I, Product rule type-II, Product rule type-III, and Product rule type-Iv. Quotient rule type-I, quotient rule type-II, quotient rule type-III, and quotient rule type-Iv formulas developed from product rule types. There are four types of chain rule formulas: chain rule type-I, chain rule type-II, chain rule type-III, and chain rule type-Iv.
△ Less
Submitted 18 January, 2021;
originally announced January 2021.
-
SSUE: Simultaneous State and Uncertainty Estimation for Dynamical Systems
Authors:
Hang Geng,
Mulugeta A. Haile,
Huazhen Fang
Abstract:
Parameters of the mathematical model describing many practical dynamical systems are prone to vary due to aging or renewal, wear and tear, as well as changes in environmental or service conditions. These variabilities will adversely affect the accuracy of state estimation. In this paper, we introduce SSUE: Simultaneous State and Uncertainty Estimation for quantifying parameter uncertainty while si…
▽ More
Parameters of the mathematical model describing many practical dynamical systems are prone to vary due to aging or renewal, wear and tear, as well as changes in environmental or service conditions. These variabilities will adversely affect the accuracy of state estimation. In this paper, we introduce SSUE: Simultaneous State and Uncertainty Estimation for quantifying parameter uncertainty while simultaneously estimating the internal state of a system. Our approach involves the development of a Bayesian framework that recursively updates the posterior joint density of the unknown state vector and parameter uncertainty. To execute the framework for practical implementation, we develop a computational algorithm based on maximum a posteriori estimation and the numerical Newton's method. Observability analysis is conducted for linear systems, and its relation with the consistency of the estimation of the uncertainty's location is unveiled. Additional simulation results are provided to demonstrate the effectiveness of the proposed SSUE approach.
△ Less
Submitted 20 October, 2020;
originally announced October 2020.
-
Deep Multimodal Transfer-Learned Regression in Data-Poor Domains
Authors:
Levi McClenny,
Mulugeta Haile,
Vahid Attari,
Brian Sadler,
Ulisses Braga-Neto,
Raymundo Arroyave
Abstract:
In many real-world applications of deep learning, estimation of a target may rely on various types of input data modes, such as audio-video, image-text, etc. This task can be further complicated by a lack of sufficient data. Here we propose a Deep Multimodal Transfer-Learned Regressor (DMTL-R) for multimodal learning of image and feature data in a deep regression architecture effective at predicti…
▽ More
In many real-world applications of deep learning, estimation of a target may rely on various types of input data modes, such as audio-video, image-text, etc. This task can be further complicated by a lack of sufficient data. Here we propose a Deep Multimodal Transfer-Learned Regressor (DMTL-R) for multimodal learning of image and feature data in a deep regression architecture effective at predicting target parameters in data-poor domains. Our model is capable of fine-tuning a given set of pre-trained CNN weights on a small amount of training image data, while simultaneously conditioning on feature information from a complimentary data mode during network training, yielding more accurate single-target or multi-target regression than can be achieved using the images or the features alone. We present results using phase-field simulation microstructure images with an accompanying set of physical features, using pre-trained weights from various well-known CNN architectures, which demonstrate the efficacy of the proposed multimodal approach.
△ Less
Submitted 16 June, 2020;
originally announced June 2020.
-
Robust Extended Kalman Filtering for Systems with Measurement Outliers
Authors:
Huazhen Fang,
Mulugeta A. Haile,
Yebin Wang
Abstract:
Outliers can contaminate the measurement process of many nonlinear systems, which can be caused by sensor errors, model uncertainties, change in ambient environment, data loss or malicious cyber attacks. When the extended Kalman filter (EKF) is applied to such systems for state estimation, the outliers can seriously reduce the estimation accuracy. This paper proposes an innovation saturation mecha…
▽ More
Outliers can contaminate the measurement process of many nonlinear systems, which can be caused by sensor errors, model uncertainties, change in ambient environment, data loss or malicious cyber attacks. When the extended Kalman filter (EKF) is applied to such systems for state estimation, the outliers can seriously reduce the estimation accuracy. This paper proposes an innovation saturation mechanism to modify the EKF toward building robustness against outliers. This mechanism applies a saturation function to the innovation process that the EKF leverages to correct the state estimation. As such, when an outlier occurs, the distorting innovation is saturated and thus prevented from damaging the state estimation. The mechanism features an adaptive adjustment of the saturation bound. The design leads to the development robust EKF approaches for continuous- and discrete-time systems. They are proven to be capable of generating bounded-error estimation in the presence of bounded outlier disturbances. An application study about mobile robot localization is presented, with the numerical simulation showing the efficacy of the proposed design. Compared to existing methods, the proposed approaches can effectively reject outliers of various magnitudes, types and durations, at significant computational efficiency and without requiring measurement redundancy.
△ Less
Submitted 30 March, 2019;
originally announced April 2019.
-
Nonlinear Bayesian Estimation: From Kalman Filtering to a Broader Horizon
Authors:
Huazhen Fang,
Ning Tian,
Yebin Wang,
MengChu Zhou,
Mulugeta A. Haile
Abstract:
This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To date, one of the most promising and popular approaches is to view and address the problem from a Bayesian probabilistic perspective, which enables estimation of…
▽ More
This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To date, one of the most promising and popular approaches is to view and address the problem from a Bayesian probabilistic perspective, which enables estimation of the unknown state variables by tracking their probabilistic distribution or statistics (e.g., mean and covariance) conditioned on the system's measurement data. This article offers a systematic introduction of the Bayesian state estimation framework and reviews various Kalman filtering (KF) techniques, progressively from the standard KF for linear systems to extended KF, unscented KF and ensemble KF for nonlinear systems. It also overviews other prominent or emerging Bayesian estimation methods including the Gaussian filtering, Gaussian-sum filtering, particle filtering and moving horizon estimation and extends the discussion of state estimation forward to more complicated problems such as simultaneous state and parameter/input estimation.
△ Less
Submitted 14 December, 2017; v1 submitted 4 December, 2017;
originally announced December 2017.
-
An electrical conductivity relaxation study of oxygen transport in samarium doped ceria
Authors:
Chirranjeevi Balaji Gopal,
Sossina M. Haile
Abstract:
The efficacy of the electrical conductivity relaxation (ECR) technique for investigating the oxygen transport properties of mixed conducting oxides has been evaluated. Fifteen mol% samarium doped ceria (SDC15), for which approximate values of the two principal transport properties, bulk oxygen diffusivity, $D_{Chem}$, and surface reaction rate constant, $k_S$, can be found in the literature, was c…
▽ More
The efficacy of the electrical conductivity relaxation (ECR) technique for investigating the oxygen transport properties of mixed conducting oxides has been evaluated. Fifteen mol% samarium doped ceria (SDC15), for which approximate values of the two principal transport properties, bulk oxygen diffusivity, $D_{Chem}$, and surface reaction rate constant, $k_S$, can be found in the literature, was chosen as the benchmark material against which to validate the methodology. Measurements were carried out at temperatures between 750 $^\circ$C and 850 $^\circ$C and over a wide range of oxygen partial pressures. An unexpectedly high p-type electronic transference number enabled ECR measurements under oxidizing conditions. A systematic data analysis procedure was developed to permit reliable extraction of the kinetic parameters even in the general case of simultaneous bulk and surface limitation. The $D_{Chem}$ from this study showed excellent qualitative and quantitative agreement with expected values, falling in the range from $\sim 2\times10^{-5}$ to $2\times10^{-4}$ cm$^2$/s. The surface reaction constant under H$_2$/H$_2$O mixtures also showed good agreement with literature results. Remarkably, this value increased by a factor of 40 under mixtures of CO/CO$_2$ or O$_2$/Ar. This observation suggests kinetic advantages for production of CO rather than H$_2$ in a two-step solar-driven thermochemical process based on samarium doped ceria.
△ Less
Submitted 2 January, 2014; v1 submitted 31 August, 2013;
originally announced September 2013.
-
Two-dimensional electrochemical model for mixed conductors: a study of ceria
Authors:
Francesco Ciucci,
William C. Chueh,
Sossina M. Haile,
David G. Goodwin
Abstract:
A two-dimensional small bias model has been developed for a patterned metal current collector $|$ mixed oxygen ion and electronic conductor (MIEC) $|$ patterned metal current collector electrochemical cell in a symmetric gas environment. Specifically, we compute the electrochemical potential distributions of oxygen vacancies and electrons in the bulk and near the surface for…
▽ More
A two-dimensional small bias model has been developed for a patterned metal current collector $|$ mixed oxygen ion and electronic conductor (MIEC) $|$ patterned metal current collector electrochemical cell in a symmetric gas environment. Specifically, we compute the electrochemical potential distributions of oxygen vacancies and electrons in the bulk and near the surface for $\text{Pt} | \text{Sm}_{0.15}\text{Ce}_{0.85}\text{O}_{1.925} | \text{Pt}$ symmetric cell in a $\text{H}_2-\text{H}_2\text{O}-\text{Ar}$ (reducing) atmosphere from 500 to $650^o C$. Using a two-dimensional finite-element model, we show that two types of electronic current exist within the cell: an in-plane drift-diffusion current that flows between the gas $|$ ceria chemical reaction site and the metal current collector, and a cross-plane current that flows between the two metal electrodes on the opposite side of the cell. By fitting the surface reaction constant $\tilde k_f^0$ to experimental electrode resistance values while fixing material properties such as bulk ionic and electronic equilibrium defect concentrations and mobilities, we are able to separate the electrode polarization into the surface reaction component and the in-plane electron drift-diffusion component. We show that for mixed conductors with a low electronic conductivity (a function of oxygen partial pressure) or a high surface reaction rate constant, the in-plane electron drift-diffusion resistance can become rate-limiting in the electrode reaction.
△ Less
Submitted 18 March, 2009;
originally announced March 2009.
