-
POD-Galerkin Reduced Order Modeling of the El Nino-Southern Oscillation (ENSO)
Authors:
Yusuf Aydogdu,
Navaratnam Sri Namachchivaya
Abstract:
Reduced order modeling (ROM) aims to mitigate computational complexity by reducing the size of a high-dimensional state space. In this study, we demonstrate the efficiency, accuracy, and stability of proper orthogonal decomposition (POD)-Galerkin ROM when applied to the El Nino Southern Oscillation model, which integrates coupled atmosphere, ocean, and sea surface temperature (SST) mechanisms in t…
▽ More
Reduced order modeling (ROM) aims to mitigate computational complexity by reducing the size of a high-dimensional state space. In this study, we demonstrate the efficiency, accuracy, and stability of proper orthogonal decomposition (POD)-Galerkin ROM when applied to the El Nino Southern Oscillation model, which integrates coupled atmosphere, ocean, and sea surface temperature (SST) mechanisms in the equatorial Pacific. While POD identifies the most energetic modes of a system from simulation data, the Galerkin projection maps the governing equations onto these reduced modes to derive a simplified dynamical system. Leveraging the unique coupling properties of the model, we propose a novel approach to formulate a reduced order model derived from Galerkin projection. Our approach achieves remarkable computational efficiency, requiring only four POD modes. The results provide highly stable and accurate solutions over 95% compared to the high-dimensional full-order model (FOM), highlighting the potential of POD-Galerkin reduction for efficient and accurate climate simulations.
△ Less
Submitted 16 April, 2025; v1 submitted 17 March, 2025;
originally announced March 2025.
-
Almost Sure Asymptotic Stability of Parabolic SPDEs with Small Multiplicative Noise
Authors:
Yiming Meng,
N. Sri. Namachchivaya,
Nicolas Perkowski
Abstract:
A better understanding of the instability margin will eventually optimize the operational range for safety-critical industries. In this paper, we investigate the almost-sure exponential asymptotic stability of the trivial solution of a parabolic semilinear stochastic partial differential equation (SPDE) driven by multiplicative noise near the deterministic Hopf bifurcation point. We show the exist…
▽ More
A better understanding of the instability margin will eventually optimize the operational range for safety-critical industries. In this paper, we investigate the almost-sure exponential asymptotic stability of the trivial solution of a parabolic semilinear stochastic partial differential equation (SPDE) driven by multiplicative noise near the deterministic Hopf bifurcation point. We show the existence and uniqueness of the invariant measure under appropriate assumptions, and approximate the exponential growth rate via asymptotic expansion, given that the strength of the noise is small. This approximate quantity can readily serve as a robust indicator of the change of almost-sure stability.
△ Less
Submitted 29 October, 2023;
originally announced October 2023.
-
Almost-Sure Stability of the Single Mode Solution of a Noisy Nonlinear Autoparametric System
Authors:
Peter H. Baxendale,
N. Sri Namachchivaya
Abstract:
For a pendulum suspended below a vibrating block with white noise forcing, the solution in which the pendulum remains vertical is called the single mode solution. When this solution becomes unstable there is energy transfer from the block to the pendulum, helping to absorb the vibrations of the block. We study the Lyapunov exponent governing the almost-sure stability of the process linearized alon…
▽ More
For a pendulum suspended below a vibrating block with white noise forcing, the solution in which the pendulum remains vertical is called the single mode solution. When this solution becomes unstable there is energy transfer from the block to the pendulum, helping to absorb the vibrations of the block. We study the Lyapunov exponent governing the almost-sure stability of the process linearized along the single mode solution. The linearized equation is excited by a combination of white and colored noise processes, which makes the evaluation of the Lyapunov exponent non trivial. We obtain an explicit third order asymptotic expression for the Lyapunov exponent as the intensity of the white noise forcing tends to zero.
△ Less
Submitted 4 February, 2023;
originally announced February 2023.
-
Compressed Compressor
Authors:
Alyssa Novelia,
Yusuf Aydogdu,
Thambirajah Ravichandran,
N. Sri Namachchivaya
Abstract:
In this paper, we present a data-driven reduced order model of viscous Moore-Greitzer (MG) partial differential equation (PDE) by threading together ideas from principal component analysis (PCA) and autoencoder neural networks to sparse regression and compressed sensing. Numerical simulation of the infinite dimensional viscous MG system is reduced into low dimensional data using PCA and autoencode…
▽ More
In this paper, we present a data-driven reduced order model of viscous Moore-Greitzer (MG) partial differential equation (PDE) by threading together ideas from principal component analysis (PCA) and autoencoder neural networks to sparse regression and compressed sensing. Numerical simulation of the infinite dimensional viscous MG system is reduced into low dimensional data using PCA and autoencoder neural networks based reduced order modelling (ROM) approaches. Based on the observation that MG equations close to bifurcations have a sparse representation (normal form) with respect to high-dimensional polynomial spaces, we use the Sparse Identification of Dynamical Systems (SINDy) algorithm which uses a collection of all monomials as sampling matrix and the LASSO algorithm to recover a system of sparse two ordinary differential equations (ODEs) with cubic nonlinearities. The discovered governing equations can be used to fully recover the original system dynamics up to 98.9% accuracy. When dimensional reduction is performed along the dataset's principal components, the resulting low dimensional differential equations will be consistent and have some resemblance to the normal form structure. Additionally, a new nonlinear behaviour is exhibited in viscous MG equations during rotating stall instability past the Hopf bifurcation point.
△ Less
Submitted 19 July, 2021;
originally announced July 2021.
-
Stochastic Parameterization using Compressed Sensing: Application to the Lorenz-96 Atmospheric Model
Authors:
Amartya Mukherjee,
Yusuf Aydogdu,
Thambirajah Ravichandran,
Navaratnam Sri Namachchivaya
Abstract:
Growing set of optimization and regression techniques, based upon sparse representations of signals, to build models from data sets has received widespread attention recently with the advent of compressed sensing. This paper deals with the parameterization of the Lorenz-96 model with two time-scales that mimics mid-latitude atmospheric dynamics with microscopic convective processes. Compressed sen…
▽ More
Growing set of optimization and regression techniques, based upon sparse representations of signals, to build models from data sets has received widespread attention recently with the advent of compressed sensing. This paper deals with the parameterization of the Lorenz-96 model with two time-scales that mimics mid-latitude atmospheric dynamics with microscopic convective processes. Compressed sensing is used to build models (vector fields) to emulate the behavior of the fine-scale process, so that explicit simulations become an online benchmark for parameterization. We apply compressed sensing, where the sparse recovery is achieved by constructing a sensing/dictionary matrix from ergodic samples generated by the Lorenz-96 atmospheric model, to parameterize the unresolved variables in terms of resolved variables. Stochastic parameterization is achieved by auto-regressive modelling of noise. We utilize the ensemble Kalman filter for data assimilation, where observations (direct measurements) are assimilated in the low-dimensional stochastic parameterized model to provide predictions. Finally, we compare the predictions of compressed sensing and Wilk's polynomial regression to demonstrate the potential effectiveness of the proposed methodology.
△ Less
Submitted 22 October, 2021; v1 submitted 26 June, 2021;
originally announced June 2021.
-
Quantitative Convergence of the Filter Solution for Multiple Timescale Nonlinear Systems with Coarse-Grain Correlated Noise
Authors:
Ryne Beeson,
N. Sri Namachchivaya,
Nicolas Perkowski
Abstract:
In this paper we prove a rate of convergence for the continuous time filtering solution of a multiple timescale correlated nonlinear system to a lower dimensional filtering equation in the limit of large timescale separation. Correlation is assumed to occur between the slow signal and observation processes. Convergence is almost sure in the weak topology. An asymptotic expansion of the dual proces…
▽ More
In this paper we prove a rate of convergence for the continuous time filtering solution of a multiple timescale correlated nonlinear system to a lower dimensional filtering equation in the limit of large timescale separation. Correlation is assumed to occur between the slow signal and observation processes. Convergence is almost sure in the weak topology. An asymptotic expansion of the dual process for the solution to the Zakai equation, and probabilistic representation using backward doubly stochastic differential equations is leveraged to prove the result.
△ Less
Submitted 17 January, 2022; v1 submitted 24 November, 2020;
originally announced November 2020.
-
Approximation of the Filter Equation for Multiple Timescale, Correlated, Nonlinear Systems
Authors:
Ryne Beeson,
N. Sri Namachchivaya,
Nicolas Perkowski
Abstract:
This paper considers the approximation of the continuous time filtering equation for the case of a multiple timescale (slow-intermediate, and fast scales) that may have correlation between the slow-intermediate process and the observation process. The signal process is considered fully coupled, taking values in $\mathbb{R^{m}} \times \mathbb{R^{n}}$ and without periodicity assumptions on coefficie…
▽ More
This paper considers the approximation of the continuous time filtering equation for the case of a multiple timescale (slow-intermediate, and fast scales) that may have correlation between the slow-intermediate process and the observation process. The signal process is considered fully coupled, taking values in $\mathbb{R^{m}} \times \mathbb{R^{n}}$ and without periodicity assumptions on coefficients. It is proved that in the weak topology, the solution of the filtering equation converges in probability to a solution of a lower dimensional averaged filtering equation in the limit of large timescale separation. The method of proof uses the perturbed test function approach (method of corrector) to handle the intermediate timescale in showing tightness and characterization of limits. The correctors are solutions of Poisson equations.
△ Less
Submitted 30 October, 2020;
originally announced October 2020.
-
First Passage Time of Nonlinear Diffusion Processes with Singular Boundary Behavior
Authors:
Leo Dostal,
Navaratnam Sri Namachchivaya
Abstract:
New theorems for the moments of the first passage time of one dimensional nonlinear stochastic processes with an entrance boundary are formulated. This important class of one dimensional stochastic processes results among others from approximations of the energy or amplitude of second order nonlinear stochastic differential equations. Since the diffusion of a stochastic process vanishes at an entr…
▽ More
New theorems for the moments of the first passage time of one dimensional nonlinear stochastic processes with an entrance boundary are formulated. This important class of one dimensional stochastic processes results among others from approximations of the energy or amplitude of second order nonlinear stochastic differential equations. Since the diffusion of a stochastic process vanishes at an entrance boundary, the entrance boundary is called a singular point of the stochastic process. The theorems for the moments of the first passage times are validated based on existing analytical results. In addition, the first passage times of a nonlinear stochastic differential equation, which is important for the determination of dangerous ship roll dynamics, are calculated. The proposed analytical expressions for the moments of the first passage times can be calculated very fast using standard quadrature formulas.
△ Less
Submitted 3 June, 2019;
originally announced June 2019.
-
Exponentially-ergodic Markovian noise perturbations of delay differential equations at Hopf bifurcation
Authors:
Nishanth Lingala,
Navaratnam Sri Namachchivaya,
Volker Wihstutz
Abstract:
We consider noise perturbations of delay differential equations (DDE) experiencing Hopf bifurcation. The noise is assumed to be exponentially ergodic, i.e. transition density converges to stationary density exponentially fast uniformly in the initial condition. We show that, under an appropriate change of time scale, as the strength of the perturbations decreases to zero, the law of the critical e…
▽ More
We consider noise perturbations of delay differential equations (DDE) experiencing Hopf bifurcation. The noise is assumed to be exponentially ergodic, i.e. transition density converges to stationary density exponentially fast uniformly in the initial condition. We show that, under an appropriate change of time scale, as the strength of the perturbations decreases to zero, the law of the critical eigenmodes converges to the law of a diffusion process (without delay). We prove the result only for scalar DDE. For vector-valued DDE without proofs see Phys.Rev.E v93, 062104.
△ Less
Submitted 17 January, 2017;
originally announced January 2017.
-
Random Perturbations of a Periodically Driven Nonlinear Oscillator: Escape from a resonance zone
Authors:
Nishanth Lingala,
Navaratnam Sri Namachchivaya,
Ilya Pavlyukevich
Abstract:
The phase space for a periodically driven nonlinear oscillator consists of many resonance zones. Let the strength of periodic excitation and the strength of the damping be indexed by a small parameter $\varepsilon$. It is well known that, as $\varepsilon \to 0$, the measure of the set of initial conditions which lead to 'capture in a resonance zone' goes to zero. In this paper we study the effect…
▽ More
The phase space for a periodically driven nonlinear oscillator consists of many resonance zones. Let the strength of periodic excitation and the strength of the damping be indexed by a small parameter $\varepsilon$. It is well known that, as $\varepsilon \to 0$, the measure of the set of initial conditions which lead to 'capture in a resonance zone' goes to zero. In this paper we study the effect of weak noise on the escape from a resonance zone.
△ Less
Submitted 16 February, 2017; v1 submitted 29 October, 2015;
originally announced October 2015.
-
Perturbations of linear delay differential equations at the verge of instability
Authors:
Nishanth Lingala,
N. Sri Namachchivaya
Abstract:
The characteristic equation for a linear delay differential equation (DDE) has countably infinite roots on the complex plane. This paper considers linear DDEs that are on the verge of instability, i.e. a pair of roots of the characteristic equation lie on the imaginary axis of the complex plane, and all other roots have negative real parts. It is shown that, when small noise perturbations are pres…
▽ More
The characteristic equation for a linear delay differential equation (DDE) has countably infinite roots on the complex plane. This paper considers linear DDEs that are on the verge of instability, i.e. a pair of roots of the characteristic equation lie on the imaginary axis of the complex plane, and all other roots have negative real parts. It is shown that, when small noise perturbations are present, the probability law of the dynamics can be approximated by the probability law of a one dimensional stochastic differential equation (SDE) without delay. This is advantageous because equations without delay are easier to simulate and one-dimensional SDE are analytically tractable. When the perturbations are also linear, it is shown that the stability depends on a specific complex number. The theory is applied to study oscillators with delayed feedback. Some errors in other articles that use multiscale approach are pointed out.
△ Less
Submitted 19 February, 2016; v1 submitted 18 February, 2014;
originally announced March 2014.
-
Nonlinear and additive white noise perturbations of linear delay differential equations at the verge of instability: an averaging approach
Authors:
Nishanth Lingala,
N. Sri Namachchivaya
Abstract:
The characteristic equation for a linear delay differential equation (DDE) has countably infinite roots on the complex plane. We deal with linear DDEs that are on the verge of instability, i.e. a pair of roots of the characteristic equation (eigenvalues) lie on the imaginary axis of the complex plane, and all other roots have negative real parts. We show that, when the system is perturbed by small…
▽ More
The characteristic equation for a linear delay differential equation (DDE) has countably infinite roots on the complex plane. We deal with linear DDEs that are on the verge of instability, i.e. a pair of roots of the characteristic equation (eigenvalues) lie on the imaginary axis of the complex plane, and all other roots have negative real parts. We show that, when the system is perturbed by small noise, under an appropriate change of time scale, the law of the amplitude of projection onto the critical eigenspace is close to the law of a certain one-dimensional stochastic differential equation (SDE) without delay. Further, we show that the projection onto the stable eigenspace is small. These results allow us to give an approximate description of the delay-system using an SDE (without delay) of just one dimension. The proof is based on the martingale problem technique.
△ Less
Submitted 3 April, 2014; v1 submitted 18 November, 2013;
originally announced November 2013.
-
Dimensional reduction in nonlinear filtering: A homogenization approach
Authors:
Peter Imkeller,
N. Sri Namachchivaya,
Nicolas Perkowski,
Hoong C. Yeong
Abstract:
We propose a homogenized filter for multiscale signals, which allows us to reduce the dimension of the system. We prove that the nonlinear filter converges to our homogenized filter with rate $\sqrt{\varepsilon}$. This is achieved by a suitable asymptotic expansion of the dual of the Zakai equation, and by probabilistically representing the correction terms with the help of BDSDEs.
We propose a homogenized filter for multiscale signals, which allows us to reduce the dimension of the system. We prove that the nonlinear filter converges to our homogenized filter with rate $\sqrt{\varepsilon}$. This is achieved by a suitable asymptotic expansion of the dual of the Zakai equation, and by probabilistically representing the correction terms with the help of BDSDEs.
△ Less
Submitted 2 December, 2013; v1 submitted 13 December, 2011;
originally announced December 2011.
