Showing 1–28 of 28 results for author: Chekroun, M D

Non-Markovian Reduced Models to Unravel Transitions in Non-equilibrium Systems

Authors: Mickaël D. Chekroun, Honghu Liu, James C. McWilliams

Abstract: This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic parameterizations to reduce the original equations' complexity while capturing the key effects of unresolved scales. It works for both Gaussian and Levy-type noise… ▽ More This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic parameterizations to reduce the original equations' complexity while capturing the key effects of unresolved scales. It works for both Gaussian and Levy-type noise. Our parameterizations offer two key advantages. First, they approximate stochastic invariant manifolds when the latter exist. Second, even when such manifolds break down, our formulas can be adapted by a simple optimization of its constitutive parameters. This allows us to handle scenarios with weak time-scale separation where the system has undergone multiple transitions, resulting in large-amplitude solutions not captured by invariant manifold or other time-scale separation methods. The optimized stochastic parameterizations capture how small-scale noise impacts larger scales through the system's nonlinear interactions. This effect is achieved by the very fabric of our parameterizations incorporating non-Markovian coefficients into the reduced equation. Such coefficients account for the noise's past influence using a finite memory length, selected for optimal performance. The specific "memory" function, which determines how this past influence is weighted, depends on the noise's strength and how it interacts with the system's nonlinearities. Remarkably, training our theory-guided reduced models on a single noise path effectively learns the optimal memory length for out-of-sample predictions, including rare events. This success stems from our "hybrid" approach, which combines analytical understanding with data-driven learning. This combination avoids a key limitation of purely data-driven methods: their struggle to generalize to unseen scenarios, also known as the "extrapolation problem." △ Less

Submitted 13 December, 2024; v1 submitted 23 August, 2024; originally announced August 2024.

Effective Reduced Models from Delay Differential Equations: Bifurcations, Tipping Solution Paths, and ENSO variability

Authors: Mickaël D. Chekroun, Honghu Liu

Abstract: Conceptual delay models have played a key role in the understanding of El Niño-Southern Oscillation (ENSO) variability. Based on such delay models, we propose a novel scenario for the fabric of ENSO variability resulting from the subtle interplay between stochastic disturbances and nonlinear invariant sets emerging from bifurcations of the unperturbed dynamics. To identify these invariant sets w… ▽ More Conceptual delay models have played a key role in the understanding of El Niño-Southern Oscillation (ENSO) variability. Based on such delay models, we propose a novel scenario for the fabric of ENSO variability resulting from the subtle interplay between stochastic disturbances and nonlinear invariant sets emerging from bifurcations of the unperturbed dynamics. To identify these invariant sets we adopt an approach combining Galerkin-Koornwinder (GK) approximations of delay differential equations and center-unstable manifold reduction techniques. In that respect, GK approximation formulas are reviewed and synthesized, as well as analytic approximation formulas of center-unstable manifolds. The reduced systems derived thereof enable us to conduct a thorough analysis of the bifurcations arising in a standard delay model of ENSO. We identify thereby a saddle-node bifurcation of periodic orbits co-existing with a subcritical Hopf bifurcation, and a homoclinic bifurcation for this model. We show furthermore that the computation of unstable periodic orbits (UPOs) unfolding through these bifurcations is considerably simplified from the reduced systems. These dynamical insights enable us in turn to design a stochastic model whose solutions -- as the delay parameter drifts slowly through its critical values -- produce a wealth of temporal patterns resembling ENSO events and exhibiting also decadal variability. Our analysis dissects the origin of this variability and shows how it is tied to certain transition paths between invariant sets of the unperturbed dynamics (for ENSO's interannual variability) or simply due to the presence of UPOs close to the homoclinic orbit (for decadal variability). In short, this study points out the role of solution paths evolving through tipping "points" beyond equilibria, as possible mechanisms organizing the variability of certain climate phenomena. △ Less

Submitted 2 January, 2024; originally announced February 2024.

Optimal Parameterizing Manifolds for Anticipating Tipping Points and Higher-order Critical Transitions

Authors: Mickaël D. Chekroun, Honghu Liu, James C. McWilliams

Abstract: A general, variational approach to derive low-order reduced systems is presented. The approach is based on the concept of optimal parameterizing manifold (OPM) that substitutes the more classical notions of invariant or slow manifold when breakdown of "slaving" occurs, i.e. when the unresolved variables cannot be expressed as an exact functional of the resolved ones anymore. The OPM provides, with… ▽ More A general, variational approach to derive low-order reduced systems is presented. The approach is based on the concept of optimal parameterizing manifold (OPM) that substitutes the more classical notions of invariant or slow manifold when breakdown of "slaving" occurs, i.e. when the unresolved variables cannot be expressed as an exact functional of the resolved ones anymore. The OPM provides, within a given class of parameterizations of the unresolved variables, the manifold that averages out optimally these variables as conditioned on the resolved ones. The class of parameterizations retained here is that of continuous deformations of parameterizations rigorously valid near the onset of instability. These deformations are produced through integration of auxiliary backward-forward (BF) systems built from the model's equations and lead to analytic formulas for parameterizations. In this modus operandi, the backward integration time is the key parameter to select per scale/variable to parameterize in order to derive the relevant parameterizations which are doomed to be no longer exact, away from instability onset, due to breakdown of slaving typically encountered e.g. for chaotic regimes. The selection criterion is then made through data-informed minimization of a least-square parameterization defect. It is thus shown, through optimization of the backward integration time per scale/variable to parameterize, that skilled OPM reduced systems can be derived for predicting with accuracy higher-order critical transitions or catastrophic tipping phenomena, while training our parameterization formulas for regimes prior to these transitions take place. △ Less

Submitted 15 September, 2023; v1 submitted 12 July, 2023; originally announced July 2023.

The High-Frequency and Rare Events Barriers to Neural Closures of Atmospheric Dynamics

Authors: Mickaël D. Chekroun, Honghu Liu, Kaushik Srinivasan, James C. McWilliams

Abstract: Recent years have seen a surge in interest for leveraging neural networks to parameterize small-scale or fast processes in climate and turbulence models. In this short paper, we point out two fundamental issues in this endeavor. The first concerns the difficulties neural networks may experience in capturing rare events due to limitations in how data is sampled. The second arises from the inherent… ▽ More Recent years have seen a surge in interest for leveraging neural networks to parameterize small-scale or fast processes in climate and turbulence models. In this short paper, we point out two fundamental issues in this endeavor. The first concerns the difficulties neural networks may experience in capturing rare events due to limitations in how data is sampled. The second arises from the inherent multiscale nature of these systems. They combine high-frequency components (like inertia-gravity waves) with slower, evolving processes (geostrophic motion). This multiscale nature creates a significant hurdle for neural network closures. To illustrate these challenges, we focus on the atmospheric 1980 Lorenz model, a simplified version of the Primitive Equations that drive climate models. This model serves as a compelling example because it captures the essence of these difficulties. △ Less

Submitted 18 March, 2024; v1 submitted 7 May, 2023; originally announced May 2023.

Galerkin-Koornwinder approximations of delay differential equations for physicists

Authors: Mickaël D. Chekroun, Honghu Liu

Abstract: Formulas for Galerkin-Koornwinder (GK) approximations of delay differential equations are summarized. The functional analysis ingredients (semigroups, operators, etc.) are intentionally omitted to focus instead on the formulas required to perform GK approximations in practice. Formulas for Galerkin-Koornwinder (GK) approximations of delay differential equations are summarized. The functional analysis ingredients (semigroups, operators, etc.) are intentionally omitted to focus instead on the formulas required to perform GK approximations in practice. △ Less

Submitted 19 April, 2023; v1 submitted 5 April, 2023; originally announced April 2023.

Deep spectral computations in linear and nonlinear diffusion problems

Authors: Eric Simonnet, Mickaël D. Chekroun

Abstract: We propose a flexible machine-learning framework for solving eigenvalue problems of diffusion operators in moderately large dimension. We improve on existing Neural Networks (NNs) eigensolvers by demonstrating our approach ability to compute (i) eigensolutions for non-self adjoint operators with small diffusion (ii) eigenpairs located deep within the spectrum (iii) computing several eigenmodes at… ▽ More We propose a flexible machine-learning framework for solving eigenvalue problems of diffusion operators in moderately large dimension. We improve on existing Neural Networks (NNs) eigensolvers by demonstrating our approach ability to compute (i) eigensolutions for non-self adjoint operators with small diffusion (ii) eigenpairs located deep within the spectrum (iii) computing several eigenmodes at once (iv) handling nonlinear eigenvalue problems. To do so, we adopt a variational approach consisting of minimizing a natural cost functional involving Rayleigh quotients, by means of simple adiabatic technics and multivalued feedforward neural parametrisation of the solutions. Compelling successes are reported for a 10-dimensional eigenvalue problem corresponding to a Kolmogorov operator associated with a mixing Stepanov flow. We moreover show that the approach allows for providing accurate eigensolutions for a 5-D Schrödinger operator having $32$ metastable states. In addition, we address the so-called Gelfand superlinear problem having exponential nonlinearities, in dimension $4$, and for nontrivial domains exhibiting cavities. In particular, we obtain NN-approximations of high-energy solutions approaching singular ones. We stress that each of these results are obtained using small-size neural networks in situations where classical methods are hopeless due to the curse of dimensionality. This work brings new perspectives for the study of Ruelle-Pollicot resonances, dimension reduction, nonlinear eigenvalue problems, and the study of metastability when the dynamics has no potential. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Comments: 22 pages, 8 figures

MSC Class: 68T07 (Primary); 65C99; 35P30; 35P99 (Secondary)

Transitions in Stochastic Non-equilibrium Systems: Efficient Reduction and Analysis

Authors: Mickaël D. Chekroun, Honghu Liu, James C. McWilliams, Shouhong Wang

Abstract: A central challenge in physics is to describe non-equilibrium systems driven by randomness, such as a randomly growing interface, or fluids subject to random fluctuations that account e.g. for local stresses and heat fluxes not related to the velocity and temperature gradients. For deterministic systems with infinitely many degrees of freedom, normal form and center manifold theory have shown a pr… ▽ More A central challenge in physics is to describe non-equilibrium systems driven by randomness, such as a randomly growing interface, or fluids subject to random fluctuations that account e.g. for local stresses and heat fluxes not related to the velocity and temperature gradients. For deterministic systems with infinitely many degrees of freedom, normal form and center manifold theory have shown a prodigious efficiency to often completely characterize how the onset of linear instability translates into the emergence of nonlinear patterns. However, in presence of random fluctuations, this reduction procedure is seriously challenged due to large excursions caused by the noise, and the approach needs to be revisited. We present an alternative framework to cope with these difficulties exploiting the approximation theory of stochastic invariant manifolds and energy estimates measuring the defect of parameterization of the high-modes. To operate for fluid problems, these error estimates are derived under assumptions regarding dissipation effects brought by the high-modes that suitably counterbalance the loss of regularity due to the nonlinear terms. The approach enables us to predict, from the reduced equations, the occurrence in large probability of a stochastic analogue to the pitchfork bifurcation, as long as the noise's intensity and the eigenvalue's magnitude of the mildly unstable mode scale accordingly. Our parameterization formulas involve non-Markovian coefficients, which depend explicitly on the history of the noise path that drives the SPDE dynamics, and their memory content is self-consistently determined by the intensity of the random force and its interaction through the SPDE's nonlinear terms. Applications to a stochastic Rayleigh-Benard problem are detailed, for which conditions for a stochastic pitchfork bifurcation (in large probability) to occur, are clarified. △ Less

Submitted 14 February, 2022; originally announced February 2022.

Comments: 46 pages, 5 figures

Optimal management of harvested population at the edge of extinction

Authors: Mickaël D. Chekroun, Honghu Liu

Abstract: Optimal control of harvested population at the edge of extinction in an unprotected area, is considered. The underlying population dynamics is governed by a Kolmogorov-Petrovsky-Piskunov equation with a harvesting term and space-dependent coefficients while the control consists of transporting individuals from a natural reserve. The nonlinear optimal control problem is approximated by means of a G… ▽ More Optimal control of harvested population at the edge of extinction in an unprotected area, is considered. The underlying population dynamics is governed by a Kolmogorov-Petrovsky-Piskunov equation with a harvesting term and space-dependent coefficients while the control consists of transporting individuals from a natural reserve. The nonlinear optimal control problem is approximated by means of a Galerkin scheme. Convergence result about the optimal controlled solutions and error estimates between the corresponding optimal controls, are derived. For certain parameter regimes, nearly optimal solutions are calculated from a simple logistic ordinary differential equation (ODE) with a harvesting term, obtained as a Galerkin approximation of the original partial differential equation (PDE) model. A critical allowable fraction $\underlineα$ of the reserve's population is inferred from the reduced logistic ODE with a harvesting term. This estimate obtained from the reduced model allows us to distinguish sharply between survival and extinction for the full PDE itself, and thus to declare whether a control strategy leads to success or failure for the corresponding rescue operation while ensuring survival in the reserve's population. In dynamical terms, this result illustrates that although continuous dependence on the forcing may hold on finite-time intervals, a high sensitivity in the system's response may occur in the asymptotic time. We believe that this work, by its generality, establishes bridges interesting to explore between optimal control problems of ODEs with a harvesting term and their PDE counterpart. △ Less

Submitted 23 July, 2020; originally announced July 2020.

Comments: To appear as a book chapter in the AIMS book series on Applied Mathematics, Special Issue on Biological Systems Modeling and Optimal Control, Editors: M. Chyba and J. Kotas

Variational approach to closure of nonlinear dynamical systems: Autonomous case

Authors: Mickaël D. Chekroun, Honghu Liu, James C. McWilliams

Abstract: A general, variational approach to derive low-order reduced systems for nonlinear systems subject to an autonomous forcing, is introduced. The approach is based on the concept of optimal parameterizing manifold (PM) that substitutes the more classical notion of slow manifold or invariant manifold when breakdown of slaving occurs. An optimal PM provides the manifold that describes the average motio… ▽ More A general, variational approach to derive low-order reduced systems for nonlinear systems subject to an autonomous forcing, is introduced. The approach is based on the concept of optimal parameterizing manifold (PM) that substitutes the more classical notion of slow manifold or invariant manifold when breakdown of slaving occurs. An optimal PM provides the manifold that describes the average motion of the neglected scales as a function of the resolved scales and allows, in principle, for determining the best vector field of the reduced state space that describes e.g. the dynamics' slow motion. The underlying optimal parameterizations are approximated by dynamically-based formulas derived analytically from the original equations. These formulas are contingent upon the determination of only a few (scalar) parameters obtained from minimization of cost functionals, depending on training dataset collected from direct numerical simulation. In practice, a training period of length comparable to a characteristic recurrence or decorrelation time of the dynamics, is sufficient for the efficient derivation of optimized parameterizations. Applications to the closure of low-order models of Atmospheric Primitive Equations and Rayleigh-Bénard convection are then discussed. The approach is finally illustrated --- in the context of the Kuramoto-Sivashinsky turbulence --- as providing efficient closures without slaving for a cutoff scale $k_c$ placed within the inertial range and the reduced state space is just spanned by the unstable modes, without inclusion of any stable modes whatsoever. The underlying optimal PMs obtained by our variational approach are far from slaving and allow for remedying the excessive backscatter transfer of energy to the low modes encountered by classical invariant manifold approximations in their standard forms when the latter are used at this cutoff wavelength. △ Less

Submitted 1 December, 2019; originally announced December 2019.

Comments: With one ancillary file. The manuscript has been accepted for publication in the Journal of Statistical Physics

A Girsanov approach to slow parameterizing manifolds in the presence of noise

Authors: Mickaël D. Chekroun, Jeroen S. W. Lamb, Christian J. Pangerl, Martin Rasmussen

Abstract: This work investigates a three-dimensional slow-fast stochastic system with quadratic nonlinearity and additive noise, inspired by fluid dynamics. The deterministic counterpart exhibits a periodic orbit and a slow manifold. We demonstrate that, under specific parameter regimes, this deterministic slow manifold can serve as an approximate parameterization of the fast variable by the slow variables… ▽ More This work investigates a three-dimensional slow-fast stochastic system with quadratic nonlinearity and additive noise, inspired by fluid dynamics. The deterministic counterpart exhibits a periodic orbit and a slow manifold. We demonstrate that, under specific parameter regimes, this deterministic slow manifold can serve as an approximate parameterization of the fast variable by the slow variables within the stochastic system. Building upon this parameterization, we derive a two-dimensional reduced model, a stochastic Hopf normal form, that captures the essential dynamics of the original system. Both the original and the reduced systems possess ergodic invariant measures, characterizing their long-term behavior. We quantify the discrepancy between the original system and its slow approximation by deriving error estimates involving the Wasserstein distance between the marginals of these invariant measures along the radial component. These error bounds are shown to be controlled by a parameterization defect, which measures the quality of the fast-slow variable parameterization. A key technical innovation lies in the application of Girsanov's theorem to obtain these error estimates in the presence of oscillatory instabilities. Furthermore, we extend our analysis to regimes exhibiting an "inverted" timescale separation, where the variable to be parameterized evolves on a slower timescale than the resolved variables. To address these more challenging scenarios, we introduce path-dependent coefficients in the parameterizing manifold, enabling the derivation of robust error bounds for the corresponding reduced model. Numerical simulations complement our theoretical findings, providing insights into the model's behavior and exploring parameter regimes beyond the scope of our analytical results. △ Less

Submitted 19 January, 2025; v1 submitted 20 March, 2019; originally announced March 2019.

Comments: 49 pages, 6 figures

Data-adaptive harmonic spectra and multilayer Stuart-Landau models

Authors: Mickael D. Chekroun, Dmitri Kondrashov

Abstract: Harmonic decompositions of multivariate time series are considered for which we adopt an integral operator approach with periodic semigroup kernels. Spectral decomposition theorems are derived that cover the important cases of two-time statistics drawn from a mixing invariant measure. The corresponding eigenvalues can be grouped per Fourier frequency, and are actually given, at each frequency, a… ▽ More Harmonic decompositions of multivariate time series are considered for which we adopt an integral operator approach with periodic semigroup kernels. Spectral decomposition theorems are derived that cover the important cases of two-time statistics drawn from a mixing invariant measure. The corresponding eigenvalues can be grouped per Fourier frequency, and are actually given, at each frequency, as the singular values of a cross-spectral matrix depending on the data. These eigenvalues obey furthermore a variational principle that allows us to define naturally a multidimensional power spectrum. The eigenmodes, as far as they are concerned, exhibit a data-adaptive character manifested in their phase which allows us in turn to define a multidimensional phase spectrum. The resulting data-adaptive harmonic (DAH) modes allow for reducing the data-driven modeling effort to elemental models stacked per frequency, only coupled at different frequencies by the same noise realization. In particular, the DAH decomposition extracts time-dependent coefficients stacked by Fourier frequency which can be efficiently modeled---provided the decay of temporal correlations is sufficiently well-resolved---within a class of multilayer stochastic models (MSMs) tailored here on stochastic Stuart-Landau oscillators. Applications to the Lorenz 96 model and to a stochastic heat equation driven by a space-time white noise, are considered. In both cases, the DAH decomposition allows for an extraction of spatio-temporal modes revealing key features of the dynamics in the embedded phase space. The multilayer Stuart-Landau models (MSLMs) are shown to successfully model the typical patterns of the corresponding time-evolving fields, as well as their statistics of occurrence. △ Less

Submitted 13 June, 2017; originally announced June 2017.

Comments: 26 pages, double columns; 15 figures

Galerkin approximations for the optimal control of nonlinear delay differential equations

Authors: Mickaël D. Chekroun, Axel Kröner, Honghu Liu

Abstract: Optimal control problems of nonlinear delay differential equations (DDEs) are considered for which we propose a general Galerkin approximation scheme built from Koornwinder polynomials. Error estimates for the resulting Galerkin-Koornwinder approximations to the optimal control and the value function, are derived for a broad class of cost functionals and nonlinear DDEs. The approach is illustrated… ▽ More Optimal control problems of nonlinear delay differential equations (DDEs) are considered for which we propose a general Galerkin approximation scheme built from Koornwinder polynomials. Error estimates for the resulting Galerkin-Koornwinder approximations to the optimal control and the value function, are derived for a broad class of cost functionals and nonlinear DDEs. The approach is illustrated on a delayed logistic equation set not far away from its Hopf bifurcation point in the parameter space. In this case, we show that low-dimensional controls for a standard quadratic cost functional can be efficiently computed from Galerkin-Koornwinder approximations to reduce at a nearly optimal cost the oscillation amplitude displayed by the DDE's solution. Optimal controls computed from the Pontryagin's maximum principle (PMP) and the Hamilton-Jacobi-Bellman equation (HJB) associated with the corresponding ODE systems, are shown to provide numerical solutions in good agreement. It is finally argued that the value function computed from the corresponding reduced HJB equation provides a good approximation of that obtained from the full HJB equation. △ Less

Submitted 7 June, 2017; originally announced June 2017.

Comments: 29 pages. This is a sequel of the arXiv preprint arXiv:1704.00427

Ruelle-Pollicott Resonances of Stochastic Systems in Reduced State Space. Part II: Stochastic Hopf Bifurcation

Authors: Alexis Tantet, Mickaël D. Chekroun, Henk A. Dijkstra, J. David Neelin

Abstract: The spectrum of the generator (Kolmogorov operator) of a diffusion process, referred to as the Ruelle-Pollicott (RP) spectrum, provides a detailed characterization of correlation functions and power spectra of stochastic systems via decomposition formulas in terms of RP resonances. Stochastic analysis techniques relying on the theory of Markov semigroups for the study of the RP spectrum and a rigo… ▽ More The spectrum of the generator (Kolmogorov operator) of a diffusion process, referred to as the Ruelle-Pollicott (RP) spectrum, provides a detailed characterization of correlation functions and power spectra of stochastic systems via decomposition formulas in terms of RP resonances. Stochastic analysis techniques relying on the theory of Markov semigroups for the study of the RP spectrum and a rigorous reduction method is presented in Part I. This framework is here applied to study a stochastic Hopf bifurcation in view of characterizing the statistical properties of nonlinear oscillators perturbed by noise, depending on their stability. In light of the Hörmander theorem, it is first shown that the geometry of the unperturbed limit cycle, in particular its isochrons, is essential to understand the effect of noise and the phenomenon of phase diffusion. In addition, it is shown that the spectrum has a spectral gap, even at the bifurcation point, and that correlations decay exponentially fast. Explicit small-noise expansions of the RP eigenvalues and eigenfunctions are then obtained, away from the bifurcation point, based on the knowledge of the linearized deterministic dynamics and the characteristics of the noise. These formulas allow one to understand how the interaction of the noise with the deterministic dynamics affect the decay of correlations. Numerical results complement the study of the RP spectrum at the bifurcation, revealing useful scaling laws. The analysis of the Markov semigroup for stochastic bifurcations is thus promising in providing a complementary approach to the more geometric random dynamical system approach. This approach is not limited to low-dimensional systems and the reduction method presented in part I is applied to a stochastic model relevant to climate dynamics in part III. △ Less

Submitted 9 March, 2020; v1 submitted 22 May, 2017; originally announced May 2017.

Galerkin approximations of nonlinear optimal control problems in Hilbert spaces

Authors: Mickaël D. Chekroun, Axel Kröner, Honghu Liu

Abstract: Nonlinear optimal control problems in Hilbert spaces are considered for which we derive approximation theorems for Galerkin approximations. Approximation theorems are available in the literature. The originality of our approach relies on the identification of a set of natural assumptions that allows us to deal with a broad class of nonlinear evolution equations and cost functionals for which we de… ▽ More Nonlinear optimal control problems in Hilbert spaces are considered for which we derive approximation theorems for Galerkin approximations. Approximation theorems are available in the literature. The originality of our approach relies on the identification of a set of natural assumptions that allows us to deal with a broad class of nonlinear evolution equations and cost functionals for which we derive convergence of the value functions associated with the optimal control problem of the Galerkin approximations. This convergence result holds for a broad class of nonlinear control strategies as well. In particular, we show that the framework applies to the optimal control of semilinear heat equations posed on a general compact manifold without boundary. The framework is then shown to apply to geoengineering and mitigation of greenhouse gas emissions formulated for the first time in terms of optimal control of energy balance climate models posed on the sphere $\mathbb{S}^2$. △ Less

Submitted 19 July, 2017; v1 submitted 3 April, 2017; originally announced April 2017.

Comments: 41 pages

Low-Dimensional Galerkin Approximations of Nonlinear Delay Differential Equations

Authors: Mickaël D. Chekroun, Michael Ghil, Honghu Liu, Shouhong Wang

Abstract: This article revisits the approximation problem of systems of nonlinear delay differential equations (DDEs) by a set of ordinary differential equations (ODEs). We work in Hilbert spaces endowed with a natural inner product including a point mass, and introduce polynomials orthogonal with respect to such an inner product that live in the domain of the linear operator associated with the underlying… ▽ More This article revisits the approximation problem of systems of nonlinear delay differential equations (DDEs) by a set of ordinary differential equations (ODEs). We work in Hilbert spaces endowed with a natural inner product including a point mass, and introduce polynomials orthogonal with respect to such an inner product that live in the domain of the linear operator associated with the underlying DDE. These polynomials are then used to design a general Galerkin scheme for which we derive rigorous convergence results and show that it can be numerically implemented via simple analytic formulas. The scheme so obtained is applied to three nonlinear DDEs, two autonomous and one forced: (i) a simple DDE with distributed delays whose solutions recall Brownian motion; (ii) a DDE with a discrete delay that exhibits bimodal and chaotic dynamics; and (iii) a periodically forced DDE with two discrete delays arising in climate dynamics. In all three cases, the Galerkin scheme introduced in this article provides a good approximation by low-dimensional ODE systems of the DDE's strange attractor, as well as of the statistical features that characterize its nonlinear dynamics. △ Less

Submitted 2 September, 2015; originally announced September 2015.

Comments: 6 figures and 1 table

MSC Class: 34K07; 34K09; 34K17; 34K28; 41A10; 11B83; 74H65; 34K23

Data-driven non-Markovian closure models

Authors: Dmitri Kondrashov, Mickaël D. Chekroun, Michael Ghil

Abstract: This paper has two interrelated foci: (i) obtaining stable and efficient data-driven closure models by using a multivariate time series of partial observations from a large-dimensional system; and (ii) comparing these closure models with the optimal closures predicted by the Mori-Zwanzig (MZ) formalism of statistical physics. Multilayer stochastic models (MSMs) are introduced as both a generalizat… ▽ More This paper has two interrelated foci: (i) obtaining stable and efficient data-driven closure models by using a multivariate time series of partial observations from a large-dimensional system; and (ii) comparing these closure models with the optimal closures predicted by the Mori-Zwanzig (MZ) formalism of statistical physics. Multilayer stochastic models (MSMs) are introduced as both a generalization and a time-continuous limit of existing multilevel, regression-based approaches to closure in a data-driven setting; these approaches include empirical model reduction (EMR), as well as more recent multi-layer modeling. It is shown that the multilayer structure of MSMs can provide a natural Markov approximation to the generalized Langevin equation (GLE) of the MZ formalism. A simple correlation-based stopping criterion for an EMR-MSM model is derived to assess how well it approximates the GLE solution. Sufficient conditions are derived on the structure of the nonlinear cross-interactions between the constitutive layers of a given MSM to guarantee the existence of a global random attractor. This existence ensures that no blow-up can occur for a very broad class of MSM applications, a class that includes non-polynomial predictors and nonlinearities that do not necessarily preserve quadratic energy invariants. The approach is applied to conceptual nonlinear models borrowed from climate dynamics and population dynamics. In both cases, it is shown that the resulting closure models are able to capture the main statistical features of the dynamics, even in presence of weak time-scale separation. △ Less

Submitted 17 November, 2014; originally announced November 2014.

Comments: 47 pages, 7 figures

Numerical weather prediction in two dimensions with topography, using a finite volume method

Authors: Arthur Bousquet, Mickaël D. Chekroun, Youngjoon Hong, Roger Temam, Joseph Tribbia

Abstract: We aim to study a finite volume scheme to solve the two dimensional inviscid primitive equations of the atmosphere with humidity and saturation, in presence of topography and subject to physically plausible boundary conditions to the system of equations. In that respect, a version of a projection method is introduced to enforce the compatibility condition on the horizontal velocity field, which co… ▽ More We aim to study a finite volume scheme to solve the two dimensional inviscid primitive equations of the atmosphere with humidity and saturation, in presence of topography and subject to physically plausible boundary conditions to the system of equations. In that respect, a version of a projection method is introduced to enforce the compatibility condition on the horizontal velocity field, which comes from the boundary conditions. The resulting scheme allows for a significant reduction of the errors near the topography when compared to more standard finite volume schemes. In the numerical simulations, we first present the associated good convergence results that are satisfied by the solutions simulated by our scheme when compared to particular analytic solutions. We then report on numerical experiments using realistic parameters. Finally, the effects of a random small-scale forcing on the velocity equation is numerically investigated. The numerical results show that such a forcing is responsible for recurrent large-scale patterns to emerge in the temperature and velocity fields. △ Less

Submitted 16 September, 2014; originally announced September 2014.

Comments: 34 pages, 18 figures

MSC Class: 37H10; 65M08; 65P40; 86A10; 76B60

Finite-Horizon Parameterizing Manifolds, and Applications to Suboptimal Control of Nonlinear Parabolic PDEs

Authors: Mickaël D. Chekroun, Honghu Liu

Abstract: This article proposes a new approach based on finite-horizon parameterizing manifolds (PMs) for the design of low-dimensional suboptimal controllers to optimal control problems of nonlinear partial differential equations (PDEs) of parabolic type. Given a finite horizon $[0,T]$ and a low-mode truncation of the PDE, a PM provides an approximate parameterization of the uncontrolled high modes by the… ▽ More This article proposes a new approach based on finite-horizon parameterizing manifolds (PMs) for the design of low-dimensional suboptimal controllers to optimal control problems of nonlinear partial differential equations (PDEs) of parabolic type. Given a finite horizon $[0,T]$ and a low-mode truncation of the PDE, a PM provides an approximate parameterization of the uncontrolled high modes by the controlled low ones so that the unexplained high-mode energy is reduced, in an $L^2$-sense, when this parameterization is applied. Analytic formulas of such PMs are derived by application of the method of pullback approximation of the high-modes (Chekroun, Liu, and Wang, 2013, https://arxiv.boxedpaper.com/pdf/1310.3896v1.pdf). These formulas allow for an effective derivation of reduced ODE systems, aimed to model the evolution of the low-mode truncation of the controlled state variable, where the high-mode part is approximated by the PM function applied to the low modes. A priori error estimates between the resulting PM-based low-dimensional suboptimal controller $u_R^\ast$ and the optimal controller $u^*$ are derived. These estimates demonstrate that the closeness of $u_R^\ast$ to $u^*$ is mainly conditioned on two factors: (i) the parameterization defect of a given PM, associated respectively with $u_R^\ast$ and $u^*$; and (ii) the energy kept in the high modes of the PDE solution either driven by $u_R^\ast$ or $u^*$ itself. The practical performances of such PM-based suboptimal controllers are numerically assessed for various optimal control problems associated with a Burgers-type equation. The numerical results show that a PM-based reduced system allows for the design of suboptimal controllers with good performances provided that the associated parameterization defects and energy kept in the high modes are small enough, in agreement with the rigorous results. △ Less

Submitted 10 April, 2014; v1 submitted 17 March, 2014; originally announced March 2014.

Comments: 58 pages; 10 figures. Complementary results to this work can be found here: http://www.environnement.ens.fr/IMG/Burgers_control_empirical_ArXiv.pdf

MSC Class: 35K10; 37L05; 37L25; 37L65; 49K15; 49K20

Journal ref: Acta Applicandae Mathematicae, 09/26, 2014

Non-Markovian Reduced Systems for Stochastic Partial Differential Equations: The Additive Noise Case

Authors: Mickaël D. Chekroun, Honghu Liu, Shouhong Wang

Abstract: This article proposes for stochastic partial differential equations (SPDEs) driven by additive noise, a novel approach for the approximate parameterizations of the ``small'' scales by the ``large'' ones, along with the derivaton of the corresponding reduced systems. This is accomplished by seeking for stochastic parameterizing manifolds (PMs) introduced in a previous work by the authors(*), which… ▽ More This article proposes for stochastic partial differential equations (SPDEs) driven by additive noise, a novel approach for the approximate parameterizations of the ``small'' scales by the ``large'' ones, along with the derivaton of the corresponding reduced systems. This is accomplished by seeking for stochastic parameterizing manifolds (PMs) introduced in a previous work by the authors(*), which are random manifolds aiming to provide --- in a mean square sense --- such approximate parameterizations. Backward-forward systems are designed to give access to such PMs as pullback limits depending through the nonlinear terms on the time-history of the dynamics of the low modes when the latter is simply approximated by its stochastic linear component. It is shown that the corresponding pullback limits can be efficiently determined, leading in turn to an operational procedure for the derivation of non-Markovian reduced systems able to achieve good modeling performances in practice. This is illustrated on a stochastic Burgers-type equation, where it is shown that the corresponding non-Markovian features of these reduced systems play a key role to reach such performances. △ Less

Submitted 13 November, 2013; originally announced November 2013.

Comments: (*) work complementary to M.D. Chekroun, H. Liu, and S. Wang (2013): "On stochastic parameterizing manifolds: Pullback characterization and Non-Markovian reduced equations,'' arXiv:1310.3896

MSC Class: 34F05; 35B42; 35R60; 37D10; 37L05; 37L10; 37L25; 37L55; 37L65; 60H15

Topological instabilities in families of semilinear parabolic problems subject to nonlinear perturbations

Authors: Mickael D. Chekroun

Abstract: In this article it is proved that the dynamical properties of a broad class of semilinear parabolic problems are sensitive to arbitrarily small but smooth perturbations of the nonlinear term, when the spatial dimension is either equal to one or two. This topological instability is shown to result from a local deformation of the global bifurcation diagram associated with the corresponding elliptic… ▽ More In this article it is proved that the dynamical properties of a broad class of semilinear parabolic problems are sensitive to arbitrarily small but smooth perturbations of the nonlinear term, when the spatial dimension is either equal to one or two. This topological instability is shown to result from a local deformation of the global bifurcation diagram associated with the corresponding elliptic problems. Such a deformation is shown to systematically occur via the creation of either a multiple-point or a new fold-point on this diagram when an appropriate small perturbation is applied to the nonlinear term. More precisely, it is shown that for a broad class of nonlinear elliptic problems, one can always find an arbitrary small perturbation of the nonlinear term, that generates a local S on the bifurcation diagram whereas the latter is e.g. monotone when no perturbation is applied; substituting thus a single solution by several ones. Such an increase in the local multiplicity of the solutions to the elliptic problem results then into a topological instability for the corresponding parabolic problem. The rigorous proof of the latter instability result requires though to revisit the classical concept of topological equivalence to encompass important cases for the applications such as semi-linear parabolic problems for which the semigroup may exhibit non-global dissipative properties, allowing for the coexistence of blow-up regions and local attractors in the phase space; cases that arise e.g. in combustion theory. A revised framework of topological robustness is thus introduced in that respect within which the main topological instability result is then proved for continuous, locally Lipschitz but not necessarily $C^1$ nonlinear terms, that prevent in particular the use of linearization techniques, and for which the family of semigroups may exhibit non-dissipative properties. △ Less

Submitted 18 January, 2018; v1 submitted 24 October, 2013; originally announced October 2013.

Comments: 2 figures, 27 pages

MSC Class: 35J61; 35B30; 35B32; 35B20; 35K58; 35A16; 37K50; 37C20; 37H20; 37J20; 47H11

On stochastic parameterizing manifolds: Pullback characterization and Non-Markovian reduced equations

Authors: Mickael D. Chekroun, Honghu Liu, Shouhong Wang

Abstract: A general approach to provide approximate parameterizations of the "small" scales by the "large" ones, is developed for stochastic partial differential equations driven by linear multiplicative noise. This is accomplished via the concept of parameterizing manifolds (PMs) that are stochastic manifolds which improve in mean square error the partial knowledge of the full SPDE solution $u$ when compar… ▽ More A general approach to provide approximate parameterizations of the "small" scales by the "large" ones, is developed for stochastic partial differential equations driven by linear multiplicative noise. This is accomplished via the concept of parameterizing manifolds (PMs) that are stochastic manifolds which improve in mean square error the partial knowledge of the full SPDE solution $u$ when compared to the projection of $u$ onto the resolved modes, for a given realization of the noise. Backward-forward systems are designed to give access to such PMs in practice. The key idea consists of representing the modes with high wave numbers (as parameterized by the sought PM) as a pullback limit depending on the time-history of the modes with low wave numbers. The resulting manifolds obtained by such a procedure are not subject to a spectral gap condition such as encountered in the classical theory. Instead, certain PMs can be determined under weaker non-resonance conditions. Non-Markovian stochastic reduced systems are then derived based on such a PM approach. Such reduced systems take the form of SDEs involving random coefficients that convey memory effects via the history of the Wiener process, and arise from the nonlinear interactions between the low modes, embedded in the "noise bath." These random coefficients follow typically non-Gaussian statistics and exhibit an exponential decay of correlations whose rate depends explicitly on gaps arising in the non-resonances conditions. It is shown on a stochastic Burgers-type equation, that such PM-based reduced systems can achieve very good performance in reproducing statistical features of the SPDE dynamics projected onto the resolved modes, such as the autocorrelations and probability functions of the corresponding modes amplitude. △ Less

Submitted 14 October, 2013; originally announced October 2013.

Comments: 143 pp

Climate dynamics and fluid mechanics: Natural variability and related uncertainties

Authors: Michael Ghil, Mickaël D. Chekroun, Eric Simonnet

Abstract: The purpose of this review-and-research paper is twofold: (i) to review the role played in climate dynamics by fluid-dynamical models; and (ii) to contribute to the understanding and reduction of the uncertainties in future climate-change projections. To illustrate the first point, we focus on the large-scale, wind-driven flow of the mid-latitude oceans which contribute in a crucial way to Earth's… ▽ More The purpose of this review-and-research paper is twofold: (i) to review the role played in climate dynamics by fluid-dynamical models; and (ii) to contribute to the understanding and reduction of the uncertainties in future climate-change projections. To illustrate the first point, we focus on the large-scale, wind-driven flow of the mid-latitude oceans which contribute in a crucial way to Earth's climate, and to changes therein. We study the low-frequency variability (LFV) of the wind-driven, double-gyre circulation in mid-latitude ocean basins, via the bifurcation sequence that leads from steady states through periodic solutions and on to the chaotic, irregular flows documented in the observations. This sequence involves local, pitchfork and Hopf bifurcations, as well as global, homoclinic ones. The natural climate variability induced by the LFV of the ocean circulation is but one of the causes of uncertainties in climate projections. Another major cause of such uncertainties could reside in the structural instability in the topological sense, of the equations governing climate dynamics, including but not restricted to those of atmospheric and ocean dynamics. We propose a novel approach to understand, and possibly reduce, these uncertainties, based on the concepts and methods of random dynamical systems theory. As a very first step, we study the effect of noise on the topological classes of the Arnol'd family of circle maps, a paradigmatic model of frequency locking as occurring in the nonlinear interactions between the El Nino-Southern Oscillations (ENSO) and the seasonal cycle. It is shown that the maps' fine-grained resonant landscape is smoothed by the noise, thus permitting their coarse-grained classification. This result is consistent with stabilizing effects of stochastic parametrization obtained in modeling of ENSO phenomenon via some general circulation models. △ Less

Submitted 14 June, 2010; originally announced June 2010.

Comments: Invited survey paper for Special Issue on The Euler Equations: 250 Years On, in Physica D: Nonlinear phenomena

MSC Class: 37B55; 37G15; 34F05; 34C37; 34D30; 37C20; 37C15; 37C29; 37E10; 37E45; 34D08; 37D20; 76U05; 35Q35; 86A05; 86-06

Journal ref: Physica D: Nonlinear phenomena, Special Issue on The Euler Equations: 250 Years On, {\bf 237}(2008), 2111--2126

Averaging of time-periodic systems without a small parameter

Authors: Mickaël D. Chekroun, Michael Ghil, Jean Roux, Ferenc Varadi

Abstract: In this article, we present a new approach to averaging in non-Hamiltonian systems with periodic forcing. The results here do not depend on the existence of a small parameter. In fact, we show that our averaging method fits into an appropriate nonlinear equivalence problem, and that this problem can be solved formally by using the Lie transform framework to linearize it. According to this approach… ▽ More In this article, we present a new approach to averaging in non-Hamiltonian systems with periodic forcing. The results here do not depend on the existence of a small parameter. In fact, we show that our averaging method fits into an appropriate nonlinear equivalence problem, and that this problem can be solved formally by using the Lie transform framework to linearize it. According to this approach, we derive formal coordinate transformations associated with both first-order and higher-order averaging, which result in more manageable formulae than the classical ones. Using these transformations, it is possible to correct the solution of an averaged system by recovering the oscillatory components of the original non-averaged system. In this framework, the inverse transformations are also defined explicitly by formal series; they allow the estimation of appropriate initial data for each higher-order averaged system, respecting the equivalence relation. Finally, we show how these methods can be used for identifying and computing periodic solutions for a very large class of nonlinear systems with time-periodic forcing. We test the validity of our approach by analyzing both the first-order and the second-order averaged system for a problem in atmospheric chemistry. △ Less

Submitted 14 June, 2010; originally announced June 2010.

Comments: This version contains a proof of Lemma 6.1 from the published version

MSC Class: 34C20; 34C25; 34C29; 37C15; 37M99; 86-08

Journal ref: Discrete and Continuous Dynamical Systems, Ser. A, {\bf 14}(4), (2006) 753-782

Asymptotics of the Coleman-Gurtin model

Authors: Mickaël D. Chekroun, Francesco Di Plinio, Nathan E. Glatt-Holtz, Vittorino Pata

Abstract: This paper is concerned with the integrodifferential equation $$\partial_t u-Δu -\int_0^\infty κ(s)Δu(t-s)\,\d s + \varphi(u)=f$$ arising in the Coleman-Gurtin's theory of heat conduction with hereditary memory, in presence of a nonlinearity $\varphi$ of critical growth. Rephrasing the equation within the history space framework, we prove the existence of global and exponential attractors of optim… ▽ More This paper is concerned with the integrodifferential equation $$\partial_t u-Δu -\int_0^\infty κ(s)Δu(t-s)\,\d s + \varphi(u)=f$$ arising in the Coleman-Gurtin's theory of heat conduction with hereditary memory, in presence of a nonlinearity $\varphi$ of critical growth. Rephrasing the equation within the history space framework, we prove the existence of global and exponential attractors of optimal regularity and finite fractal dimension for the related solution semigroup, acting both on the basic weak-energy space and on a more regular phase space. △ Less

Submitted 13 June, 2010; originally announced June 2010.

Comments: Accepted in Discrete and Continuous Dynamical Systems, Serie S

MSC Class: Primary: 35B41; 35K05; Secondary: 45K05; 47H20

On population resilience to external perturbations

Authors: Lionel Roques, Mickaël D. Chekroun

Abstract: We study a spatially explicit harvesting model in periodic or bounded environments. The model is governed by a parabolic equation with a spatially dependent nonlinearity of Kolmogorov--Petrovsky--Piskunov type, and a negative external forcing term $-δ$. Using sub- and supersolution methods and the characterization of the first eigenvalue of some linear elliptic operators, we obtain existence and n… ▽ More We study a spatially explicit harvesting model in periodic or bounded environments. The model is governed by a parabolic equation with a spatially dependent nonlinearity of Kolmogorov--Petrovsky--Piskunov type, and a negative external forcing term $-δ$. Using sub- and supersolution methods and the characterization of the first eigenvalue of some linear elliptic operators, we obtain existence and nonexistence results as well as results on the number of stationary solutions. We also characterize the asymptotic behavior of the evolution equation as a function of the forcing term amplitude. In particular, we define two critical values $δ^*$ and $δ_2$ such that, if $δ$ is smaller than $δ^*$, the population density converges to a "significant" state, which is everywhere above a certain small threshold, whereas if $δ$ is larger than $δ_2$, the population density converges to a "remnant" state, everywhere below this small threshold. Our results are shown to be useful for studying the relationships between environmental fragmentation and maximum sustainable yield from populations. We present numerical results in the case of stochastic environments. △ Less

Submitted 13 June, 2010; originally announced June 2010.

MSC Class: 35K57; 35K55; 35J60; 35P05; 35P15; 92D25; 92D40; 60G60

Journal ref: SIAM Journal on Applied Mathematics (SIAP), {\bf 68} (1), (2007) 133--153

Models of population dynamics under the influence of external perturbations: mathematical results

Authors: Mickaël D. Chekroun, Lionel Roques

Abstract: In this Note, we describe the stationary equilibria and the asymptotic behaviour of an heterogeneous logistic reaction-diffusion equation under the influence of autonomous or time-periodic forcing terms. We show that the study of the asymptotic behaviour in the time-periodic forcing case can be reduced to the autonomous one, the last one being described in function of the "size" of the external pe… ▽ More In this Note, we describe the stationary equilibria and the asymptotic behaviour of an heterogeneous logistic reaction-diffusion equation under the influence of autonomous or time-periodic forcing terms. We show that the study of the asymptotic behaviour in the time-periodic forcing case can be reduced to the autonomous one, the last one being described in function of the "size" of the external perturbation. Our results can be interpreted in terms of maximal sustainable yields from populations. We briefly discuss this last aspect through a numerical computation. △ Less

Submitted 13 June, 2010; originally announced June 2010.

MSC Class: 35K57; 35K55; 35J60; 35P05; 35P15; 92D25; 92D40; 60G60

Journal ref: Comptes Rendus de l'Académie des Sciences, Paris, Ser. I (2006), 343: 307--310

Homeomorphisms group of normed vector space: Conjugacy problems and the Koopman operator

Authors: Mickael D. Chekroun, Jean Roux

Abstract: This article is concerned with conjugacy problems arising in homeomorphisms group, Hom($F$), of unbounded subsets $F$ of normed vector spaces $E$. Given two homeomorphisms $f$ and $g$ in Hom($F$), it is shown how the existence of a conjugacy may be related to the existence of a common generalized eigenfunction of the associated Koopman operators. This common eigenfunction serves to build a topolog… ▽ More This article is concerned with conjugacy problems arising in homeomorphisms group, Hom($F$), of unbounded subsets $F$ of normed vector spaces $E$. Given two homeomorphisms $f$ and $g$ in Hom($F$), it is shown how the existence of a conjugacy may be related to the existence of a common generalized eigenfunction of the associated Koopman operators. This common eigenfunction serves to build a topology on Hom($F$), where the conjugacy is obtained as limit of a sequence generated by the conjugacy operator, when this limit exists. The main conjugacy theorem is presented in a class of generalized Lipeomorphisms. △ Less

Submitted 11 February, 2013; v1 submitted 9 June, 2010; originally announced June 2010.

Comments: 23 pages

MSC Class: 37C15; 20E45; 39B72; 57S05

Does reaction-diffusion support the duality of fragmentation effect?

Authors: Lionel Roques, Mickaël D. Chekroun

Abstract: There is a gap between single-species model predictions, and empirical studies, regarding the effect of habitat fragmentation per se, i.e., a process involving the breaking apart of habitat without loss of habitat. Empirical works indicate that fragmentation can have positive as well as negative effects, whereas, traditionally, single-species models predict a negative effect of fragmentation. Wi… ▽ More There is a gap between single-species model predictions, and empirical studies, regarding the effect of habitat fragmentation per se, i.e., a process involving the breaking apart of habitat without loss of habitat. Empirical works indicate that fragmentation can have positive as well as negative effects, whereas, traditionally, single-species models predict a negative effect of fragmentation. Within the class of reaction-diffusion models, studies almost unanimously predict such a detrimental effect. In this paper, considering a single-species reaction-diffusion model with a removal -- or similarly harvesting -- term, in two dimensions, we find both positive and negative effects of fragmentation of the reserves, i.e. the protected regions where no removal occurs. Fragmented reserves lead to higher population sizes for time-constant removal terms. On the other hand, when the removal term is proportional to the population density, higher population sizes are obtained on aggregated reserves, but maximum yields are attained on fragmented configurations, and for intermediate harvesting intensities. △ Less

Submitted 6 July, 2009; originally announced July 2009.