-
Highly accurate and fine-scale estimation of equilibrium measures
Authors:
Caroline L. Wormell
Abstract:
Equilibrium measures are special invariant measures of chaotic dynamical systems and iterated function systems, commonly studied as salient examples of fractal measures. While useful analytic expressions are rare, computational exploration of these measures can yield useful insight, in particular in studying their Fourier decay. In this note we present simple, efficient computational methods to ob…
▽ More
Equilibrium measures are special invariant measures of chaotic dynamical systems and iterated function systems, commonly studied as salient examples of fractal measures. While useful analytic expressions are rare, computational exploration of these measures can yield useful insight, in particular in studying their Fourier decay. In this note we present simple, efficient computational methods to obtain weak estimates of equilibrium and related measures (i.e. as integrals against smooth functions) at high spatial resolution. These methods proceed via Chebyshev-Lagrange approximation of the transfer operator. One method, which estimates measures directly from spectral data, gives exponentially accurate estimates at spatial scales larger than the approximation's resolution. Another, method, which generates random point samples, has a Central Limit Theorem-style accuracy down to an exponentially small spatial resolution. This means that these measures and their Fourier decay can be studied very accurately, and at very high Fourier frequencies.
△ Less
Submitted 18 December, 2023;
originally announced December 2023.
-
Orthogonal polynomial approximation and Extended Dynamic Mode Decomposition in chaos
Authors:
Caroline L. Wormell
Abstract:
Extended Dynamic Mode Decomposition (EDMD) is a data-driven tool for forecasting and model reduction of dynamics, which has been extensively taken up in the physical sciences. While the method is conceptually simple, in deterministic chaos it is unclear what its properties are or even what it converges to. In particular, it is not clear how EDMD's least-squares approximation treats the classes of…
▽ More
Extended Dynamic Mode Decomposition (EDMD) is a data-driven tool for forecasting and model reduction of dynamics, which has been extensively taken up in the physical sciences. While the method is conceptually simple, in deterministic chaos it is unclear what its properties are or even what it converges to. In particular, it is not clear how EDMD's least-squares approximation treats the classes of differentiable functions on which chaotic systems act.
We develop for the first time a general, rigorous theory of EDMD on the simplest examples of chaotic maps: analytic expanding maps of the circle. To do this, we prove a new, basic approximation result in the theory of orthogonal polynomials on the unit circle (OPUC) and apply methods from transfer operator theory. We show that in the infinite-data limit, the least-squares projection error is exponentially small for trigonometric polynomial observable dictionaries. As a result, we show that forecasts and Koopman spectral data produced using EDMD in this setting converge to the physically meaningful limits, exponentially fast with respect to the size of the dictionary. This demonstrates that with only a relatively small polynomial dictionary, EDMD can be very effective, even when the sampling measure is not uniform. Furthermore, our OPUC result suggests that data-based least-squares projection may be a very effective approximation strategy more generally.
△ Less
Submitted 17 October, 2024; v1 submitted 14 May, 2023;
originally announced May 2023.
-
On convergence of linear response formulae in some piecewise hyperbolic maps
Authors:
Caroline L. Wormell
Abstract:
When high-dimensional non-uniformly hyperbolic chaotic systems undergo dynamical perturbations, their long-time statistics are generally observed to respond differentiably with respect to the perturbation. Although important in applications, this differentiability, which is thought to be connected to the dimensionality of the system, has remained resistant to rigorous study. To model non-uniformly…
▽ More
When high-dimensional non-uniformly hyperbolic chaotic systems undergo dynamical perturbations, their long-time statistics are generally observed to respond differentiably with respect to the perturbation. Although important in applications, this differentiability, which is thought to be connected to the dimensionality of the system, has remained resistant to rigorous study. To model non-uniformly hyperbolic systems, we consider a family of the mathematically tractable class of piecewise smooth hyperbolic maps, the Lozi maps. For these maps we prove that the existence of a formal derivative of the response reduces to an exponential mixing property of the SRB measure when conditioned on the map's singularity set. This property appears to be true and is of independent interest. Further study of this conditional mixing property may yield a better picture of linear response theory.
△ Less
Submitted 31 October, 2022; v1 submitted 18 June, 2022;
originally announced June 2022.
-
Conditional mixing in deterministic chaos
Authors:
Caroline L. Wormell
Abstract:
While on the one hand, chaotic dynamical systems can be predicted for all time given exact knowledge of an initial state, they are also in many cases rapidly mixing, meaning that smooth probabilistic information (quantified by measures) on the system's state has negligible value for predicting the long-term future. However, an understanding of the long-term predictive value of intermediate kinds o…
▽ More
While on the one hand, chaotic dynamical systems can be predicted for all time given exact knowledge of an initial state, they are also in many cases rapidly mixing, meaning that smooth probabilistic information (quantified by measures) on the system's state has negligible value for predicting the long-term future. However, an understanding of the long-term predictive value of intermediate kinds of probabilistic information is necessary in various physical problems, and largely remains lacking.
Of particular interest in data assimilation and linear response theory are the conditional measures of the SRB measure on zero sets of general smooth functions of the phase space. In this paper we give rigorous and numerical evidence that such measures generically converge back under the dynamics to the full SRB measures, exponentially quickly. We call this property conditional mixing. We will prove that conditional mixing holds in a class of generalised baker's maps, and demonstrate it numerically in some non-Markovian piecewise hyperbolic maps. Conditional mixing provides a natural limit on the effectiveness of long-term forecasting of chaotic systems via partial observations, and appears key to proving the existence of linear response outside the setting of smooth uniform hyperbolicity.
△ Less
Submitted 31 October, 2022; v1 submitted 18 June, 2022;
originally announced June 2022.
-
Non-hyperbolicity at large scales of a high-dimensional chaotic system
Authors:
Caroline L. Wormell
Abstract:
The dynamics of many important high-dimensional dynamical systems are both chaotic and complex, meaning that strong reducing hypotheses are required to understand the dynamics. The highly influential chaotic hypothesis of Gallavotti and Cohen states that the large-scale dynamics of high-dimensional systems are effectively uniformly hyperbolic, which implies many felicitous statistical properties.…
▽ More
The dynamics of many important high-dimensional dynamical systems are both chaotic and complex, meaning that strong reducing hypotheses are required to understand the dynamics. The highly influential chaotic hypothesis of Gallavotti and Cohen states that the large-scale dynamics of high-dimensional systems are effectively uniformly hyperbolic, which implies many felicitous statistical properties. We obtain direct and reliable numerical evidence, contrary to the chaotic hypothesis, of the existence of non-hyperbolic large-scale dynamical structures in a mean-field coupled system. To do this we reduce the system to its thermodynamic limit, which we approximate numerically with a Chebyshev basis transfer operator discretisation. This enables us to obtain a high precision estimate of a homoclinic tangency, implying a failure of uniform hyperbolicity. Robust non-hyperbolic behaviour is expected under perturbation. As a result, the chaotic hypothesis should not be {\it a priori} assumed to hold in all systems, and a better understanding of the domain of its validity is required.
△ Less
Submitted 3 February, 2022; v1 submitted 16 September, 2021;
originally announced September 2021.
-
Efficient computation of statistical properties of intermittent dynamics
Authors:
Caroline L. Wormell
Abstract:
Intermittent maps of the interval are simple and widely-studied models for chaos with slow mixing rates, but have been notoriously resistant to numerical study. In this paper we present an effective framework to compute many ergodic properties of these systems, in particular invariant measures and mean return times. The framework combines three ingredients that each harness the smooth structure of…
▽ More
Intermittent maps of the interval are simple and widely-studied models for chaos with slow mixing rates, but have been notoriously resistant to numerical study. In this paper we present an effective framework to compute many ergodic properties of these systems, in particular invariant measures and mean return times. The framework combines three ingredients that each harness the smooth structure of these systems' induced maps: Abel functions to compute the action of the induced maps, Euler-Maclaurin summation to compute the pointwise action of their transfer operators, and Chebyshev Galerkin discretisations to compute the spectral data of the transfer operators. The combination of these techniques allows one to obtain exponential convergence of estimates for polynomially growing computational outlay, independent of the order of the map's neutral fixed point. This enables numerical exploration of intermittent dynamics in all parameter regimes, including in the infinite ergodic regime.
△ Less
Submitted 2 June, 2021;
originally announced June 2021.
-
Spectral convergence of diffusion maps: improved error bounds and an alternative normalisation
Authors:
Caroline L. Wormell,
Sebastian Reich
Abstract:
Diffusion maps is a manifold learning algorithm widely used for dimensionality reduction. Using a sample from a distribution, it approximates the eigenvalues and eigenfunctions of associated Laplace-Beltrami operators. Theoretical bounds on the approximation error are however generally much weaker than the rates that are seen in practice. This paper uses new approaches to improve the error bounds…
▽ More
Diffusion maps is a manifold learning algorithm widely used for dimensionality reduction. Using a sample from a distribution, it approximates the eigenvalues and eigenfunctions of associated Laplace-Beltrami operators. Theoretical bounds on the approximation error are however generally much weaker than the rates that are seen in practice. This paper uses new approaches to improve the error bounds in the model case where the distribution is supported on a hypertorus. For the data sampling (variance) component of the error we make spatially localised compact embedding estimates on certain Hardy spaces; we study the deterministic (bias) component as a perturbation of the Laplace-Beltrami operator's associated PDE, and apply relevant spectral stability results. Using these approaches, we match long-standing pointwise error bounds for both the spectral data and the norm convergence of the operator discretisation.
We also introduce an alternative normalisation for diffusion maps based on Sinkhorn weights. This normalisation approximates a Langevin diffusion on the sample and yields a symmetric operator approximation. We prove that it has better convergence compared with the standard normalisation on flat domains, and present a highly efficient algorithm to compute the Sinkhorn weights.
△ Less
Submitted 7 April, 2021; v1 submitted 3 June, 2020;
originally announced June 2020.
-
Linear response for macroscopic observables in high-dimensional systems
Authors:
Caroline L. Wormell,
Georg A. Gottwald
Abstract:
The long-term average response of observables of chaotic systems to dynamical perturbations can often be predicted using linear response theory, but not all chaotic systems possess a linear response. Macroscopic observables of complex dissipative chaotic systems, however, are widely assumed to have a linear response even if the microscopic variables do not, but the mechanism for this is not well-u…
▽ More
The long-term average response of observables of chaotic systems to dynamical perturbations can often be predicted using linear response theory, but not all chaotic systems possess a linear response. Macroscopic observables of complex dissipative chaotic systems, however, are widely assumed to have a linear response even if the microscopic variables do not, but the mechanism for this is not well-understood.
We present a comprehensive picture for the linear response of macroscopic observables in high-dimensional coupled deterministic dynamical systems, where the coupling is via a mean field and the microscopic subsystems may or may not obey linear response theory. We derive stochastic reductions of the dynamics of these observables from statistics of the microscopic system, and provide conditions for linear response theory to hold in finite dimensional systems and in the thermodynamic limit. In particular, we show that for large systems of finite size, linear response is induced via self-generated noise.
We present examples in the thermodynamic limit where the macroscopic observable satisfies LRT, although the microscopic subsystems individually violate LRT, as well a converse example where the macroscopic observable does not satisfy LRT despite all microscopic subsystems satisfying LRT when uncoupled. This latter, maybe surprising, example is associated with emergent non-trivial dynamics of the macroscopic observable. We provide numerical evidence for our results on linear response as well as some analytical intuition.
△ Less
Submitted 23 October, 2019; v1 submitted 31 July, 2019;
originally announced July 2019.
-
On the validity of linear response theory in high-dimensional deterministic dynamical systems
Authors:
Caroline L. Wormell,
Georg A. Gottwald
Abstract:
This theoretical work considers the following conundrum: linear response theory is successfully used by scientists in numerous fields, but mathematicians have shown that typical low-dimensional dynamical systems violate the theory's assumptions. Here we provide a proof of concept for the validity of linear response theory in high-dimensional deterministic systems for large-scale observables. We in…
▽ More
This theoretical work considers the following conundrum: linear response theory is successfully used by scientists in numerous fields, but mathematicians have shown that typical low-dimensional dynamical systems violate the theory's assumptions. Here we provide a proof of concept for the validity of linear response theory in high-dimensional deterministic systems for large-scale observables. We introduce an exemplary model in which observables of resolved degrees of freedom are weakly coupled to a large, inhomogeneous collection of unresolved chaotic degrees of freedom. By employing statistical limit laws we give conditions under which such systems obey linear response theory even if all the degrees of freedom individually violate linear response. We corroborate our result with numerical simulations.
△ Less
Submitted 19 June, 2018; v1 submitted 29 January, 2018;
originally announced January 2018.
-
Spectral Galerkin methods for transfer operators in uniformly expanding dynamics
Authors:
Caroline L. Wormell
Abstract:
Markov expanding maps, a class of simple chaotic systems, are commonly used as models for chaotic dynamics, but existing numerical methods to study long-time statistical properties such as invariant measures have a poor trade-off between computational effort and accuracy. We develop a spectral Galerkin method for these maps' transfer operators, estimating statistical quantities using finite submat…
▽ More
Markov expanding maps, a class of simple chaotic systems, are commonly used as models for chaotic dynamics, but existing numerical methods to study long-time statistical properties such as invariant measures have a poor trade-off between computational effort and accuracy. We develop a spectral Galerkin method for these maps' transfer operators, estimating statistical quantities using finite submatrices of the transfer operators' infinite Fourier or Chebyshev basis coefficient matrices. Rates of convergence of these estimates are obtained via quantitative bounds on the full transfer operator matrix entries; we find the method furnishes up to exponentially accurate estimates of statistical properties in only a polynomially large computational time.
To implement these results we suggest and demonstrate two algorithms: a rigorously-validated algorithm, and a fast, more convenient adaptive algorithm. Using the first algorithm we prove rigorous bounds on some exemplar quantities that are substantially more accurate than previous. We show that the adaptive algorithm can produce double floating-point accuracy estimates in a fraction of a second on a personal computer.
△ Less
Submitted 2 June, 2020; v1 submitted 11 May, 2017;
originally announced May 2017.
-
On spurious detection of linear response and misuse of the fluctuation-dissipation theorem in finite time series
Authors:
Georg A. Gottwald,
Caroline L. Wormell,
Jeroen Wouters
Abstract:
Using a sensitive statistical test we determine whether or not one can detect the breakdown of linear response given observations of deterministic dynamical systems. A goodness-of-fit statistics is developed for a linear statistical model of the observations, based on results on central limit theorems for deterministic dynamical systems, and used to detect linear response breakdown. We apply the m…
▽ More
Using a sensitive statistical test we determine whether or not one can detect the breakdown of linear response given observations of deterministic dynamical systems. A goodness-of-fit statistics is developed for a linear statistical model of the observations, based on results on central limit theorems for deterministic dynamical systems, and used to detect linear response breakdown. We apply the method to discrete maps which do not obey linear response and show that the successful detection of breakdown depends on the length of the time series, the magnitude of the perturbation and on the choice of the observable.
We find that in order to reliably reject the assumption of linear response for typical observables sufficiently large data sets are needed. Even for simple systems such as the logistic map, one needs of the order of $10^6$ observations to reliably detect the breakdown, if less observations are available one may be falsely led to conclude that linear response theory is valid. The amount of data required is larger the smaller the applied perturbation. For judiciously chosen observables the necessary amount of data can be drastically reduced, but requires detailed {\em{a priori}} knowledge about the invariant measure which is typically not available for complex dynamical systems.
Furthermore we explore the use of the fluctuation-dissipation theorem (FDT) in cases with limited data length or coarse-graining of observations. The FDT, if applied naively to a system without linear response, is shown to be very sensitive to the details of the sampling method, resulting in erroneous predictions of the response.
△ Less
Submitted 9 September, 2021; v1 submitted 12 January, 2016;
originally announced January 2016.