-
Unsupervised multi-scale diagnostics
Authors:
Karl Lapo,
Sara M. Ichinaga,
Nathan Kutz
Abstract:
The unsupervised and principled diagnosis of multi-scale data is a fundamental obstacle in modern scientific problems from, for instance, weather and climate prediction, neurology, epidemiology, and turbulence. Multi-scale data is characterized by a combination of processes acting along multiple dimensions simultaneously, spatiotemporal scales across orders of magnitude, non-stationarity, and/or i…
▽ More
The unsupervised and principled diagnosis of multi-scale data is a fundamental obstacle in modern scientific problems from, for instance, weather and climate prediction, neurology, epidemiology, and turbulence. Multi-scale data is characterized by a combination of processes acting along multiple dimensions simultaneously, spatiotemporal scales across orders of magnitude, non-stationarity, and/or invariances such as translation and rotation. Existing methods are not well-suited to multi-scale data, usually requiring supervised strategies such as human intervention, extensive tuning, or selection of ideal time periods. We present the multi-resolution Coherent Spatio-Temporal Scale Separation (mrCOSTS), a hierarchical and automated algorithm for the diagnosis of coherent patterns or modes in multi-scale data. mrCOSTS is a variant of Dynamic Mode Decomposition which decomposes data into bands of spatial patterns with shared time dynamics, thereby providing a robust method for analyzing multi-scale data. It requires no training but instead takes advantage of the hierarchical nature of multi-scale systems. We demonstrate mrCOSTS using complex multi-scale data sets that are canonically difficult to analyze: 1) climate patterns of sea surface temperature, 2) electrophysiological observations of neural signals of the motor cortex, and 3) horizontal wind in the mountain boundary layer. With mrCOSTS, we trivially retrieve complex dynamics that were previously difficult to resolve while additionally extracting hitherto unknown patterns of activity embedded in the dynamics, allowing for advancing the understanding of these fields of study. This method is an important advancement for addressing the multi-scale data which characterize many of the grand challenges in science and engineering.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
PyDMD: A Python package for robust dynamic mode decomposition
Authors:
Sara M. Ichinaga,
Francesco Andreuzzi,
Nicola Demo,
Marco Tezzele,
Karl Lapo,
Gianluigi Rozza,
Steven L. Brunton,
J. Nathan Kutz
Abstract:
The dynamic mode decomposition (DMD) is a simple and powerful data-driven modeling technique that is capable of revealing coherent spatiotemporal patterns from data. The method's linear algebra-based formulation additionally allows for a variety of optimizations and extensions that make the algorithm practical and viable for real-world data analysis. As a result, DMD has grown to become a leading…
▽ More
The dynamic mode decomposition (DMD) is a simple and powerful data-driven modeling technique that is capable of revealing coherent spatiotemporal patterns from data. The method's linear algebra-based formulation additionally allows for a variety of optimizations and extensions that make the algorithm practical and viable for real-world data analysis. As a result, DMD has grown to become a leading method for dynamical system analysis across multiple scientific disciplines. PyDMD is a Python package that implements DMD and several of its major variants. In this work, we expand the PyDMD package to include a number of cutting-edge DMD methods and tools specifically designed to handle dynamics that are noisy, multiscale, parameterized, prohibitively high-dimensional, or even strongly nonlinear. We provide a complete overview of the features available in PyDMD as of version 1.0, along with a brief overview of the theory behind the DMD algorithm, information for developers, tips regarding practical DMD usage, and introductory coding examples. All code is available at https://github.com/PyDMD/PyDMD .
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Network inference via process motifs for lagged correlation in linear stochastic processes
Authors:
Alice C. Schwarze,
Sara M. Ichinaga,
Bingni W. Brunton
Abstract:
A major challenge for causal inference from time-series data is the trade-off between computational feasibility and accuracy. Motivated by process motifs for lagged covariance in an autoregressive model with slow mean-reversion, we propose to infer networks of causal relations via pairwise edge measure (PEMs) that one can easily compute from lagged correlation matrices. Motivated by contributions…
▽ More
A major challenge for causal inference from time-series data is the trade-off between computational feasibility and accuracy. Motivated by process motifs for lagged covariance in an autoregressive model with slow mean-reversion, we propose to infer networks of causal relations via pairwise edge measure (PEMs) that one can easily compute from lagged correlation matrices. Motivated by contributions of process motifs to covariance and lagged variance, we formulate two PEMs that correct for confounding factors and for reverse causation. To demonstrate the performance of our PEMs, we consider network interference from simulations of linear stochastic processes, and we show that our proposed PEMs can infer networks accurately and efficiently. Specifically, for slightly autocorrelated time-series data, our approach achieves accuracies higher than or similar to Granger causality, transfer entropy, and convergent crossmapping -- but with much shorter computation time than possible with any of these methods. Our fast and accurate PEMs are easy-to-implement methods for network inference with a clear theoretical underpinning. They provide promising alternatives to current paradigms for the inference of linear models from time-series data, including Granger causality, vector-autoregression, and sparse inverse covariance estimation.
△ Less
Submitted 21 August, 2022; v1 submitted 18 August, 2022;
originally announced August 2022.
-
Structured Time-Delay Models for Dynamical Systems with Connections to Frenet-Serret Frame
Authors:
Seth M. Hirsh,
Sara M. Ichinaga,
Steven L. Brunton,
J. Nathan Kutz,
Bingni W. Brunton
Abstract:
Time-delay embeddings and dimensionality reduction are powerful techniques for discovering effective coordinate systems to represent the dynamics of physical systems. Recently, it has been shown that models identified by dynamic mode decomposition (DMD) on time-delay coordinates provide linear representations of strongly nonlinear systems, in the so-called Hankel alternative view of Koopman (HAVOK…
▽ More
Time-delay embeddings and dimensionality reduction are powerful techniques for discovering effective coordinate systems to represent the dynamics of physical systems. Recently, it has been shown that models identified by dynamic mode decomposition (DMD) on time-delay coordinates provide linear representations of strongly nonlinear systems, in the so-called Hankel alternative view of Koopman (HAVOK) approach. Curiously, the resulting linear model has a matrix representation that is approximately antisymmetric and tridiagonal with a zero diagonal; for chaotic systems, there is an additional forcing term in the last component. In this paper, we establish a new theoretical connection between HAVOK and the Frenet-Serret frame from differential geometry, and also develop an improved algorithm to identify more stable and accurate models from less data. In particular, we show that the sub- and super-diagonal entries of the linear model correspond to the intrinsic curvatures in Frenet-Serret frame. Based on this connection, we modify the algorithm to promote this antisymmetric structure, even in the noisy, low-data limit. We demonstrate this improved modeling procedure on data from several nonlinear synthetic and real-world examples.
△ Less
Submitted 20 January, 2021;
originally announced January 2021.
