Showing 1–38 of 38 results for author: Kantz, H

Multifractional Brownian motion with telegraphic, stochastically varying exponent

Authors: Michał Balcerek, Samudrajit Thapa, Krzysztof Burnecki, Holger Kantz, Ralf Metzler, Agnieszka Wyłomańska, Aleksei Chechkin

Abstract: The diversity of diffusive systems exhibiting long-range correlations characterized by a stochastically varying Hurst exponent calls for a generic multifractional model. We present a simple, analytically tractable model which fills the gap between mathematical formulations of multifractional Brownian motion and empirical studies. In our model, called telegraphic multifractional Brownian motion, th… ▽ More The diversity of diffusive systems exhibiting long-range correlations characterized by a stochastically varying Hurst exponent calls for a generic multifractional model. We present a simple, analytically tractable model which fills the gap between mathematical formulations of multifractional Brownian motion and empirical studies. In our model, called telegraphic multifractional Brownian motion, the Hurst exponent is modelled by a smoothed telegraph process which results in a stationary beta distribution of exponents as observed in biological experiments. We also provide a methodology to identify our model in experimental data and present concrete examples from biology, climate and finance to demonstrate the efficacy of our approach. △ Less

Submitted 20 April, 2025; originally announced April 2025.

Utilizing long memory and circulation patterns for stochastic forecasts of temperature extremes

Authors: Johannes A. Kassel, Holger Kantz

Abstract: Long memory and circulation patterns are potential sources of subseasonal-to-seasonal predictions. Here, we infer one-dimensional nonlinear stochastic models of daily temperature which capture both long memory and external driving by the Arctic Oscillation (AO) index. To this end, we employ a data-driven method which combines fractional calculus and stochastic difference equations. A causal analys… ▽ More Long memory and circulation patterns are potential sources of subseasonal-to-seasonal predictions. Here, we infer one-dimensional nonlinear stochastic models of daily temperature which capture both long memory and external driving by the Arctic Oscillation (AO) index. To this end, we employ a data-driven method which combines fractional calculus and stochastic difference equations. A causal analysis of AO and North-Atlantic Oscillation indices and European daily extreme temperatures reveals the largest influence of the AO index on winter temperature in southern Scandinavia. Stochastic temperature forecasts for Visby Flygplats, Sweden, show significantly improved performance for long memory models. Binary temperature forecasts show predictive power for up to 20 (11) days lead time for maximum (minimum) daily temperature (66% CI) while an AR(1) model possesses predictive power for 8 (3) days lead time for daily maximum (minimum) temperature (66% CI). Our results show the potential of long memory and circulation patterns for extreme temperature forecasts. △ Less

Submitted 4 January, 2025; originally announced January 2025.

Comments: 13 pages, 4 figures, supporting information

A conceptual predator-prey model with super-long transients

Authors: Misha Chai, Holger Kantz

Abstract: Drawing on the understanding of the logistic map, we propose a simple predator-prey model where predators and prey adapt to each other, leading to the co-evolution of the system. The special dynamics observed in periodic windows contribute to the coexistence of multiple time scales, adding to the complexity of the system. Typical dynamics in ecosystems, such as the persistence and coexistence of p… ▽ More Drawing on the understanding of the logistic map, we propose a simple predator-prey model where predators and prey adapt to each other, leading to the co-evolution of the system. The special dynamics observed in periodic windows contribute to the coexistence of multiple time scales, adding to the complexity of the system. Typical dynamics in ecosystems, such as the persistence and coexistence of population cycles and chaotic behaviors, the emergence of super-long transients, regime shifts, and the quantifying of resilience, are encapsulated within this single model. The simplicity of our model allows for detailed analysis, reinforcing its potential as a conceptual tool for understanding ecosystems deeply. △ Less

Submitted 2 October, 2024; v1 submitted 12 June, 2024; originally announced June 2024.

Inferring nonlinear fractional diffusion processes from single trajectories

Authors: Johannes A. Kassel, Benjamin Walter, Holger Kantz

Abstract: We present a method to infer the arbitrary space-dependent drift and diffusion of a nonlinear stochastic model driven by multiplicative fractional Gaussian noise from a single trajectory. Our method, fractional Onsager-Machlup optimisation (fOMo), introduces a maximum likelihood estimator by minimising a field-theoretic action which we construct from the observed time series. We successfully test… ▽ More We present a method to infer the arbitrary space-dependent drift and diffusion of a nonlinear stochastic model driven by multiplicative fractional Gaussian noise from a single trajectory. Our method, fractional Onsager-Machlup optimisation (fOMo), introduces a maximum likelihood estimator by minimising a field-theoretic action which we construct from the observed time series. We successfully test fOMo for a wide range of Hurst exponents using artificial data with strong nonlinearities, and apply it to a data set of daily mean temperatures. We further highlight the significant systematic estimation errors when ignoring non-Markovianity, underlining the need for nonlinear fractional inference methods when studying real-world long-range (anti-)correlated systems. △ Less

Submitted 4 November, 2023; v1 submitted 5 April, 2023; originally announced April 2023.

Comments: 21 pages, 5 figures, appendices

Scale-dependent Error Growth in Navier--Stokes Simulations

Authors: Nazmi Burak Budanur, Holger Kantz

Abstract: We estimate the maximal Lyapunov exponent at different resolutions and Reynolds numbers in large eddy (LES) and direct numerical simulations (DNS) of sinusoidally-driven Navier--Stokes equations in three dimensions. Independent of the Reynolds number when nondimensionalized by Kolmogorov units, the LES Lyapunov exponent diverges as an inverse power of the effective grid spacing showing that the fi… ▽ More We estimate the maximal Lyapunov exponent at different resolutions and Reynolds numbers in large eddy (LES) and direct numerical simulations (DNS) of sinusoidally-driven Navier--Stokes equations in three dimensions. Independent of the Reynolds number when nondimensionalized by Kolmogorov units, the LES Lyapunov exponent diverges as an inverse power of the effective grid spacing showing that the fine scale structures exhibit much faster error growth rates than the larger ones. Effectively, i.e., ignoring the cut-off of this phenomenon at the Kolmogorov scale, this behavior introduces an upper bound to the prediction horizon that can be achieved by improving the precision of initial conditions through refining of the measurement grid. △ Less

Submitted 2 September, 2022; originally announced September 2022.

Comments: 13 pages, 4 figures

Journal ref: Phys. Rev. E 106, 045102 (2022)

Local equilibrium properties of ultraslow diffusion in the Sinai model

Authors: Amin Padash, Erez Aghion, Alexander Schulz, Eli Barkai, Aleksei V Chechkin, Ralf Metzler, Holger Kantz

Abstract: We perform numerical studies of a thermally driven, overdamped particle in a random quenched force field, known as the Sinai model. We compare the unbounded motion on an infinite 1-dimensional domain to the motion in bounded domains with reflecting boundaries and show that the unbounded motion is at every time close to the equilibrium state of a finite system of growing size. This is due to time s… ▽ More We perform numerical studies of a thermally driven, overdamped particle in a random quenched force field, known as the Sinai model. We compare the unbounded motion on an infinite 1-dimensional domain to the motion in bounded domains with reflecting boundaries and show that the unbounded motion is at every time close to the equilibrium state of a finite system of growing size. This is due to time scale separation: Inside wells of the random potential, there is relatively fast equilibration, while the motion across major potential barriers is ultraslow. Quantities studied by us are the time dependent mean squared displacement, the time dependent mean energy of an ensemble of particles, and the time dependent entropy of the probability distribution. Using a very fast numerical algorithm, we can explore times up top $10^{17}$ steps and thereby also study finite-time crossover phenomena. △ Less

Submitted 21 July, 2022; v1 submitted 6 July, 2022; originally announced July 2022.

Journal ref: New J. Phys. 24 (2022) 073026

Data-Driven Interaction Analysis of Line Failure Cascading in Power Grid Networks

Authors: Abdorasoul Ghasemi, Holger Kantz

Abstract: We use machine learning tools to model the line interaction of failure cascading in power grid networks. We first collect data sets of simulated trajectories of possible consecutive line failure following an initial random failure and considering actual constraints in a model power network until the system settles at a steady state. We use weighted $l_1$-regularized logistic regression-based model… ▽ More We use machine learning tools to model the line interaction of failure cascading in power grid networks. We first collect data sets of simulated trajectories of possible consecutive line failure following an initial random failure and considering actual constraints in a model power network until the system settles at a steady state. We use weighted $l_1$-regularized logistic regression-based models to find static and dynamic models that capture pairwise and latent higher-order lines' failure interactions using pairwise statistical data. The static model captures the failures' interactions near the steady states of the network, and the dynamic model captures the failure unfolding in a time series of consecutive network states. We test models over independent trajectories of failure unfolding in the network to evaluate their failure predictive power. We observe asymmetric, strongly positive, and negative interactions between different lines' states in the network. We use the static interaction model to estimate the distribution of cascade size and identify groups of lines that tend to fail together, and compare against the data. The dynamic interaction model successfully predicts the network state for long-lasting failure propagation trajectories after an initial failure. △ Less

Submitted 2 December, 2021; originally announced December 2021.

Comments: 10 pages, 7 figures

Statistical Inference of 1D Persistent Nonlinear Time Series and Application to Predictions

Authors: Johannes A. Kassel, Holger Kantz

Abstract: We introduce a method for reconstructing macroscopic models of one-dimensional stochastic processes with long-range correlations from sparsely sampled time series by combining fractional calculus and discrete-time Langevin equations. The method is illustrated for the ARFIMA(1,d,0) process and a nonlinear auto-regressive toy model with multiplicative noise. We reconstruct a model for daily mean tem… ▽ More We introduce a method for reconstructing macroscopic models of one-dimensional stochastic processes with long-range correlations from sparsely sampled time series by combining fractional calculus and discrete-time Langevin equations. The method is illustrated for the ARFIMA(1,d,0) process and a nonlinear auto-regressive toy model with multiplicative noise. We reconstruct a model for daily mean temperature data recorded at Potsdam (Germany) and use it to predict the first frost date by computing the mean first passage time of the reconstructed process and the zero degree Celsius temperature line, illustrating the potential of long-memory models for predictions in the subseasonal-to-seasonal range. △ Less

Submitted 4 November, 2023; v1 submitted 30 July, 2021; originally announced July 2021.

Comments: 7 pages, 6 Figures

Journal ref: Phys. Rev. Research 4, 013206 (2022)

Anomalous diffusion in the citation time series of scientific publications

Authors: Maryam Zamani, Erez Aghion, Peter Pollner, Tamas Vicsek, Holger Kantz

Abstract: We analyze the citation time-series of manuscripts in three different fields of science; physics, social science and technology. The evolution of the time-series of the yearly number of citations, namely the citation trajectories, diffuse anomalously, their variance scales with time $\propto t^{2H}$, where $H\neq 1/2$. We provide detailed analysis of the various factors that lead to the anomalous… ▽ More We analyze the citation time-series of manuscripts in three different fields of science; physics, social science and technology. The evolution of the time-series of the yearly number of citations, namely the citation trajectories, diffuse anomalously, their variance scales with time $\propto t^{2H}$, where $H\neq 1/2$. We provide detailed analysis of the various factors that lead to the anomalous behavior: non-stationarity, long-ranged correlations and a fat-tailed increment distribution. The papers exhibit high degree of heterogeneity, across the various fields, as the statistics of the highest cited papers is fundamentally different from that of the lower ones. The citation data is shown to be highly correlated and non-stationary; as all the papers except the small percentage of them with high number of citations, die out in time. △ Less

Submitted 29 June, 2021; v1 submitted 18 June, 2021; originally announced June 2021.

Comments: 12 pages, 12 figures

Data-Driven Load Profiles and the Dynamics of Residential Electric PowerConsumption

Authors: Mehrnaz Anvari, Elisavet Proedrou, Benjamin Schaefer, Christian Beck, Holger Kantz, Marc Timme

Abstract: The dynamics of power consumption constitutes an essential building block for planning and operating energy systems based on renewable energy supply. Whereas variations in the dynamics of renewable energy generation are reasonably well studied, a deeper understanding of short and long term variations in consumption dynamics is still missing. Here, we analyse highly resolved residential electricity… ▽ More The dynamics of power consumption constitutes an essential building block for planning and operating energy systems based on renewable energy supply. Whereas variations in the dynamics of renewable energy generation are reasonably well studied, a deeper understanding of short and long term variations in consumption dynamics is still missing. Here, we analyse highly resolved residential electricity consumption data of Austrian and German households and propose a generally applicable methodology for extracting both the average demand profiles and the demand fluctuations purely from time series data. The analysis reveals that demand fluctuations of individual households are skewed and consistently highly intermittent. We introduce a stochastic model to quantitatively capture such real-world fluctuations. The analysis indicates in how far the broadly used standard load profile (SLP) may be is insufficient to describe the key characteristics observed. These results offer a better understanding of demand dynamics, in particular its fluctuations, and provide general tools for disentangling mean demand and fluctuations for any given system. The insights on the demand dynamics may support planning and operating future-compliant (micro) grids in maintaining supply-demand balance. △ Less

Submitted 19 September, 2020; originally announced September 2020.

Moses, Noah and Joseph Effects in Coupled Lévy Processes

Authors: Erez Aghion, Philipp G. Meyer, Vidushi Adalkha, Holger Kantz, Kevin E. Bassler

Abstract: We study a method for detecting the origins of anomalous diffusion, when it is observed in an ensemble of times-series, generated experimentally or numerically, without having knowledge about the exact underlying dynamics. The reasons for anomalous diffusive scaling of the mean-squared displacement are decomposed into three root causes: increment correlations are expressed by the "Joseph effect" [… ▽ More We study a method for detecting the origins of anomalous diffusion, when it is observed in an ensemble of times-series, generated experimentally or numerically, without having knowledge about the exact underlying dynamics. The reasons for anomalous diffusive scaling of the mean-squared displacement are decomposed into three root causes: increment correlations are expressed by the "Joseph effect" [Mandelbrot 1968], fat-tails of the increment probability density lead to a "Noah effect" [Mandelbrot 1968], and non-stationarity, to the "Moses effect" [Chen et al. 2017]. After appropriate rescaling, based on the quantification of these effects, the increment distribution converges at increasing times to a time-invariant asymptotic shape. For different processes, this asymptotic limit can be an equilibrium state, an infinite-invariant, or an infinite-covariant density. We use numerical methods of time-series analysis to quantify the three effects in a model of a non-linearly coupled Lévy walk, compare our results to theoretical predictions, and discuss the generality of the method. △ Less

Submitted 22 December, 2020; v1 submitted 18 September, 2020; originally announced September 2020.

Comments: Main text is 13 pages, 3 pages of appendixes

Leveraging large-deviation statistics to decipher the stochastic properties of measured trajectories

Authors: Samudrajit Thapa, Agnieszka Wyłomańska, Grzegorz Sikora, Caroline E. Wagner, Diego Krapf, Holger Kantz, Aleksei V. Chechkin, Ralf Metzler

Abstract: Extensive time-series encoding the position of particles such as viruses, vesicles, or individual proteins are routinely garnered in single-particle tracking experiments or supercomputing studies. They contain vital clues on how viruses spread or drugs may be delivered in biological cells. Similar time-series are being recorded of stock values in financial markets and of climate data. Such time-se… ▽ More Extensive time-series encoding the position of particles such as viruses, vesicles, or individual proteins are routinely garnered in single-particle tracking experiments or supercomputing studies. They contain vital clues on how viruses spread or drugs may be delivered in biological cells. Similar time-series are being recorded of stock values in financial markets and of climate data. Such time-series are most typically evaluated in terms of time-average mean-squared displacements, which remain random variables for finite measurement times. Their statistical properties are different for different physical stochastic processes, thus allowing us to extract valuable information on the stochastic process itself. To exploit the full potential of the statistical information encoded in measured time-series we here propose an easy-to-implement and computationally inexpensive new methodology, based on deviations of the time-averaged mean-squared displacement from its ensemble average counterpart. Specifically, we use the upper bound of these deviations for Brownian motion to check the applicability of this approach to simulated and real data sets. By comparing the probability of deviations for different data sets, we demonstrate how the theoretical bound for Brownian motion reveals additional information about observed stochastic processes. We apply the large-deviation method to data sets of tracer beads tracked in aqueous solution, tracer beads measured in mucin hydrogels, and of geographic surface temperature anomalies. Our analysis shows how the large-deviation properties can be efficiently used as a simple yet effective routine test to reject the Brownian motion hypothesis and unveil crucial information on statistical properties such as ergodicity breaking and short-time correlations. △ Less

Submitted 5 May, 2020; originally announced May 2020.

Comments: 16 pages, 11 figures, RevTeX

Journal ref: New J. Phys. 23 013008 (2021)

Evolution and Transformation of Scientific Knowledge over the Sphaera Corpus: A Network Study

Authors: Maryam Zamani, Alejandro Tejedor, Malte Vogl, Florian Krautli, Matteo Valleriani, Holger Kantz

Abstract: We investigated the evolution and transformation of scientific knowledge in the early modern period, analyzing more than 350 different editions of textbooks used for teaching astronomy in European universities from the late fifteenth century to mid-seventeenth century. These historical sources constitute the Sphaera Corpus. By examining different semantic relations among individual parts of each e… ▽ More We investigated the evolution and transformation of scientific knowledge in the early modern period, analyzing more than 350 different editions of textbooks used for teaching astronomy in European universities from the late fifteenth century to mid-seventeenth century. These historical sources constitute the Sphaera Corpus. By examining different semantic relations among individual parts of each edition on record, we built a multiplex network consisting of six layers, as well as the aggregated network built from the superposition of all the layers. The network analysis reveals the emergence of five different communities. The contribution of each layer in shaping the communities and the properties of each community are studied. The most influential books in the corpus are found by calculating the average age of all the out-going and in-coming links for each book. A small group of editions is identified as a transmitter of knowledge as they bridge past knowledge to the future through a long temporal interval. Our analysis, moreover, identifies the most disruptive books. These books introduce new knowledge that is then adopted by almost all the books published afterwards until the end of the whole period of study. The historical research on the content of the identified books, as an empirical test, finally corroborates the results of all our analyses. △ Less

Submitted 1 April, 2020; originally announced April 2020.

Comments: 19 pages, 9 figures

Data-driven model of the power-grid frequency dynamics

Authors: Leonardo Rydin Gorjão, Mehrnaz Anvari, Holger Kantz, Christian Beck, Dirk Witthaut, Marc Timme, Benjamin Schäfer

Abstract: The energy system is rapidly changing to accommodate the increasing number of renewable generators and the general transition towards a more sustainable future. Simultaneously, business models and market designs evolve, affecting power-grid operation and power-grid frequency. Problems raised by this ongoing transition are increasingly addressed by transdisciplinary research approaches, ranging fro… ▽ More The energy system is rapidly changing to accommodate the increasing number of renewable generators and the general transition towards a more sustainable future. Simultaneously, business models and market designs evolve, affecting power-grid operation and power-grid frequency. Problems raised by this ongoing transition are increasingly addressed by transdisciplinary research approaches, ranging from purely mathematical modelling to applied case studies. These approaches require a stochastic description of consumer behaviour, fluctuations by renewables, market rules, and how they influence the stability of the power-grid frequency. Here, we introduce an easy-to-use, data-driven, stochastic model for the power-grid frequency and demonstrate how it reproduces key characteristics of the observed statistics of the Continental European and British power grids. We offer executable code and guidelines on how to use the model on any power grid for various mathematical or engineering applications. △ Less

Submitted 2 October, 2019; v1 submitted 18 September, 2019; originally announced September 2019.

Comments: 14 pages, 10 figures, Supplemental Material with code

A simple decomposition of European temperature variability capturing the variance from days to a decade

Authors: Philipp G Meyer, Holger Kantz

Abstract: We analyze European temperature variability from station data with the method of detrended fluctuation analysis. This method is known to give a scaling exponent indicating long range correlations in time for temperature anomalies. However, by a more careful look at the fluctuation function we are able to explain the emergent scaling behaviour by short time relaxation, the yearly cycle and one addi… ▽ More We analyze European temperature variability from station data with the method of detrended fluctuation analysis. This method is known to give a scaling exponent indicating long range correlations in time for temperature anomalies. However, by a more careful look at the fluctuation function we are able to explain the emergent scaling behaviour by short time relaxation, the yearly cycle and one additional process. It turns out that for many stations this interannual variability is an oscillatory mode with a period length of approximately 7-8 years, which is consistent with results of other methods. We discuss the spatial patterns in all parameters and validate the finding of the 7-8 year period by comparing stations with and without this mode. △ Less

Submitted 6 August, 2019; originally announced August 2019.

Star-Convex structures as prototypes of Lagrangian coherent structures

Authors: Benedict Lünsmann, Holger Kantz

Abstract: Oceanic surface flows are dominated by finite-time Lagrangian coherent structures that separate regions of qualitatively different dynamical behavior. Among these, eddy boundaries are of particular interest. Their exact identification is crucial for the study of oceanic transport processes and the investigation of impacts on marine life and the climate. Here, we present a novel method purely based… ▽ More Oceanic surface flows are dominated by finite-time Lagrangian coherent structures that separate regions of qualitatively different dynamical behavior. Among these, eddy boundaries are of particular interest. Their exact identification is crucial for the study of oceanic transport processes and the investigation of impacts on marine life and the climate. Here, we present a novel method purely based on convexity, a condition that is intuitive and well-established, yet not fully explored. We discuss the underlying theory, derive an algorithm that yields comprehensible results and illustrate the presented method by identifying coherent structures and filaments in simulations and real oceanic velocity fields. △ Less

Submitted 15 May, 2019; originally announced May 2019.

Comments: 5 pages, 4 figures

Power law error growth in multi-hierarchical chaotic systems -- a dynamical mechanism for finite prediction horizon in weather forecasts

Authors: Jonathan Brisch, Holger Kantz

Abstract: We propose a dynamical mechanism for a scale dependent error growth rate, by the introduction of a class of hierarchical models. The coupling of time scales and length scales is motivated by atmospheric dynamics. This model class can be tuned to exhibit a scale dependent error growth rate in the form of a power law, which translates in power law error growth over time instead of exponential error… ▽ More We propose a dynamical mechanism for a scale dependent error growth rate, by the introduction of a class of hierarchical models. The coupling of time scales and length scales is motivated by atmospheric dynamics. This model class can be tuned to exhibit a scale dependent error growth rate in the form of a power law, which translates in power law error growth over time instead of exponential error growth as in conventional chaotic systems. The consequence is a strictly finite prediction horizon, since in the limit of infinitesimal errors of initial conditions, the error growth rate diverges and hence additional accuracy is not translated into longer prediction times. By re-analyzing data of the NCEP Global Forecast System published by Harlim et al.[13] we show that such a power law error growth rate can indeed be found in numerical weather forecast models. △ Less

Submitted 17 April, 2019; originally announced April 2019.

Comments: 10 pages, 4 figures,

An extended transfer operator approach for time-consistent coherent set analysis

Authors: Benedict Lünsmann, Rahel Vortmeyer-Kley, Holger Kantz

Abstract: Coherent oceanic mesoscale structures, especially the non-filamenting cores of oceanic eddies, have gained a lot of attention in recent years. These Lagrangian structures are considered to play a significant role in oceanic transport processes which, in turn, impact marine life, weather and potentially even the climate itself. Answering questions regarding these phenomena requires robust tools for… ▽ More Coherent oceanic mesoscale structures, especially the non-filamenting cores of oceanic eddies, have gained a lot of attention in recent years. These Lagrangian structures are considered to play a significant role in oceanic transport processes which, in turn, impact marine life, weather and potentially even the climate itself. Answering questions regarding these phenomena requires robust tools for the detection and identification of these structures. In this article, we use transfer operator ideas to develop a novel method for the identification of weakly-mixing coherent volumes in oceanic velocity field data sets. Unlike other methods, the approach focuses on maximizing consistency over longer time periods. We employ a time-centralized transfer operator approach with practical modifications to identify potential structures in predetermined domains and couple adjacent time steps to decide how to conduct the final partitioning. The analysis pipeline includes plausibility checks that give further insights into the stability and coherence of the inferred structure. The presented method is able to find changing masses of maximal coherence in stationary and non-stationary toy models and yields good results when applied to field data. △ Less

Submitted 12 March, 2019; originally announced March 2019.

Comments: 12 pages, 6 figures, submitted to Chaos

Large deviations of time-averaged statistics for Gaussian processes

Authors: J. Gajda, A. Wylomanska, H. Kantz, A. V. Chechkin, G. Sikora

Abstract: In this paper we study the large deviations of time averaged mean square displacement (TAMSD) for Gaussian processes. The theory of large deviations is related to the exponential decay of probabilities of large fluctuations in random systems. From the mathematical point of view a given statistics satisfies the large deviation principle, if the probability that it belongs to a certain range decreas… ▽ More In this paper we study the large deviations of time averaged mean square displacement (TAMSD) for Gaussian processes. The theory of large deviations is related to the exponential decay of probabilities of large fluctuations in random systems. From the mathematical point of view a given statistics satisfies the large deviation principle, if the probability that it belongs to a certain range decreases exponentially. The TAMSD is one of the main statistics used in the problem of anomalous diffusion detection. Applying the theory of generalized chi-squared distribution and sub-gamma random variables we prove the upper bound for large deviations of TAMSD for Gaussian processes. As a special case we consider fractional Brownian motion, one of the most popular models of anomalous diffusion. Moreover, we derive the upper bound for large deviations of the estimator for the anomalous diffusion exponent. △ Less

Submitted 27 November, 2018; originally announced November 2018.

Journal ref: Statistics and Probability Letters 143, 47-55, 2018

Probabilistic properties of detrended fluctuation analysis for Gaussian processes

Authors: G. Sikora, M. Hoell, A. Wylomanska, J. Gajda, A. V. Chechkin, H. Kantz

Abstract: The detrended fluctuation analysis (DFA) is one of the most widely used tools for the detection of long-range correlations in time series. Although DFA has found many interesting applications and has been shown as one of the best performing detrending methods, its probabilistic foundations are still unclear. In this paper we study probabilistic properties of DFA for Gaussian processes. The main at… ▽ More The detrended fluctuation analysis (DFA) is one of the most widely used tools for the detection of long-range correlations in time series. Although DFA has found many interesting applications and has been shown as one of the best performing detrending methods, its probabilistic foundations are still unclear. In this paper we study probabilistic properties of DFA for Gaussian processes. The main attention is paid to the distribution of the squared error sum of the detrended process. This allows us to find the expected value and the variance of the fluctuation function of DFA for a Gaussian process of general form. The results obtained can serve as a starting point for analyzing the statistical properties of the DFA-based estimators for the fluctuation and correlation parameters. The obtained theoretical formulas are supported by numerical simulations of particular Gaussian processes possessing short-and long-memory behaviour. △ Less

Submitted 27 November, 2018; originally announced November 2018.

Journal ref: Phys. Rev. E 101, 032114 (2020)

Early warning signal for interior crises in excitable systems

Authors: Rajat Karnatak, Holger Kantz, Stephan Bialonski

Abstract: The ability to reliably predict critical transitions in dynamical systems is a long-standing goal of diverse scientific communities. Previous work focused on early warning signals related to local bifurcations (critical slowing down) and non-bifurcation type transitions. We extend this toolbox and report on a characteristic scaling behavior (critical attractor growth) which is indicative of an imp… ▽ More The ability to reliably predict critical transitions in dynamical systems is a long-standing goal of diverse scientific communities. Previous work focused on early warning signals related to local bifurcations (critical slowing down) and non-bifurcation type transitions. We extend this toolbox and report on a characteristic scaling behavior (critical attractor growth) which is indicative of an impending global bifurcation, an interior crisis in excitable systems. We demonstrate our early warning signal in a conceptual climate model as well as in a model of coupled neurons known to exhibit extreme events. We observed critical attractor growth prior to interior crises of chaotic as well as strange-nonchaotic attractors. These observations promise to extend the classes of transitions that can be predicted via early warning signals. △ Less

Submitted 13 November, 2017; originally announced November 2017.

Comments: 6 pages, 4 figures

Journal ref: Phys. Rev. E 96, 042211 (2017)

Stochastic dynamics and the predictability of big hits in online videos

Authors: Jose M. Miotto, Holger Kantz, Eduardo G. Altmann

Abstract: The competition for the attention of users is a central element of the Internet. Crucial issues are the origin and predictability of big hits, the few items that capture a big portion of the total attention. We address these issues analyzing 10 million time series of videos' views from YouTube. We find that the average gain of views is linearly proportional to the number of views a video already h… ▽ More The competition for the attention of users is a central element of the Internet. Crucial issues are the origin and predictability of big hits, the few items that capture a big portion of the total attention. We address these issues analyzing 10 million time series of videos' views from YouTube. We find that the average gain of views is linearly proportional to the number of views a video already has, in agreement with usual rich-get-richer mechanisms and Gibrat's law, but this fails to explain the prevalence of big hits. The reason is that the fluctuations around the average views are themselves heavy tailed. Based on these empirical observations, we propose a stochastic differential equation with Lévy noise as a model of the dynamics of videos. We show how this model is substantially better in estimating the probability of an ordinary item becoming a big hit, which is considerably underestimated in the traditional proportional-growth models. △ Less

Submitted 10 March, 2017; v1 submitted 20 September, 2016; originally announced September 2016.

Comments: Manuscript (8 pages and 5 figures)

Journal ref: Phys. Rev. E 95, 032311 (2017)

Data-driven prediction and prevention of extreme events in a spatially extended excitable system

Authors: Stephan Bialonski, Gerrit Ansmann, Holger Kantz

Abstract: Extreme events occur in many spatially extended dynamical systems, often devastatingly affecting human life which makes their reliable prediction and efficient prevention highly desirable. We study the prediction and prevention of extreme events in a spatially extended system, a system of coupled FitzHugh-Nagumo units, in which extreme events occur in a spatially and temporally irregular way. Mimi… ▽ More Extreme events occur in many spatially extended dynamical systems, often devastatingly affecting human life which makes their reliable prediction and efficient prevention highly desirable. We study the prediction and prevention of extreme events in a spatially extended system, a system of coupled FitzHugh-Nagumo units, in which extreme events occur in a spatially and temporally irregular way. Mimicking typical constraints faced in field studies, we assume not to know the governing equations of motion and to be able to observe only a subset of all phase-space variables for a limited period of time. Based on reconstructing the local dynamics from data and despite being challenged by the rareness of events, we are able to predict extreme events remarkably well. With small, rare, and spatiotemporally localized perturbations which are guided by our predictions, we are able to completely suppress extreme events in this system. △ Less

Submitted 8 October, 2015; originally announced October 2015.

Comments: 13 pages, 8 figures

Journal ref: Phys. Rev. E 92, 042910 (2015)

Spatiotemporal clustering and separation in regional earthquakes

Authors: Rene C. Batac, Holger Kantz

Abstract: Spatiotemporal clustering of earthquake events is a generally-established fact, and is important for designing models and assessment techniques in seismicity. Here, we investigate how this behavior can manifest in the statistical distributions of inter-event distances and times between earthquakes from different regional catalogs. We complement the analysis of previous authors (Touati et al., PRL… ▽ More Spatiotemporal clustering of earthquake events is a generally-established fact, and is important for designing models and assessment techniques in seismicity. Here, we investigate how this behavior can manifest in the statistical distributions of inter-event distances and times between earthquakes from different regional catalogs. We complement the analysis of previous authors (Touati et al., PRL 102, 168501 (2009)) and observe histograms best described by a superposition of two component distributions for "short" and "long" distances and times. Our results quantify the spatiotemporal clustering of earthquakes that are possibly generated by the same triggering mechanism. Independent earthquakes, on the other hand, are found to be separated by long inter-event distances and times. The statistics presented reveal regional differences, suggesting non-universality of the distributions. △ Less

Submitted 5 July, 2013; originally announced July 2013.

Comments: Submitted to Physical Review Letters

Fluctuations of $1/f$ noise and the low frequency cutoff paradox

Authors: Markus Niemann, Holger Kantz, Eli Barkai

Abstract: Recent experiments on blinking quantum dots and weak turbulence in liquid crystals reveal the fundamental connection between $1/f$ noise and power law intermittency. The non-stationarity of the process implies that the power spectrum is random -- a manifestation of weak ergodicity breaking. Here we obtain the universal distribution of the power spectrum, which can be used to identify intermittency… ▽ More Recent experiments on blinking quantum dots and weak turbulence in liquid crystals reveal the fundamental connection between $1/f$ noise and power law intermittency. The non-stationarity of the process implies that the power spectrum is random -- a manifestation of weak ergodicity breaking. Here we obtain the universal distribution of the power spectrum, which can be used to identify intermittency as the source of the noise. We solve an outstanding paradox on the non integrability of $1/f$ noise and the violation of Parseval's theorem. We explain why there is no physical low frequency cutoff and therefore cannot be found in experiments. △ Less

Submitted 10 September, 2012; originally announced September 2012.

Comments: 5 pages, 2 figures, supplementary material (4 pages)

Predicting Failures of Point Forecasts

Authors: S. Hallerberg, J. Bröcker, H. Kantz, L. A. Smith

Abstract: The predictability of errors in deterministic temperature forecasts is investigated. More precisely, the aim is to issue warnings whenever the differences between forecast and verification exceed a given threshold. The warnings are generated by analyzing the output of an ensemble forecast system in terms of a decision making approach. The quality of the resulting predictions is evaluated by comput… ▽ More The predictability of errors in deterministic temperature forecasts is investigated. More precisely, the aim is to issue warnings whenever the differences between forecast and verification exceed a given threshold. The warnings are generated by analyzing the output of an ensemble forecast system in terms of a decision making approach. The quality of the resulting predictions is evaluated by computing receiver operating characteristics, the Brier score, and the Ignorance score. Special emphasis is also given to the question whether rare events are better predictable. △ Less

Submitted 7 December, 2011; originally announced December 2011.

Comments: 19 pages, 13 figures

Prediction of extreme events in the OFC model on a small world network

Authors: Filippo Caruso, Holger Kantz

Abstract: We investigate the predictability of extreme events in a dissipative Olami-Feder-Christensen model on a small world topology. Due to the mechanism of self-organized criticality, it is impossible to predict the magnitude of the next event knowing previous ones, if the system has an infinite size. However, by exploiting the finite size effects, we show that probabilistic predictions of the occurrenc… ▽ More We investigate the predictability of extreme events in a dissipative Olami-Feder-Christensen model on a small world topology. Due to the mechanism of self-organized criticality, it is impossible to predict the magnitude of the next event knowing previous ones, if the system has an infinite size. However, by exploiting the finite size effects, we show that probabilistic predictions of the occurrence of extreme events in the next time step are possible in a finite system. In particular, the finiteness of the system unavoidably leads to repulsive temporal correlations of extreme events. The predictability of those is higher for larger magnitudes and for larger complex network sizes. Finally, we show that our prediction analysis is also robust by remarkably reducing the accessible number of events used to construct the optimal predictor. △ Less

Submitted 27 April, 2010; originally announced April 2010.

Comments: 5 pages, 4 figures

Journal ref: Eur. Phys. J. B 79, 7-11 (2011)

Statistical analysis of wind speed fluctuation and increments of non-stationary atmospheric boundary layer turbulence

Authors: T. Laubrich, F. Ghasemi, J. Peinke, H. Kantz

Abstract: We study the statistics of the horizontal component of atmospheric boundary layer wind speed. Motivated by its non-stationarity, we investigate which parameters remain constant or can be regarded as being piece-wise constant and explain how to estimate them. We will verify the picture of natural atmospheric boundary layer turbulence to be composed of successively occurring close to ideal turbule… ▽ More We study the statistics of the horizontal component of atmospheric boundary layer wind speed. Motivated by its non-stationarity, we investigate which parameters remain constant or can be regarded as being piece-wise constant and explain how to estimate them. We will verify the picture of natural atmospheric boundary layer turbulence to be composed of successively occurring close to ideal turbulence with different parameters. The first focus is put on the fluctuation of wind speed around its mean behaviour. We describe a method estimating the proportionality factor between the standard deviation of the fluctuation and the mean wind speed and analyse its time dependence. The second focus is put on the wind speed increments. We investigate the increment distribution and use an algorithm based on superstatistics to quantify the time dependence of the parameters describing the distribution. Applying the introduced tools yields a comprehensive description of the wind speed in the atmospheric boundary layer. △ Less

Submitted 20 November, 2008; originally announced November 2008.

Comments: 25 pages, 14 figures, presented at DAMES 2008 (Potsdam)

Return interval distribution of extreme events and long term memory

Authors: M. S. Santhanam, Holger Kantz

Abstract: The distribution of recurrence times or return intervals between extreme events is important to characterize and understand the behavior of physical systems and phenomena in many disciplines. It is well known that many physical processes in nature and society display long range correlations. Hence, in the last few years, considerable research effort has been directed towards studying the distrib… ▽ More The distribution of recurrence times or return intervals between extreme events is important to characterize and understand the behavior of physical systems and phenomena in many disciplines. It is well known that many physical processes in nature and society display long range correlations. Hence, in the last few years, considerable research effort has been directed towards studying the distribution of return intervals for long range correlated time series. Based on numerical simulations, it was shown that the return interval distributions are of stretched exponential type. In this paper, we obtain an analytical expression for the distribution of return intervals in long range correlated time series which holds good when the average return intervals are large. We show that the distribution is actually a product of power law and a stretched exponential form. We also discuss the regimes of validity and perform detailed studies on how the return interval distribution depends on the threshold used to define extreme events. △ Less

Submitted 12 March, 2008; originally announced March 2008.

Comments: 8 pages, 6 figures

Journal ref: Phys. Rev. E 78, 051113 (2008)

When are Extreme Events the better predictable, the larger they are?

Authors: S. Hallerberg, H. Kantz

Abstract: We investigate the predictability of extreme events in time series. The focus of this work is to understand under which circumstances large events are better predictable than smaller events. Therefore we use a simple prediction algorithm based on precursory structures which are identified using the maximum likelihood principle. Using the receiver operator characteristic curve as a measure for th… ▽ More We investigate the predictability of extreme events in time series. The focus of this work is to understand under which circumstances large events are better predictable than smaller events. Therefore we use a simple prediction algorithm based on precursory structures which are identified using the maximum likelihood principle. Using the receiver operator characteristic curve as a measure for the quality of predictions we find that the dependence on the event magnitude is closely linked to the probability distribution function of the underlying stochastic process. We evaluate this dependence on the probability distribution function analytically and numerically. If we assume that the optimal precursory structures are used to make the predictions, we find that large increments are better predictable if the underlying stochastic process has a Gaussian probability distribution function, whereas larger increments are harder to predict if the underlying probability distribution function has a power law tail. In the case of an exponential distribution function we find no significant dependence on the event magnitude. Furthermore we compare these results with predictions of increments in correlated data, namely, velocity increments of a free jet flow. The velocity increments in the free jet flow are in dependence on the time scale either asymptotically Gaussian or asymptotically exponential distributed. The numerical results for predictions within free jet data are in good agreement with the previous analytical considerations for random numbers. △ Less

Submitted 29 January, 2008; originally announced January 2008.

Journal ref: Phys. Rev. E 77, 011108 (2008)

Hoelder-exponent-MFDFA-based test for long-range correlations in pseudorandom sequences

Authors: Nikolay K. Vitanov, Kh. Tarnev, H. Kantz

Abstract: We discuss the problem for detecting long-range correlations in sequences of values obtained by generators of pseudo-random numbers. The basic idea is that the H{ö}lder exponent for a sufficiently long sequence of uncorrelated random numbers has the fixed value $h=1/2$. The presence of long-range correlations leads to deviation from this value. We calculate the H{ö}lder exponent by the method of… ▽ More We discuss the problem for detecting long-range correlations in sequences of values obtained by generators of pseudo-random numbers. The basic idea is that the H{ö}lder exponent for a sufficiently long sequence of uncorrelated random numbers has the fixed value $h=1/2$. The presence of long-range correlations leads to deviation from this value. We calculate the H{ö}lder exponent by the method of multifractal detrended fluctuation analysis (MFDFA). We discuss frequently used tests for randomness, finite sample properties of the MFDFA, and the conditions for a correct application of the method. We observe that the fluctuation function $F_{q}$ used in the MFDFA reacts to trends caused by low periodicity presented in the pseudo-random number generator. In order to select appropriate generators from the numerous programs we propose a test for the ensemble properties of the generated pseudo-random sequences with respect to their robustness against presence of long-range correlations, and a selection rule which orders the generators that pass the test. Selecting generators that successfully pass the ensemble test and have good performance with respect to the selection rule is not enough. For the selected generator we have to choose appropriate pseudo-random sequences for the length of the sequence required by the solved problem. This choice is based on the closeness of the H{ö}lder exponent of the generated sequence to its value 1/2 characteristic for the case of absence of correlations. △ Less

Submitted 7 August, 2006; originally announced August 2006.

Comments: 19 pages, 3 figures, 3 tables

Precursors of extreme increments

Authors: Sarah Hallerberg, Eduardo G. Altmann, Detlef Holstein, Holger Kantz

Abstract: We investigate precursors and predictability of extreme increments in a time series. The events we are focusing on consist in large increments within successive time steps. We are especially interested in understanding how the quality of the predictions depends on the strategy to choose precursors, on the size of the event and on the correlation strength. We study the prediction of extreme incre… ▽ More We investigate precursors and predictability of extreme increments in a time series. The events we are focusing on consist in large increments within successive time steps. We are especially interested in understanding how the quality of the predictions depends on the strategy to choose precursors, on the size of the event and on the correlation strength. We study the prediction of extreme increments analytically in an AR(1) process, and numerically in wind speed recordings and long-range correlated ARMA data. We evaluate the success of predictions via receiver operator characteristics (ROC-curves). Furthermore, we observe an increase of the quality of predictions with increasing event size and with decreasing correlation in all examples. Both effects can be understood by using the likelihood ratio as a summary index for smooth ROC-curves. △ Less

Submitted 12 September, 2006; v1 submitted 20 April, 2006; originally announced April 2006.

Journal ref: Phys. Rev. E 75, 016706 (2007)

Reactions to extreme events: moving threshold model

Authors: Eduardo G. Altmann, Sarah Hallerberg, Holger Kantz

Abstract: In spite of precautions to avoid the harmful effects of extreme events, we experience recurrently phenomena that overcome the preventive barriers. These barriers usually increase drastically right after the occurrence of such extreme events, but steadily decay in their absence. In this paper we consider a simple model that mimics the evolution of the protection barriers to study the efficiency o… ▽ More In spite of precautions to avoid the harmful effects of extreme events, we experience recurrently phenomena that overcome the preventive barriers. These barriers usually increase drastically right after the occurrence of such extreme events, but steadily decay in their absence. In this paper we consider a simple model that mimics the evolution of the protection barriers to study the efficiency of the system's reaction to extreme events and how it changes our perception of the sequence of extreme events itself. We obtain that the usual method of fighting extreme events introduces a periodicity in their occurrence and is generally less efficient than the use of a constant barrier. On the other hand, it shows a good adaptation to the presence of slow non-stationarities. △ Less

Submitted 23 August, 2005; originally announced August 2005.

Comments: 14 pages and 7 figures

Journal ref: Physica A 364 p. 435 (2006)

Improvement of speech recognition by nonlinear noise reduction

Authors: Krzysztof Urbanowicz, Holger Kantz

Abstract: The success of nonlinear noise reduction applied to a single channel recording of human voice is measured in terms of the recognition rate of a commercial speech recognition program in comparison to the optimal linear filter. The overall performance of the nonlinear method is shown to be superior. We hence demonstrate that an algorithm which has its roots in the theory of nonlinear deterministic… ▽ More The success of nonlinear noise reduction applied to a single channel recording of human voice is measured in terms of the recognition rate of a commercial speech recognition program in comparison to the optimal linear filter. The overall performance of the nonlinear method is shown to be superior. We hence demonstrate that an algorithm which has its roots in the theory of nonlinear deterministic dynamics possesses a large potential in a realistic application. △ Less

Submitted 3 May, 2007; v1 submitted 6 July, 2005; originally announced July 2005.

Comments: see urbanowicz.org.pl

Journal ref: Chaos 17, 023121 (2007) (6 pages)

Recurrence time analysis, long-term correlations, and extreme events

Authors: Eduardo G. Altmann, Holger Kantz

Abstract: The recurrence times between extreme events have been the central point of statistical analyses in many different areas of science. Simultaneously, the Poincaré recurrence time has been extensively used to characterize nonlinear dynamical systems. We compare the main properties of these statistical methods pointing out their consequences for the recurrence analysis performed in time series. In p… ▽ More The recurrence times between extreme events have been the central point of statistical analyses in many different areas of science. Simultaneously, the Poincaré recurrence time has been extensively used to characterize nonlinear dynamical systems. We compare the main properties of these statistical methods pointing out their consequences for the recurrence analysis performed in time series. In particular, we analyze the dependence of the mean recurrence time and of the recurrence time statistics on the probability density function, on the interval whereto the recurrences are observed, and on the temporal correlations of time series. In the case of long-term correlations, we verify the validity of the stretched exponential distribution, which is uniquely defined by the exponent $γ$, at the same time showing that it is restricted to the class of linear long-term correlated processes. Simple transformations are able to modify the correlations of time series leading to stretched exponentials recurrence time statistics with different $γ$, which shows a lack of invariance under the change of observables. △ Less

Submitted 8 March, 2005; originally announced March 2005.

Comments: 9 pages, 7 figures

Journal ref: Phys. Rev. E 71, 056106 (2005).

Stochastic analysis of surface roughness

Authors: M. Waechter, F. Riess, H. Kantz, J. Peinke

Abstract: For the characterization of surface height profiles we present a new stochastic approach which is based on the theory of Markov processes. With this analysis we achieve a characterization of the complexity of the surface roughness by means of a Fokker-Planck or Langevin equation, providing the complete stochastic information of multiscale joint probabilities. The method was applied to different… ▽ More For the characterization of surface height profiles we present a new stochastic approach which is based on the theory of Markov processes. With this analysis we achieve a characterization of the complexity of the surface roughness by means of a Fokker-Planck or Langevin equation, providing the complete stochastic information of multiscale joint probabilities. The method was applied to different road surface profiles which were measured with high resolution. Evidence of Markov properties is shown. Estimations for the parameters of the Fokker-Planck equation are based on pure, parameter free data analysis. △ Less

Submitted 30 October, 2003; originally announced October 2003.

Journal ref: Europhys. Lett., 64 (5), pp. 579-585 (2003)

Stochastic analysis of road surface roughness

Authors: M. Waechter, F. Riess, H. Kantz, J. Peinke

Abstract: This paper was withdrawn by the authors due to significant new findings. A new paper on the same topic has been submitted as physics/0310159. This paper was withdrawn by the authors due to significant new findings. A new paper on the same topic has been submitted as physics/0310159. △ Less

Submitted 30 October, 2003; v1 submitted 22 March, 2002; originally announced March 2002.

Comments: This paper has been withdrawn

Chaos or Noise - Difficulties of a Distinction

Authors: M. Cencini, M. Falcioni, H. Kantz, E. Olbrich, A. Vulpiani

Abstract: In experiments, the dynamical behavior of systems is reflected in time series. Due to the finiteness of the observational data set it is not possible to reconstruct the invariant measure up to arbitrary fine resolution and arbitrary high embedding dimension. These restrictions limit our ability to distinguish between signals generated by different systems, such as regular, chaotic or stochastic… ▽ More In experiments, the dynamical behavior of systems is reflected in time series. Due to the finiteness of the observational data set it is not possible to reconstruct the invariant measure up to arbitrary fine resolution and arbitrary high embedding dimension. These restrictions limit our ability to distinguish between signals generated by different systems, such as regular, chaotic or stochastic ones, when analyzed from a time series point of view. We propose to classify the signal behavior, without referring to any specific model, as stochastic or deterministic on a certain scale of the resolution $ε$, according to the dependence of the $(ε,τ)$-entropy, $h(ε, τ)$, and of the finite size Lyapunov exponent, $λ(ε)$, on $ε$. △ Less

Submitted 20 March, 2000; v1 submitted 14 February, 2000; originally announced February 2000.

Comments: 24 pages RevTeX, 9 eps figures included, two references added, minor corrections, one section has been split in two (submitted to PRE)

Journal ref: Phys. Rev. E 62, 427-437 (2000)