-
Multifractal-spectral features enhance classification of anomalous diffusion
Authors:
Henrik Seckler,
Ralf Metzler,
Damian G. Kelty-Stephen,
Madhur Mangalam
Abstract:
Anomalous diffusion processes pose a unique challenge in classification and characterization. Previously (Mangalam et al., 2023, Physical Review Research 5, 023144), we established a framework for understanding anomalous diffusion using multifractal formalism. The present study delves into the potential of multifractal spectral features for effectively distinguishing anomalous diffusion trajectori…
▽ More
Anomalous diffusion processes pose a unique challenge in classification and characterization. Previously (Mangalam et al., 2023, Physical Review Research 5, 023144), we established a framework for understanding anomalous diffusion using multifractal formalism. The present study delves into the potential of multifractal spectral features for effectively distinguishing anomalous diffusion trajectories from five widely used models: fractional Brownian motion, scaled Brownian motion, continuous time random walk, annealed transient time motion, and Lévy walk. To accomplish this, we generate extensive datasets comprising $10^6$ trajectories from these five anomalous diffusion models and extract multiple multifractal spectra from each trajectory. Our investigation entails a thorough analysis of neural network performance, encompassing features derived from varying numbers of spectra. Furthermore, we explore the integration of multifractal spectra into traditional feature datasets, enabling us to assess their impact comprehensively. To ensure a statistically meaningful comparison, we categorize features into concept groups and train neural networks using features from each designated group. Notably, several feature groups demonstrate similar levels of accuracy, with the highest performance observed in groups utilizing moving-window characteristics and $p$-variation features. Multifractal spectral features, particularly those derived from three spectra involving different timescales and cutoffs, closely follow, highlighting their robust discriminatory potential. Remarkably, a neural network exclusively trained on features from a single multifractal spectrum exhibits commendable performance, surpassing other feature groups. Our findings underscore the diverse and potent efficacy of multifractal spectral features in enhancing classification of anomalous diffusion.
△ Less
Submitted 15 January, 2024;
originally announced January 2024.
-
Multifractal emergent processes: Multiplicative interactions override nonlinear component properties
Authors:
Madhur Mangalam,
Damian G Kelty-Stephen
Abstract:
Among the statistical models employed to approximate nonlinear interactions in biological and psychological processes, one prominent framework is that of cascades. Despite decades of empirical work using multifractal formalisms, a fundamental question has persisted: Do the observed nonlinear interactions across scales owe their origin to multiplicative interactions, or do they inherently reside wi…
▽ More
Among the statistical models employed to approximate nonlinear interactions in biological and psychological processes, one prominent framework is that of cascades. Despite decades of empirical work using multifractal formalisms, a fundamental question has persisted: Do the observed nonlinear interactions across scales owe their origin to multiplicative interactions, or do they inherently reside within the constituent processes? This study presents the results of rigorous numerical simulations that demonstrate the supremacy of multiplicative interactions over the intrinsic nonlinear properties of component processes. To elucidate this point, we conducted simulations of cascade time series featuring component processes operating at distinct timescales, each characterized by one of four properties: multifractal nonlinearity, multifractal linearity (obtained via the Iterative Amplitude Adjusted Wavelet Transform of multifractal nonlinearity), phase-randomized linearity (obtained via the Iterative Amplitude Adjustment Fourier Transform), and phase- and amplitude-randomized (obtained via shuffling). Our findings unequivocally establish that the multiplicative interactions among components, rather than the inherent properties of the component processes themselves, decisively dictate the multifractal emergent properties. Remarkably, even component processes exhibiting purely linear traits can generate nonlinear interactions across scales when these interactions assume a multiplicative nature. In stark contrast, additivity among component processes inevitably leads to a linear outcome. These outcomes provide a robust theoretical underpinning for current interpretations of multifractal nonlinearity, firmly anchoring its roots in the domain of multiplicative interactions across scales within biological and psychological processes.
△ Less
Submitted 10 January, 2024;
originally announced January 2024.
-
Multifractal nonlinearity as a robust estimator of multiplicative cascade dynamics
Authors:
Madhur Mangalam,
Aaron D Likens,
Damian G Kelty-Stephen
Abstract:
Multifractal formalisms provide an apt framework to study random cascades in which multifractal spectrum width $Δα$ fluctuates depending on the number of estimable power-law relationships. Then again, multifractality without surrogate comparison can be ambiguous: the original measurement series' multifractal spectrum width $Δα_\mathrm{Orig}$ can be sensitive to the series length, ergodicity-breaki…
▽ More
Multifractal formalisms provide an apt framework to study random cascades in which multifractal spectrum width $Δα$ fluctuates depending on the number of estimable power-law relationships. Then again, multifractality without surrogate comparison can be ambiguous: the original measurement series' multifractal spectrum width $Δα_\mathrm{Orig}$ can be sensitive to the series length, ergodicity-breaking linear temporal correlations (e.g., fractional Gaussian noise, $fGn$), or additive cascade dynamics. To test these threats, we built a suite of random cascades that differ by the length, type of noise (i.e., additive white Gaussian noise, $awGn$, or $fGn$), and mixtures of $awGn$ or $fGn$ across generations (progressively more $awGn$, progressively more $fGn$, and a random sampling by generation), and operations applying noise (i.e., addition vs. multiplication). The so-called ``multifractal nonlinearity'' $t_\mathrm{MF}$ (i.e., a $t$-statistic comparing $Δα_\mathrm{Orig}$ and multifractal spectra width for phase-randomized linear surrogates $Δα_\mathrm{Surr}$) is a robust indicator of random multiplicative rather than random additive cascade processes irrespective of the series length or type of noise. $t_\mathrm{MF}$ is more sensitive to the number of generations than the series length. Furthermore, the random additive cascades exhibited much stronger ergodicity breaking than all multiplicative analogs. Instead, ergodicity breaking in random multiplicative cascades more closely followed the ergodicity-breaking of the constituent noise types -- breaking ergodicity much less when arising from ergodic $awGn$ and more so for noise incorporating relatively more correlated $fGn$. Hence, $t_\mathrm{MF}$ is a robust multifractal indicator of multiplicative cascade processes and not spuriously sensitive to ergodicity breaking.
△ Less
Submitted 9 December, 2023;
originally announced December 2023.
-
Reproducible biomarkers: Leveraging nonlinear descriptors in the face of non-ergodicity
Authors:
Madhur Mangalam,
Arash Sadri,
Junichiro Hayano,
Eiichi Watanabe,
Ken Kiyono,
Damian G. Kelty-Stephen
Abstract:
Any reliable biomarker has to be specific, generalizable, and reproducible across individuals and contexts. The exact values of such a biomarker must represent similar health states in different individuals and at different times within the same individual to result in the minimum possible false-positive and false-negative rates. The application of standard cut-off points and risk scores across po…
▽ More
Any reliable biomarker has to be specific, generalizable, and reproducible across individuals and contexts. The exact values of such a biomarker must represent similar health states in different individuals and at different times within the same individual to result in the minimum possible false-positive and false-negative rates. The application of standard cut-off points and risk scores across populations hinges upon the assumption of such generalizability. Such generalizability, in turn, hinges upon this condition that the phenomenon investigated by current statistical methods is ergodic, i.e., its statistical measures converge over individuals and time within the finite limit of observations. However, emerging evidence indicates that biological processes abound with non-ergodicity, threatening this generalizability. Here, we present a solution for how to make generalizable inferences by deriving ergodic descriptions of non-ergodic phenomena. For this aim, we proposed capturing the origin of ergodicity-breaking in many biological processes: cascade dynamics. To assess our hypotheses, we embraced the challenge of identifying reliable biomarkers for heart disease and stroke, which, despite being the leading cause of death worldwide and decades of research, lacks reliable biomarkers and risk stratification tools. We showed that raw R-R interval data and its common descriptors based on mean and variance are non-ergodic and non-specific. On the other hand, the cascade-dynamical descriptors, the Hurst exponent encoding linear temporal correlations, and multifractal nonlinearity encoding nonlinear interactions across scales described the non-ergodic heart rate variability ergodically and were specific. This study inaugurates applying the critical concept of ergodicity in discovering and applying digital biomarkers of health and disease.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Ergodic characterization of non-ergodic anomalous diffusion processes
Authors:
Madhur Mangalam,
Ralf Metzler,
Damian G. Kelty-Stephen
Abstract:
Canonical characterization techniques that rely upon mean squared displacement ($\mathrm{MSD}$) break down for non-ergodic processes, making it challenging to characterize anomalous diffusion from an individual time-series measurement. Non-ergodicity reigns when the time-averaged mean square displacement $\mathrm{TA}$-$\mathrm{MSD}$ differs from the ensemble-averaged mean squared displacement…
▽ More
Canonical characterization techniques that rely upon mean squared displacement ($\mathrm{MSD}$) break down for non-ergodic processes, making it challenging to characterize anomalous diffusion from an individual time-series measurement. Non-ergodicity reigns when the time-averaged mean square displacement $\mathrm{TA}$-$\mathrm{MSD}$ differs from the ensemble-averaged mean squared displacement $\mathrm{EA}$-$\mathrm{MSD}$ even in the limit of long measurement series. In these cases, the typical theoretical results for ensemble averages cannot be used to understand and interpret data acquired from time averages. The difficulty then lies in obtaining statistical descriptors of the measured diffusion process that are not non-ergodic. We show that linear descriptors such as the standard deviation ($SD$), coefficient of variation ($CV$), and root mean square ($RMS$) break ergodicity in proportion to non-ergodicity in the diffusion process. In contrast, time series of descriptors addressing sequential structure and its potential nonlinearity: multifractality change in a time-independent way and fulfill the ergodic assumption, largely independent of the time series' non-ergodicity. We show that these findings follow the multiplicative cascades underlying these diffusion processes. Adding fractal and multifractal descriptors to typical linear descriptors would improve the characterization of anomalous diffusion processes. Two particular points bear emphasis here. First, as an appropriate formalism for encoding the nonlinearity that might generate non-ergodicity, multifractal modeling offers descriptors that can behave ergodically enough to meet the needs of linear modeling. Second, this capacity to describe non-ergodic processes in ergodic terms offers the possibility that multifractal modeling could unify several disparate non-ergodic diffusion processes into a common framework.
△ Less
Submitted 19 February, 2023;
originally announced February 2023.
-
In search for an alternative to the computer metaphor of the mind and brain
Authors:
Damian G. Kelty-Stephen,
Paul E. Cisek,
Benjamin De Bari,
James Dixon,
Luis H. Favela,
Fred Hasselman,
Fred Keijzer,
Vicente Raja,
Jeffrey B. Wagman,
Brandon J. Thomas,
Madhur Mangalam
Abstract:
The brain-as-computer metaphor has anchored the professed computational nature of the mind, wresting it down from the intangible logic of Platonic philosophy to a material basis for empirical science. However, as with many long-lasting metaphors in science, the computer metaphor has been explored and stretched long enough to reveal its boundaries. These boundaries highlight widening gaps in our un…
▽ More
The brain-as-computer metaphor has anchored the professed computational nature of the mind, wresting it down from the intangible logic of Platonic philosophy to a material basis for empirical science. However, as with many long-lasting metaphors in science, the computer metaphor has been explored and stretched long enough to reveal its boundaries. These boundaries highlight widening gaps in our understanding of the brain's role in an organism's goal-directed, intelligent behaviors and thoughts. In search of a more appropriate metaphor that reflects the potentially noncomputable functions of mind and brain, eight author groups answer the following questions: (1) What do we understand by the computer metaphor of the brain and cognition? (2) What are some of the limitations of this computer metaphor? (3) What metaphor should replace the computational metaphor? (4) What findings support alternative metaphors? Despite agreeing about feeling the strain of the strictures of computer metaphors, the authors suggest an exciting diversity of possible metaphoric options for future research into the mind and brain.
△ Less
Submitted 9 June, 2022;
originally announced June 2022.
-
Turing's cascade instability supports the coordination of the mind, brain, and behavior
Authors:
Damian G. Kelty-Stephen,
Madhur Mangalam
Abstract:
Turing inspired a computer metaphor of the mind and brain that has been handy and has spawned decades of empirical investigation, but he did much more and offered behavioral and cognitive sciences another metaphor--that of the cascade. The time has come to confront Turing's cascading instability, which suggests a geometrical framework driven by power laws and can be studied using multifractal form…
▽ More
Turing inspired a computer metaphor of the mind and brain that has been handy and has spawned decades of empirical investigation, but he did much more and offered behavioral and cognitive sciences another metaphor--that of the cascade. The time has come to confront Turing's cascading instability, which suggests a geometrical framework driven by power laws and can be studied using multifractal formalism and multiscale probability density function analysis. Here, we review a rapidly growing body of scientific investigations revealing signatures of cascade instability and their consequences for a perceiving, acting, and thinking organism. We review work related to executive functioning (planning to act), postural control (bodily poise for turning plans into action), and effortful perception (action to gather information in a single modality and action to blend multimodal information). We also review findings on neuronal avalanches in the brain, specifically about neural participation in body-wide cascades. Turing's cascade instability blends the mind, brain, and behavior across space and time scales and provides an alternative to the dominant computer metaphor.
△ Less
Submitted 16 April, 2022;
originally announced April 2022.
-
Fractal and multifractal descriptors restore ergodicity broken by non-Gaussianity in time series
Authors:
Damian G. Kelty-Stephen,
Madhur Mangalam
Abstract:
Ergodicity breaking is a challenge for biological and psychological sciences. Ergodicity is a necessary condition for linear causal modeling. Long-range correlations and non-Gaussianity characterizing various biological and psychological measurements break ergodicity routinely, threatening our capacity for causal modeling. Long-range correlations (e.g., in fractional Gaussian noise, a.k.a. "pink n…
▽ More
Ergodicity breaking is a challenge for biological and psychological sciences. Ergodicity is a necessary condition for linear causal modeling. Long-range correlations and non-Gaussianity characterizing various biological and psychological measurements break ergodicity routinely, threatening our capacity for causal modeling. Long-range correlations (e.g., in fractional Gaussian noise, a.k.a. "pink noise") break ergodicity--in raw Gaussian series, as well as in some but not all standard descriptors of variability, i.e., in coefficient of variation (CV) and root mean square (RMS) but not standard deviation (SD) for longer series. The present work demonstrates that progressive increases in non-Gaussianity conspire with long-range correlations to break ergodicity in SD for all series lengths. Meanwhile, explicitly encoding the cascade dynamics that can generate temporally correlated non-Gaussian noise offers a way to restore ergodicity to our causal models. Specifically, fractal and multifractal properties encode both scale-invariant power-law correlations and their variety, respectively, both of which features index the underlying cascade parameters. Fractal and multifractal descriptors of long-range correlated non-Gaussian processes show no ergodicity breaking and hence, provide a more stable explanation for the long-range correlated non-Gaussian form of biological and psychological processes. Fractal and multifractal descriptors offer a path to restoring ergodicity to causal modeling in these fields.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
Ergodic descriptors of nonergodic stochastic processes
Authors:
Madhur Mangalam,
Damian G. Kelty-Stephen
Abstract:
The stochastic processes underlying the growth and stability of biological and psychological systems reveal themselves when far from equilibrium. Far from equilibrium, nonergodicity reigns. Nonergodicity implies that the average outcome for a group/ensemble (i.e., of representative organisms/minds) is not necessarily a reliable estimate of the average outcome for an individual over time. However,…
▽ More
The stochastic processes underlying the growth and stability of biological and psychological systems reveal themselves when far from equilibrium. Far from equilibrium, nonergodicity reigns. Nonergodicity implies that the average outcome for a group/ensemble (i.e., of representative organisms/minds) is not necessarily a reliable estimate of the average outcome for an individual over time. However, the scientific interest in causal inference suggests that we somehow aim at stable estimates of the cause that will generalize to new individuals in the long run. Therefore, the valid analysis must extract an ergodic stationary measure from fluctuating physiological data. So the challenge is to extract statistical estimates that may describe or quantify some of this nonergodicity (i.e., of the raw measured data) without themselves (i.e., the estimates) being nonergodic. We show that traditional linear statistics such as the standard deviation (SD), coefficient of variation (CV), and root mean square (RMS) can show nonstationarity, violating the ergodic assumption. Time series of statistics addressing sequential structure and its potential nonlinearity: fractality and multifractality, change in a time-independent way and fulfill the ergodic assumption. Complementing traditional linear indices with fractal and multifractal indices would empower the study of stochastic far-from-equilibrium biological and psychological dynamics.
△ Less
Submitted 2 February, 2022;
originally announced February 2022.
-
Multifractal test for nonlinear changes in time series
Authors:
Damian G. Kelty-Stephen,
Elizabeth Lane,
Madhur Mangalam
Abstract:
The creativity and emergence of biological and psychological behavior are nonlinear. However, that does not necessarily mean only that the measurements of the behaviors are curvilinear. Furthermore, the linear model might fail to reduce these measurements to a sum of independent random factors, implying nonlinear changes over time. The present work reviews some of the concepts implicated in linear…
▽ More
The creativity and emergence of biological and psychological behavior are nonlinear. However, that does not necessarily mean only that the measurements of the behaviors are curvilinear. Furthermore, the linear model might fail to reduce these measurements to a sum of independent random factors, implying nonlinear changes over time. The present work reviews some of the concepts implicated in linear changes over time and details the mathematical steps involved. It introduces multifractality as a mathematical framework helpful in determining whether and to what degree the measured time series exhibits nonlinear changes over time. The mathematical steps include multifractal analysis and surrogate data production for resolving when multifractality entails nonlinear changes over time. Ultimately, when measurements fail to fit the structures of the traditional linear model, multifractal modeling gives us the means to make those nonlinear excursions explicit and perhaps permit the development of theory that draws on both linear and nonlinear processes.
△ Less
Submitted 26 May, 2021;
originally announced May 2021.
-
Point estimates, Simpson's paradox and nonergodicity in biological sciences
Authors:
Madhur Mangalam,
Damian G. Kelty-Stephen
Abstract:
Modern biomedical, behavioral and psychological inference about cause-effect relationships respects an ergodic assumption, that is, that mean response of representative samples allow predictions about individual members of those samples. Recent empirical evidence in all of the same fields indicates systematic violations of the ergodic assumption. Indeed, violation of ergodicity in biomedical, beha…
▽ More
Modern biomedical, behavioral and psychological inference about cause-effect relationships respects an ergodic assumption, that is, that mean response of representative samples allow predictions about individual members of those samples. Recent empirical evidence in all of the same fields indicates systematic violations of the ergodic assumption. Indeed, violation of ergodicity in biomedical, behavioral and psychological causes is precisely the inspiration behind our research inquiry. Here, we review the long term costs to scientific progress in these domains and a practical way forward. Specifically, we advocate the use of statistical measures that can themselves encode the degree and type of non-ergodicity in measurements. Taking such steps will lead to a paradigm shift, allowing researchers to investigate the nonstationary, far-from-equilibrium processes that characterize the creativity and emergence of biological and psychological behavior.
△ Less
Submitted 1 September, 2020;
originally announced September 2020.
