-
A Method for the Time-Frequency Analysis of High-Order Interactions in Non-Stationary Physiological Networks
Authors:
Yuri Antonacci,
Chiara Bara',
Laura Sparacino,
Gorana Mijatovic,
Ludovico Minati,
Luca Faes
Abstract:
Several data-driven approaches based on information theory have been proposed for analyzing high-order interactions involving three or more components of a network system. Most of these methods are defined only in the time domain and rely on the assumption of stationarity in the underlying dynamics, making them inherently unable to detect frequency-specific behaviors and track transient functional…
▽ More
Several data-driven approaches based on information theory have been proposed for analyzing high-order interactions involving three or more components of a network system. Most of these methods are defined only in the time domain and rely on the assumption of stationarity in the underlying dynamics, making them inherently unable to detect frequency-specific behaviors and track transient functional links in physiological networks. This study introduces a new framework which enables the time-varying and time-frequency analysis of high-order interactions in network of random processes through the spectral representation of vector autoregressive models. The time- and frequency-resolved analysis of synergistic and redundant interactions among groups of processes is ensured by a robust identification procedure based on a recursive least squares estimator with a forgetting factor. Validation on simulated networks illustrates how the time-frequency analysis is able to highlight transient synergistic behaviors emerging in specific frequency bands which cannot be detected by time-domain stationary analyses. The application on brain evoked potentials in rats elicits the presence of redundant information timed with whisker stimulation and mostly occurring in the contralateral hemisphere. The proposed framework enables a comprehensive time-varying and time-frequency analysis of the hierarchical organization of dynamic networks. As our approach goes beyond pairwise interactions, it is well suited for the study of transient high-order behaviors arising during state transitions in many network systems commonly studied in physiology, neuroscience and other fields.
△ Less
Submitted 16 March, 2025;
originally announced March 2025.
-
Decomposing Multivariate Information Rates in Networks of Random Processes
Authors:
Laura Sparacino,
Gorana Mijatovic,
Yuri Antonacci,
Leonardo Ricci,
Daniele Marinazzo,
Sebastiano Stramaglia,
Luca Faes
Abstract:
The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (P…
▽ More
The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate (MIR) instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To solve PIRD, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology.
△ Less
Submitted 20 February, 2025; v1 submitted 6 February, 2025;
originally announced February 2025.
-
Partial Information Rate Decomposition
Authors:
Luca Faes,
Laura Sparacino,
Gorana Mijatovic,
Yuri Antonacci,
Leonardo Ricci,
Daniele Marinazzo,
Sebastiano Stramaglia
Abstract:
Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effec…
▽ More
Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effects by PID schemes applied to dynamic networks, we introduce the framework of Partial Information Rate Decomposition (PIRD). PIRD is formalized applying lattice theory to decompose the information shared dynamically between a target random process and a set of source processes, implemented for Gaussian processes through a spectral expansion of information rates, and demonstrated in practice analyzing time series from large-scale climate oscillations.
△ Less
Submitted 20 February, 2025; v1 submitted 6 February, 2025;
originally announced February 2025.
-
Predictive Information Decomposition as a Tool to Quantify Emergent Dynamical Behaviors In Physiological Networks
Authors:
Luca Faes,
Gorana Mijatovic,
Laura Sparacino,
Alberto Porta
Abstract:
Objective: This work introduces a framework for multivariate time series analysis aimed at detecting and quantifying collective emerging behaviors in the dynamics of physiological networks. Methods: Given a network system mapped by a vector random process, we compute the predictive information (PI) between the present and past network states and dissect it into amounts quantifying the unique, redu…
▽ More
Objective: This work introduces a framework for multivariate time series analysis aimed at detecting and quantifying collective emerging behaviors in the dynamics of physiological networks. Methods: Given a network system mapped by a vector random process, we compute the predictive information (PI) between the present and past network states and dissect it into amounts quantifying the unique, redundant and synergistic information shared by the present of the network and the past of each unit. Emergence is then quantified as the prevalence of the synergistic over the redundant contribution. The framework is implemented in practice using vector autoregressive (VAR) models. Results: Validation in simulated VAR processes documents that emerging behaviors arise in networks where multiple causal interactions coexist with internal dynamics. The application to cardiovascular and respiratory networks mapping the beat-to-beat variability of heart rate, arterial pressure and respiration measured at rest and during postural stress reveals the presence of statistically significant net synergy, as well as its modulation with sympathetic nervous system activation. Conclusion: Causal emergence can be efficiently assessed decomposing the PI of network systems via VAR models applied to multivariate time series. This approach evidences the synergy/redundancy balance as a hallmark of integrated short-term autonomic control in cardiovascular and respiratory networks. Significance: Measures of causal emergence provide a practical tool to quantify the mechanisms of causal influence that determine the dynamic state of cardiovascular and neural network systems across distinct physiopathological conditions.
△ Less
Submitted 2 February, 2025;
originally announced February 2025.
-
Measuring hierarchically-organized interactions in dynamic networks through spectral entropy rates: theory, estimation, and illustrative application to physiological networks
Authors:
Laura Sparacino,
Yuri Antonacci,
Gorana Mijatovic,
Luca Faes
Abstract:
Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to speci…
▽ More
Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to specific oscillations with physiological meaning. In this context, the present work formalizes a coherent framework which integrates several information dynamics approaches to quantify node-specific, pairwise and higher-order interactions in network systems. The framework establishes a hierarchical organization of interactions of different order using measures of entropy rate, mutual information rate and O-information rate, to quantify respectively the dynamics of individual nodes, the links between pairs of nodes, and the redundant/synergistic hyperlinks between groups of nodes. All measures are formulated in the time domain, and then expanded to the spectral domain to obtain frequency-specific information. The practical computation of all measures is favored presenting a toolbox that implements their parametric and non-parametric estimation, and includes approaches to assess their statistical significance. The framework is illustrated first using theoretical examples where the properties of the measures are displayed in benchmark simulated network systems, and then applied to representative examples of multivariate time series in the context of Network Neuroscience and Network Physiology.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
Assessing High-Order Links in Cardiovascular and Respiratory Networks via Static and Dynamic Information Measures
Authors:
Gorana Mijatovic,
Laura Sparacino,
Yuri Antonacci,
Michal Javorka,
Daniele Marinazzo,
Sebastiano Stramaglia,
Luca Faes
Abstract:
The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network top…
▽ More
The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network topology. To address these limitations, here we introduce a framework which combines the assessment of high-order interactions with statistical inference for the characterization of the functional links sustaining physiological networks. The framework develops information-theoretic measures quantifying how two nodes interact in a redundant or synergistic way with the rest of the network, and employs these measures for reconstructing the functional structure of the network. The measures are implemented for both static and dynamic networks mapped respectively by random variables and random processes using plug-in and model-based entropy estimators. The validation on theoretical and numerical simulated networks documents the ability of the framework to represent high-order interactions as networks and to detect statistical structures associated to cascade, common drive and common target effects. The application to cardiovascular networks mapped by the beat-to-beat variability of heart rate, respiration, arterial pressure, cardiac output and vascular resistance allowed noninvasive characterization of several mechanisms of cardiovascular control operating in resting state and during orthostatic stress. Our approach brings to new comprehensive assessment of physiological interactions and complements existing strategies for the classification of pathophysiological states.
△ Less
Submitted 10 January, 2024;
originally announced January 2024.
-
A method to assess Granger causality, isolation and autonomy in the time and frequency domains: theory and application to cerebrovascular variability
Authors:
Laura Sparacino,
Yuri Antonacci,
Chiara BarĂ ,
Angela Valenti,
Alberto Porta,
Luca Faes
Abstract:
Concepts of Granger causality (GC) and Granger autonomy (GA) are central to assess the dynamics of coupled physiologic processes. While causality measures have been already proposed and applied in time and frequency domains, measures quantifying self-dependencies are still limited to the time-domain formulation and lack of a clear spectral representation. We embed into the classical linear paramet…
▽ More
Concepts of Granger causality (GC) and Granger autonomy (GA) are central to assess the dynamics of coupled physiologic processes. While causality measures have been already proposed and applied in time and frequency domains, measures quantifying self-dependencies are still limited to the time-domain formulation and lack of a clear spectral representation. We embed into the classical linear parametric framework for computing GC from a driver random process X to a target process Y a measure of Granger Isolation (GI) quantifying the part of the dynamics of Y not originating from X, and a new spectral measure of GA assessing frequency-specific patterns of self-dependencies in Y. The measures are illustrated in theoretical simulations and applied to time series of mean arterial pressure and cerebral blood flow velocity obtained in subjects prone to develop postural syncope and healthy controls. Simulations show that GI is complementary to GC but not trivially related to it, while GA reflects the regularity of the internal dynamics of the analyzed target process. In the application to cerebrovascular interactions, spectral GA quantified the physiological response to postural stress of slow cerebral blood flow oscillations, while spectral GC and GI detected an altered response to postural stress in subjects prone to syncope, likely related to impaired cerebral autoregulation. The new spectral measures of GI and GA are useful complements to GC for the analysis of interacting oscillatory processes, and detect physiological and pathological responses to postural stress which cannot be traced in the time domain. The assessment of causality, isolation and autonomy opens new perspectives for the analysis of coupled biological processes in both physiological and clinical investigations.
△ Less
Submitted 18 July, 2023;
originally announced July 2023.
-
A Framework for the Time- and Frequency-Domain Assessment of High-Order Interactions in Brain and Physiological Networks
Authors:
Luca Faes,
Gorana Mijatovic,
Yuri Antonacci,
Riccardo Pernice,
Chiara BarĂ ,
Laura Sparacino,
Marco Sammartino,
Alberto Porta,
Daniele Marinazzo,
Sebastiano Stramaglia
Abstract:
While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the…
▽ More
While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the so-called O-information rate (OIR) as a new metric to assess HOIs for multivariate time series, and propose a framework to decompose it into measures quantifying Granger-causal and instantaneous influences, as well as to expand it in the frequency domain. The framework exploits the spectral representation of vector autoregressive and state-space models to assess synergistic and redundant interactions among groups of processes, both in specific bands and in the time domain after whole-band integration. Validation on simulated networks illustrates how the spectral OIR can highlight redundant and synergistic HOIs emerging at specific frequencies but not using time-domain measures. The application to physiological networks described by heart period, arterial pressure and respiration measured in healthy subjects during paced breathing, and to brain networks described by ECoG signals acquired in an animal experiment during anesthesia, document the capability of our approach to identify informational circuits relevant to well-defined cardiovascular oscillations and brain rhythms and related to specific physiological mechanisms of autonomic control and altered consciousness. The proposed framework allows a hierarchically-organized evaluation of time- and frequency-domain interactions in networks mapped by multivariate time series, and its high flexibility and scalability make it suitable to investigate networks beyond pairwise interactions in neuroscience, physiology and other fields.
△ Less
Submitted 8 February, 2022;
originally announced February 2022.