Showing 1–10 of 10 results for author: Mijatovic, G

A Method for the Time-Frequency Analysis of High-Order Interactions in Non-Stationary Physiological Networks

Authors: Yuri Antonacci, Chiara Bara', Laura Sparacino, Gorana Mijatovic, Ludovico Minati, Luca Faes

Abstract: Several data-driven approaches based on information theory have been proposed for analyzing high-order interactions involving three or more components of a network system. Most of these methods are defined only in the time domain and rely on the assumption of stationarity in the underlying dynamics, making them inherently unable to detect frequency-specific behaviors and track transient functional… ▽ More Several data-driven approaches based on information theory have been proposed for analyzing high-order interactions involving three or more components of a network system. Most of these methods are defined only in the time domain and rely on the assumption of stationarity in the underlying dynamics, making them inherently unable to detect frequency-specific behaviors and track transient functional links in physiological networks. This study introduces a new framework which enables the time-varying and time-frequency analysis of high-order interactions in network of random processes through the spectral representation of vector autoregressive models. The time- and frequency-resolved analysis of synergistic and redundant interactions among groups of processes is ensured by a robust identification procedure based on a recursive least squares estimator with a forgetting factor. Validation on simulated networks illustrates how the time-frequency analysis is able to highlight transient synergistic behaviors emerging in specific frequency bands which cannot be detected by time-domain stationary analyses. The application on brain evoked potentials in rats elicits the presence of redundant information timed with whisker stimulation and mostly occurring in the contralateral hemisphere. The proposed framework enables a comprehensive time-varying and time-frequency analysis of the hierarchical organization of dynamic networks. As our approach goes beyond pairwise interactions, it is well suited for the study of transient high-order behaviors arising during state transitions in many network systems commonly studied in physiology, neuroscience and other fields. △ Less

Submitted 16 March, 2025; originally announced March 2025.

Decomposing Multivariate Information Rates in Networks of Random Processes

Authors: Laura Sparacino, Gorana Mijatovic, Yuri Antonacci, Leonardo Ricci, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (P… ▽ More The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate (MIR) instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To solve PIRD, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology. △ Less

Submitted 20 February, 2025; v1 submitted 6 February, 2025; originally announced February 2025.

Partial Information Rate Decomposition

Authors: Luca Faes, Laura Sparacino, Gorana Mijatovic, Yuri Antonacci, Leonardo Ricci, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effec… ▽ More Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effects by PID schemes applied to dynamic networks, we introduce the framework of Partial Information Rate Decomposition (PIRD). PIRD is formalized applying lattice theory to decompose the information shared dynamically between a target random process and a set of source processes, implemented for Gaussian processes through a spectral expansion of information rates, and demonstrated in practice analyzing time series from large-scale climate oscillations. △ Less

Submitted 20 February, 2025; v1 submitted 6 February, 2025; originally announced February 2025.

Predictive Information Decomposition as a Tool to Quantify Emergent Dynamical Behaviors In Physiological Networks

Authors: Luca Faes, Gorana Mijatovic, Laura Sparacino, Alberto Porta

Abstract: Objective: This work introduces a framework for multivariate time series analysis aimed at detecting and quantifying collective emerging behaviors in the dynamics of physiological networks. Methods: Given a network system mapped by a vector random process, we compute the predictive information (PI) between the present and past network states and dissect it into amounts quantifying the unique, redu… ▽ More Objective: This work introduces a framework for multivariate time series analysis aimed at detecting and quantifying collective emerging behaviors in the dynamics of physiological networks. Methods: Given a network system mapped by a vector random process, we compute the predictive information (PI) between the present and past network states and dissect it into amounts quantifying the unique, redundant and synergistic information shared by the present of the network and the past of each unit. Emergence is then quantified as the prevalence of the synergistic over the redundant contribution. The framework is implemented in practice using vector autoregressive (VAR) models. Results: Validation in simulated VAR processes documents that emerging behaviors arise in networks where multiple causal interactions coexist with internal dynamics. The application to cardiovascular and respiratory networks mapping the beat-to-beat variability of heart rate, arterial pressure and respiration measured at rest and during postural stress reveals the presence of statistically significant net synergy, as well as its modulation with sympathetic nervous system activation. Conclusion: Causal emergence can be efficiently assessed decomposing the PI of network systems via VAR models applied to multivariate time series. This approach evidences the synergy/redundancy balance as a hallmark of integrated short-term autonomic control in cardiovascular and respiratory networks. Significance: Measures of causal emergence provide a practical tool to quantify the mechanisms of causal influence that determine the dynamic state of cardiovascular and neural network systems across distinct physiopathological conditions. △ Less

Submitted 2 February, 2025; originally announced February 2025.

A Model-Free Method to Quantify Memory Utilization in Neural Point Processes

Authors: Gorana Mijatovic, Sebastiano Stramaglia, Luca Faes

Abstract: Quantifying the predictive capacity of a neural system, intended as the capability to store information and actively use it for dynamic system evolution, is a key component of neural information processing. Information storage (IS), the main measure quantifying the active utilization of memory in a dynamic system, is only defined for discrete-time processes. While recent theoretical work laid the… ▽ More Quantifying the predictive capacity of a neural system, intended as the capability to store information and actively use it for dynamic system evolution, is a key component of neural information processing. Information storage (IS), the main measure quantifying the active utilization of memory in a dynamic system, is only defined for discrete-time processes. While recent theoretical work laid the foundations for the continuous-time analysis of the predictive capacity stored in a process, methods for the effective computation of the related measures are needed to favor widespread utilization on neural data. This work introduces a method for the model-free estimation of the so-called memory utilization rate (MUR), the continuous-time counterpart of the IS, specifically designed to quantify the predictive capacity stored in neural point processes. The method employs nearest-neighbor entropy estimation applied to the inter-spike intervals measured from point-process realizations to quantify the extent of memory used by a spike train. An empirical procedure based on surrogate data is implemented to compensate the estimation bias and detect statistically significant levels of memory. The method is validated in simulated Poisson processes and in realistic models of coupled cortical dynamics and heartbeat dynamics. It is then applied to real spike trains reflecting central and autonomic nervous system activities: in spontaneously growing cortical neuron cultures, the MUR detected increasing memory utilization across maturation stages, associated to emergent bursting synchronized activity; in the study of the neuro-autonomic modulation of human heartbeats, the MUR reflected the sympathetic activation occurring with postural but not with mental stress. The proposed approach offers a computationally reliable tool to analyze spike train data in computational neuroscience and physiology. △ Less

Submitted 28 August, 2024; originally announced August 2024.

Network Representation of Higher-Order Interactions Based on Information Dynamics

Authors: Gorana Mijatovic, Yuri Antonacci, Michal Javorka, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: Many complex systems in science and engineering are modeled as networks whose nodes and links depict the temporal evolution of each system unit and the dynamic interaction between pairs of units, which are assessed respectively using measures of auto- and cross-correlation or variants thereof. However, a growing body of work is documenting that this standard network representation can neglect pote… ▽ More Many complex systems in science and engineering are modeled as networks whose nodes and links depict the temporal evolution of each system unit and the dynamic interaction between pairs of units, which are assessed respectively using measures of auto- and cross-correlation or variants thereof. However, a growing body of work is documenting that this standard network representation can neglect potentially crucial information shared by three or more dynamic processes in the form of higher-order interactions (HOIs). While several measures, mostly derived from information theory, are available to assess HOIs in network systems mapped by multivariate time series, none of them is able to provide a compact and detailed representation of higher-order interdependencies. In this work, we fill this gap by introducing a framework for the assessment of HOIs in dynamic network systems at different levels of resolution. The framework is grounded on the dynamic implementation of the O-information, a new measure assessing HOIs in dynamic networks, which is here used together with its local counterpart and its gradient to quantify HOIs respectively for the network as a whole, for each link, and for each node. The integration of these measures into the conventional network representation results in a tool for the representation of HOIs as networks, which is defined formally using measures of information dynamics, implemented in its linear version by using vector regression models and statistical validation techniques, illustrated in simulated network systems, and finally applied to an illustrative example in the field of network physiology. △ Less

Submitted 28 August, 2024; originally announced August 2024.

Measuring hierarchically-organized interactions in dynamic networks through spectral entropy rates: theory, estimation, and illustrative application to physiological networks

Authors: Laura Sparacino, Yuri Antonacci, Gorana Mijatovic, Luca Faes

Abstract: Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to speci… ▽ More Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to specific oscillations with physiological meaning. In this context, the present work formalizes a coherent framework which integrates several information dynamics approaches to quantify node-specific, pairwise and higher-order interactions in network systems. The framework establishes a hierarchical organization of interactions of different order using measures of entropy rate, mutual information rate and O-information rate, to quantify respectively the dynamics of individual nodes, the links between pairs of nodes, and the redundant/synergistic hyperlinks between groups of nodes. All measures are formulated in the time domain, and then expanded to the spectral domain to obtain frequency-specific information. The practical computation of all measures is favored presenting a toolbox that implements their parametric and non-parametric estimation, and includes approaches to assess their statistical significance. The framework is illustrated first using theoretical examples where the properties of the measures are displayed in benchmark simulated network systems, and then applied to representative examples of multivariate time series in the context of Network Neuroscience and Network Physiology. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Assessing High-Order Links in Cardiovascular and Respiratory Networks via Static and Dynamic Information Measures

Authors: Gorana Mijatovic, Laura Sparacino, Yuri Antonacci, Michal Javorka, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network top… ▽ More The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network topology. To address these limitations, here we introduce a framework which combines the assessment of high-order interactions with statistical inference for the characterization of the functional links sustaining physiological networks. The framework develops information-theoretic measures quantifying how two nodes interact in a redundant or synergistic way with the rest of the network, and employs these measures for reconstructing the functional structure of the network. The measures are implemented for both static and dynamic networks mapped respectively by random variables and random processes using plug-in and model-based entropy estimators. The validation on theoretical and numerical simulated networks documents the ability of the framework to represent high-order interactions as networks and to detect statistical structures associated to cascade, common drive and common target effects. The application to cardiovascular networks mapped by the beat-to-beat variability of heart rate, respiration, arterial pressure, cardiac output and vascular resistance allowed noninvasive characterization of several mechanisms of cardiovascular control operating in resting state and during orthostatic stress. Our approach brings to new comprehensive assessment of physiological interactions and complements existing strategies for the classification of pathophysiological states. △ Less

Submitted 10 January, 2024; originally announced January 2024.

Comments: 14 pages, 8 figures

A Framework for the Time- and Frequency-Domain Assessment of High-Order Interactions in Brain and Physiological Networks

Authors: Luca Faes, Gorana Mijatovic, Yuri Antonacci, Riccardo Pernice, Chiara Barà, Laura Sparacino, Marco Sammartino, Alberto Porta, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the… ▽ More While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the so-called O-information rate (OIR) as a new metric to assess HOIs for multivariate time series, and propose a framework to decompose it into measures quantifying Granger-causal and instantaneous influences, as well as to expand it in the frequency domain. The framework exploits the spectral representation of vector autoregressive and state-space models to assess synergistic and redundant interactions among groups of processes, both in specific bands and in the time domain after whole-band integration. Validation on simulated networks illustrates how the spectral OIR can highlight redundant and synergistic HOIs emerging at specific frequencies but not using time-domain measures. The application to physiological networks described by heart period, arterial pressure and respiration measured in healthy subjects during paced breathing, and to brain networks described by ECoG signals acquired in an animal experiment during anesthesia, document the capability of our approach to identify informational circuits relevant to well-defined cardiovascular oscillations and brain rhythms and related to specific physiological mechanisms of autonomic control and altered consciousness. The proposed framework allows a hierarchically-organized evaluation of time- and frequency-domain interactions in networks mapped by multivariate time series, and its high flexibility and scalability make it suitable to investigate networks beyond pairwise interactions in neuroscience, physiology and other fields. △ Less

Submitted 8 February, 2022; originally announced February 2022.

An information-theoretic framework to measure the dynamic interaction between neural spike trains

Authors: Gorana Mijatovic, Yuri Antonacci, Tatjana Loncar-Turukalo, Ludovico Minati, Luca Faes

Abstract: Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as existing methods either do not consider the inherent point process nature of spike trains or are based on parametric assumptions that may lead to wrong inferences i… ▽ More Understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience. However, an optimal approach of assessing these interactions has not been established, as existing methods either do not consider the inherent point process nature of spike trains or are based on parametric assumptions that may lead to wrong inferences if not met. This work presents a framework, grounded in the field of information dynamics, for the model-free, continuous-time estimation of both undirected (symmetric) and directed (causal) interactions between pairs of spike trains. The framework decomposes the overall information exchanged dynamically between two point processes X and Y as the sum of the dynamic mutual information (dMI) between the histories of X and Y, plus the transfer entropy (TE) along the directions X->Y and Y->X. Building on recent work which derived theoretical expressions and consistent estimators for the TE in continuous time, we develop algorithms for estimating efficiently all measures in our framework through nearest neighbor statistics. These algorithms are validated in simulations of independent and coupled spike train processes, showing the accuracy of dMI and TE in the assessment of undirected and directed interactions even for weakly coupled and short realizations, and proving the superiority of the continuous-time estimator over the discrete-time method. Then, the usefulness of the framework is illustrated in a real data scenario of recordings from in-vitro preparations of spontaneously-growing cultures of cortical neurons, where we show the ability of dMI and TE to identify how the networks of undirected and directed spike train interactions change their topology through maturation of the neuronal cultures. △ Less

Submitted 15 December, 2020; originally announced December 2020.

Comments: 12 pages, 7 figures; supplementary material at www.lucafaes.net/TEMI.html