Showing 1–50 of 67 results for author: Marinazzo, D

Cognitive networks highlight differences and similarities in the STEM mindsets of human and LLM-simulated trainees, experts and academics

Authors: Edith Haim, Lars van den Bergh, Cynthia S. Q. Siew, Yoed N. Kenett, Daniele Marinazzo, Massimo Stella

Abstract: Understanding attitudes towards STEM means quantifying the cognitive and emotional ways in which individuals, and potentially large language models too, conceptualise such subjects. This study uses behavioural forma mentis networks (BFMNs) to investigate the STEM-focused mindset, i.e. ways of associating and perceiving ideas, of 177 human participants and 177 artificial humans simulated by GPT-3.5… ▽ More Understanding attitudes towards STEM means quantifying the cognitive and emotional ways in which individuals, and potentially large language models too, conceptualise such subjects. This study uses behavioural forma mentis networks (BFMNs) to investigate the STEM-focused mindset, i.e. ways of associating and perceiving ideas, of 177 human participants and 177 artificial humans simulated by GPT-3.5. Participants were split in 3 groups - trainees, experts and academics - to compare the influence of expertise level on their mindset. The results revealed that human forma mentis networks exhibited significantly higher clustering coefficients compared to GPT-3.5, indicating that human mindsets displayed a tendency to form and close triads of conceptual associations while recollecting STEM ideas. Human experts, in particular, demonstrated robust clustering coefficients, reflecting better integration of STEM concepts into their cognitive networks. In contrast, GPT-3.5 produced sparser mindsets. Furthermore, both human and GPT mindsets framed mathematics in neutral or positive terms, differently from STEM high schoolers, researchers and other large language models sampled in other works. This research contributes to understanding how mindset structure can provide cognitive insights about memory structure and machine limitations. △ Less

Submitted 26 February, 2025; originally announced February 2025.

Comments: Keywords: cognitive network science; mindset measurement; associative knowledge; artificial intelligence; simulated participants

MSC Class: 68T01 (Primary); 05C82 (Secondary)

Decomposing Multivariate Information Rates in Networks of Random Processes

Authors: Laura Sparacino, Gorana Mijatovic, Yuri Antonacci, Leonardo Ricci, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (P… ▽ More The Partial Information Decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of Partial Information Rate Decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate (MIR) instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To solve PIRD, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology. △ Less

Submitted 20 February, 2025; v1 submitted 6 February, 2025; originally announced February 2025.

Partial Information Rate Decomposition

Authors: Luca Faes, Laura Sparacino, Gorana Mijatovic, Yuri Antonacci, Leonardo Ricci, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effec… ▽ More Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to multivariate time series taken as realizations of random processes with temporal statistical structure. Here, to overcome the incorrect depiction of high-order effects by PID schemes applied to dynamic networks, we introduce the framework of Partial Information Rate Decomposition (PIRD). PIRD is formalized applying lattice theory to decompose the information shared dynamically between a target random process and a set of source processes, implemented for Gaussian processes through a spectral expansion of information rates, and demonstrated in practice analyzing time series from large-scale climate oscillations. △ Less

Submitted 20 February, 2025; v1 submitted 6 February, 2025; originally announced February 2025.

Assessing high-order effects in feature importance via predictability decomposition

Authors: Marlis Ontivero-Ortega, Luca Faes, Jesus M Cortes, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: Leveraging the large body of work devoted in recent years to describe redundancy and synergy in multivariate interactions among random variables, we propose a novel approach to quantify cooperative effects in feature importance, one of the most used techniques for explainable artificial intelligence. In particular, we propose an adaptive version of a well-known metric of feature importance, named… ▽ More Leveraging the large body of work devoted in recent years to describe redundancy and synergy in multivariate interactions among random variables, we propose a novel approach to quantify cooperative effects in feature importance, one of the most used techniques for explainable artificial intelligence. In particular, we propose an adaptive version of a well-known metric of feature importance, named Leave One Covariate Out (LOCO), to disentangle high-order effects involving a given input feature in regression problems. LOCO is the reduction of the prediction error when the feature under consideration is added to the set of all the features used for regression. Instead of calculating the LOCO using all the features at hand, as in its standard version, our method searches for the multiplet of features that maximize LOCO and for the one that minimize it. This provides a decomposition of the LOCO as the sum of a two-body component and higher-order components (redundant and synergistic), also highlighting the features that contribute to building these high-order effects alongside the driving feature. We report the application to proton/pion discrimination from simulated detector measures by GEANT. △ Less

Submitted 12 March, 2025; v1 submitted 13 December, 2024; originally announced December 2024.

Comments: 11 pages, 3 figures

Journal ref: Phys. Rev. E 111, L033301 (2025)

Network Representation of Higher-Order Interactions Based on Information Dynamics

Authors: Gorana Mijatovic, Yuri Antonacci, Michal Javorka, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: Many complex systems in science and engineering are modeled as networks whose nodes and links depict the temporal evolution of each system unit and the dynamic interaction between pairs of units, which are assessed respectively using measures of auto- and cross-correlation or variants thereof. However, a growing body of work is documenting that this standard network representation can neglect pote… ▽ More Many complex systems in science and engineering are modeled as networks whose nodes and links depict the temporal evolution of each system unit and the dynamic interaction between pairs of units, which are assessed respectively using measures of auto- and cross-correlation or variants thereof. However, a growing body of work is documenting that this standard network representation can neglect potentially crucial information shared by three or more dynamic processes in the form of higher-order interactions (HOIs). While several measures, mostly derived from information theory, are available to assess HOIs in network systems mapped by multivariate time series, none of them is able to provide a compact and detailed representation of higher-order interdependencies. In this work, we fill this gap by introducing a framework for the assessment of HOIs in dynamic network systems at different levels of resolution. The framework is grounded on the dynamic implementation of the O-information, a new measure assessing HOIs in dynamic networks, which is here used together with its local counterpart and its gradient to quantify HOIs respectively for the network as a whole, for each link, and for each node. The integration of these measures into the conventional network representation results in a tool for the representation of HOIs as networks, which is defined formally using measures of information dynamics, implemented in its linear version by using vector regression models and statistical validation techniques, illustrated in simulated network systems, and finally applied to an illustrative example in the field of network physiology. △ Less

Submitted 28 August, 2024; originally announced August 2024.

Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition

Authors: Kenzo Clauw, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: This paper studies emergent phenomena in neural networks by focusing on grokking where models suddenly generalize after delayed memorization. To understand this phase transition, we utilize higher-order mutual information to analyze the collective behavior (synergy) and shared properties (redundancy) between neurons during training. We identify distinct phases before grokking allowing us to antici… ▽ More This paper studies emergent phenomena in neural networks by focusing on grokking where models suddenly generalize after delayed memorization. To understand this phase transition, we utilize higher-order mutual information to analyze the collective behavior (synergy) and shared properties (redundancy) between neurons during training. We identify distinct phases before grokking allowing us to anticipate when it occurs. We attribute grokking to an emergent phase transition caused by the synergistic interactions between neurons as a whole. We show that weight decay and weight initialization can enhance the emergent phase. △ Less

Submitted 16 August, 2024; originally announced August 2024.

Comments: ICML 2024 MI workshop

Large language models surpass human experts in predicting neuroscience results

Authors: Xiaoliang Luo, Akilles Rechardt, Guangzhi Sun, Kevin K. Nejad, Felipe Yáñez, Bati Yilmaz, Kangjoo Lee, Alexandra O. Cohen, Valentina Borghesani, Anton Pashkov, Daniele Marinazzo, Jonathan Nicholas, Alessandro Salatiello, Ilia Sucholutsky, Pasquale Minervini, Sepehr Razavi, Roberta Rocca, Elkhan Yusifov, Tereza Okalova, Nianlong Gu, Martin Ferianc, Mikail Khona, Kaustubh R. Patil, Pui-Shee Lee, Rui Mata , et al. (14 additional authors not shown)

Abstract: Scientific discoveries often hinge on synthesizing decades of research, a task that potentially outstrips human information processing capacities. Large language models (LLMs) offer a solution. LLMs trained on the vast scientific literature could potentially integrate noisy yet interrelated findings to forecast novel results better than human experts. To evaluate this possibility, we created Brain… ▽ More Scientific discoveries often hinge on synthesizing decades of research, a task that potentially outstrips human information processing capacities. Large language models (LLMs) offer a solution. LLMs trained on the vast scientific literature could potentially integrate noisy yet interrelated findings to forecast novel results better than human experts. To evaluate this possibility, we created BrainBench, a forward-looking benchmark for predicting neuroscience results. We find that LLMs surpass experts in predicting experimental outcomes. BrainGPT, an LLM we tuned on the neuroscience literature, performed better yet. Like human experts, when LLMs were confident in their predictions, they were more likely to be correct, which presages a future where humans and LLMs team together to make discoveries. Our approach is not neuroscience-specific and is transferable to other knowledge-intensive endeavors. △ Less

Submitted 28 November, 2024; v1 submitted 4 March, 2024; originally announced March 2024.

Comments: The latest version of this paper has been published at Nature Human Behaviour, please see https://www.nature.com/articles/s41562-024-02046-9

Disentangling high order effects in the transfer entropy

Authors: Sebastiano Stramaglia, Luca Faes, Jesus M. Cortes, Daniele Marinazzo

Abstract: Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead… ▽ More Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead of conditioning TE on all network processes except the driver and target, as in its fully conditioned version, or not conditioning at all, as in the pairwise approach, our method searches for both the multiplets of variables that maximize information flow and those that minimize it. This provides a decomposition of TE into unique, redundant, and synergistic atoms. Our approach enables the quantification of the relative importance of high-order effects compared to pure two-body effects in information transfer between two processes, while also highlighting the processes that contribute to building these high-order effects alongside the driver. We demonstrate the application of our approach in climatology by analyzing data from El Niño and the Southern Oscillation. △ Less

Submitted 13 February, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Assessing High-Order Links in Cardiovascular and Respiratory Networks via Static and Dynamic Information Measures

Authors: Gorana Mijatovic, Laura Sparacino, Yuri Antonacci, Michal Javorka, Daniele Marinazzo, Sebastiano Stramaglia, Luca Faes

Abstract: The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network top… ▽ More The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links based on pairwise interaction measures cannot reveal high-order effects involving more than two nodes, and are not appropriate to infer the underlying network topology. To address these limitations, here we introduce a framework which combines the assessment of high-order interactions with statistical inference for the characterization of the functional links sustaining physiological networks. The framework develops information-theoretic measures quantifying how two nodes interact in a redundant or synergistic way with the rest of the network, and employs these measures for reconstructing the functional structure of the network. The measures are implemented for both static and dynamic networks mapped respectively by random variables and random processes using plug-in and model-based entropy estimators. The validation on theoretical and numerical simulated networks documents the ability of the framework to represent high-order interactions as networks and to detect statistical structures associated to cascade, common drive and common target effects. The application to cardiovascular networks mapped by the beat-to-beat variability of heart rate, respiration, arterial pressure, cardiac output and vascular resistance allowed noninvasive characterization of several mechanisms of cardiovascular control operating in resting state and during orthostatic stress. Our approach brings to new comprehensive assessment of physiological interactions and complements existing strategies for the classification of pathophysiological states. △ Less

Submitted 10 January, 2024; originally announced January 2024.

Comments: 14 pages, 8 figures

brainlife.io: A decentralized and open source cloud platform to support neuroscience research

Authors: Soichi Hayashi, Bradley A. Caron, Anibal Sólon Heinsfeld, Sophia Vinci-Booher, Brent McPherson, Daniel N. Bullock, Giulia Bertò, Guiomar Niso, Sandra Hanekamp, Daniel Levitas, Kimberly Ray, Anne MacKenzie, Lindsey Kitchell, Josiah K. Leong, Filipi Nascimento-Silva, Serge Koudoro, Hanna Willis, Jasleen K. Jolly, Derek Pisner, Taylor R. Zuidema, Jan W. Kurzawski, Kyriaki Mikellidou, Aurore Bussalb, Christopher Rorden, Conner Victory , et al. (39 additional authors not shown)

Abstract: Neuroscience research has expanded dramatically over the past 30 years by advancing standardization and tool development to support rigor and transparency. Consequently, the complexity of the data pipeline has also increased, hindering access to FAIR (Findable, Accessible, Interoperabile, and Reusable) data analysis to portions of the worldwide research community. brainlife.io was developed to red… ▽ More Neuroscience research has expanded dramatically over the past 30 years by advancing standardization and tool development to support rigor and transparency. Consequently, the complexity of the data pipeline has also increased, hindering access to FAIR (Findable, Accessible, Interoperabile, and Reusable) data analysis to portions of the worldwide research community. brainlife.io was developed to reduce these burdens and democratize modern neuroscience research across institutions and career levels. Using community software and hardware infrastructure, the platform provides open-source data standardization, management, visualization, and processing and simplifies the data pipeline. brainlife.io automatically tracks the provenance history of thousands of data objects, supporting simplicity, efficiency, and transparency in neuroscience research. Here brainlife.io's technology and data services are described and evaluated for validity, reliability, reproducibility, replicability, and scientific utility. Using data from 4 modalities and 3,200 participants, we demonstrate that brainlife.io's services produce outputs that adhere to best practices in modern neuroscience research. △ Less

Submitted 11 August, 2023; v1 submitted 3 June, 2023; originally announced June 2023.

Higher-order mutual information reveals synergistic sub-networks for multi-neuron importance

Authors: Kenzo Clauw, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: Quantifying which neurons are important with respect to the classification decision of a trained neural network is essential for understanding their inner workings. Previous work primarily attributed importance to individual neurons. In this work, we study which groups of neurons contain synergistic or redundant information using a multivariate mutual information method called the O-information. W… ▽ More Quantifying which neurons are important with respect to the classification decision of a trained neural network is essential for understanding their inner workings. Previous work primarily attributed importance to individual neurons. In this work, we study which groups of neurons contain synergistic or redundant information using a multivariate mutual information method called the O-information. We observe the first layer is dominated by redundancy suggesting general shared features (i.e. detecting edges) while the last layer is dominated by synergy indicating local class-specific features (i.e. concepts). Finally, we show the O-information can be used for multi-neuron importance. This can be demonstrated by re-training a synergistic sub-network, which results in a minimal change in performance. These results suggest our method can be used for pruning and unsupervised representation learning. △ Less

Submitted 8 November, 2022; v1 submitted 1 November, 2022; originally announced November 2022.

Comments: Paper presented at InfoCog @ NeurIPS 2022

Cognitive modelling with multilayer networks: Insights, advancements and future challenges

Authors: Massimo Stella, Salvatore Citraro, Giulio Rossetti, Daniele Marinazzo, Yoed N. Kenett, Michael S. Vitevitch

Abstract: The mental lexicon is a complex cognitive system representing information about the words/concepts that one knows. Decades of psychological experiments have shown that conceptual associations across multiple, interactive cognitive levels can greatly influence word acquisition, storage, and processing. How can semantic, phonological, syntactic, and other types of conceptual associations be mapped w… ▽ More The mental lexicon is a complex cognitive system representing information about the words/concepts that one knows. Decades of psychological experiments have shown that conceptual associations across multiple, interactive cognitive levels can greatly influence word acquisition, storage, and processing. How can semantic, phonological, syntactic, and other types of conceptual associations be mapped within a coherent mathematical framework to study how the mental lexicon works? We here review cognitive multilayer networks as a promising quantitative and interpretative framework for investigating the mental lexicon. Cognitive multilayer networks can map multiple types of information at once, thus capturing how different layers of associations might co-exist within the mental lexicon and influence cognitive processing. This review starts with a gentle introduction to the structure and formalism of multilayer networks. We then discuss quantitative mechanisms of psychological phenomena that could not be observed in single-layer networks and were only unveiled by combining multiple layers of the lexicon: (i) multiplex viability highlights language kernels and facilitative effects of knowledge processing in healthy and clinical populations; (ii) multilayer community detection enables contextual meaning reconstruction depending on psycholinguistic features; (iii) layer analysis can mediate latent interactions of mediation, suppression and facilitation for lexical access. By outlining novel quantitative perspectives where multilayer networks can shed light on cognitive knowledge representations, also in next-generation brain/mind models, we discuss key limitations and promising directions for cutting-edge future research. △ Less

Submitted 2 October, 2022; originally announced October 2022.

Gradients of O-information: low-order descriptors of high-order dependencies

Authors: Tomas Scagliarini, Davide Nuzzi, Yuri Antonacci, Luca Faes, Fernando E. Rosas, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here we propose the gradients of the O-information as low-order descriptors that can characterise how high-order effects are localised across a system of interest. W… ▽ More O-information is an information-theoretic metric that captures the overall balance between redundant and synergistic information shared by groups of three or more variables. To complement the global assessment provided by this metric, here we propose the gradients of the O-information as low-order descriptors that can characterise how high-order effects are localised across a system of interest. We illustrate the capabilities of the proposed framework by revealing the role of specific spins in Ising models with frustration, and on practical data analysis on US macroeconomic data. Our theoretical and empirical analyses demonstrate the potential of these gradients to highlight the contribution of variables in forming high-order informational circuits △ Less

Submitted 1 July, 2022; originally announced July 2022.

Comments: 4 pages + supplementary material, 3 figures

An information-theoretic approach to hypergraph psychometrics

Authors: Daniele Marinazzo, Jan Van Roozendaal, Fernando E. Rosas, Massimo Stella, Renzo Comolatti, Nigel Colenbier, Sebastiano Stramaglia, Yves Rosseel

Abstract: Psychological network approaches propose to see symptoms or questionnaire items as interconnected nodes, with links between them reflecting pairwise statistical dependencies evaluated cross-sectional, time-series, or panel data. These networks constitute an established methodology to assess the interactions and relative importance of nodes/indicators, providing an important complement to other app… ▽ More Psychological network approaches propose to see symptoms or questionnaire items as interconnected nodes, with links between them reflecting pairwise statistical dependencies evaluated cross-sectional, time-series, or panel data. These networks constitute an established methodology to assess the interactions and relative importance of nodes/indicators, providing an important complement to other approaches such as factor analysis. However, focusing the modelling solely on pairwise relationships can neglect potentially critical information shared by groups of three or more variables in the form of higher-order interdependencies. To overcome this important limitation, here we propose an information-theoretic framework based on hypergraphs as psychometric models. As edges in hypergraphs are capable of encompassing several nodes together, this extension can thus provide a richer representation of the interactions that may exist among sets of psychological variables. Our results show how psychometric hypergraphs can highlight meaningful redundant and synergistic interactions on either simulated or state-of-art, re-analyzed psychometric datasets. Overall, our framework extends current network approaches while leading to new ways of assessing the data that differ at their core from other methods, extending the psychometric toolbox and opening promising avenues for future investigation. △ Less

Submitted 13 May, 2022; v1 submitted 2 May, 2022; originally announced May 2022.

Journal ref: Behavior Research Methods, 2024

Disentangling high-order mechanisms and high-order behaviours in complex systems

Authors: Fernando E. Rosas, Pedro A. M. Mediano, Andrea I. Luppi, Thomas F. Varley, Joseph T. Lizier, Sebastiano Stramaglia, Henrik J. Jensen, Daniele Marinazzo

Abstract: Battiston et al. (arXiv:2110.06023) provide a comprehensive overview of how investigations of complex systems should take into account interactions between more than two elements, which can be modelled by hypergraphs and studied via topological data analysis. Following a separate line of enquiry, a broad literature has developed information-theoretic tools to characterize high-order interdependenc… ▽ More Battiston et al. (arXiv:2110.06023) provide a comprehensive overview of how investigations of complex systems should take into account interactions between more than two elements, which can be modelled by hypergraphs and studied via topological data analysis. Following a separate line of enquiry, a broad literature has developed information-theoretic tools to characterize high-order interdependencies from observed data. While these could seem to be competing approaches aiming to address the same question, in this correspondence we clarify that this is not the case, and that a complete account of higher-order phenomena needs to embrace both. △ Less

Submitted 21 March, 2022; originally announced March 2022.

Journal ref: Nature Physics (2022)

Frontal effective connectivity increases with task demands and time on task: a Dynamic Causal Model of electrocorticogram in macaque monkeys

Authors: Katharina Wegner, Charles R. E. Wilson, Emmanuel Procyk, Karl J. Friston, Frederik Van de Steen, Dimitris A. Pinotsis, Daniele Marinazzo

Abstract: We apply Dynamic Causal Models to electrocorticogram recordings from two macaque monkeys performing a problem-solving task that engages working memory, and induces time-on-task effects. We thus provide a computational account of changes in effective connectivity within two regions of the fronto-parietal network, the dorsolateral prefrontal cortex and the pre-supplementary motor area. We find that… ▽ More We apply Dynamic Causal Models to electrocorticogram recordings from two macaque monkeys performing a problem-solving task that engages working memory, and induces time-on-task effects. We thus provide a computational account of changes in effective connectivity within two regions of the fronto-parietal network, the dorsolateral prefrontal cortex and the pre-supplementary motor area. We find that forward connections between the two regions increased in strength when task demands increased, and as the experimental session progressed. Similarities in the effects of task demands and time on task allow us to interpret changes in frontal connectivity in terms of increased attentional effort allocation that compensates cognitive fatigue. △ Less

Submitted 1 February, 2023; v1 submitted 21 February, 2022; originally announced February 2022.

Journal ref: Neurons, Behavior, Data analysis, and Theory, Volume 6, Issue 1, 2023

A Framework for the Time- and Frequency-Domain Assessment of High-Order Interactions in Brain and Physiological Networks

Authors: Luca Faes, Gorana Mijatovic, Yuri Antonacci, Riccardo Pernice, Chiara Barà, Laura Sparacino, Marco Sammartino, Alberto Porta, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the… ▽ More While the standard network description of complex systems is based on quantifying links between pairs of system units, higher-order interactions (HOIs) involving three or more units play a major role in governing the collective network behavior. This work introduces an approach to quantify pairwise and HOIs for multivariate rhythmic processes interacting across multiple time scales. We define the so-called O-information rate (OIR) as a new metric to assess HOIs for multivariate time series, and propose a framework to decompose it into measures quantifying Granger-causal and instantaneous influences, as well as to expand it in the frequency domain. The framework exploits the spectral representation of vector autoregressive and state-space models to assess synergistic and redundant interactions among groups of processes, both in specific bands and in the time domain after whole-band integration. Validation on simulated networks illustrates how the spectral OIR can highlight redundant and synergistic HOIs emerging at specific frequencies but not using time-domain measures. The application to physiological networks described by heart period, arterial pressure and respiration measured in healthy subjects during paced breathing, and to brain networks described by ECoG signals acquired in an animal experiment during anesthesia, document the capability of our approach to identify informational circuits relevant to well-defined cardiovascular oscillations and brain rhythms and related to specific physiological mechanisms of autonomic control and altered consciousness. The proposed framework allows a hierarchically-organized evaluation of time- and frequency-domain interactions in networks mapped by multivariate time series, and its high flexibility and scalability make it suitable to investigate networks beyond pairwise interactions in neuroscience, physiology and other fields. △ Less

Submitted 8 February, 2022; originally announced February 2022.

WHOCARES: data-driven WHOle-brain CArdiac signal REgression from highly accelerated simultaneous multi-Slice fMRI acquisitions

Authors: Nigel Colenbier, Marco Marino, Giorgio Arcara, Blaise Frederick, Giovanni Pellegrino, Daniele Marinazzo, Giulio Ferrazzi

Abstract: Cardiac pulsation is a physiological confound of functional magnetic resonance imaging (fMRI) time-series that introduces spurious signal fluctuations in proximity to blood vessels. fMRI alone is not sufficiently fast to resolve cardiac pulsation. Depending on the ratio between the instantaneous heart-rate and the acquisition sampling frequency (1/TR, with TR being the repetition time), the cardia… ▽ More Cardiac pulsation is a physiological confound of functional magnetic resonance imaging (fMRI) time-series that introduces spurious signal fluctuations in proximity to blood vessels. fMRI alone is not sufficiently fast to resolve cardiac pulsation. Depending on the ratio between the instantaneous heart-rate and the acquisition sampling frequency (1/TR, with TR being the repetition time), the cardiac signal may alias into the frequency band of neural activation. The introduction of simultaneous multi-slice (SMS) imaging has significantly reduced the chances of cardiac aliasing. However, the necessity of covering the entire brain at high spatial resolution restrain the shortest TR to just over 0.5 seconds, which is in turn not sufficiently short to resolve cardiac pulsation beyond 60 beats per minute. Recently, hyper-sampling of the fMRI time-series has been introduced to overcome this issue. While each anatomical location is sampled every TR seconds, the time between consecutive excitations is shorter and thus adequate to resolve cardiac pulsation. In this study, we show that it is feasible to temporally and spatially resolve cardiac waveforms at each voxel location by combining a dedicated hyper-sampling decomposition scheme with SMS. We developed the technique on 774 healthy subjects selected from the Human Connectome Project (HCP) and validated the technology against the RETROICOR method. The proposed approach, which we name Data-driven WHOle-brain CArdiac signal REgression from highly accelerated simultaneous multi-Slice fMRI acquisitions (WHOCARES), is fully data-driven, does not make specific assumptions on cardiac pulsatility, and is independent from external physiological recordings so that the retrospective correction of fMRI data becomes possible when such measurements are not available. WHOCARES is freely available at https://github.com/gferrazzi/WHOCARES. △ Less

Submitted 3 January, 2022; originally announced January 2022.

Quantifying high-order interdependencies on individual patterns via the local O-information: theory and applications to music analysis

Authors: Tomas Scagliarini, Daniele Marinazzo, Yike Guo, Sebastiano Stramaglia, Fernando E. Rosas

Abstract: High-order, beyond-pairwise interdependencies are at the core of biological, economic, and social complex systems, and their adequate analysis is paramount to understand, engineer, and control such systems. This paper presents a framework to measure high-order interdependence that disentangles their effect on each individual pattern exhibited by a multivariate system. The approach is centred on th… ▽ More High-order, beyond-pairwise interdependencies are at the core of biological, economic, and social complex systems, and their adequate analysis is paramount to understand, engineer, and control such systems. This paper presents a framework to measure high-order interdependence that disentangles their effect on each individual pattern exhibited by a multivariate system. The approach is centred on the 'local O-information', a new measure that assesses the balance between synergistic and redundant interdependencies at each pattern. To illustrate the potential of this framework, we present a detailed analysis of music scores from J.S. Bach, which reveals how high-order interdependence is deeply connected with highly non-trivial aspects of the musical discourse. Our results place the local O-information as a promising tool of wide applicability, which opens new perspectives for analysing high-order relationships in the patterns exhibited by complex systems. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: 14 pages, 10 figures

Journal ref: Phys. Rev. Research 4, 013184 2022

Brain Modelling as a Service: The Virtual Brain on EBRAINS

Authors: Michael Schirner, Lia Domide, Dionysios Perdikis, Paul Triebkorn, Leon Stefanovski, Roopa Pai, Paula Popa, Bogdan Valean, Jessica Palmer, Chloê Langford, André Blickensdörfer, Michiel van der Vlag, Sandra Diaz-Pier, Alexander Peyser, Wouter Klijn, Dirk Pleiter, Anne Nahm, Oliver Schmid, Marmaduke Woodman, Lyuba Zehl, Jan Fousek, Spase Petkoski, Lionel Kusch, Meysam Hashemi, Daniele Marinazzo , et al. (19 additional authors not shown)

Abstract: The Virtual Brain (TVB) is now available as open-source cloud ecosystem on EBRAINS, a shared digital research platform for brain science. It offers services for constructing, simulating and analysing brain network models (BNMs) including the TVB network simulator; magnetic resonance imaging (MRI) processing pipelines to extract structural and functional connectomes; multiscale co-simulation of spi… ▽ More The Virtual Brain (TVB) is now available as open-source cloud ecosystem on EBRAINS, a shared digital research platform for brain science. It offers services for constructing, simulating and analysing brain network models (BNMs) including the TVB network simulator; magnetic resonance imaging (MRI) processing pipelines to extract structural and functional connectomes; multiscale co-simulation of spiking and large-scale networks; a domain specific language for automatic high-performance code generation from user-specified models; simulation-ready BNMs of patients and healthy volunteers; Bayesian inference of epilepsy spread; data and code for mouse brain simulation; and extensive educational material. TVB cloud services facilitate reproducible online collaboration and discovery of data assets, models, and software embedded in scalable and secure workflows, a precondition for research on large cohort data sets, better generalizability and clinical translation. △ Less

Submitted 29 March, 2021; v1 submitted 11 February, 2021; originally announced February 2021.

Beyond pairwise network similarity: exploring Mediation and Suppression between networks

Authors: Lucas Lacasa, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: Network similarity measures quantify how and when two networks are symmetrically related, including measures of statistical association such as pairwise distance or other correlation measures between networks or between the layers of a multiplex network, but neither can directly unveil whether there are hidden confounding network factors nor can they estimate when such correlation is underpinned b… ▽ More Network similarity measures quantify how and when two networks are symmetrically related, including measures of statistical association such as pairwise distance or other correlation measures between networks or between the layers of a multiplex network, but neither can directly unveil whether there are hidden confounding network factors nor can they estimate when such correlation is underpinned by a causal relation. In this work we extend this pairwise conceptual framework to triplets of networks and quantify how and when a network is related to a second network directly or via the indirect mediation or interaction with a third network. Accordingly, we develop a simple and intuitive set-theoretic approach to quantify mediation and suppression between networks. We validate our theory with synthetic models and further apply it to triplets of real-world networks, unveiling mediation and suppression effects which emerge when considering different modes of interaction in online social networks and different routes of information processing in the brain. △ Less

Submitted 15 December, 2020; originally announced December 2020.

PRINCIPIA: a Decentralized Peer-Review Ecosystem

Authors: Andrea Mambrini, Andrea Baronchelli, Michele Starnini, Daniele Marinazzo, Manlio De Domenico

Abstract: Peer review is a cornerstone of modern scientific endeavor. However, there is growing consensus that several limitations of the current peer review system, from lack of incentives to reviewers to lack of transparency, risks to undermine its benefits. Here, we introduce the PRINCIPIA (http://www.principia.network/) framework for peer-review of scientific outputs (e.g., papers, grant proposals or pa… ▽ More Peer review is a cornerstone of modern scientific endeavor. However, there is growing consensus that several limitations of the current peer review system, from lack of incentives to reviewers to lack of transparency, risks to undermine its benefits. Here, we introduce the PRINCIPIA (http://www.principia.network/) framework for peer-review of scientific outputs (e.g., papers, grant proposals or patents). The framework allows key players of the scientific ecosystem -- including existing publishing groups -- to create and manage peer-reviewed journals, by building a free market for reviews and publications. PRINCIPIA's referees are transparently rewarded according to their efforts and the quality of their reviews. PRINCIPIA also naturally allows to recognize the prestige of users and journals, with an intrinsic reputation system that does not depend on third-parties. PRINCIPIA re-balances the power between researchers and publishers, stimulates valuable assessments from referees, favors a fair competition between journals, and reduces the costs to access research output and to publish. △ Less

Submitted 20 August, 2020; originally announced August 2020.

Comments: 14 pages, 3 figures, comments and feedbacks welcome

Quantifying dynamical high-order interdependencies from the O-information: an application to neural spiking dynamics

Authors: Sebastiano Stramaglia, Tomas Scagliarini, Bryan C. Daniels, Daniele Marinazzo

Abstract: We address the problem of efficiently and informatively quantifying how multiplets of variables carry information about the future of the dynamical system they belong to. In particular we want to identify groups of variables carrying redundant or synergistic information, and track how the size and the composition of these multiplets changes as the collective behavior of the system evolves. In orde… ▽ More We address the problem of efficiently and informatively quantifying how multiplets of variables carry information about the future of the dynamical system they belong to. In particular we want to identify groups of variables carrying redundant or synergistic information, and track how the size and the composition of these multiplets changes as the collective behavior of the system evolves. In order to afford a parsimonious expansion of shared information, and at the same time control for lagged interactions and common effect, we develop a dynamical, conditioned version of the O-information, a framework recently proposed to quantify high-order interdependencies via multivariate extension of the mutual information. We thus obtain an expansion of the transfer entropy in which synergistic and redundant effects are separated. We apply this framework to a dataset of spiking neurons from a monkey performing a perceptual discrimination task. The method identifies synergistic multiplets that include neurons previously categorized as containing little relevant information individually. △ Less

Submitted 31 July, 2020; originally announced July 2020.

Synergistic information in a dynamical model implemented on the human structural connectome reveals spatially distinct associations with age

Authors: Davide Nuzzi, Mario Pellicoro, Leonardo Angelini, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: We implement the dynamical Ising model on the large scale architecture of white matter connections of healthy subjects in the age range 4-85 years, and analyze the dynamics in terms of the synergy, a quantity measuring the extent to which the joint state of pairs of variables is projected onto the dynamics of a target one. We find that the amount of synergy in explaining the dynamics of the hubs o… ▽ More We implement the dynamical Ising model on the large scale architecture of white matter connections of healthy subjects in the age range 4-85 years, and analyze the dynamics in terms of the synergy, a quantity measuring the extent to which the joint state of pairs of variables is projected onto the dynamics of a target one. We find that the amount of synergy in explaining the dynamics of the hubs of the structural connectivity (in terms of degree strength) peaks before the critical temperature, and can thus be considered as a precursor of a critical transition. Conversely the greatest amount of synergy goes into explaining the dynamics of more central nodes. We also find that the aging of the structural connectivity is associated to significant changes in the simulated dynamics: there are brain regions whose synergy decreases with age, in particular the frontal pole, the Subcallosal area and the Supplementary Motor area; these areas could then be more likely to show a decline in terms of the capability to perform higher order computation (if structural connectivity was the sole variable). On the other hand, several regions in the temporal cortex show a positive correlation with age in the first 30 years of life, i.e. during brain maturation. △ Less

Submitted 11 February, 2020; originally announced February 2020.

Comments: 18 pages, 8 figures

A mean field approach to model levels of consciousness from EEG recordings

Authors: Marco Alberto Javarone, Olivia Gosseries, Daniele Marinazzo, Quentin Noirhomme, Vincent Bonhomme, Steven Laureys, Srivas Chennu

Abstract: We introduce a mean-field model for analysing the dynamics of human consciousness. In particular, inspired by the Giulio Tononi's Integrated Information Theory and by the Max Tegmark's representation of consciousness, we study order-disorder phase transitions on Curie-Weiss models generated by processing EEG signals. The latter have been recorded on healthy individuals undergoing deep sedation. Th… ▽ More We introduce a mean-field model for analysing the dynamics of human consciousness. In particular, inspired by the Giulio Tononi's Integrated Information Theory and by the Max Tegmark's representation of consciousness, we study order-disorder phase transitions on Curie-Weiss models generated by processing EEG signals. The latter have been recorded on healthy individuals undergoing deep sedation. Then, we implement a machine learning tool for classifying mental states using, as input, the critical temperatures computed in the Curie-Weiss models. Results show that, by the proposed method, it is possible to discriminate between states of awareness and states of deep sedation. Besides, we identify a state space for representing the path between mental states, whose dimensions correspond to critical temperatures computed over different frequency bands of the EEG signal. Beyond possible theoretical implications in the study of human consciousness, resulting from our model, we deem relevant to emphasise that the proposed method could be exploited for clinical applications. △ Less

Submitted 4 August, 2020; v1 submitted 6 February, 2020; originally announced February 2020.

Comments: 23 pages, 6 figures. Accepted for publication in Journal of Statistical Mechanics: Theory and Experiment

Synergy as a warning sign of transitions: the case of the two-dimensional Ising model

Authors: Daniele Marinazzo, Leonardo Angelini, Mario Pellicoro, Sebastiano Stramaglia

Abstract: We consider the formalism of information decomposition of target effects from multi-source interactions, i.e. the problem of defining redundant and synergistic components of the information that a set of source variables provides about a target, and apply it to the two-dimensional Ising model as a paradigm of a critically transitioning system. Intuitively, synergy is the information about the targ… ▽ More We consider the formalism of information decomposition of target effects from multi-source interactions, i.e. the problem of defining redundant and synergistic components of the information that a set of source variables provides about a target, and apply it to the two-dimensional Ising model as a paradigm of a critically transitioning system. Intuitively, synergy is the information about the target variable that is uniquely obtained taking the sources together, but not considering them alone; redundancy is the information which is shared by the sources. To disentangle the components of the information both at the static level and at the dynamical one, the decomposition is applied respectively to the mutual information and to the transfer entropy between a given spin, the target, and a pair of neighbouring spins (taken as the drivers). We show that a key signature of an impending phase transition (approached from the disordered size) is the fact that the synergy peaks in the disordered phase, both in the static and in the dynamic case: the synergy can thus be considered a precursor of the transition. The redundancy, instead, reaches its maximum at the critical temperature. The peak of the synergy of the transfer entropy is far more pronounced than those of the static mutual information. We show that these results are robust w.r.t. the details of the information decomposition approach, as we find the same results using two different methods; moreover, w.r.t. previous literature rooted on the notion of Global Transfer Entropy, our results demonstrate that considering as few as three variables is sufficient to construct a precursor of the transition, and provide a paradigm for the investigation of a variety of systems prone to crisis, like financial markets, social media, or epileptic seizures. △ Less

Submitted 19 April, 2019; v1 submitted 16 January, 2019; originally announced January 2019.

Journal ref: Phys. Rev. E 99, 040101 (2019)

On the interpretability and computational reliability of frequency-domain Granger causality

Authors: Luca Faes, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: This is a comment to the paper 'A study of problems encountered in Granger causality analysis from a neuroscience perspective'. We agree that interpretation issues of Granger Causality in Neuroscience exist (partially due to the historical unfortunate use of the name 'causality', as nicely described in previous literature). On the other hand we think that the paper uses a formulation of Granger ca… ▽ More This is a comment to the paper 'A study of problems encountered in Granger causality analysis from a neuroscience perspective'. We agree that interpretation issues of Granger Causality in Neuroscience exist (partially due to the historical unfortunate use of the name 'causality', as nicely described in previous literature). On the other hand we think that the paper uses a formulation of Granger causality which is outdated (albeit still used), and in doing so it dismisses the measure based on a suboptimal use of it. Furthermore, since data from simulated systems are used, the pitfalls that are found with the used formulation are intended to be general, and not limited to neuroscience. It would be a pity if this paper, even written in good faith, became a wildcard against all possible applications of Granger Causality, regardless of the hard work of colleagues aiming to seriously address the methodological and interpretation pitfalls. In order to provide a balanced view, we replicated their simulations used the updated State Space implementation, proposed already some years ago, in which the pitfalls are mitigated or directly solved. △ Less

Submitted 23 August, 2017; originally announced August 2017.

Multiscale Granger causality analysis by à trous wavelet transform

Authors: Sebastiano Stramaglia, Iege Bassez, Luca Faes, Daniele Marinazzo

Abstract: Since interactions in neural systems occur across multiple temporal scales, it is likely that information flow will exhibit a multiscale structure, thus requiring a multiscale generalization of classical temporal precedence causality analysis like Granger's approach. However, the computation of multiscale measures of information dynamics is complicated by theoretical and practical issues such as f… ▽ More Since interactions in neural systems occur across multiple temporal scales, it is likely that information flow will exhibit a multiscale structure, thus requiring a multiscale generalization of classical temporal precedence causality analysis like Granger's approach. However, the computation of multiscale measures of information dynamics is complicated by theoretical and practical issues such as filtering and undersampling: to overcome these problems, we propose a wavelet-based approach for multiscale Granger causality (GC) analysis, which is characterized by the following properties: (i) only the candidate driver variable is wavelet transformed (ii) the decomposition is performed using the à trous wavelet transform with cubic B-spline filter. We measure GC, at a given scale, by including the wavelet coefficients of the driver times series, at that scale, in the regression model of the target. To validate our method, we apply it to publicly available scalp EEG signals, and we find that the condition of closed eyes, at rest, is characterized by an enhanced GC among channels at slow scales w.r.t. eye open condition, whilst the standard Granger causality is not significantly different in the two conditions. △ Less

Submitted 12 July, 2017; originally announced July 2017.

Comments: 4 pages, 3 figures

Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes

Authors: Luca Faes, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for differen… ▽ More Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by mainly redundant or synergistic information transfer persisting across multiple time scales or even by the alternating prevalence of redundant and synergistic source interaction depending on the time scale. Then, we apply our method to an important topic in neuroscience, i.e., the detection of causal interactions in human epilepsy networks, for which we show the relevance of partial information decomposition to the detection of multiscale information transfer spreading from the seizure onset zone. △ Less

Submitted 18 August, 2017; v1 submitted 21 June, 2017; originally announced June 2017.

Journal ref: Entropy, 19, 408 (2017)

Multiscale Granger causality

Authors: Luca Faes, Giandomenico Nollo, Sebastiano Stramaglia, Daniele Marinazzo

Abstract: In the study of complex physical and biological systems represented by multivariate stochastic processes, an issue of great relevance is the description of the system dynamics spanning multiple temporal scales. While methods to assess the dynamic complexity of individual processes at different time scales are well-established, multiscale analysis of directed interactions has never been formalized… ▽ More In the study of complex physical and biological systems represented by multivariate stochastic processes, an issue of great relevance is the description of the system dynamics spanning multiple temporal scales. While methods to assess the dynamic complexity of individual processes at different time scales are well-established, multiscale analysis of directed interactions has never been formalized theoretically, and empirical evaluations are complicated by practical issues such as filtering and downsampling. Here we extend the very popular measure of Granger causality (GC), a prominent tool for assessing directed lagged interactions between joint processes, to quantify information transfer across multiple time scales. We show that the multiscale processing of a vector autoregressive (AR) process introduces a moving average (MA) component, and describe how to represent the resulting ARMA process using state space (SS) models and to combine the SS model parameters for computing exact GC values at arbitrarily large time scales. We exploit the theoretical formulation to identify peculiar features of multiscale GC in basic AR processes, and demonstrate with numerical simulations the much larger estimation accuracy of the SS approach compared with pure AR modeling of filtered and downsampled data. The improved computational reliability is exploited to disclose meaningful multiscale patterns of information transfer between global temperature and carbon dioxide concentration time series, both in paleoclimate and in recent years. △ Less

Submitted 25 October, 2017; v1 submitted 24 March, 2017; originally announced March 2017.

Journal ref: Phys. Rev. E 96, 042150 (2017)

Dilution of Ferromagnets via a Random Graph-based Strategy

Authors: Marco Alberto Javarone, Daniele Marinazzo

Abstract: The dynamics and behavior of ferromagnets have a great relevance even beyond the domain of statistical physics. In this work, we propose a Monte Carlo method, based on random graphs, for modeling their dilution. In particular, we focus on ferromagnets with dimension $D \ge 4$, which can be approximated by the Curie-Weiss model. Since the latter has as graphic counterpart a complete graph, a diluti… ▽ More The dynamics and behavior of ferromagnets have a great relevance even beyond the domain of statistical physics. In this work, we propose a Monte Carlo method, based on random graphs, for modeling their dilution. In particular, we focus on ferromagnets with dimension $D \ge 4$, which can be approximated by the Curie-Weiss model. Since the latter has as graphic counterpart a complete graph, a dilution can be in this case viewed as a pruning process. Hence, in order to exploit this mapping, the proposed strategy uses a modified version of the Erdős-Renyi graph model. In doing so, we are able both to simulate a continuous dilution, and to realize diluted ferromagnets in one step. The proposed strategy is studied by means of numerical simulations, aimed to analyze main properties and equilibria of the resulting diluted ferromagnets. To conclude, we also provide a brief description of further applications of our strategy in the field of complex networks. △ Less

Submitted 16 February, 2018; v1 submitted 14 February, 2017; originally announced February 2017.

Comments: 23 pages, 7 figures; accepted for publication in Complexity

Evolutionary Dynamics of Group Formation

Authors: Marco Alberto Javarone, Daniele Marinazzo

Abstract: We introduce a model, based on the Evolutionary Game Theory, for studying the dynamics of group formation. The latter constitutes a relevant phenomenon observed in different animal species, whose individuals tend to cluster together forming groups of different size. Results of previous investigations suggest that this phenomenon might have similar reasons across different species, such as improvin… ▽ More We introduce a model, based on the Evolutionary Game Theory, for studying the dynamics of group formation. The latter constitutes a relevant phenomenon observed in different animal species, whose individuals tend to cluster together forming groups of different size. Results of previous investigations suggest that this phenomenon might have similar reasons across different species, such as improving the individual safety (e.g. from predators), and increasing the probability to get food resources. Remarkably, the group size might strongly vary from species to species, and sometimes even within the same species. In the proposed model, an agent population tries to form homogeneous groups. The homogeneity of a group is computed according to a spin vector, that characterizes each agent, and represents a set a features (e.g. physical traits). We analyze the formation of groups of different size, on varying a parameter named 'individual payoff'. The latter represents the gain one agent would receive acting individually. In particular, the agents choose whether to form a group (receiving a 'group payoff'), or if to play individually (receiving an 'individual payoff'). The phase diagram representing the equilibria of our population shows a sharp transition between the 'group phase' and the 'individual phase', in correspondence of a critical 'individual payoff'. In addition, we found that forming (homogeneous) small groups is easier than forming big groups. To conclude, we deem that our model and the related results supports the hypothesis that the phenomenon of group formation has evolutionary roots. △ Less

Submitted 12 December, 2016; originally announced December 2016.

Comments: 13 pages, 5 figures

Consensus clustering approach to group brain connectivity matrices

Authors: Javier Rasero, Mario Pellicoro, Leonardo Angelini, Jesus M. Cortes, Daniele Marinazzo, Sebastiano Stramaglia

Abstract: A novel approach rooted on the notion of consensus clustering, a strategy developed for community detection in complex networks, is proposed to cope with the heterogeneity that characterizes connectivity matrices in health and disease. The method can be summarized as follows: (i) define, for each node, a distance matrix for the set of subjects by comparing the connectivity pattern of that node i… ▽ More A novel approach rooted on the notion of consensus clustering, a strategy developed for community detection in complex networks, is proposed to cope with the heterogeneity that characterizes connectivity matrices in health and disease. The method can be summarized as follows: (i) define, for each node, a distance matrix for the set of subjects by comparing the connectivity pattern of that node in all pairs of subjects; (ii) cluster the distance matrix for each node; (iii) build the consensus network from the corresponding partitions; (iv) extract groups of subjects by finding the communities of the consensus network thus obtained. Differently from the previous implementations of consensus clustering, we thus propose to use the consensus strategy to combine the information arising from the connectivity patterns of each node. The proposed approach may be seen either as an exploratory technique or as an unsupervised pre-training step to help the subsequent construction of a supervised classifier. Applications on a toy model and two real data sets, show the effectiveness of the proposed methodology, which represents heterogeneity of a set of subjects in terms of a weighted network, the consensus matrix. △ Less

Submitted 8 May, 2017; v1 submitted 12 December, 2016; originally announced December 2016.

Critical comments on EEG sensor space dynamical connectivity analysis

Authors: Frederik van de Steen, Luca Faes, Esin Karahan, Jitkomut Songsiri, Pedro Antonio Valdes Sosa, Daniele Marinazzo

Abstract: Many different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with g… ▽ More Many different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with great care. The goal of this paper is to show, both theoretically and using simulations, that results obtained by applying causal connectivity measures on the sensor (scalp) time series do not allow interpretation in terms of interacting brain sources. This is because 1) the channel locations cannot be seen as an approximation of a source's anatomical location and 2) spurious connectivity can occur between sensors. Although many measures of causal connectivity derived from EEG sensor time series are affected by the latter, here we will focus on the well-known time domain index of Granger causality (GC) and on the frequency domain directed transfer function (DTF). Using the state-space framework and designing two simulation studies we show that mixing effects caused by volume conduction can lead to spurious connections, detected either by time domain GC or by DTF. Therefore, GC/DTF causal connectivity measures should be computed at the source level, or derived within analysis frameworks that model the effects of volume conduction. Since mixing effects can also occur in the source space, it is advised to combine source space analysis with connectivity measures that are robust to mixing. △ Less

Submitted 8 November, 2016; v1 submitted 13 July, 2016; originally announced July 2016.

Mapping the functional connectome traits of levels of consciousness

Authors: Enrico Amico, Daniele Marinazzo, Carol DiPerri, Lizette Heine, Jitka Annen, Charlotte Martial, Mario Dzemidzic, Steven Laureys, Joaquín Goñi

Abstract: Examining task-free functional connectivity (FC) in the human brain offers insights on how spontaneous integration and segregation of information relate to human cognition, and how this organization may be altered in different conditions, and neurological disorders. This is particularly relevant for patients in disorders of consciousness (DOC) following severe acquired brain damage and coma, one o… ▽ More Examining task-free functional connectivity (FC) in the human brain offers insights on how spontaneous integration and segregation of information relate to human cognition, and how this organization may be altered in different conditions, and neurological disorders. This is particularly relevant for patients in disorders of consciousness (DOC) following severe acquired brain damage and coma, one of the most devastating conditions in modern medical care. We present a novel data-driven methodology, connICA, which implements Independent Component Analysis (ICA) for the extraction of robust independent FC patterns (FC-traits) from a set of individual functional connectomes, without imposing any a priori data stratification into groups. We here apply connICA to investigate associations between network traits derived from task-free FC and cognitive/clinical features that define levels of consciousness. Three main independent FC-traits were identified and linked to consciousness-related clinical features. The first one represents the functional configuration it is associated to a sedative (sevoflurane), the overall effect of the pathology and the level of arousal. The second FC-trait reflects the disconnection of the visual and sensory-motor connectivity patterns. It also relates to the time since the insult and to the ability of communicating with the external environment. The third FC-trait isolates the connectivity pattern encompassing the fronto-parietal and the default-mode network areas as well as the interaction between left and right hemispheres, which are also associated to the awareness of the self and its surroundings. Each FC-trait represents a distinct functional process with a role in the degradation of conscious states of functional brain networks, shedding further light on the functional subcircuits that get disrupted in severe brain-damage. △ Less

Submitted 2 November, 2016; v1 submitted 10 May, 2016; originally announced May 2016.

Lagged and instantaneous dynamical influences related to brain structural connectivity

Authors: C. Alonso-Montes, I. Diez, L. Remaki, I. Escudero, B. Mateos, Y. Rosseel, D. Marinazzo, S. Stramaglia, J. Cortes

Abstract: Contemporary neuroimaging methods can shed light on the basis of human neural and cognitive specializations, with important implications for neuroscience and medicine. Different MRI acquisitions provide different brain networks at the macroscale; whilst diffusion-weighted MRI (dMRI) provides a structural connectivity (SC) coincident with the bundles of parallel fibers between brain areas, function… ▽ More Contemporary neuroimaging methods can shed light on the basis of human neural and cognitive specializations, with important implications for neuroscience and medicine. Different MRI acquisitions provide different brain networks at the macroscale; whilst diffusion-weighted MRI (dMRI) provides a structural connectivity (SC) coincident with the bundles of parallel fibers between brain areas, functional MRI (fMRI) accounts for the variations in the blood-oxygenation-level-dependent T2* signal, providing functional connectivity (FC).Understanding the precise relation between FC and SC, that is, between brain dynamics and structure, is still a challenge for neuroscience. To investigate this problem, we acquired data at rest and built the corresponding SC (with matrix elements corresponding to the fiber number between brain areas) to be compared with FC connectivity matrices obtained by 3 different methods: directed dependencies by an exploratory version of structural equation modeling (eSEM), linear correlations (C) and partial correlations (PC). We also considered the possibility of using lagged correlations in time series; so, we compared a lagged version of eSEM and Granger causality (GC). Our results were two-fold: firstly, eSEM performance in correlating with SC was comparable to those obtained from C and PC, but eSEM (not C nor PC) provides information about directionality of the functional interactions. Second, interactions on a time scale much smaller than the sampling time, captured by instantaneous connectivity methods, are much more related to SC than slow directed influences captured by the lagged analysis. Indeed the performance in correlating with SC was much worse for GC and for the lagged version of eSEM. We expect these results to supply further insights to the interplay between SC and functional patterns, an important issue in the study of brain physiology and function. △ Less

Submitted 22 February, 2016; originally announced February 2016.

Comments: Accepted and published in Frontiers in Psychology in its current form. 27 pages, 1 table, 5 figures, 2 suppl. figures

Journal ref: Published Frontiers in Psychology 6:1024, 2015

Multiscale Analysis of Information Dynamics for Linear Multivariate Processes

Authors: Luca Faes, Alessandro Montalto, Sebastiano Stramaglia, Giandomenico Nollo, Daniele Marinazzo

Abstract: In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood.… ▽ More In the study of complex physical and physiological systems represented by multivariate time series, an issue of great interest is the description of the system dynamics over a range of different temporal scales. While information-theoretic approaches to the multiscale analysis of complex dynamics are being increasingly used, the theoretical properties of the applied measures are poorly understood. This study introduces for the first time a framework for the analytical computation of information dynamics for linear multivariate stochastic processes explored at different time scales. After showing that the multiscale processing of a vector autoregressive (VAR) process introduces a moving average (MA) component, we describe how to represent the resulting VARMA process using state-space (SS) models and how to exploit the SS model parameters to compute analytical measures of information storage and information transfer for the original and rescaled processes. The framework is then used to quantify multiscale information dynamics for simulated unidirectionally and bidirectionally coupled VAR processes, showing that rescaling may lead to insightful patterns of information storage and transfer but also to potentially misleading behaviors. △ Less

Submitted 24 February, 2016; v1 submitted 19 February, 2016; originally announced February 2016.

Conserved Ising Model on the Human Connectome

Authors: Sebastiano Stramaglia, Mario Pellicoro, Leonardo Angelini, Enrico Amico, Hannelore Aerts, Jesus Cortés, Steven Laureys, Daniele Marinazzo

Abstract: Dynamical models implemented on the large scale architecture of the human brain may shed light on how function arises from the underlying structure. This is the case notably for simple abstract models, such as the Ising model. We compare the spin correlations of the Ising model and the empirical functional brain correlations, both at the single link level and at the modular level, and show that th… ▽ More Dynamical models implemented on the large scale architecture of the human brain may shed light on how function arises from the underlying structure. This is the case notably for simple abstract models, such as the Ising model. We compare the spin correlations of the Ising model and the empirical functional brain correlations, both at the single link level and at the modular level, and show that their match increases at the modular level in anesthesia, in line with recent results and theories. Moreover, we show that at the peak of the specific heat (the \it{critical state}) the spin correlations are minimally shaped by the underlying structural network, explaining how the best match between structure and function is obtained at the onset of criticality, as previously observed. These findings confirm that brain dynamics under anesthesia shows a departure from criticality and could open the way to novel perspectives when the conserved magnetization is interpreted in terms of an homeostatic principle imposed to neural activity. △ Less

Submitted 6 April, 2017; v1 submitted 9 September, 2015; originally announced September 2015.

Journal ref: Chaos 27, 047407 (2017)

Neural Networks with Non-Uniform Embedding and Explicit Validation Phase to Assess Granger Causality

Authors: Alessandro Montalto, Sebastiano Stramaglia, Luca Faes, Giovanni Tessitore, Roberto Prevete, Daniele Marinazzo

Abstract: A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used approaches are a model-free one (transfer entropy) and a model-based one (Granger causality). Several pitfalls are related to the presence or absence of assump… ▽ More A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used approaches are a model-free one (transfer entropy) and a model-based one (Granger causality). Several pitfalls are related to the presence or absence of assumptions in modeling the relevant features of the data. We tried to overcome those pitfalls using a neural network approach in which a model is built without any a priori assumptions. In this sense this method can be seen as a bridge between model-free and model-based approaches. The experiments performed will show that the method presented in this work can detect the correct dynamical information flows occurring in a system of time series. Additionally we adopt a non-uniform embedding framework according to which only the past states that actually help the prediction are entered into the model, improving the prediction and avoiding the risk of overfitting. This method also leads to a further improvement with respect to traditional Granger causality approaches when redundant variables (i.e. variables sharing the same information about the future of the system) are involved. Neural networks are also able to recognize dynamics in data sets completely different from the ones used during the training phase. △ Less

Submitted 8 September, 2015; v1 submitted 1 July, 2015; originally announced July 2015.

Journal ref: Neural Networks 71, pp. 159 - 171, 2015

Information flow between resting state networks

Authors: Ibai Diez, Asier Erramuzpe, Inaki Escudero, Beatriz Mateos, Alberto Cabrera, Daniele Marinazzo, Ernesto J. Sanz-Arigita, Sebastiano Stramaglia, Jesus M. Cortes

Abstract: The resting brain dynamics self-organizes into a finite number of correlated patterns known as resting state networks (RSNs). It is well known that techniques like independent component analysis can separate the brain activity at rest to provide such RSNs, but the specific pattern of interaction between RSNs is not yet fully understood. To this aim, we propose here a novel method to compute the in… ▽ More The resting brain dynamics self-organizes into a finite number of correlated patterns known as resting state networks (RSNs). It is well known that techniques like independent component analysis can separate the brain activity at rest to provide such RSNs, but the specific pattern of interaction between RSNs is not yet fully understood. To this aim, we propose here a novel method to compute the information flow (IF) between different RSNs from resting state magnetic resonance imaging. After haemodynamic response function blind deconvolution of all voxel signals, and under the hypothesis that RSNs define regions of interest, our method first uses principal component analysis to reduce dimensionality in each RSN to next compute IF (estimated here in terms of Transfer Entropy) between the different RSNs by systematically increasing k (the number of principal components used in the calculation). When k = 1, this method is equivalent to computing IF using the average of all voxel activities in each RSN. For k greater than one our method calculates the k-multivariate IF between the different RSNs. We find that the average IF among RSNs is dimension-dependent, increasing from k =1 (i.e., the average voxels activity) up to a maximum occurring at k =5 to finally decay to zero for k greater than 10. This suggests that a small number of components (close to 5) is sufficient to describe the IF pattern between RSNs. Our method - addressing differences in IF between RSNs for any generic data - can be used for group comparison in health or disease. To illustrate this, we have calculated the interRSNs IF in a dataset of Alzheimer's Disease (AD) to find that the most significant differences between AD and controls occurred for k =2, in addition to AD showing increased IF w.r.t. controls. △ Less

Submitted 13 May, 2015; originally announced May 2015.

Comments: 47 pages, 5 figures, 4 tables, 3 supplementary figures. Accepted for publication in Brain Connectivity in its current form

Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI

Authors: Sebastiano Stramaglia, Leonardo Angelini, Guorong Wu, Jesus M. Cortés, Luca Faes, Daniele Marinazzo

Abstract: Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Grange… ▽ More Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data renders difficult to estimate the neat flow of information from each driver variable to a given target. We show that adopting an unnormalized definition of Granger causality one may put in evidence redundant multiplets of variables influencing the target by maximizing the total Granger causality to a given target, over all the possible partitions of the set of driving variables. Consequently we introduce a pairwise index of synergy which is zero when two independent sources additively influence the future state of the system, differently from previous definitions of synergy. Results: We report the application of the proposed approach to resting state fMRI data from the Human Connectome Project, showing that redundant pairs of regions arise mainly due to space contiguity and interhemispheric symmetry, whilst synergy occurs mainly between non-homologous pairs of regions in opposite hemispheres. Conclusions: Redundancy and synergy, in healthy resting brains, display characteristic patterns, revealed by the proposed approach. Significance: The pairwise synergy index, here introduced, maps the informational character of the system at hand into a weighted complex network: the same approach can be applied to other complex systems whose normal state corresponds to a balance between redundant and synergetic circuits. △ Less

Submitted 16 May, 2016; v1 submitted 14 April, 2015; originally announced April 2015.

Comments: 6 figures. arXiv admin note: text overlap with arXiv:1403.5156

Journal ref: Published in IEEE Transactions on Biomedical Engineering, 2016

Identification of redundant and synergetic circuits in triplets of electrophysiological data

Authors: Asier Erramuzpe, Guillermo J. Ortega, Jesus Pastor, Rafael G. de Sola, Daniele Marinazzo, Sebastiano Stramaglia, Jesus M. Cortes

Abstract: Neural systems are comprised of interacting units, and relevant information regarding their function or malfunction can be inferred by analyzing the statistical dependencies between the activity of each unit. Whilst correlations and mutual information are commonly used to characterize these dependencies, our objective here is to extend interactions to triplets of variables to better detect and cha… ▽ More Neural systems are comprised of interacting units, and relevant information regarding their function or malfunction can be inferred by analyzing the statistical dependencies between the activity of each unit. Whilst correlations and mutual information are commonly used to characterize these dependencies, our objective here is to extend interactions to triplets of variables to better detect and characterize dynamic information transfer. Our approach relies on the measure of interaction information (II). The sign of II provides information as to the extent to which the interaction of variables in triplets is redundant (R) or synergetic (S). Here, based on this approach, we calculated the R and S status for triplets of electrophysiological data recorded from drug-resistant patients with mesial temporal lobe epilepsy in order to study the spatial organization and dynamics of R and S close to the epileptogenic zone (the area responsible for seizure propagation). In terms of spatial organization, our results show that R matched the epileptogenic zone while S was distributed more in the surrounding area. In relation to dynamics, R made the largest contribution to high frequency bands (14-100Hz), whilst S was expressed more strongly at lower frequencies (1-7Hz). Thus, applying interaction information to such clinical data reveals new aspects of epileptogenic structure in terms of the nature (redundancy vs. synergy) and dynamics (fast vs. slow rhythms) of the interactions. We expect this methodology, robust and simple, can reveal new aspects beyond pair-interactions in networks of interacting units in other setups with multi-recording data sets (and thus, not necessarily in epilepsy, the pathology we have approached here). △ Less

Submitted 10 September, 2015; v1 submitted 27 April, 2014; originally announced April 2014.

Comments: 31 pages, 6 figures, 3 supplementary figures. To appear in the Journal of Neural Engineering in its current form

Synergy and redundancy in the Granger causal analysis of dynamical networks

Authors: Sebastiano Stramaglia, Jesus M. Cortes, Daniele Marinazzo

Abstract: We analyze by means of Granger causality the effect of synergy and redundancy in the inference (from time series data) of the information flow between subsystems of a complex network. Whilst we show that fully conditioned Granger causality is not affected by synergy, the pairwise analysis fails to put in evidence synergetic effects. In cases when the number of samples is low, thus making the ful… ▽ More We analyze by means of Granger causality the effect of synergy and redundancy in the inference (from time series data) of the information flow between subsystems of a complex network. Whilst we show that fully conditioned Granger causality is not affected by synergy, the pairwise analysis fails to put in evidence synergetic effects. In cases when the number of samples is low, thus making the fully conditioned approach unfeasible, we show that partially conditioned Granger causality is an effective approach if the set of conditioning variables is properly chosen. We consider here two different strategies (based either on informational content for the candidate driver or on selecting the variables with highest pairwise influences) for partially conditioned Granger causality and show that depending on the data structure either one or the other might be valid. On the other hand, we observe that fully conditioned approaches do not work well in presence of redundancy, thus suggesting the strategy of separating the pairwise links in two subsets: those corresponding to indirect connections of the fully conditioned Granger causality (which should thus be excluded) and links that can be ascribed to redundancy effects and, together with the results from the fully connected approach, provide a better description of the causality pattern in presence of redundancy. We finally apply these methods to two different real datasets. First, analyzing electrophysiological data from an epileptic brain, we show that synergetic effects are dominant just before seizure occurrences. Second, our analysis applied to gene expression time series from HeLa culture shows that the underlying regulatory networks are characterized by both redundancy and synergy. △ Less

Submitted 31 July, 2014; v1 submitted 20 March, 2014; originally announced March 2014.

Point-process deconvolution of fMRI reveals effective connectivity alterations in chronic pain patients

Authors: Guorong Wu, Enzo Tagliazucchi, Dante R. Chialvo, Daniele Marinazzo

Abstract: It is now recognized that important information can be extracted from the brain spontaneous activity, as exposed by recent analysis using a repertoire of computational methods. In this context a novel method, based on a blind deconvolution technique, is used in this paper to analyze potential changes due to chronic pain in the brain pain matrix's effective connectivity. The approach is able to dec… ▽ More It is now recognized that important information can be extracted from the brain spontaneous activity, as exposed by recent analysis using a repertoire of computational methods. In this context a novel method, based on a blind deconvolution technique, is used in this paper to analyze potential changes due to chronic pain in the brain pain matrix's effective connectivity. The approach is able to deconvolve the hemodynamic response function to spontaneous neural events, i.e., in the absence of explicit onset timings, and to evaluate information transfer between two regions as a joint probability of the occurrence of such spontaneous events. The method revealed that the chronic pain patients exhibit important changes in the Insula's effective connectivity which can be relevant to understand the overall impact of chronic pain on brain function. △ Less

Submitted 30 October, 2013; originally announced October 2013.

Information transfer of an Ising model on a brain network

Authors: Daniele Marinazzo, Mario Pellicoro, Guorong Wu, Leonardo Angelini, Jesus M Cortes, Sebastiano Stramaglia

Abstract: We implement the Ising model on a structural connectivity matrix describing the brain at a coarse scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find a maximal amount of total information transfer between the spin variables. At this point the amount of information that can be redistributed by some nodes reaches a limit and the net dynamics exhibits s… ▽ More We implement the Ising model on a structural connectivity matrix describing the brain at a coarse scale. Tuning the model temperature to its critical value, i.e. at the susceptibility peak, we find a maximal amount of total information transfer between the spin variables. At this point the amount of information that can be redistributed by some nodes reaches a limit and the net dynamics exhibits signature of the law of diminishing marginal returns, a fundamental principle connected to saturated levels of production. Our results extend the recent analysis of dynamical oscillators models on the connectome structure, taking into account lagged and directional influences, focusing only on the nodes that are more prone to became bottlenecks of information. The ratio between the outgoing and the incoming information at each node is related to the number of incoming links. △ Less

Submitted 1 September, 2013; v1 submitted 15 February, 2013; originally announced February 2013.

A blind deconvolution approach to recover effective connectivity brain networks from resting state fMRI data

Authors: G. Wu, W. Liao, S. Stramaglia, J. Ding, H. Chen, D. Marinazzo

Abstract: A great improvement to the insight on brain function that we can get from fMRI data can come from effective connectivity analysis, in which the flow of information between even remote brain regions is inferred by the parameters of a predictive dynamical model. As opposed to biologically inspired models, some techniques as Granger causality (GC) are purely data-driven and rely on statistical predic… ▽ More A great improvement to the insight on brain function that we can get from fMRI data can come from effective connectivity analysis, in which the flow of information between even remote brain regions is inferred by the parameters of a predictive dynamical model. As opposed to biologically inspired models, some techniques as Granger causality (GC) are purely data-driven and rely on statistical prediction and temporal precedence. While powerful and widely applicable, this approach could suffer from two main limitations when applied to BOLD fMRI data: confounding effect of hemodynamic response function (HRF) and conditioning to a large number of variables in presence of short time series. For task-related fMRI, neural population dynamics can be captured by modeling signal dynamics with explicit exogenous inputs; for resting-state fMRI on the other hand, the absence of explicit inputs makes this task more difficult, unless relying on some specific prior physiological hypothesis. In order to overcome these issues and to allow a more general approach, here we present a simple and novel blind-deconvolution technique for BOLD-fMRI signal. Coming to the second limitation, a fully multivariate conditioning with short and noisy data leads to computational problems due to overfitting. Furthermore, conceptual issues arise in presence of redundancy. We thus apply partial conditioning to a limited subset of variables in the framework of information theory, as recently proposed. Mixing these two improvements we compare the differences between BOLD and deconvolved BOLD level effective networks and draw some conclusions. △ Less

Submitted 18 August, 2012; originally announced August 2012.

Expanding the Transfer Entropy to Identify Information Subgraphs in Complex Systems

Authors: S. Stramaglia, Guo-Rong Wu, M. Pellicoro, D. Marinazzo

Abstract: We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion are associated to informational circuits present in the system, with an informational character which can be associated to the sign of the contribution. For th… ▽ More We propose a formal expansion of the transfer entropy to put in evidence irreducible sets of variables which provide information for the future state of each assigned target. Multiplets characterized by a large contribution to the expansion are associated to informational circuits present in the system, with an informational character which can be associated to the sign of the contribution. For the sake of computational complexity, we adopt the assumption of Gaussianity and use the corresponding exact formula for the conditional mutual information. We report the application of the proposed methodology on two EEG data sets. △ Less

Submitted 24 September, 2012; v1 submitted 14 March, 2012; originally announced March 2012.

Information flow in a network model and the law of diminishing marginal returns

Authors: Daniele Marinazzo, Mario Pellicoro, Guorong Wu, Leonardo Angelini, Sebastiano Stramaglia

Abstract: We analyze a simple dynamical network model which describes the limited capacity of nodes to process the input information. For a suitable choice of the parameters, the information flow pattern is characterized by exponential distribution of the incoming information and a fat-tailed distribution of the outgoing information, as a signature of the law of diminishing marginal returns. The analysis of… ▽ More We analyze a simple dynamical network model which describes the limited capacity of nodes to process the input information. For a suitable choice of the parameters, the information flow pattern is characterized by exponential distribution of the incoming information and a fat-tailed distribution of the outgoing information, as a signature of the law of diminishing marginal returns. The analysis of a real EEG data-set shows that similar phenomena may be relevant for brain signals. △ Less

Submitted 18 April, 2012; v1 submitted 22 February, 2012; originally announced February 2012.

Comments: 5 pages, 7 figures

Causal information approach to partial conditioning in multivariate data sets

Authors: Daniele Marinazzo, Mario Pellicoro, Sebastiano Stramaglia

Abstract: When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced number of samples, full conditioning can lead to computational and numerical problems. In this paper we address the problem of partial conditioning to a limited su… ▽ More When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced number of samples, full conditioning can lead to computational and numerical problems. In this paper we address the problem of partial conditioning to a limited subset of variables, in the framework of information theory. The proposed approach is tested on simulated datasets and on an example of intracranial EEG recording from an epileptic subject. We show that, in many instances, conditioning on a small number of variables, chosen as the most informative ones for the driver node, leads to results very close to those obtained with a fully multivariate analysis, and even better in the presence of a small number of samples. This is particularly relevant when the pattern of causalities is sparse. △ Less

Submitted 23 March, 2012; v1 submitted 2 November, 2011; originally announced November 2011.

Comments: accepted for publication in Computational and Mathematical Methods in Medicine, special issue on "Methodological Advances in Brain Connectivity"

Abnormal effective connectivity in migraine with aura under photic stimulation

Authors: Sebastiano Stramaglia, Daniele Marinazzo, Mario Pellicoro, Marina de Tommaso

Abstract: Migraine patients with aura show a peculiar pattern of visual reactivity compared with those of migraine patients without aura: an increased effective connectivity, connected to a reduced synchronization among EEG channels, for frequencies in the beta band. The effective connectivity is evaluated in terms of the Granger causality. This anomalous response to visual stimuli may play a crucial role i… ▽ More Migraine patients with aura show a peculiar pattern of visual reactivity compared with those of migraine patients without aura: an increased effective connectivity, connected to a reduced synchronization among EEG channels, for frequencies in the beta band. The effective connectivity is evaluated in terms of the Granger causality. This anomalous response to visual stimuli may play a crucial role in the progression of spreading depression and clinical evidences of aura symptoms. △ Less

Submitted 11 May, 2011; v1 submitted 13 April, 2011; originally announced April 2011.

Comments: 4 pages, 6 figures