-
Causal information approach to partial conditioning in multivariate data sets
Authors:
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced number of samples, full conditioning can lead to computational and numerical problems. In this paper we address the problem of partial conditioning to a limited su…
▽ More
When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced number of samples, full conditioning can lead to computational and numerical problems. In this paper we address the problem of partial conditioning to a limited subset of variables, in the framework of information theory. The proposed approach is tested on simulated datasets and on an example of intracranial EEG recording from an epileptic subject. We show that, in many instances, conditioning on a small number of variables, chosen as the most informative ones for the driver node, leads to results very close to those obtained with a fully multivariate analysis, and even better in the presence of a small number of samples. This is particularly relevant when the pattern of causalities is sparse.
△ Less
Submitted 23 March, 2012; v1 submitted 2 November, 2011;
originally announced November 2011.
-
Abnormal effective connectivity in migraine with aura under photic stimulation
Authors:
Sebastiano Stramaglia,
Daniele Marinazzo,
Mario Pellicoro,
Marina de Tommaso
Abstract:
Migraine patients with aura show a peculiar pattern of visual reactivity compared with those of migraine patients without aura: an increased effective connectivity, connected to a reduced synchronization among EEG channels, for frequencies in the beta band. The effective connectivity is evaluated in terms of the Granger causality. This anomalous response to visual stimuli may play a crucial role i…
▽ More
Migraine patients with aura show a peculiar pattern of visual reactivity compared with those of migraine patients without aura: an increased effective connectivity, connected to a reduced synchronization among EEG channels, for frequencies in the beta band. The effective connectivity is evaluated in terms of the Granger causality. This anomalous response to visual stimuli may play a crucial role in the progression of spreading depression and clinical evidences of aura symptoms.
△ Less
Submitted 11 May, 2011; v1 submitted 13 April, 2011;
originally announced April 2011.
-
The effect of neural adaptation of population coding accuracy
Authors:
J. M. Cortes,
D. Marinazzo,
P. Series,
M. W. Oram,
T. J. Sejnowski,
M. C. W. van Rossum
Abstract:
Most neurons in the primary visual cortex initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. The functional consequences of adaptation are unclear. Typically a reduction of firing rate would reduce single neuron accuracy as less spikes are available for decoding, but it has been suggested that on the population level, adaptation increases codin…
▽ More
Most neurons in the primary visual cortex initially respond vigorously when a preferred stimulus is presented, but adapt as stimulation continues. The functional consequences of adaptation are unclear. Typically a reduction of firing rate would reduce single neuron accuracy as less spikes are available for decoding, but it has been suggested that on the population level, adaptation increases coding accuracy. This question requires careful analysis as adaptation not only changes the firing rates of neurons, but also the neural variability and correlations between neurons, which affect coding accuracy as well. We calculate the coding accuracy using a computational model that implements two forms of adaptation: spike frequency adaptation and synaptic adaptation in the form of short-term synaptic plasticity. We find that the net effect of adaptation is subtle and heterogeneous. Depending on adaptation mechanism and test stimulus, adaptation can either increase or decrease coding accuracy. We discuss the neurophysiological and psychophysical implications of the findings and relate it to published experimental data.
△ Less
Submitted 14 March, 2011;
originally announced March 2011.
-
Grouping time series by pairwise measures of redundancy
Authors:
Daniele Marinazzo,
Wei Liao,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
A novel approach is proposed to group redundant time series in the frame of causality. It assumes that (i) the dynamics of the system can be described using just a small number of characteristic modes, and that (ii) a pairwise measure of redundancy is sufficient to elicit the presence of correlated degrees of freedom. We show the application of the proposed approach on fMRI data from a resting hum…
▽ More
A novel approach is proposed to group redundant time series in the frame of causality. It assumes that (i) the dynamics of the system can be described using just a small number of characteristic modes, and that (ii) a pairwise measure of redundancy is sufficient to elicit the presence of correlated degrees of freedom. We show the application of the proposed approach on fMRI data from a resting human brain and gene expression profiles from HeLa cell culture.
△ Less
Submitted 24 June, 2010;
originally announced June 2010.
-
Redundant variables and Granger causality
Authors:
L. Angelini,
M. de Tommaso,
D. Marinazzo,
L. Nitti,
M. Pellicoro,
S. Stramaglia
Abstract:
We discuss the use of multivariate Granger causality in presence of redundant variables: the application of the standard analysis, in this case, leads to under-estimation of causalities. Using the un-normalized version of the causality index, we quantitatively develop the notions of redundancy and synergy in the frame of causality and propose two approaches to group redundant variables: (i) for…
▽ More
We discuss the use of multivariate Granger causality in presence of redundant variables: the application of the standard analysis, in this case, leads to under-estimation of causalities. Using the un-normalized version of the causality index, we quantitatively develop the notions of redundancy and synergy in the frame of causality and propose two approaches to group redundant variables: (i) for a given target, the remaining variables are grouped so as to maximize the total causality and (ii) the whole set of variables is partitioned to maximize the sum of the causalities between subsets. We show the application to a real neurological experiment, aiming to a deeper understanding of the physiological basis of abnormal neuronal oscillations in the migraine brain. The outcome by our approach reveals the change in the informational pattern due to repetitive transcranial magnetic stimulations.
△ Less
Submitted 17 February, 2010; v1 submitted 28 September, 2009;
originally announced September 2009.
-
Phase diagram of a generalized Winfree model
Authors:
F. Giannuzzi,
D. Marinazzo,
G. Nardulli,
M. Pellicoro,
S. Stramaglia
Abstract:
We study the phase diagram of a generalized Winfree model. The modification is such that the coupling depends on the fraction of synchronized oscillators, a situation which has been noted in some experiments on coupled Josephson junctions and mechanical systems. We let the global coupling k be a function of the Kuramoto order parameter r through an exponent z such that z=1 corresponds to the sta…
▽ More
We study the phase diagram of a generalized Winfree model. The modification is such that the coupling depends on the fraction of synchronized oscillators, a situation which has been noted in some experiments on coupled Josephson junctions and mechanical systems. We let the global coupling k be a function of the Kuramoto order parameter r through an exponent z such that z=1 corresponds to the standard Winfree model, z<1 strengthens the coupling at low r (low amount of synchronization) and, at z>1, the coupling is weakened for low r. Using both analytical and numerical approaches, we find that z controls the size of the incoherent phase region, and one may make the incoherent behavior less typical by choosing z<1. We also find that the original Winfree model is a rather special case, indeed the partial locked behavior disappears for z>1. At fixed k and varying gamma, the stability boundary of the locked phase corresponds to a transition that is continuous for z<1 and first-order for z>1. This change in the nature of the transition is in accordance with a previous study on a similarly modified Kuramoto model.
△ Less
Submitted 24 July, 2008;
originally announced July 2008.
-
Kernel Granger causality and the analysis of dynamical networks
Authors:
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
We propose a method of analysis of dynamical networks based on a recent measure of Granger causality between time series, based on kernel methods. The generalization of kernel Granger causality to the multivariate case, here presented, shares the following features with the bivariate measures: (i) the nonlinearity of the regression model can be controlled by choosing the kernel function and (ii)…
▽ More
We propose a method of analysis of dynamical networks based on a recent measure of Granger causality between time series, based on kernel methods. The generalization of kernel Granger causality to the multivariate case, here presented, shares the following features with the bivariate measures: (i) the nonlinearity of the regression model can be controlled by choosing the kernel function and (ii) the problem of false-causalities, arising as the complexity of the model increases, is addressed by a selection strategy of the eigenvectors of a reduced Gram matrix whose range represents the additional features due to the second time series. Moreover, there is no {\it a priori} assumption that the network must be a directed acyclic graph. We apply the proposed approach to a network of chaotic maps and to a simulated genetic regulatory network: it is shown that the underlying topology of the network can be reconstructed from time series of node's dynamics, provided that a sufficient number of samples is available. Considering a linear dynamical network, built by preferential attachment scheme, we show that for limited data use of bivariate Granger causality is a better choice w.r.t methods using $L1$ minimization. Finally we consider real expression data from HeLa cells, 94 genes and 48 time points. The analysis of static correlations between genes reveals two modules corresponding to well known transcription factors; Granger analysis puts in evidence nineteen causal relationships, all involving genes related to tumor development.
△ Less
Submitted 20 March, 2008;
originally announced March 2008.
-
Kernel method for nonlinear Granger causality
Authors:
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
Important information on the structure of complex systems, consisting of more than one component, can be obtained by measuring to which extent the individual components exchange information among each other. Such knowledge is needed to reach a deeper comprehension of phenomena ranging from turbulent fluids to neural networks, as well as complex physiological signals. The linear Granger approach,…
▽ More
Important information on the structure of complex systems, consisting of more than one component, can be obtained by measuring to which extent the individual components exchange information among each other. Such knowledge is needed to reach a deeper comprehension of phenomena ranging from turbulent fluids to neural networks, as well as complex physiological signals. The linear Granger approach, to detect cause-effect relationships between time series, has emerged in recent years as a leading statistical technique to accomplish this task. Here we generalize Granger causality to the nonlinear case using the theory of reproducing kernel Hilbert spaces. Our method performs linear Granger causality in the feature space of suitable kernel functions, assuming arbitrary degree of nonlinearity. We develop a new strategy to cope with the problem of overfitting, based on the geometry of reproducing kernel Hilbert spaces. Applications to coupled chaotic maps and physiological data sets are presented.
△ Less
Submitted 20 March, 2008; v1 submitted 16 November, 2007;
originally announced November 2007.
-
Semi-supervised learning by search of optimal target vector
Authors:
Leonardo Angelini,
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
We introduce a semi-supervised learning estimator which tends to the first kernel principal component as the number of labelled points vanishes. Our approach is based on the notion of optimal target vector, which is defined as follows. Given an input data-set of ${\bf x}$ values, the optimal target vector $\mathbf{y}$ is such that treating it as the target and using kernel ridge regression to mo…
▽ More
We introduce a semi-supervised learning estimator which tends to the first kernel principal component as the number of labelled points vanishes. Our approach is based on the notion of optimal target vector, which is defined as follows. Given an input data-set of ${\bf x}$ values, the optimal target vector $\mathbf{y}$ is such that treating it as the target and using kernel ridge regression to model the dependency of $y$ on ${\bf x}$, the training error achieves its minimum value. For an unlabeled data set, the first kernel principal component is the optimal vector. In the case one is given a partially labeled data set, still one may look for the optimal target vector minimizing the training error. We use this new estimator in two directions. As a substitute of kernel principal component analysis, in the case one has some labeled data, to produce dimensionality reduction. Second, to develop a semi-supervised regression and classification algorithm for transductive inference. We show application of the proposed method in both directions.
△ Less
Submitted 12 October, 2006;
originally announced October 2006.
-
Identification of network modules by optimization of ratio association
Authors:
Leonardo Angelini,
Stefano Boccaletti,
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
We introduce a novel method for identifying the modular structures of a network based on the maximization of an objective function: the ratio association. This cost function arises when the communities detection problem is described in the probabilistic autoencoder frame. An analogy with kernel k-means methods allows to develop an efficient optimization algorithm, based on the deterministic anne…
▽ More
We introduce a novel method for identifying the modular structures of a network based on the maximization of an objective function: the ratio association. This cost function arises when the communities detection problem is described in the probabilistic autoencoder frame. An analogy with kernel k-means methods allows to develop an efficient optimization algorithm, based on the deterministic annealing scheme. The performance of the proposed method is shown on a real data set and on simulated networks.
△ Less
Submitted 3 January, 2007; v1 submitted 6 October, 2006;
originally announced October 2006.
-
Causal interactions and delays in a neuronal ensemble
Authors:
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
We analyze a neural system which mimics a sensorial cortex, with different input characteristics, in presence of transmission delays. We propose a new measure to characterize collective behavior, based on the nonlinear extension of the concept of Granger causality, and an interpretation is given of the variation of the percentage of the causally relevant interactions with transmission delays.
We analyze a neural system which mimics a sensorial cortex, with different input characteristics, in presence of transmission delays. We propose a new measure to characterize collective behavior, based on the nonlinear extension of the concept of Granger causality, and an interpretation is given of the variation of the percentage of the causally relevant interactions with transmission delays.
△ Less
Submitted 20 September, 2006;
originally announced September 2006.
-
Natural clustering: the modularity approach
Authors:
L. Angelini,
D. Marinazzo,
M. Pellicoro,
S. Stramaglia
Abstract:
We show that modularity, a quantity introduced in the study of networked systems, can be generalized and used in the clustering problem as an indicator for the quality of the solution. The introduction of this measure arises very naturally in the case of clustering algorithms that are rooted in Statistical Mechanics and use the analogy with a physical system.
We show that modularity, a quantity introduced in the study of networked systems, can be generalized and used in the clustering problem as an indicator for the quality of the solution. The introduction of this measure arises very naturally in the case of clustering algorithms that are rooted in Statistical Mechanics and use the analogy with a physical system.
△ Less
Submitted 22 May, 2007; v1 submitted 25 July, 2006;
originally announced July 2006.
-
Nonlinear parametric model for Granger causality of time series
Authors:
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
We generalize a previously proposed approach for nonlinear Granger causality of time series, based on radial basis function. The proposed model is not constrained to be additive in variables from the two time series and can approximate any function of these variables, still being suitable to evaluate causality. Usefulness of this measure of causality is shown in a physiological example and in th…
▽ More
We generalize a previously proposed approach for nonlinear Granger causality of time series, based on radial basis function. The proposed model is not constrained to be additive in variables from the two time series and can approximate any function of these variables, still being suitable to evaluate causality. Usefulness of this measure of causality is shown in a physiological example and in the study of the feed-back loop in a model of excitatory and inhibitory neurons.
△ Less
Submitted 7 February, 2006;
originally announced February 2006.
-
Kernel method for clustering based on optimal target vector
Authors:
Leonardo Angelini,
Daniele Marinazzo,
Mario Pellicoro,
Sebastiano Stramaglia
Abstract:
We introduce the notion of optimal target vector, and describe how it creates a link between supervised and unsupervised learning. We exploit this notion to construct Ising models, for dichotomic clustering, whose couplings are (i) both ferro- and anti-ferromagnetic (ii) depending on the whole data-set and not only on pairs of samples. The effectiveness of the method is shown in the case of the…
▽ More
We introduce the notion of optimal target vector, and describe how it creates a link between supervised and unsupervised learning. We exploit this notion to construct Ising models, for dichotomic clustering, whose couplings are (i) both ferro- and anti-ferromagnetic (ii) depending on the whole data-set and not only on pairs of samples. The effectiveness of the method is shown in the case of the well known iris data-set and in benchmarks of gene expression levels.
△ Less
Submitted 25 November, 2005;
originally announced November 2005.
-
Multiscale analysis of heart rate, blood pressure and respiration time series
Authors:
L. Angelini,
R. Maestri,
D. Marinazzo,
L. Nitti,
M. Pellicoro,
G. D. Pinna,
S. Stramaglia,
S. A. Tupputi
Abstract:
We present the multiscale entropy analysis of short term physiological time series of simultaneously acquired samples of heart rate, blood pressure and lung volume, from healthy subjects and from subjects with Chronic Heart Failure. Evaluating the complexity of signals at the multiple time scales inherent in physiologic dynamics, we find that healthy subjects show more complex time series at lar…
▽ More
We present the multiscale entropy analysis of short term physiological time series of simultaneously acquired samples of heart rate, blood pressure and lung volume, from healthy subjects and from subjects with Chronic Heart Failure. Evaluating the complexity of signals at the multiple time scales inherent in physiologic dynamics, we find that healthy subjects show more complex time series at large time scales; on the other hand, at fast time scales, which are more influenced by respiration, the pathologic dynamics of blood pressure is the most random. These results robustly separate healthy and pathologic groups. We also propose a multiscale approach to evaluate interactions between time series, by performing a multivariate autoregressive modelling of the coarse grained time series: this analysis provides several new quantitative indicators which are statistically correlated with the pathology.
△ Less
Submitted 28 October, 2005;
originally announced October 2005.
-
Leave-one-out prediction error of systolic arterial pressure time series under paced breathing
Authors:
N. Ancona,
R. Maestri,
D. Marinazzo,
L. Nitti,
M. Pellicoro,
G. D. Pinna,
S. Stramaglia
Abstract:
In this paper we show that different physiological states and pathological conditions may be characterized in terms of predictability of time series signals from the underlying biological system. In particular we consider systolic arterial pressure time series from healthy subjects and Chronic Heart Failure patients, undergoing paced respiration. We model time series by the regularized least squ…
▽ More
In this paper we show that different physiological states and pathological conditions may be characterized in terms of predictability of time series signals from the underlying biological system. In particular we consider systolic arterial pressure time series from healthy subjects and Chronic Heart Failure patients, undergoing paced respiration. We model time series by the regularized least squares approach and quantify predictability by the leave-one-out error. We find that the entrainment mechanism connected to paced breath, that renders the arterial blood pressure signal more regular, thus more predictable, is less effective in patients, and this effect correlates with the seriousness of the heart failure. The leave-one-out error separates controls from patients and, when all orders of nonlinearity are taken into account, alive patients from patients for which cardiac death occurred.
△ Less
Submitted 22 November, 2004;
originally announced November 2004.
-
Extending Granger causality to nonlinear systems
Authors:
Nicola Ancona,
Daniele Marinazzo,
Sebastiano Stramaglia
Abstract:
We consider extension of Granger causality to nonlinear bivariate time series. In this frame, if the prediction error of the first time series is reduced by including measurements from the second time series, then the second time series is said to have a causal influence on the first one. Not all the nonlinear prediction schemes are suitable to evaluate causality, indeed not all of them allow to…
▽ More
We consider extension of Granger causality to nonlinear bivariate time series. In this frame, if the prediction error of the first time series is reduced by including measurements from the second time series, then the second time series is said to have a causal influence on the first one. Not all the nonlinear prediction schemes are suitable to evaluate causality, indeed not all of them allow to quantify how much the knowledge of the other time series counts to improve prediction error. We present a novel approach with bivariate time series modelled by a generalization of radial basis functions and show its application to a pair of unidirectionally coupled chaotic maps and to a physiological example.
△ Less
Submitted 3 May, 2004;
originally announced May 2004.
-
Steady-state visual evoked potentials and phase synchronization in migraine
Authors:
L. Angelini,
M. De Tommaso,
M. Guido,
K. Hu,
P. Ch. Ivanov,
D. Marinazzo,
G. Nardulli,
L. Nitti,
M. Pellicoro,
C. Pierro,
S. Stramaglia
Abstract:
We investigate phase synchronization in EEG recordings from migraine patients. We use the analytic signal technique, based on the Hilbert transform, and find that migraine brains are characterized by enhanced alpha band phase synchronization in presence of visual stimuli. Our findings show that migraine patients have an overactive regulatory mechanism that renders them more sensitive to external…
▽ More
We investigate phase synchronization in EEG recordings from migraine patients. We use the analytic signal technique, based on the Hilbert transform, and find that migraine brains are characterized by enhanced alpha band phase synchronization in presence of visual stimuli. Our findings show that migraine patients have an overactive regulatory mechanism that renders them more sensitive to external stimuli.
△ Less
Submitted 5 April, 2004;
originally announced April 2004.
-
Phase shifts of synchronized oscillators and the systolic/diastolic blood pressure relation
Authors:
L. Angelini,
G. Lattanzi,
R. Maestri,
D. Marinazzo,
G. Nardulli,
L. Nitti,
M. Pellicoro,
G. D. Pinna,
S. Stramaglia
Abstract:
We study the phase-synchronization properties of systolic and diastolic arterial pressure in healthy subjects. We find that delays in the oscillatory components of the time series depend on the frequency bands that are considered, in particular we find a change of sign in the phase shift going from the Very Low Frequency band to the High Frequency band. This behavior should reflect a collective…
▽ More
We study the phase-synchronization properties of systolic and diastolic arterial pressure in healthy subjects. We find that delays in the oscillatory components of the time series depend on the frequency bands that are considered, in particular we find a change of sign in the phase shift going from the Very Low Frequency band to the High Frequency band. This behavior should reflect a collective behavior of a system of nonlinear interacting elementary oscillators. We prove that some models describing such systems, e.g. the Winfree and the Kuramoto models offer a clue to this phenomenon. For these theoretical models there is a linear relationship between phase shifts and the difference of natural frequencies of oscillators and a change of sign in the phase shift naturally emerges.
△ Less
Submitted 19 February, 2004;
originally announced February 2004.
