Showing 1–35 of 35 results for author: Wit, E C

Functional structural equation models with out-of-sample guarantees

Authors: Philip Kennerberg, Ernst C. Wit

Abstract: Statistical learning methods typically assume that the training and test data originate from the same distribution, enabling effective risk minimization. However, real-world applications frequently involve distributional shifts, leading to poor model generalization. To address this, recent advances in causal inference and robust learning have introduced strategies such as invariant causal predicti… ▽ More Statistical learning methods typically assume that the training and test data originate from the same distribution, enabling effective risk minimization. However, real-world applications frequently involve distributional shifts, leading to poor model generalization. To address this, recent advances in causal inference and robust learning have introduced strategies such as invariant causal prediction and anchor regression. While these approaches have been explored for traditional structural equation models (SEMs), their extension to functional systems remains limited. This paper develops a risk minimization framework for functional SEMs using linear, potentially unbounded operators. We introduce a functional worst-risk minimization approach, ensuring robust predictive performance across shifted environments. Our key contribution is a novel worst-risk decomposition theorem, which expresses the maximum out-of-sample risk in terms of observed environments. We establish conditions for the existence and uniqueness of the worst-risk minimizer and provide consistent estimation procedures. Empirical results on functional systems illustrate the advantages of our method in mitigating distributional shifts. These findings contribute to the growing literature on robust functional regression and causal learning, offering practical guarantees for out-of-sample generalization in dynamic environments. △ Less

Submitted 25 March, 2025; originally announced March 2025.

Comments: 17 pages, 4 figures, with supplementary materials containing proofs. arXiv admin note: text overlap with arXiv:2412.00412

MSC Class: 62R10

Causal drivers of dynamic networks

Authors: Melania Lembo, Ester Riccardi, Veronica Vinciotti, Ernst C. Wit

Abstract: Dynamic networks models describe temporal interactions between social actors, and as such have been used to describe financial fraudulent transactions, dispersion of destructive invasive species across the globe, and the spread of fake news. An important question in all of these examples is what are the causal drivers underlying these processes. Current network models are exclusively descriptive a… ▽ More Dynamic networks models describe temporal interactions between social actors, and as such have been used to describe financial fraudulent transactions, dispersion of destructive invasive species across the globe, and the spread of fake news. An important question in all of these examples is what are the causal drivers underlying these processes. Current network models are exclusively descriptive and based on correlative structures. In this paper we propose a causal extension of dynamic network modelling. In particular, we prove that the causal model satisfies a set of population conditions that uniquely identifies the causal drivers. The empirical analogue of these conditions provide a consistent causal discovery algorithm, which distinguishes it from other inferential approaches. Crucially, data from a single environment is sufficient. We apply the method in an analysis of bike sharing data in Washington D.C. in July 2023. △ Less

Submitted 5 March, 2025; originally announced March 2025.

Inferring the dynamics of quasi-reaction systems via nonlinear local mean-field approximations

Authors: Matteo Framba, Veronica Vinciotti, Ernst C. Wit

Abstract: In the modelling of stochastic phenomena, such as quasi-reaction systems, parameter estimation of kinetic rates can be challenging, particularly when the time gap between consecutive measurements is large. Local linear approximation approaches account for the stochasticity in the system but fail to capture the nonlinear nature of the underlying process. At the mean level, the dynamics of the syste… ▽ More In the modelling of stochastic phenomena, such as quasi-reaction systems, parameter estimation of kinetic rates can be challenging, particularly when the time gap between consecutive measurements is large. Local linear approximation approaches account for the stochasticity in the system but fail to capture the nonlinear nature of the underlying process. At the mean level, the dynamics of the system can be described by a system of ODEs, which have an explicit solution only for simple unitary systems. An analytical solution for generic quasi-reaction systems is proposed via a first order Taylor approximation of the hazard rate. This allows a nonlinear forward prediction of the future dynamics given the current state of the system. Predictions and corresponding observations are embedded in a nonlinear least-squares approach for parameter estimation. The performance of the algorithm is compared to existing SDE and ODE-based methods via a simulation study. Besides the increased computational efficiency of the approach, the results show an improvement in the kinetic rate estimation, particularly for data observed at large time intervals. Additionally, the availability of an explicit solution makes the method robust to stiffness, which is often present in biological systems. An illustration on Rhesus Macaque data shows the applicability of the approach to the study of cell differentiation. △ Less

Submitted 17 October, 2024; originally announced October 2024.

Some statistical aspects of the Covid-19 response

Authors: Simon N. Wood, Ernst C. Wit, Paul M. McKeigue, Danshu Hu, Beth Flood, Lauren Corcoran, Thea Abou Jawad

Abstract: This paper discusses some statistical aspects of the U.K. Covid-19 pandemic response, focussing particularly on cases where we believe that a statistically questionable approach or presentation has had a substantial impact on public perception, or government policy, or both. We discuss the presentation of statistics relating to Covid risk, and the risk of the response measures, arguing that biases… ▽ More This paper discusses some statistical aspects of the U.K. Covid-19 pandemic response, focussing particularly on cases where we believe that a statistically questionable approach or presentation has had a substantial impact on public perception, or government policy, or both. We discuss the presentation of statistics relating to Covid risk, and the risk of the response measures, arguing that biases tended to operate in opposite directions, overplaying Covid risk and underplaying the response risks. We also discuss some issues around presentation of life loss data, excess deaths and the use of case data. The consequences of neglect of most individual variability from epidemic models, alongside the consequences of some other statistically important omissions are also covered. Finally the evidence for full stay at home lockdowns having been necessary to reverse waves of infection is examined, with new analyses provided for a number of European countries. △ Less

Submitted 5 February, 2025; v1 submitted 10 September, 2024; originally announced September 2024.

Comments: Version finally accepted by Journal of the Royal Statistical Society (Series A) as a discussion paper

Bayesian Dynamic Generalized Additive Model for Mortality during COVID-19 Pandemic

Authors: Wei Zhang, Antonietta Mira, Ernst C. Wit

Abstract: While COVID-19 has resulted in a significant increase in global mortality rates, the impact of the pandemic on mortality from other causes remains uncertain. To gain insight into the broader effects of COVID-19 on various causes of death, we analyze an Italian dataset that includes monthly mortality counts for different causes from January 2015 to December 2020. Our approach involves a generalized… ▽ More While COVID-19 has resulted in a significant increase in global mortality rates, the impact of the pandemic on mortality from other causes remains uncertain. To gain insight into the broader effects of COVID-19 on various causes of death, we analyze an Italian dataset that includes monthly mortality counts for different causes from January 2015 to December 2020. Our approach involves a generalized additive model enhanced with correlated random effects. The generalized additive model component effectively captures non-linear relationships between various covariates and mortality rates, while the random effects are multivariate time series observations recorded in various locations, and they embody information on the dependence structure present among geographical locations and different causes of mortality. Adopting a Bayesian framework, we impose suitable priors on the model parameters. For efficient posterior computation, we employ variational inference, specifically for fixed effect coefficients and random effects, Gaussian variational approximation is assumed, which streamlines the analysis process. The optimisation is performed using a coordinate ascent variational inference algorithm and several computational strategies are implemented along the way to address the issues arising from the high dimensional nature of the data, providing accelerated and stabilised parameter estimation and statistical inference. △ Less

Submitted 3 September, 2024; originally announced September 2024.

Causal generalized linear models via Pearson risk invariance

Authors: Alice Polinelli, Veronica Vinciotti, Ernst C. Wit

Abstract: Prediction invariance of causal models under heterogeneous settings has been exploited by a number of recent methods for causal discovery, typically focussing on recovering the causal parents of a target variable of interest. Existing methods require observational data from a number of sufficiently different environments, which is rarely available. In this paper, we consider a structural equation… ▽ More Prediction invariance of causal models under heterogeneous settings has been exploited by a number of recent methods for causal discovery, typically focussing on recovering the causal parents of a target variable of interest. Existing methods require observational data from a number of sufficiently different environments, which is rarely available. In this paper, we consider a structural equation model where the target variable is described by a generalized linear model conditional on its parents. Besides having finite moments, no modelling assumptions are made on the conditional distributions of the other variables in the system, and nonlinear effects on the target variable can naturally be accommodated by a generalized additive structure. Under this setting, we characterize the causal model uniquely by means of two key properties: the Pearson risk invariant under the causal model and, conditional on the causal parents, the causal parameters maximize the expected likelihood. These two properties form the basis of a computational strategy for searching the causal model among all possible models. A stepwise greedy search is proposed for systems with a large number of variables. Crucially, for generalized linear models with a known dispersion parameter, such as Poisson and logistic regression, the causal model can be identified from a single data environment. The method is implemented in the R package causalreg. △ Less

Submitted 10 April, 2025; v1 submitted 23 July, 2024; originally announced July 2024.

Goodness of fit of relational event models

Authors: Martina Boschi, Ernst-Jan Camiel Wit

Abstract: A type of dynamic network involves temporally ordered interactions between actors, where past network configurations may influence future ones. The relational event model can be used to identify the underlying dynamics that drive interactions among system components. Despite the rapid development of this model over the past 15 years, an ongoing area of research revolves around evaluating the goodn… ▽ More A type of dynamic network involves temporally ordered interactions between actors, where past network configurations may influence future ones. The relational event model can be used to identify the underlying dynamics that drive interactions among system components. Despite the rapid development of this model over the past 15 years, an ongoing area of research revolves around evaluating the goodness of fit of this model, especially when it incorporates time-varying and random effects. Current methodologies often rely on comparing observed and simulated events using specific statistics, but this can be computationally intensive, and requires various assumptions. We propose an additive mixed-effect relational event model estimated via case-control sampling, and introduce a versatile framework for testing the goodness of fit of such models using weighted martingale residuals. Our focus is on a Kolmogorov-Smirnov type test designed to assess if covariates are accurately modeled. Our approach can be easily extended to evaluate whether other features of network dynamics have been appropriately incorporated into the model. We assess the goodness of fit of various relational event models using synthetic data to evaluate the test's power and coverage. Furthermore, we apply the method to a social study involving 57,791 emails sent by 159 employees of a Polish manufacturing company in 2010. The method is implemented in the R package mgcv. △ Less

Submitted 11 July, 2024; originally announced July 2024.

Relational event models with global covariates

Authors: Melania Lembo, Rūta Juozaitienė, Veronica Vinciotti, Ernst C. Wit

Abstract: Bike sharing is an increasingly popular mobility choice as it is a sustainable, healthy and economically viable transportation mode. By interpreting rides between bike stations over time as temporal events connecting two bike stations, relational event models can provide important insights into this phenomenon. The focus of relational event models, as a typical event history model, is normally on… ▽ More Bike sharing is an increasingly popular mobility choice as it is a sustainable, healthy and economically viable transportation mode. By interpreting rides between bike stations over time as temporal events connecting two bike stations, relational event models can provide important insights into this phenomenon. The focus of relational event models, as a typical event history model, is normally on dyadic or node-specific covariates, as global covariates are considered nuisance parameters in a partial likelihood approach. As full likelihood approaches are infeasible given the sheer size of the relational process, we propose an innovative sampling approach of temporally shifted non-events to recover important global drivers of the relational process. The method combines nested case-control sampling on a time-shifted version of the event process. This leads to a partial likelihood of the relational event process that is identical to that of a degenerate logistic additive model, enabling efficient estimation of both global and non-global covariate effects. The computational effectiveness of the method is demonstrated through a simulation study. The analysis of around 350,000 bike rides in the Washington D.C. area reveals significant influences of weather and time of day on bike sharing dynamics, besides a number of traditional node-specific and dyadic covariates. △ Less

Submitted 14 December, 2024; v1 submitted 13 June, 2024; originally announced June 2024.

Functional Gaussian Graphical Regression Models For Air Quality Data

Authors: Rita Fici, Gianluca Sottile, Luigi Augugliaro, Ernst-Jan Camiel Wit

Abstract: Functional data describe a wide range of processes, such as growth curves and spectral absorption. In this study, we analyze air pollution data from the In-service Aircraft for a Global Observing System, focusing on the spatial interactions among chemicals in the atmosphere and their dependence on meteorological conditions. This requires functional regression, where both response and covariates ar… ▽ More Functional data describe a wide range of processes, such as growth curves and spectral absorption. In this study, we analyze air pollution data from the In-service Aircraft for a Global Observing System, focusing on the spatial interactions among chemicals in the atmosphere and their dependence on meteorological conditions. This requires functional regression, where both response and covariates are functional objects evolving over the troposphere. Evaluating both the functional relatedness between the response and covariates and the relatedness of a multivariate response function can be challenging. We propose a solution to these challenges by introducing a functional Gaussian graphical regression model, extending conditional Gaussian graphical models to partially separable functions. To estimate the model, we propose a doubly-penalized estimator. Additionally, we present a novel adaptation of Kullback-Leibler cross-validation tailored for graph estimators which accounts for precision and regression matrices when the population presents one or more sub-groups, named joint Kullback-Leibler cross-validation. Evaluation of model performance is done in terms of Kullback-Leibler divergence and graph recovery power. △ Less

Submitted 13 November, 2024; v1 submitted 18 January, 2024; originally announced January 2024.

Comments: 41 pages

Modeling non-linear Effects with Neural Networks in Relational Event Models

Authors: Edoardo Filippi-Mazzola, Ernst C. Wit

Abstract: Dynamic networks offer an insight of how relational systems evolve. However, modeling these networks efficiently remains a challenge, primarily due to computational constraints, especially as the number of observed events grows. This paper addresses this issue by introducing the Deep Relational Event Additive Model (DREAM) as a solution to the computational challenges presented by modeling non-lin… ▽ More Dynamic networks offer an insight of how relational systems evolve. However, modeling these networks efficiently remains a challenge, primarily due to computational constraints, especially as the number of observed events grows. This paper addresses this issue by introducing the Deep Relational Event Additive Model (DREAM) as a solution to the computational challenges presented by modeling non-linear effects in Relational Event Models (REMs). DREAM relies on Neural Additive Models to model non-linear effects, allowing each effect to be captured by an independent neural network. By strategically trading computational complexity for improved memory management and leveraging the computational capabilities of Graphic Processor Units (GPUs), DREAM efficiently captures complex non-linear relationships within data. This approach demonstrates the capability of DREAM in modeling dynamic networks and scaling to larger networks. Comparisons with traditional REM approaches showcase DREAM superior computational efficiency. The model potential is further demonstrated by an examination of the patent citation network, which contains nearly 8 million nodes and 100 million events. △ Less

Submitted 19 December, 2023; originally announced December 2023.

Joint modelling of national cultures accounting for within and between-country heterogeneity

Authors: Veronica Vinciotti, Luca De Benedictis, Ernst C. Wit

Abstract: Cultural values vary significantly around the world. Despite a large heterogeneity, similarities across national cultures are present. This paper studies cross-country culture heterogeneity via the joint inference of country-specific copula graphical models from world-wide survey data. To this end, a random graph generative model of the cultural networks is introduced, with a latent space and prox… ▽ More Cultural values vary significantly around the world. Despite a large heterogeneity, similarities across national cultures are present. This paper studies cross-country culture heterogeneity via the joint inference of country-specific copula graphical models from world-wide survey data. To this end, a random graph generative model of the cultural networks is introduced, with a latent space and proximity measures that embed cultural relatedness across countries. Within-country heterogeneity is also accounted for, via parametric modelling of the marginal distributions of each cultural trait. All together, the different components of the model are able to identify several dimensions of culture. △ Less

Submitted 21 December, 2023; v1 submitted 24 November, 2023; originally announced November 2023.

Latent event history models for quasi-reaction systems

Authors: Matteo Framba, Veronica Vinciotti, Ernst C. Wit

Abstract: Various processes can be modelled as quasi-reaction systems of stochastic differential equations, such as cell differentiation and disease spreading. Since the underlying data of particle interactions, such as reactions between proteins or contacts between people, are typically unobserved, statistical inference of the parameters driving these systems is developed from concentration data measuring… ▽ More Various processes can be modelled as quasi-reaction systems of stochastic differential equations, such as cell differentiation and disease spreading. Since the underlying data of particle interactions, such as reactions between proteins or contacts between people, are typically unobserved, statistical inference of the parameters driving these systems is developed from concentration data measuring each unit in the system over time. While observing the continuous time process at a time scale as fine as possible should in theory help with parameter estimation, the existing Local Linear Approximation (LLA) methods fail in this case, due to numerical instability caused by small changes of the system at successive time points. On the other hand, one may be able to reconstruct the underlying unobserved interactions from the observed count data. Motivated by this, we first formalise the latent event history model underlying the observed count process. We then propose a computationally efficient Expectation-Maximation algorithm for parameter estimation, with an extended Kalman filtering procedure for the prediction of the latent states. A simulation study shows the performance of the proposed method and highlights the settings where it is particularly advantageous compared to the existing LLA approaches. Finally, we present an illustration of the methodology on the spreading of the COVID-19 pandemic in Italy. △ Less

Submitted 25 October, 2023; originally announced October 2023.

Bayesian Poisson Regression and Tensor Train Decomposition Model for Learning Mortality Pattern Changes during COVID-19 Pandemic

Authors: Wei Zhang, Antonietta Mira, Ernst C. Wit

Abstract: COVID-19 has led to excess deaths around the world, however it remains unclear how the mortality of other causes of death has changed during the pandemic. Aiming at understanding the wider impact of COVID-19 on other death causes, we study Italian data set that consists of monthly mortality counts of different causes from January 2015 to December 2020. Due to the high dimensional nature of the dat… ▽ More COVID-19 has led to excess deaths around the world, however it remains unclear how the mortality of other causes of death has changed during the pandemic. Aiming at understanding the wider impact of COVID-19 on other death causes, we study Italian data set that consists of monthly mortality counts of different causes from January 2015 to December 2020. Due to the high dimensional nature of the data, we develop a model which combines conventional Poisson regression with tensor train decomposition to explore the lower dimensional residual structure of the data. We take a Bayesian approach, impose priors on model parameters. Posterior inference is performed using an efficient Metropolis-Hastings within Gibbs algorithm. The validity of our approach is tested in simulation studies. Our method not only identifies differential effects of interventions on cause specific mortality rates through the Poisson regression component, but also offers informative interpretations of the relationship between COVID-19 and other causes of death as well as latent classes that underline demographic characteristics, temporal patterns and causes of death respectively. △ Less

Submitted 11 July, 2023; originally announced July 2023.

Relational Event Modeling

Authors: Federica Bianchi, Edoardo Filippi-Mazzola, Alessandro Lomi, Ernst C. Wit

Abstract: Advances in information technology have increased the availability of time-stamped relational data such as those produced by email exchanges or interaction through social media. Whereas the associated information flows could be aggregated into cross-sectional panels, the temporal ordering of the events frequently contains information that requires new models for the analysis of continuous-time int… ▽ More Advances in information technology have increased the availability of time-stamped relational data such as those produced by email exchanges or interaction through social media. Whereas the associated information flows could be aggregated into cross-sectional panels, the temporal ordering of the events frequently contains information that requires new models for the analysis of continuous-time interactions, subject to both endogenous and exogenous influences. The introduction of the Relational Event Model (REM) has been a major development that has led to further methodological improvements stimulated by new questions that REMs made possible. In this review, we track the intellectual history of the REM, define its core properties, and discuss why and how it has been considered useful in empirical research. We describe how the demands of novel applications have stimulated methodological, computational, and inferential advancements. △ Less

Submitted 30 June, 2023; originally announced June 2023.

Comments: 22 pages, 1 figure, 1 table

Efficient implementation of sets and multisets in R using hash tables

Authors: Giacomo Ceoldo, Ernst C. Wit

Abstract: The package hset for the R language contains an implementation of a S4 class for sets and multisets of numbers. The implementation, based on the hash table data structure from the package hash (Brown, 2019), allows for quick operations when the set is a dynamic object. An important example is when a set or a multiset is part of the state of a Markov chain in which in each iteration various element… ▽ More The package hset for the R language contains an implementation of a S4 class for sets and multisets of numbers. The implementation, based on the hash table data structure from the package hash (Brown, 2019), allows for quick operations when the set is a dynamic object. An important example is when a set or a multiset is part of the state of a Markov chain in which in each iteration various elements are moved in and out of the set. △ Less

Submitted 19 April, 2023; originally announced April 2023.

Stochastic Actor Oriented Model with Random Effects

Authors: Giacomo Ceoldo, Tom A. B. Snijders, Ernst C. Wit

Abstract: The stochastic actor oriented model (SAOM) is a method for modelling social interactions and social behaviour over time. It can be used to model drivers of dynamic interactions using both exogenous covariates and endogenous network configurations, but also the co-evolution of behaviour and social interactions. In its standard implementations, it assumes that all individual have the same interactio… ▽ More The stochastic actor oriented model (SAOM) is a method for modelling social interactions and social behaviour over time. It can be used to model drivers of dynamic interactions using both exogenous covariates and endogenous network configurations, but also the co-evolution of behaviour and social interactions. In its standard implementations, it assumes that all individual have the same interaction evaluation function. This lack of heterogeneity is one of its limitations. The aim of this paper is to extend the inference framework for the SAOM to include random effects, so that the heterogeneity of individuals can be modeled more accurately. We decompose the linear evaluation function that models the probability of forming or removing a tie from the network, in a homogeneous fixed part and a random, individual-specific part. We extend the Robbins-Monro algorithm to the estimation of the variance of the random parameters. Our method is applicable for the general random effect formulations. We illustrate the method with a random out-degree model and show the parameter estimation of the random components, significance tests and model evaluation. We apply the method to the Kapferer's Tailor shop study. It is shown that a random out-degree constitutes a serious alternative to including transitivity and higher-order dependency effects. △ Less

Submitted 31 January, 2024; v1 submitted 14 April, 2023; originally announced April 2023.

Mixed additive modelling of global alien species co-invasions of plants and insects

Authors: Martina Boschi, Rūta Juozaitienė, Ernst-Jan Camiel Wit

Abstract: Alien species refer to non-native species introduced by humans into an ecosystem, which can cause harm to the environment, economy, or human health. Although there is considerable literature on the subject, the presence of confounding factors has so far prevented a comprehensive picture of the relative importance of various drivers of such invasions. In this manuscript, we aim to develop and apply… ▽ More Alien species refer to non-native species introduced by humans into an ecosystem, which can cause harm to the environment, economy, or human health. Although there is considerable literature on the subject, the presence of confounding factors has so far prevented a comprehensive picture of the relative importance of various drivers of such invasions. In this manuscript, we aim to develop and apply a general mixed additive relational event model to describe the pattern of global invasions of alien species. The diffusion of alien species can be regarded as a relational event, where the species -- the sender -- reaches a region -- the receiver -- at a specific time in history. We use the First Record Database, which contains all co-invasions by insects and plants between 1880 and 2005. A relational event model (REM) is employed to describe the underlying hazard of each species-region pair. Besides potentially time-varying, exogenous, and endogenous covariates, the mixed additive REM incorporates time-varying and random effects, allowing for taxa-specific baseline rates while accounting for the potential synergistic effect between plants and insects in the invasion process. Our efficient inference procedure relies on case-control sampling, yielding the same likelihood as that of a degenerate logistic regression. We propose fitting the mixed additive REM via a generalised additive model with random effects as 0-dimensional splines. The resulting computational efficiency means that complex models for large dynamic networks can be estimated in seconds on a standard computer. Furthermore, we present a framework for testing the goodness-of-fit of our mixed additive REM for the invasions by vascular plants and insects by means of cumulative martingale-residuals. Implementation is performed through the R package mgcv. △ Less

Submitted 20 May, 2025; v1 submitted 2 April, 2023; originally announced April 2023.

A Stochastic Gradient Relational Event Additive Model for modelling US patent citations from 1976 until 2022

Authors: Edoardo Filippi-Mazzola, Ernst C. Wit

Abstract: Until 2022, the US patent citation network contained almost 10 million patents and over 100 million citations. To overcome limitations in analyzing such complex networks, we propose a stochastic gradient relational event additive model (STREAM) that models the relationships between citing patents as events that occur over time, where predictors are modeled through B-splines. Our model identifies k… ▽ More Until 2022, the US patent citation network contained almost 10 million patents and over 100 million citations. To overcome limitations in analyzing such complex networks, we propose a stochastic gradient relational event additive model (STREAM) that models the relationships between citing patents as events that occur over time, where predictors are modeled through B-splines. Our model identifies key factors driving patent citation and reveals insights, such as time windows where citations are more likely and the relevance of the increasing citation numbers per patent. Overall, the STREAM offers the potential for capturing dynamics in large sparse networks while maintaining interpretability. △ Less

Submitted 24 April, 2023; v1 submitted 14 March, 2023; originally announced March 2023.

Analysing ecological dynamics with relational event models: the case of biological invasions

Authors: Rūta Juozaitienė, Hanno Seebens, Guillaume Latombe, Franz Essl, Ernst C. Wit

Abstract: Aim: Spatio-temporal processes play a key role in ecology, from genes to large-scale macroecological and biogeographical processes. Existing methods studying such spatio-temporally structured data either simplify the dynamic structure or the complex interactions of ecological drivers. This paper aims to present a generic method for ecological research that allows analysing spatio-temporal patterns… ▽ More Aim: Spatio-temporal processes play a key role in ecology, from genes to large-scale macroecological and biogeographical processes. Existing methods studying such spatio-temporally structured data either simplify the dynamic structure or the complex interactions of ecological drivers. This paper aims to present a generic method for ecological research that allows analysing spatio-temporal patterns of biological processes at large spatial scales by including the time-varying variables that drive these dynamics. Methods: We introduce a method called relational event modelling (REM), which relies on temporal interaction dynamics, that encode sequences of relational events connecting a sender node to a recipient node at a specific point in time. We apply REM to the spread of alien species around the globe between 1880 and 2005, following accidental or deliberate introductions into geographical regions outside of their native range. In this context, a relational event represents the new occurrence of an alien species given its former distribution. Results: The application of REM to the first reported invasions of 4835 established alien species outside of their native ranges from four major taxonomic groups enables us to unravel the main drivers of the dynamics of the spread of invasive alien species. Combining the alien species first records data with other spatio-temporal information enables us to discover which factors have been responsible for the spread of species across the globe. Besides the usual drivers of species invasions, such as trade, land use and climatic conditions, we also find evidence for species-interconnectedness in alien species spread. Conclusions: REM offer the capacity to account for the temporal sequences of ecological events such as biological invasions and to investigate how relationships between these events and potential drivers change over time. △ Less

Submitted 11 March, 2023; originally announced March 2023.

Drivers of the decrease of patent similarities from 1976 to 2021

Authors: Edoardo Filippi-Mazzola, Federica Bianchi, Ernst C. Wit

Abstract: The citation network of patents citing prior art arises from the legal obligation of patent applicants to properly disclose their invention. One way to study the relationship between current patents and their antecedents is by analyzing the similarity between the textual elements of patents. Many patent similarity indicators have shown a constant decrease since the mid-70s. Although several explan… ▽ More The citation network of patents citing prior art arises from the legal obligation of patent applicants to properly disclose their invention. One way to study the relationship between current patents and their antecedents is by analyzing the similarity between the textual elements of patents. Many patent similarity indicators have shown a constant decrease since the mid-70s. Although several explanations have been proposed, more comprehensive analyses of this phenomenon have been rare. In this paper, we use a computationally efficient measure of patent similarity scores that leverages state-of-the-art Natural Language Processing tools, to investigate potential drivers of this apparent similarity decrease. This is achieved by modeling patent similarity scores by means of generalized additive models. We found that non-linear modeling specifications are able to distinguish between distinct, temporally varying drivers of the patent similarity levels that explain more variation in the data ($R^2\sim 18\%$) compared to previous methods. Moreover, the model reveals an underlying trend in similarity scores that is fundamentally different from the one presented previously. △ Less

Submitted 14 March, 2023; v1 submitted 12 December, 2022; originally announced December 2022.

Dynamic latent space relational event model

Authors: Igor Artico, Ernst C. Wit

Abstract: Dynamic relational processes, such as e-mail exchanges, bank loans and scientific citations, are important examples of dynamic networks, in which the relational events consistute time-stamped edges. There are contexts where the network might be considered a reflection of underlying dynamics in some latent space, whereby nodes are associated with dynamic locations and their relative distances drive… ▽ More Dynamic relational processes, such as e-mail exchanges, bank loans and scientific citations, are important examples of dynamic networks, in which the relational events consistute time-stamped edges. There are contexts where the network might be considered a reflection of underlying dynamics in some latent space, whereby nodes are associated with dynamic locations and their relative distances drive their interaction tendencies. As time passes nodes can change their locations assuming new configurations, with different interaction patterns. The aim of this paper is to define a dynamic latent space relational event model. We then develop a computationally efficient method for inferring the locations of the nodes. We make use of the Expectation Maximization algorithm which embeds an extension of the universal Kalman filter. Kalman filters are known for being effective tools in the context of tracking objects in the space, with successful applications in fields such as geolocalization. We extend its application to dynamic networks by filtering the signal from a sequence of adjacency matrices and recovering the hidden movements. Besides the latent space our formulation includes also more traditional fixed and random effects, achieving a general model that can suit a large variety of applications. △ Less

Submitted 10 April, 2022; originally announced April 2022.

Nodal heterogeneity can induce ghost triadic effects in relational event models

Authors: Rūta Juozaitienė, Ernst C. Wit

Abstract: Temporal network data is often encoded as time-stamped interaction events between senders and receivers, such as co-authoring scientific articles or communication via email. A number of relational event frameworks have been proposed to address specific issues raised by complex temporal dependencies. These models attempt to quantify how individual behaviour, endogenous and exogenous factors, as wel… ▽ More Temporal network data is often encoded as time-stamped interaction events between senders and receivers, such as co-authoring scientific articles or communication via email. A number of relational event frameworks have been proposed to address specific issues raised by complex temporal dependencies. These models attempt to quantify how individual behaviour, endogenous and exogenous factors, as well as interactions with other individuals modify the network dynamics over time. It is often of interest to determine whether changes in the network can be attributed to endogenous mechanisms reflecting natural relational tendencies, such as reciprocity or triadic effects. The propensity to form or receive ties can also, at least partially, be related to actor attributes. Nodal heterogeneity in the network is often modelled by including actor-specific or dyadic covariates. However, comprehensively capturing all personality traits is difficult in practice, if not impossible. A failure to account for heterogeneity may confound the substantive effect of key variables of interest. This work shows that failing to account for node level sender and receiver effects can induce ghost triadic effects. We propose a random-effect extension of the relational event model to deal with these problems. We show that it is often effective over more traditional approaches, such as in-degree and out-degree statistics. These results that the violation of the hierarchy principle due to insufficient information about nodal heterogeneity can be resolved by including random effects in the relational event model as a standard. △ Less

Submitted 8 March, 2024; v1 submitted 30 March, 2022; originally announced March 2022.

Journal ref: Psychometrika. 2024 Mar 6. PMID: 38446394

A predictive model for planning emergency events rescue during COVID-19 in Lombardy, Italy

Authors: Angela Andreella, Antonietta Mira, Spyros Balafas, Ernst C. Wit, Fabrizio Ruggeri, Giovanni Nattino, Giulia Ghilardi, Guido Bertolini

Abstract: Italy, particularly the Lombardy region, was among the first countries outside of Asia to report cases of COVID-19. The emergency medical service called Regional Emergency Agency (AREU) coordinates the intra- and inter-regional non-hospital emergency network and the European emergency number service in Lombardy. AREU must deal with daily and seasonal variations of call volume. The number and type… ▽ More Italy, particularly the Lombardy region, was among the first countries outside of Asia to report cases of COVID-19. The emergency medical service called Regional Emergency Agency (AREU) coordinates the intra- and inter-regional non-hospital emergency network and the European emergency number service in Lombardy. AREU must deal with daily and seasonal variations of call volume. The number and type of emergency calls changed dramatically during the COVID-19 pandemic. A model to predict incoming calls and how many of these turn into events, i.e., dispatch of transport and equipment until the rescue is completed, was developed to address the emergency period. We used the generalized additive model with a negative binomial family to predict the number of events one, two, five, and seven days ahead. The over-dispersion of the data was tackled by using the negative binomial family and the nonlinear relationship between the number of events and covariates (e.g., seasonal effects) by smoothing splines. The model coefficients show the effect of variables, e.g., the day of the week, on the number of events and how these effects change during the pre-COVID-19 period. The proposed model returns reasonable mean absolute errors for most of the 2020-2021 period. △ Less

Submitted 27 March, 2022; originally announced March 2022.

Comments: 18 pages, 13 figures

Mixtures of multivariate generalized linear models with overlapping clusters

Authors: Saverio Ranciati, Veronica Vinciotti, Ernst C. Wit, Giuliano Galimberti

Abstract: With the advent of ubiquitous monitoring and measurement protocols, studies have started to focus more and more on complex, multivariate and heterogeneous datasets. In such studies, multivariate response variables are drawn from a heterogeneous population often in the presence of additional covariate information. In order to deal with this intrinsic heterogeneity, regression analyses have to be cl… ▽ More With the advent of ubiquitous monitoring and measurement protocols, studies have started to focus more and more on complex, multivariate and heterogeneous datasets. In such studies, multivariate response variables are drawn from a heterogeneous population often in the presence of additional covariate information. In order to deal with this intrinsic heterogeneity, regression analyses have to be clustered for different groups of units. Up until now, mixture model approaches assigned units to distinct and non-overlapping groups. However, not rarely these units exhibit more complex organization and clustering. It is our aim to define a mixture of generalized linear models with overlapping clusters of units. This involves crucially an overlap function, that maps the coefficients of the parent clusters into the the coefficient of the multiple allocation units. We present a computationally efficient MCMC scheme that samples the posterior distribution of the parameters in the model. An example on a two-mode network study shows details of the implementation in the case of a multivariate probit regression setting. A simulation study shows the overall performance of the method, whereas an illustration of the voting behaviour on the US supreme court shows how the 9 justices split in two overlapping sets of justices. △ Less

Submitted 20 November, 2019; originally announced November 2019.

Comments: 24 pages, 3 figures

Dynamic Chain Graph Models for Ordinal Time Series Data

Authors: Pariya Behrouzi, Fentaw Abegaz, Ernst C. Wit

Abstract: This paper introduces sparse dynamic chain graph models for network inference in high dimensional non-Gaussian time series data. The proposed method parametrized by a precision matrix that encodes the intra time-slice conditional independence among variables at a fixed time point, and an autoregressive coefficient that contains dynamic conditional independences interactions among time series compo… ▽ More This paper introduces sparse dynamic chain graph models for network inference in high dimensional non-Gaussian time series data. The proposed method parametrized by a precision matrix that encodes the intra time-slice conditional independence among variables at a fixed time point, and an autoregressive coefficient that contains dynamic conditional independences interactions among time series components across consecutive time steps. The proposed model is a Gaussian copula vector autoregressive model, which is used to model sparse interactions in a high-dimensional setting. Estimation is achieved via a penalized EM algorithm. In this paper, we use an efficient coordinate descent algorithm to optimize the penalized log-likelihood with the smoothly clipped absolute deviation penalty. We demonstrate our approach on simulated and genomic datasets. The method is implemented in an R package tsnetwork. △ Less

Submitted 24 May, 2018; originally announced May 2018.

Comments: 19 pages, 2 tables, 1 figure

Identifying overlapping terrorist cells from the Noordin Top actor-event network

Authors: Saverio Ranciati, Veronica Vinciotti, Ernst C. Wit

Abstract: Actor-event data are common in sociological settings, whereby one registers the pattern of attendance of a group of social actors to a number of events. We focus on 79 members of the Noordin Top terrorist network, who were monitored attending 45 events. The attendance or non-attendance of the terrorist to events defines the social fabric, such as group coherence and social communities. The aim of… ▽ More Actor-event data are common in sociological settings, whereby one registers the pattern of attendance of a group of social actors to a number of events. We focus on 79 members of the Noordin Top terrorist network, who were monitored attending 45 events. The attendance or non-attendance of the terrorist to events defines the social fabric, such as group coherence and social communities. The aim of the analysis of such data is to learn about the affiliation structure. Actor-event data is often transformed to actor-actor data in order to be further analysed by network models, such as stochastic block models. This transformation and such analyses lead to a natural loss of information, particularly when one is interested in identifying, possibly overlapping, subgroups or communities of actors on the basis of their attendances to events. In this paper we propose an actor-event model for overlapping communities of terrorists, which simplifies interpretation of the network. We propose a mixture model with overlapping clusters for the analysis of the binary actor-event network data, called {\tt manet}, and develop a Bayesian procedure for inference. After a simulation study, we show how this analysis of the terrorist network has clear interpretative advantages over the more traditional approaches of affiliation network analysis. △ Less

Submitted 28 December, 2019; v1 submitted 27 October, 2017; originally announced October 2017.

Comments: 24 pages, 5 figures; related R package (manet) available on CRAN

Journal ref: Annals of Applied Statistics 2020, Vol. 14, No. 3, 1516-1534

netgwas: An R Package for Network-Based Genome-Wide Association Studies

Authors: Pariya Behrouzi, Danny Arends, Ernst C. Wit

Abstract: Graphical models are a powerful tool in modelling and analysing complex biological associations in high-dimensional data. The R-package netgwas implements the recent methodological development on copula graphical models to (i) construct linkage maps, (ii) infer linkage disequilibrium networks from genotype data, and (iii) detect high-dimensional genotype-phenotype networks. The netgwas learns the… ▽ More Graphical models are a powerful tool in modelling and analysing complex biological associations in high-dimensional data. The R-package netgwas implements the recent methodological development on copula graphical models to (i) construct linkage maps, (ii) infer linkage disequilibrium networks from genotype data, and (iii) detect high-dimensional genotype-phenotype networks. The netgwas learns the structure of networks from ordinal data and mixed ordinal-and-continuous data. Here, we apply the functionality in netgwas to various multivariate example datasets taken from the literature to demonstrate the kind of insight that can be obtained from the package. We show that our package offers a more realistic association analysis than the classical approaches, as it discriminates between direct and induced correlations by adjusting for the effect of all other variables while performing pairwise associations. This feature controls for spurious interactions between variables that can arise from conventional approaches in a biological sense. The netgwas package uses a parallelization strategy on multi-core processors to speed-up computations. The netgwas package is freely available at https://cran.r-project.org/web/packages/netgwas △ Less

Submitted 26 January, 2023; v1 submitted 3 October, 2017; originally announced October 2017.

Comments: 20 pages, 8 figures

De novo construction of polyploid linkage maps using discrete graphical models

Authors: Pariya Behrouzi, Ernst C. Wit

Abstract: Linkage maps are used to identify the location of genes responsible for traits and diseases. New sequencing techniques have created opportunities to substantially increase the density of genetic markers. Such revolutionary advances in technology have given rise to new challenges, such as creating high-density linkage maps. Current multiple testing approaches based on pairwise recombination fractio… ▽ More Linkage maps are used to identify the location of genes responsible for traits and diseases. New sequencing techniques have created opportunities to substantially increase the density of genetic markers. Such revolutionary advances in technology have given rise to new challenges, such as creating high-density linkage maps. Current multiple testing approaches based on pairwise recombination fractions are underpowered in the high-dimensional setting and do not extend easily to polyploid species. We propose to construct linkage maps using graphical models either via a sparse Gaussian copula or a nonparanormal skeptic approach. Linkage groups (LGs), typically chromosomes, and the order of markers in each LG are determined by inferring the conditional independence relationships among large numbers of markers in the genome. Through simulations, we illustrate the utility of our map construction method and compare its performance with other available methods, both when the data are clean and contain no missing observations and when data contain genotyping errors and are incomplete. We apply the proposed method to two genotype datasets: barley and potato from diploid and polypoid populations, respectively. Our comprehensive map construction method makes full use of the dosage SNP data to reconstruct linkage map for any bi-parental diploid and polyploid species. We have implemented the method in the R package netgwas. △ Less

Submitted 2 April, 2018; v1 submitted 3 October, 2017; originally announced October 2017.

Comments: 25 pages, 7 figures

Detecting Epistatic Selection with Partially Observed Genotype Data Using Copula Graphical Models

Authors: P. Behrouzi, E. C. Wit

Abstract: Recombinant Inbred Lines derived from divergent parental lines can display extensive segregation distortion and long-range linkage disequilibrium (LD) between distant loci. These genomic signatures are consistent with epistatic selection during inbreeding. Epistatic interactions affect growth and fertility traits or even cause complete lethality. Detecting epistasis is challenging as multiple test… ▽ More Recombinant Inbred Lines derived from divergent parental lines can display extensive segregation distortion and long-range linkage disequilibrium (LD) between distant loci. These genomic signatures are consistent with epistatic selection during inbreeding. Epistatic interactions affect growth and fertility traits or even cause complete lethality. Detecting epistasis is challenging as multiple testing approaches are under-powered and true long-range LD is difficult to distinguish from drift. Here we develop a method for reconstructing an underlying network of genomic signatures of high-dimensional epistatic selection from multi-locus genotype data. The network captures the conditionally dependent short- and long-range LD structure and thus reveals "aberrant" marker-marker associations that are due to epistatic selection rather than gametic linkage. The network estimation relies on penalized Gaussian copula graphical models, which accounts for a large number of markers p and a small number of individuals n. A multi-core implementation of our algorithm makes it feasible to estimate the graph in high-dimensions also in the presence of significant portions of missing data. We demonstrate the efficiency of the proposed method on simulated datasets as well as on genotyping data in A.thaliana and maize. In addition, we implemented the method in the R package netgwas which is freely available at https://CRAN.R-project.org/package=netgwas. △ Less

Submitted 30 December, 2017; v1 submitted 2 October, 2017; originally announced October 2017.

Comments: 27 pages, 9 figures

A penalized inference approach to stochastic block modelling of community structure in the Italian Parliament

Authors: Mirko Signorelli, Ernst C. Wit

Abstract: We analyse bill cosponsorship networks in the Italian Chamber of Deputies. In comparison with other parliaments, a distinguishing feature of the Chamber is the large number of political groups. Our analysis aims to infer the pattern of collaborations between these groups from data on bill cosponsorships. We propose an extension of stochastic block models for edge-valued graphs and derive measures… ▽ More We analyse bill cosponsorship networks in the Italian Chamber of Deputies. In comparison with other parliaments, a distinguishing feature of the Chamber is the large number of political groups. Our analysis aims to infer the pattern of collaborations between these groups from data on bill cosponsorships. We propose an extension of stochastic block models for edge-valued graphs and derive measures of group productivity and of collaboration between political parties. As the model proposed encloses a large number of parameters, we pursue a penalized likelihood approach that enables us to infer a sparse reduced graph displaying collaborations between political parties. △ Less

Submitted 31 July, 2017; v1 submitted 29 July, 2016; originally announced July 2016.

Comments: The original version of the paper is freely available (Open Access) from the editor's website (http://onlinelibrary.wiley.com/doi/10.1111/rssc.12234/full), Journal of the Royal Statistical Society: Series C (Applied Statistics), 2017

Journal ref: Journal of the Royal Statistical Society: Series C (Applied Statistics), 2017, 67 (2), 355-369

NEAT: an efficient network enrichment analysis test

Authors: Mirko Signorelli, Veronica Vinciotti, Ernst C. Wit

Abstract: Network enrichment analysis is a powerful method, which allows to integrate gene enrichment analysis with the information on relationships between genes that is provided by gene networks. Existing tests for network enrichment analysis deal only with undirected networks, they can be computationally slow and are based on normality assumptions. We propose NEAT, a test for network enrichment analysi… ▽ More Network enrichment analysis is a powerful method, which allows to integrate gene enrichment analysis with the information on relationships between genes that is provided by gene networks. Existing tests for network enrichment analysis deal only with undirected networks, they can be computationally slow and are based on normality assumptions. We propose NEAT, a test for network enrichment analysis. The test is based on the hypergeometric distribution, which naturally arises as the null distribution in this context. NEAT can be applied not only to undirected, but to directed and partially directed networks as well. Our simulations indicate that NEAT is considerably faster than alternative resampling-based methods, and that its capacity to detect enrichments is at least as good as the one of alternative tests. We discuss applications of NEAT to network analyses in yeast by testing for enrichment of the Environmental Stress Response target gene set with GO Slim and KEGG functional gene sets, and also by testing for associations between GO Slim categories themselves. NEAT is a flexible and efficient test for network enrichment analysis that aims to overcome some limitations of existing resampling-based tests. The method is implemented in the R package neat, which can be freely downloaded from CRAN (http://cran.r-project.org/package=neat). △ Less

Submitted 17 September, 2016; v1 submitted 5 April, 2016; originally announced April 2016.

Comments: The original version of the paper is freely available (Open Access) from the editor's website (https://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-016-1203-6)

Journal ref: BMC Bioinformatics (2016), 17:352

BDgraph: An R Package for Bayesian Structure Learning in Graphical Models

Authors: Reza Mohammadi, Ernst C. Wit

Abstract: Graphical models provide powerful tools to uncover complicated patterns in multivariate data and are commonly used in Bayesian statistics and machine learning. In this paper, we introduce the R package BDgraph which performs Bayesian structure learning for general undirected graphical models (decomposable and non-decomposable) with continuous, discrete, and mixed variables. The package efficiently… ▽ More Graphical models provide powerful tools to uncover complicated patterns in multivariate data and are commonly used in Bayesian statistics and machine learning. In this paper, we introduce the R package BDgraph which performs Bayesian structure learning for general undirected graphical models (decomposable and non-decomposable) with continuous, discrete, and mixed variables. The package efficiently implements recent improvements in the Bayesian literature, including that of Mohammadi and Wit (2015) and Dobra and Mohammadi (2018). To speed up computations, the computationally intensive tasks have been implemented in C++ and interfaced with R, and the package has parallel computing capabilities. In addition, the package contains several functions for simulation and visualization, as well as several multivariate datasets taken from the literature and used to describe the package capabilities. The paper includes a brief overview of the statistical methods which have been implemented in the package. The main part of the paper explains how to use the package. Furthermore, we illustrate the package's functionality in both real and artificial examples. △ Less

Submitted 13 May, 2019; v1 submitted 21 January, 2015; originally announced January 2015.

Comments: Published at https://www.jstatsoft.org/article/view/v089i03 in the Journal of Statistical Software

Journal ref: Journal of Statistical Software 2019, Volume 89, Issue 3, 1-30

Bayesian Gaussian Copula Graphical Modeling for Dupuytren Disease

Authors: Abdolreza Mohammadi, Fentaw Abegaz, Edwin van den Heuvel, Ernst C. Wit

Abstract: Dupuytren disease is a fibroproliferative disorder with unknown etiology that often progresses and eventually can cause permanent contractures of the affected fingers. In this paper, we provide a computationally efficient Bayesian framework to discover potential risk factors and investigate which fingers are jointly affected. Our Bayesian approach is based on Gaussian copula graphical models, whic… ▽ More Dupuytren disease is a fibroproliferative disorder with unknown etiology that often progresses and eventually can cause permanent contractures of the affected fingers. In this paper, we provide a computationally efficient Bayesian framework to discover potential risk factors and investigate which fingers are jointly affected. Our Bayesian approach is based on Gaussian copula graphical models, which are one potential way to discover the underlying conditional independence structure of variables in multivariate mixed data. In particular, we combine the semiparametric Gaussian copula with extended rank likelihood which is appropriate to analyse multivariate mixed data with arbitrary marginal distributions. For the graph structure learning, we construct a computationally efficient search algorithm which is a trans-dimensional MCMC algorithm based on a birth-death process. In addition, to make our statistical method easily accessible to other researchers, we have implemented our method in C++ and interfaced with R software as an R package BDgraph which is available online. △ Less

Submitted 15 September, 2015; v1 submitted 20 January, 2015; originally announced January 2015.

Bayesian Structure Learning in Sparse Gaussian Graphical Models

Authors: A. Mohammadi, E. C. Wit

Abstract: Decoding complex relationships among large numbers of variables with relatively few observations is one of the crucial issues in science. One approach to this problem is Gaussian graphical modeling, which describes conditional independence of variables through the presence or absence of edges in the underlying graph. In this paper, we introduce a novel and efficient Bayesian framework for Gaussian… ▽ More Decoding complex relationships among large numbers of variables with relatively few observations is one of the crucial issues in science. One approach to this problem is Gaussian graphical modeling, which describes conditional independence of variables through the presence or absence of edges in the underlying graph. In this paper, we introduce a novel and efficient Bayesian framework for Gaussian graphical model determination which is a trans-dimensional Markov Chain Monte Carlo (MCMC) approach based on a continuous-time birth-death process. We cover the theory and computational details of the method. It is easy to implement and computationally feasible for high-dimensional graphs. We show our method outperforms alternative Bayesian approaches in terms of convergence, mixing in the graph space and computing time. Unlike frequentist approaches, it gives a principled and, in practice, sensible approach for structure learning. We illustrate the efficiency of the method on a broad range of simulated data. We then apply the method on large-scale real applications from human and mammary gland gene expression studies to show its empirical usefulness. In addition, we implemented the method in the R package BDgraph which is freely available at http://CRAN.R-project.org/package=BDgraph △ Less

Submitted 25 April, 2019; v1 submitted 19 October, 2012; originally announced October 2012.

Comments: Published at http://dx.doi.org/10.1214/14-BA889 in the Bayesian Analysis (http://projecteuclid.org/euclid.ba) by the International Society of Bayesian Analysis (http://bayesian.org/)

Report number: VTeX-BA-BA889

Journal ref: Bayesian Analysis 2015, Vol. 10, No. 1, 109-138

Factorial graphical lasso for dynamic networks

Authors: E. C. Wit, A. Abbruzzo

Abstract: Dynamic networks models describe a growing number of important scientific processes, from cell biology and epidemiology to sociology and finance. There are many aspects of dynamical networks that require statistical considerations. In this paper we focus on determining network structure. Estimating dynamic networks is a difficult task since the number of components involved in the system is very l… ▽ More Dynamic networks models describe a growing number of important scientific processes, from cell biology and epidemiology to sociology and finance. There are many aspects of dynamical networks that require statistical considerations. In this paper we focus on determining network structure. Estimating dynamic networks is a difficult task since the number of components involved in the system is very large. As a result, the number of parameters to be estimated is bigger than the number of observations. However, a characteristic of many networks is that they are sparse. For example, the molecular structure of genes make interactions with other components a highly-structured and therefore sparse process. Penalized Gaussian graphical models have been used to estimate sparse networks. However, the literature has focussed on static networks, which lack specific temporal constraints. We propose a structured Gaussian dynamical graphical model, where structures can consist of specific time dynamics, known presence or absence of links and block equality constraints on the parameters. Thus, the number of parameters to be estimated is reduced and accuracy of the estimates, including the identification of the network, can be tuned up. Here, we show that the constrained optimization problem can be solved by taking advantage of an efficient solver, logdetPPA, developed in convex optimization. Moreover, model selection methods for checking the sensitivity of the inferred networks are described. Finally, synthetic and real data illustrate the proposed methodologies. △ Less

Submitted 13 May, 2012; originally announced May 2012.

Comments: 30 pp, 5 figures