-
Machine Learning Informed by Micro and Mesoscopic Statistical Physics Methods for Community Detection
Authors:
Yijun Ran,
Junfan Yi,
Wei Si,
Michael Small,
Ke-ke Shang
Abstract:
Community detection plays a crucial role in understanding the structural organization of complex networks. Previous methods, particularly those from statistical physics, primarily focus on the analysis of mesoscopic network structures and often struggle to integrate fine-grained node similarities. To address this limitation, we propose a low-complexity framework that integrates machine learning to…
▽ More
Community detection plays a crucial role in understanding the structural organization of complex networks. Previous methods, particularly those from statistical physics, primarily focus on the analysis of mesoscopic network structures and often struggle to integrate fine-grained node similarities. To address this limitation, we propose a low-complexity framework that integrates machine learning to embed micro-level node-pair similarities into mesoscopic community structures. By leveraging ensemble learning models, our approach enhances both structural coherence and detection accuracy. Experimental evaluations on artificial and real-world networks demonstrate that our framework consistently outperforms conventional methods, achieving higher modularity and improved accuracy in NMI and ARI. Notably, when ground-truth labels are available, our approach yields the most accurate detection results, effectively recovering real-world community structures while minimizing misclassifications. To further explain our framework's performance, we analyze the correlation between node-pair similarity and evaluation metrics. The results reveal a strong and statistically significant correlation, underscoring the critical role of node-pair similarity in enhancing detection accuracy. Overall, our findings highlight the synergy between machine learning and statistical physics, demonstrating how machine learning techniques can enhance network analysis and uncover complex structural patterns.
△ Less
Submitted 18 April, 2025;
originally announced April 2025.
-
Selecting embedding delays: An overview of embedding techniques and a new method using persistent homology
Authors:
Eugene Tan,
Shannon Algar,
Débora Corrêa,
Michael Small,
Thomas Stemler,
David Walker
Abstract:
Delay embedding methods are a staple tool in the field of time series analysis and prediction. However, the selection of embedding parameters can have a big impact on the resulting analysis. This has led to the creation of a large number of methods to optimise the selection of parameters such as embedding lag. This paper aims to provide a comprehensive overview of the fundamentals of embedding the…
▽ More
Delay embedding methods are a staple tool in the field of time series analysis and prediction. However, the selection of embedding parameters can have a big impact on the resulting analysis. This has led to the creation of a large number of methods to optimise the selection of parameters such as embedding lag. This paper aims to provide a comprehensive overview of the fundamentals of embedding theory for readers who are new to the subject. We outline a collection of existing methods for selecting embedding lag in both uniform and non-uniform delay embedding cases. Highlighting the poor dynamical explainability of existing methods of selecting non-uniform lags, we provide an alternative method of selecting embedding lags that includes a mixture of both dynamical and topological arguments. The proposed method, {\em Significant Times on Persistent Strands} (SToPS), uses persistent homology to construct a characteristic time spectrum that quantifies the relative dynamical significance of each time lag. We test our method on periodic, chaotic and fast-slow time series and find that our method performs similar to existing automated non-uniform embedding methods. Additionally, $n$-step predictors trained on embeddings constructed with SToPS was found to outperform other embedding methods when predicting fast-slow time series.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
Backpropagation on Dynamical Networks
Authors:
Eugene Tan,
Débora Corrêa,
Thomas Stemler,
Michael Small
Abstract:
Dynamical networks are versatile models that can describe a variety of behaviours such as synchronisation and feedback. However, applying these models in real world contexts is difficult as prior information pertaining to the connectivity structure or local dynamics is often unknown and must be inferred from time series observations of network states. Additionally, the influence of coupling intera…
▽ More
Dynamical networks are versatile models that can describe a variety of behaviours such as synchronisation and feedback. However, applying these models in real world contexts is difficult as prior information pertaining to the connectivity structure or local dynamics is often unknown and must be inferred from time series observations of network states. Additionally, the influence of coupling interactions between nodes further complicates the isolation of local node dynamics. Given the architectural similarities between dynamical networks and recurrent neural networks (RNN), we propose a network inference method based on the backpropagation through time (BPTT) algorithm commonly used to train recurrent neural networks. This method aims to simultaneously infer both the connectivity structure and local node dynamics purely from observation of node states. An approximation of local node dynamics is first constructed using a neural network. This is alternated with an adapted BPTT algorithm to regress corresponding network weights by minimising prediction errors of the dynamical network based on the previously constructed local models until convergence is achieved. This method was found to be succesful in identifying the connectivity structure for coupled networks of Lorenz, Chua and FitzHugh-Nagumo oscillators. Freerun prediction performance with the resulting local models and weights was found to be comparable to the true system with noisy initial conditions. The method is also extended to non-conventional network couplings such as asymmetric negative coupling.
△ Less
Submitted 7 February, 2023; v1 submitted 7 July, 2022;
originally announced July 2022.
-
Modelling strong control measures for epidemic propagation with networks -- A COVID-19 case study
Authors:
Michael Small,
David Cavanagh
Abstract:
We show that precise knowledge of epidemic transmission parameters is not required to build an informative model of the spread of disease. We propose a detailed model of the topology of the contact network under various external control regimes and demonstrate that this is sufficient to capture the salient dynamical characteristics and to inform decisions. Contact between individuals in the commun…
▽ More
We show that precise knowledge of epidemic transmission parameters is not required to build an informative model of the spread of disease. We propose a detailed model of the topology of the contact network under various external control regimes and demonstrate that this is sufficient to capture the salient dynamical characteristics and to inform decisions. Contact between individuals in the community is characterised by a contact graph, the structure of that contact graph is selected to mimic community control measures. Our model of city-level transmission of an infectious agent (SEIR model) characterises spread via a (a) scale-free contact network (no control); (b) a random graph (elimination of mass gatherings); and (c) small world lattice (partial to full lockdown -- "social" distancing). This model exhibits good qualitative agreement between simulation and data from the 2020 pandemic spread of coronavirus. Estimates of the relevant rate parameters of the SEIR model are obtained and we demonstrate the robustness of our model predictions under uncertainty of those estimates. The social context and utility of this work is identified, contributing to a highly effective pandemic response in Western Australia.
△ Less
Submitted 8 June, 2020; v1 submitted 22 April, 2020;
originally announced April 2020.
-
Global stability of epidemic models with imperfect vaccination and quarantine on scale-free networks
Authors:
Shanshan Chen,
Michael Small,
Xinchu Fu
Abstract:
Public health services are constantly searching for new ways to reduce the spread of infectious diseases, such as public vaccination of asymptomatic individuals, quarantine (isolation) and treatment of symptomatic individuals. Epidemic models have a long history of assisting in public health planning and policy making. In this paper, we introduce epidemic models including variable population size,…
▽ More
Public health services are constantly searching for new ways to reduce the spread of infectious diseases, such as public vaccination of asymptomatic individuals, quarantine (isolation) and treatment of symptomatic individuals. Epidemic models have a long history of assisting in public health planning and policy making. In this paper, we introduce epidemic models including variable population size, degree-related imperfect vaccination and quarantine on scale-free networks. More specifically, the models are formulated both on the population with and without permanent natural immunity to infection, which corresponds respectively to the susceptible-vaccinated-infected-quarantined-recovered (SVIQR) model and the susceptible-vaccinated-infected-quarantined (SVIQS) model. We develop different mathematical methods and techniques to study the dynamics of two models, including the basic reproduction number, the global stability of disease-free and endemic equilibria. For the SVIQR model, we show that the system exhibits a forward bifurcation. Meanwhile, the disease-free and unique endemic equilibria are shown to be globally asymptotically stable by constructing suitable Lyapunov functions. For the SVIQS model, conditions ensuring the occurrence of multiple endemic equilibria are derived. Under certain conditions, this system cannot undergo a backward bifurcation. The global asymptotical stability of disease-free equilibrium, and the persistence of the disease are proved. The endemic equilibrium is shown to be globally attractive by using monotone iterative technique. Finally, stochastic network simulations yield quantitative agreement with the deterministic mean-field approach.
△ Less
Submitted 7 June, 2018;
originally announced June 2018.
-
Prevention of infectious diseases by public vaccination and individual protection
Authors:
Xiao-Long Peng,
Xin-Jian Xu,
Michael Small,
Xinchu Fu,
Zhen Jin
Abstract:
In the face of serious infectious diseases, governments endeavour to implement containment measures such as public vaccination at a macroscopic level. Meanwhile, individuals tend to protect themselves by avoiding contacts with infections at a microscopic level. However, a comprehensive understanding of how such combined strategy influences epidemic dynamics is still lacking. We study a susceptible…
▽ More
In the face of serious infectious diseases, governments endeavour to implement containment measures such as public vaccination at a macroscopic level. Meanwhile, individuals tend to protect themselves by avoiding contacts with infections at a microscopic level. However, a comprehensive understanding of how such combined strategy influences epidemic dynamics is still lacking. We study a susceptible-infected-susceptible epidemic model with imperfect vaccination on dynamic contact networks, where the macroscopic intervention is represented by random vaccination of the population and the microscopic protection is characterised by susceptible individuals rewiring contacts from infective neighbours. In particular, the model is formulated both in populations without and then with demographic effects. Using the pairwise approximation and the probability generating function approach, we investigate both dynamics of the epidemic and the underlying network. For populations without demography, the emerging degree correlations, bistable states, and oscillations demonstrate the combined effects of the public vaccination program and individual protective behavior. Compared to either strategy in isolation, the combination of public vaccination and individual protection is more effective in preventing and controlling the spread of infectious diseases by increasing both the invasion threshold and the persistence threshold. For populations with additional demographic factors, the integration between vaccination intervention and individual rewiring may promote epidemic spreading due to the birth effect. Moreover, the degree distributions of both networks in the steady state is closely related to the degree distribution of newborns, which leads to uncorrelated connectivity. All the results demonstrate the importance of both local protection and global intervention, as well as the demographic effects.
△ Less
Submitted 20 April, 2016; v1 submitted 13 April, 2016;
originally announced April 2016.
-
Time lagged ordinal partition networks for capturing dynamics of continuous dynamical systems
Authors:
Michael McCullough,
Michael Small,
Thomas Stemler,
Herbert Ho-Ching Iu
Abstract:
We investigate a generalised version of the recently proposed ordinal partition time series to network transformation algorithm. Firstly we introduce a fixed time lag for the elements of each partition that is selected using techniques from traditional time delay embedding. The resulting partitions define regions in the embedding phase space that are mapped to nodes in the network space. Edges are…
▽ More
We investigate a generalised version of the recently proposed ordinal partition time series to network transformation algorithm. Firstly we introduce a fixed time lag for the elements of each partition that is selected using techniques from traditional time delay embedding. The resulting partitions define regions in the embedding phase space that are mapped to nodes in the network space. Edges are allocated between nodes based on temporal succession thus creating a Markov chain representation of the time series. We then apply this new transformation algorithm to time series generated by the Rössler system and find that periodic dynamics translate to ring structures whereas chaotic time series translate to band or tube-like structures -- thereby indicating that our algorithm generates networks whose structure is sensitive to system dynamics. Furthermore we demonstrate that simple network measures including the mean out degree and variance of out degrees can track changes in the dynamical behaviour in a manner comparable to the largest Lyapunov exponent. We also apply the same analysis to experimental time series generated by a diode resonator circuit and show that the network size, mean shortest path length and network diameter are highly sensitive to the interior crisis captured in this particular data set.
△ Less
Submitted 27 January, 2015;
originally announced January 2015.
-
Expected degree of finite preferential attachment networks
Authors:
Michael Small
Abstract:
We provide an analytic expression for the quantity described in the title. Namely, we perform a preferential attachment growth process to generate a scale-free network. At each stage we add a new node with $m$ new links. Let $k$ denote the degree of a node, and $N$ the number of nodes in the network. The degree distribution is assumed to converge to a power-law (for $k\geq m$) of the form…
▽ More
We provide an analytic expression for the quantity described in the title. Namely, we perform a preferential attachment growth process to generate a scale-free network. At each stage we add a new node with $m$ new links. Let $k$ denote the degree of a node, and $N$ the number of nodes in the network. The degree distribution is assumed to converge to a power-law (for $k\geq m$) of the form $k^{-γ}$ and we obtain an exact implicit relationship for $γ$, $m$ and $N$. We verify this with numerical calculations over several orders of magnitude. Although this expression is exact, it provides only an implicit expression for $γ(m)$. Nonetheless, we provide a reasonable guess as to the form of this curve and perform curve fitting to estimate the parameters of that curve --- demonstrating excellent agreement between numerical fit, theory, and simulation.
△ Less
Submitted 11 August, 2014; v1 submitted 30 June, 2014;
originally announced July 2014.
-
Exploration of period-doubling cascade route to chaos with complex network based time series construction
Authors:
Ruoxi Xiang,
Michael Small
Abstract:
In this work, the topologies of networks constructed from time series from an underlying system undergo a period doubling cascade have been explored by means of the prevalence of different motifs using an efficient computational motif detection algorithm. By doing this we adopt a refinement based on the $k$ nearest neighbor recurrence-based network has been proposed. We demonstrate that the refine…
▽ More
In this work, the topologies of networks constructed from time series from an underlying system undergo a period doubling cascade have been explored by means of the prevalence of different motifs using an efficient computational motif detection algorithm. By doing this we adopt a refinement based on the $k$ nearest neighbor recurrence-based network has been proposed. We demonstrate that the refinement of network construction together with the study of prevalence of different motifs allows a full explosion of the evolving period doubling cascade route to chaos in both discrete and continuous dynamical systems. Further, this links the phase space time series topologies to the corresponding network topologies, and thus helps to understand the empirical "superfamily" phenomenon, as shown by Xu.
△ Less
Submitted 18 June, 2014;
originally announced June 2014.
-
Basin of Attraction Determines Hysteresis in Explosive Synchronization
Authors:
Yong Zou,
Tiago Pereira,
Michael Small,
Zonghua Liu,
Jürgen Kurths
Abstract:
Spontaneous explosive emergent behavior takes place in heterogeneous networks when the frequencies of the nodes are positively correlated to the node degree. A central feature of such explosive transitions is a hysteretic behavior at the transition to synchronization. We unravel the underlying mechanisms and show that the dynamical origin of the hysteresis is a change of basin of attraction of the…
▽ More
Spontaneous explosive emergent behavior takes place in heterogeneous networks when the frequencies of the nodes are positively correlated to the node degree. A central feature of such explosive transitions is a hysteretic behavior at the transition to synchronization. We unravel the underlying mechanisms and show that the dynamical origin of the hysteresis is a change of basin of attraction of the synchronization state. Our findings hold for heterogeneous networks with star graph motifs such as scale free networks, and hence reveal how microscopic network parameters such as node degree and frequency affect the global network properties and can be used for network design and control.
△ Less
Submitted 11 February, 2014; v1 submitted 6 January, 2014;
originally announced January 2014.
-
Exactly scale-free scale-free networks
Authors:
Linjun Zhang,
Michael Small,
Kevin Judd
Abstract:
Many complex natural and physical systems exhibit patterns of interconnection that conform, approximately, to a network structure referred to as scale-free. Preferential attachment is one of many algorithms that have been introduced to model the growth and structure of scale-free networks. With so many different models of scale-free networks it is unclear what properties of scale-free networks are…
▽ More
Many complex natural and physical systems exhibit patterns of interconnection that conform, approximately, to a network structure referred to as scale-free. Preferential attachment is one of many algorithms that have been introduced to model the growth and structure of scale-free networks. With so many different models of scale-free networks it is unclear what properties of scale-free networks are typical, and what properties are peculiarities of a particular growth or construction process. We propose a simple maximum entropy process which provides the best representation of what are typical properties of scale-free networks, and provides a standard against which real and algorithmically generated networks can be compared. As an example we consider preferential attachment and find that this particular growth model does not yield typical realizations of scale-free networks. In particular, the widely discussed "fragility" of scale-free networks is actually found to be due to the peculiar "hub-centric" structure of preferential attachment networks. We provide a method to generate or remove this latent hub-centric bias --- thereby demonstrating exactly which features of preferential attachment networks are atypical of the broader class of scale-free networks. We are also able to statistically demonstrate whether real networks are typical realizations of scale-free networks, or networks with that particular degree distribution; using a new surrogate generation method for complex networks, exactly analogous the the widely used surrogate tests of nonlinear time series analysis.
△ Less
Submitted 16 November, 2014; v1 submitted 4 September, 2013;
originally announced September 2013.
-
Complex Network Approach to the Statistical Features of the Sunspot Series
Authors:
Yong Zou,
Michael Small,
Zonghua Liu,
Jürgen Kurths
Abstract:
Complex network approaches have been recently developed as an alternative framework to study the statistical features of time-series data. We perform a visibility-graph analysis on both the daily and monthly sunspot series. Based on the data, we propose two ways to construct the network: one is from the original observable measurements and the other is from a negative-inverse-transformed series. T…
▽ More
Complex network approaches have been recently developed as an alternative framework to study the statistical features of time-series data. We perform a visibility-graph analysis on both the daily and monthly sunspot series. Based on the data, we propose two ways to construct the network: one is from the original observable measurements and the other is from a negative-inverse-transformed series. The degree distribution of the derived networks for the strong maxima has clear non-Gaussian properties, while the degree distribution for minima is bimodal. The long-term variation of the cycles is reflected by hubs in the network which span relatively large time intervals. Based on standard network structural measures, we propose to characterize the long-term correlations by waiting times between two subsequent events. The persistence range of the solar cycles has been identified over 15\,--\,1000 days by a power-law regime with scaling exponent $γ= 2.04$ of the occurrence time of the two subsequent and successive strong minima. In contrast, a persistent trend is not present in the maximal numbers, although maxima do have significant deviations from an exponential form. Our results suggest some new insights for evaluating existing models. The power-law regime suggested by the waiting times does indicate that there are some level of predictable patterns in the minima.
△ Less
Submitted 23 July, 2013;
originally announced July 2013.
-
A surrogate for networks -- How scale-free is my scale-free network?
Authors:
Michael Small,
Kevin Judd,
Thomas Stemler
Abstract:
Complex networks are now being studied in a wide range of disciplines across science and technology. In this paper we propose a method by which one can probe the properties of experimentally obtained network data. Rather than just measuring properties of a network inferred from data, we aim to ask how typical is that network? What properties of the observed network are typical of all such scale fr…
▽ More
Complex networks are now being studied in a wide range of disciplines across science and technology. In this paper we propose a method by which one can probe the properties of experimentally obtained network data. Rather than just measuring properties of a network inferred from data, we aim to ask how typical is that network? What properties of the observed network are typical of all such scale free networks, and which are peculiar? To do this we propose a series of methods that can be used to generate statistically likely complex networks which are both similar to the observed data and also consistent with an underlying null-hypothesis -- for example a particular degree distribution. There is a direct analogy between the approach we propose here and the surrogate data methods applied to nonlinear time series data.
△ Less
Submitted 17 June, 2013;
originally announced June 2013.
-
What exactly are the properties of scale-free and other networks?
Authors:
Kevin Judd,
Michael Small,
Thomas Stemler
Abstract:
The concept of scale-free networks has been widely applied across natural and physical sciences. Many claims are made about the properties of these networks, even though the concept of scale-free is often vaguely defined. We present tools and procedures to analyse the statistical properties of networks defined by arbitrary degree distributions and other constraints. Doing so reveals the highly lik…
▽ More
The concept of scale-free networks has been widely applied across natural and physical sciences. Many claims are made about the properties of these networks, even though the concept of scale-free is often vaguely defined. We present tools and procedures to analyse the statistical properties of networks defined by arbitrary degree distributions and other constraints. Doing so reveals the highly likely properties, and some unrecognised richness, of scale-free networks, and casts doubt on some previously claimed properties being due to a scale-free characteristic.
△ Less
Submitted 30 May, 2013;
originally announced May 2013.
-
Super-star networks: Growing optimal scale-free networks via likelihood
Authors:
Michael Small,
Yingying Li,
Thomas Stemler,
Kevin Judd
Abstract:
Preferential attachment --- by which new nodes attach to existing nodes with probability proportional to the existing nodes' degree --- has become the standard growth model for scale-free networks, where the asymptotic probability of a node having degree $k$ is proportional to $k^{-γ}$. However, the motivation for this model is entirely ad hoc. We use exact likelihood arguments and show that the o…
▽ More
Preferential attachment --- by which new nodes attach to existing nodes with probability proportional to the existing nodes' degree --- has become the standard growth model for scale-free networks, where the asymptotic probability of a node having degree $k$ is proportional to $k^{-γ}$. However, the motivation for this model is entirely ad hoc. We use exact likelihood arguments and show that the optimal way to build a scale-free network is to attach most new links to nodes of low degree. Curiously, this leads to a scale-free networks with a single dominant hub: a star-like structure we call a super-star network. Asymptotically, the optimal strategy is to attach each new node to one of the nodes of degree $k$ with probability proportional to $\frac{1}{N+ζ(γ)(k+1)^γ}$ (in a $N$ node network) --- a stronger bias toward high degree nodes than exhibited by standard preferential attachment. Our algorithm generates optimally scale-free networks (the super-star networks) as well as randomly sampling the space of all scale-free networks with a given degree exponent $γ$. We generate viable realisation with finite $N$ for $1\ll γ<2$ as well as $γ>2$. We observe an apparently discontinuous transition at $γ\approx 2$ between so-called super-star networks and more tree-like realisations. Gradually increasing $γ$ further leads to re-emergence of a super-star hub. To quantify these structural features we derive a new analytic expression for the expected degree exponent of a pure preferential attachment process, and introduce alternative measures of network entropy. Our approach is generic and may also be applied to an arbitrary degree distribution.
△ Less
Submitted 10 November, 2014; v1 submitted 28 May, 2013;
originally announced May 2013.
-
The instability of followers and emergent vorticity in flocking behaviour for an experimental interaction rule
Authors:
Michael Small,
Xiaoke Xu
Abstract:
Computational models of collective behavior in birds has allowed us to infer interaction rules directly from experimental data. Using a generic form of these rules we explore the collective behavior and emergent dynamics of a simulated swarm. For a wide range of flock size and interaction extent (the fixed number of neighbors with which an individual will interact) we find that the computational c…
▽ More
Computational models of collective behavior in birds has allowed us to infer interaction rules directly from experimental data. Using a generic form of these rules we explore the collective behavior and emergent dynamics of a simulated swarm. For a wide range of flock size and interaction extent (the fixed number of neighbors with which an individual will interact) we find that the computational collective is inherently stable --- individuals are attracted to one another and will position themselves a preferred distance from their fixed neighbors within a rigid lattice. Nonetheless, the irregular overall shape of the flock, coupled with the need for individuals on the boundary to move towards their neighbors creates a torque which leads the flock to rotate and then meander. We argue that this "rolling meander" is a very good proxy for real collective behavior in animal species and yet arises from a simple homogeneous and deterministic rule for interaction. Rather than then introduce leaders --- which has already been shown, quite straightforwardly, to drive collective swarms such as this --- we introduce a small number of "followers". Each follower is bound to consider a random fixed individual to be among their neighbors, irrespective of actual metric distance between them. We find that the introduction of a small number of such followers causes a phase transition that quickly leads to instability in the flock structure (as no stable configuration arises) and the previously rigid crystalline interaction among neighbors now becomes fluid: the distance between neighbors decreases, the flock ceases to rotate and meanders less.
△ Less
Submitted 23 July, 2012;
originally announced July 2012.
-
The stability of networks --- towards a structural dynamical systems theory
Authors:
Michael Small,
Kevin Judd,
Thomas Stemler
Abstract:
The need to build a link between the structure of a complex network and the dynamical properties of the corresponding complex system (comprised of multiple low dimensional systems) has recently become apparent. Several attempts to tackle this problem have been made and all focus on either the controllability or synchronisability of the network --- usually analyzed by way of the master stability fu…
▽ More
The need to build a link between the structure of a complex network and the dynamical properties of the corresponding complex system (comprised of multiple low dimensional systems) has recently become apparent. Several attempts to tackle this problem have been made and all focus on either the controllability or synchronisability of the network --- usually analyzed by way of the master stability function, or the graph Laplacian. We take a different approach. Using the basic tools from dynamical systems theory we show that the dynamical stability of a network can easily be defined in terms of the eigenvalues of an homologue of the network adjacency matrix. This allows us to compute the stability of a network (a quantity derived from the eigenspectrum of the adjacency matrix). Numerical experiments show that this quantity is very closely related too, and can even be predicted from, the standard structural network properties. Following from this we show that the stability of large network systems can be understood via an analytic study of the eigenvalues of their fixed points --- even for a very large number of fixed points.
△ Less
Submitted 15 June, 2012; v1 submitted 11 June, 2012;
originally announced June 2012.
-
Multiscale characterization of recurrence-based phase space networks constructed from time series
Authors:
Ruoxi Xiang,
Jie Zhang,
Xiao-ke Xu,
Michael Small
Abstract:
Recently, a framework for analyzing time series by constructing an associated complex network has attracted significant research interest. One of the advantages of the complex network method for studying time series is that complex network theory provides a tool to describe either important nodes, or structures that exist in the networks, at different topological scale. This can then provide disti…
▽ More
Recently, a framework for analyzing time series by constructing an associated complex network has attracted significant research interest. One of the advantages of the complex network method for studying time series is that complex network theory provides a tool to describe either important nodes, or structures that exist in the networks, at different topological scale. This can then provide distinct information for time series of different dynamical systems. In this paper, we systematically investigate the recurrence-based phase space network of order $k$ that has previously been used to specify different types of dynamics in terms of the motif ranking from a different perspective. Globally, we find that the network size scales with different scale exponents and the degree distribution follows a quasi-symmetric bell shape around the value of $2k$ with different values of degree variance from periodic to chaotic Rössler systems. Local network properties such as the vertex degree, the clustering coefficients and betweenness centrality are found to be sensitive to the local stability of the orbits and hence contain complementary information.
△ Less
Submitted 30 April, 2012;
originally announced April 2012.
-
Generating self-organizing collective behavior using separation dynamics from experimental data
Authors:
Graciano Dieck Kattas,
Xiao-ke Xu,
Michael Small
Abstract:
Mathematical models for systems of interacting agents using simple local rules have been proposed and shown to exhibit emergent swarming behavior. Most of these models are constructed by intuition or manual observations of real phenomena, and later tuned or verified to simulate desired dynamics. In contrast to this approach, we propose using a model that attempts to follow an averaged rule of the…
▽ More
Mathematical models for systems of interacting agents using simple local rules have been proposed and shown to exhibit emergent swarming behavior. Most of these models are constructed by intuition or manual observations of real phenomena, and later tuned or verified to simulate desired dynamics. In contrast to this approach, we propose using a model that attempts to follow an averaged rule of the essential distance-dependent collective behavior of real pigeon flocks, which was abstracted from experimental data. By using a simple model to follow the behavioral tendencies of real data, we show that our model can exhibit emergent self-organizing dynamics such as flocking, pattern formation, and counter-rotating vortices. The range of behaviors observed in our simulations are richer than the standard models of collective dynamics, and should thereby give potential for new models of complex behavior.
△ Less
Submitted 30 April, 2012;
originally announced April 2012.
-
Neuronal avalanches of a self-organized neural network with active-neuron-dominant structure
Authors:
Xiumin Li,
Michael Small
Abstract:
Neuronal avalanche is a spontaneous neuronal activity which obeys a power-law distribution of population event sizes with an exponent of -3/2. It has been observed in the superficial layers of cortex both \emph{in vivo} and \emph{in vitro}. In this paper we analyze the information transmission of a novel self-organized neural network with active-neuron-dominant structure. Neuronal avalanches can b…
▽ More
Neuronal avalanche is a spontaneous neuronal activity which obeys a power-law distribution of population event sizes with an exponent of -3/2. It has been observed in the superficial layers of cortex both \emph{in vivo} and \emph{in vitro}. In this paper we analyze the information transmission of a novel self-organized neural network with active-neuron-dominant structure. Neuronal avalanches can be observed in this network with appropriate input intensity. We find that the process of network learning via spike-timing dependent plasticity dramatically increases the complexity of network structure, which is finally self-organized to be active-neuron-dominant connectivity. Both the entropy of activity patterns and the complexity of their resulting post-synaptic inputs are maximized when the network dynamics are propagated as neuronal avalanches. This emergent topology is beneficial for information transmission with high efficiency and also could be responsible for the large information capacity of this network compared with alternative archetypal networks with different neural connectivity.
△ Less
Submitted 29 April, 2012;
originally announced April 2012.
-
Predicting the outcome of roulette
Authors:
Michael Small,
Chi Kong Tse
Abstract:
There have been several popular reports of various groups exploiting the deterministic nature of the game of roulette for profit. Moreover, through its history the inherent determinism in the game of roulette has attracted the attention of many luminaries of chaos theory. In this paper we provide a short review of that history and then set out to determine to what extent that determinism can reall…
▽ More
There have been several popular reports of various groups exploiting the deterministic nature of the game of roulette for profit. Moreover, through its history the inherent determinism in the game of roulette has attracted the attention of many luminaries of chaos theory. In this paper we provide a short review of that history and then set out to determine to what extent that determinism can really be exploited for profit. To do this, we provide a very simple model for the motion of a roulette wheel and ball and demonstrate that knowledge of initial position, velocity and acceleration is sufficient to predict the outcome with adequate certainty to achieve a positive expected return. We describe two physically realisable systems to obtain this knowledge both incognito and {\em in situ}. The first system relies only on a mechanical count of rotation of the ball and the wheel to measure the relevant parameters. By applying this techniques to a standard casino-grade European roulette wheel we demonstrate an expected return of at least 18%, well above the -2.7% expected of a random bet. With a more sophisticated, albeit more intrusive, system (mounting a digital camera above the wheel) we demonstrate a range of systematic and statistically significant biases which can be exploited to provide an improved guess of the outcome. Finally, our analysis demonstrates that even a very slight slant in the roulette table leads to a very pronounced bias which could be further exploited to substantially enhance returns.
△ Less
Submitted 13 July, 2012; v1 submitted 28 April, 2012;
originally announced April 2012.
-
Recurrence-based time series analysis by means of complex network methods
Authors:
Reik V. Donner,
Michael Small,
Jonathan F. Donges,
Norbert Marwan,
Yong Zou,
Ruoxi Xiang,
Jürgen Kurths
Abstract:
Complex networks are an important paradigm of modern complex systems sciences which allows quantitatively assessing the structural properties of systems composed of different interacting entities. During the last years, intensive efforts have been spent on applying network-based concepts also for the analysis of dynamically relevant higher-order statistical properties of time series. Notably, many…
▽ More
Complex networks are an important paradigm of modern complex systems sciences which allows quantitatively assessing the structural properties of systems composed of different interacting entities. During the last years, intensive efforts have been spent on applying network-based concepts also for the analysis of dynamically relevant higher-order statistical properties of time series. Notably, many corresponding approaches are closely related with the concept of recurrence in phase space. In this paper, we review recent methodological advances in time series analysis based on complex networks, with a special emphasis on methods founded on recurrence plots. The potentials and limitations of the individual methods are discussed and illustrated for paradigmatic examples of dynamical systems as well as for real-world time series. Complex network measures are shown to provide information about structural features of dynamical systems that are complementary to those characterized by other methods of time series analysis and, hence, substantially enrich the knowledge gathered from other existing (linear as well as nonlinear) approaches.
△ Less
Submitted 25 October, 2010;
originally announced October 2010.
-
Flocking of Multi-agent Dynamical Systems Based on Pseudo-leader Mechanism
Authors:
Jin Zhou,
Wenwu Yu,
Xiaoqun Wu,
Michael Small,
Jun-an Lu
Abstract:
Flocking behavior of multiple agents can be widely observed in nature such as schooling fish and flocking birds. Recent literature has proposed the possibility that flocking is possible even only a small fraction of agents are informed of the desired position and velocity. However, it is still a challenging problem to determine which agents should be informed or have the ability to detect the de…
▽ More
Flocking behavior of multiple agents can be widely observed in nature such as schooling fish and flocking birds. Recent literature has proposed the possibility that flocking is possible even only a small fraction of agents are informed of the desired position and velocity. However, it is still a challenging problem to determine which agents should be informed or have the ability to detect the desired information. This paper aims to address this problem. By combining the ideas of virtual force and pseudo-leader mechanism, where a pseudo-leader represents an agent who can detect the desired information, we propose a scheme for choosing pseudo-leaders in a multi-agent group. The presented scheme can be applied to a multi-agent group even with an unconnected or switching neighbor graph. Experiments are given to show that the methods presented in this paper are of high accuracy and perform well.
△ Less
Submitted 7 May, 2009;
originally announced May 2009.
-
Dynamics and Synchrony from Oscillatory Data via Dimension Reduction
Authors:
J. Zhang,
K. Zhang,
J. Feng,
J. Sun,
X. Xu,
M. Small
Abstract:
Complex, oscillatory data arises from a large variety of biological, physical, and social systems. However, the inherent oscillation and ubiquitous noise pose great challenges to current methodology such as linear and nonlinear time series analysis. We exploit the state of the art technology in pattern recognition and specifically, dimensionality reduction techniques, and propose to rebuild the…
▽ More
Complex, oscillatory data arises from a large variety of biological, physical, and social systems. However, the inherent oscillation and ubiquitous noise pose great challenges to current methodology such as linear and nonlinear time series analysis. We exploit the state of the art technology in pattern recognition and specifically, dimensionality reduction techniques, and propose to rebuild the dynamics accurately on the cycle scale. This is achieved by deriving a compact representation of the cycles through global optimization, which effectively preserves the topology of the cycles that are embedded in a high dimensional Euclidian space. Our approach demonstrates a clear success in capturing the intrinsic dynamics and the subtle synchrony pattern from uni/bivariate oscillatory data over traditional methods. Application to the human locomotion data reveals important dynamical information which allows for a clinically promising discrimination between healthy subjects and those with neural pathology. Our results also provide fundamental implications for understanding the neuromuscular control of human walking.
△ Less
Submitted 18 September, 2008;
originally announced September 2008.
-
Asymptotically pivotal statistic for surrogate testing with extended hypothesis
Authors:
Xiaodong Luo,
Jie Zhang,
Junfeng Sun,
Michael Small,
Irene Moroz
Abstract:
The method of surrogate data provides a framework for testing observed data against a hierarchy of alternative hypotheses. The aim of applying this method is to exclude the possibility that the data are consistent with simple linear explanations before seeking complex nonlinear causes. However, in recent time the method has attracted considerable criticism, largely as a result of ambiguity about…
▽ More
The method of surrogate data provides a framework for testing observed data against a hierarchy of alternative hypotheses. The aim of applying this method is to exclude the possibility that the data are consistent with simple linear explanations before seeking complex nonlinear causes. However, in recent time the method has attracted considerable criticism, largely as a result of ambiguity about the formation of the underlying null hypotheses, or about the power of the chosen statistic. In this communication we show that by employing a special family of ranks statistics these problems can be avoided and the method of surrogate data placed of a firm statistical foundation.
△ Less
Submitted 2 January, 2007;
originally announced January 2007.
-
Surrogate data method applied to nonlinear time series
Authors:
Xiaodong Luo,
Tomomichi Nakamura,
Michael Small
Abstract:
The surrogate data method is widely applied as a data dependent technique to test observed time series against a barrage of hypotheses. However, often the hypotheses one is able to address are not those of greatest interest, particularly for system known to be nonlinear. In the review we focus on techniques which overcome this shortcoming. We summarize a number of recently developed surrogate da…
▽ More
The surrogate data method is widely applied as a data dependent technique to test observed time series against a barrage of hypotheses. However, often the hypotheses one is able to address are not those of greatest interest, particularly for system known to be nonlinear. In the review we focus on techniques which overcome this shortcoming. We summarize a number of recently developed surrogate data methods. While our review of surrogate methods is not exhaustive, we do focus on methods which may be applied to experimental, and potentially nonlinear, data. In each case, the hypothesis being tested is one of the interests to the experimental scientist.
△ Less
Submitted 1 March, 2006;
originally announced March 2006.
-
Exact nonparametric inference for detection of nonlinear determinism
Authors:
Xiaodong Luo,
Jie Zhang,
Michael Small,
Irene Moroz
Abstract:
We propose an exact nonparametric inference scheme for the detection of nonlinear determinism. The essential fact utilized in our scheme is that, for a linear stochastic process with jointly symmetric innovations, its ordinary least square (OLS) linear prediction error is symmetric about zero. Based on this viewpoint, a class of linear signed rank statistics, e.g. the Wilcoxon signed rank statis…
▽ More
We propose an exact nonparametric inference scheme for the detection of nonlinear determinism. The essential fact utilized in our scheme is that, for a linear stochastic process with jointly symmetric innovations, its ordinary least square (OLS) linear prediction error is symmetric about zero. Based on this viewpoint, a class of linear signed rank statistics, e.g. the Wilcoxon signed rank statistic, can be derived with the known null distributions from the prediction error. Thus one of the advantages of our scheme is that, it can provide exact confidence levels for our null hypothesis tests. Furthermore, the exactness is applicable for finite samples with arbitrary length. We demonstrate the test power of this statistic through several examples.
△ Less
Submitted 4 November, 2006; v1 submitted 23 July, 2005;
originally announced July 2005.
-
Optimal phase space projection for noise reduction
Authors:
Xiaodong Luo,
Jie Zhang,
Michael Small
Abstract:
In this communication we will re-examine the widely studied technique of phase space projection. By imposing a time domain constraint (TDC) on the residual noise, we deduce a more general version of the optimal projector, which includes those appearing in previous literature as subcases but does not assume the independence between the clean signal and the noise. As an application, we will apply…
▽ More
In this communication we will re-examine the widely studied technique of phase space projection. By imposing a time domain constraint (TDC) on the residual noise, we deduce a more general version of the optimal projector, which includes those appearing in previous literature as subcases but does not assume the independence between the clean signal and the noise. As an application, we will apply this technique for noise reduction. Numerical results show that our algorithm has succeeded in augmenting the signal-to-noise ratio (SNR) for simulated data from the Rössler system and experimental speech record.
△ Less
Submitted 4 September, 2005; v1 submitted 7 June, 2005;
originally announced June 2005.
-
Surrogate Test to Distinguish between Chaotic and Pseudoperiodic Time Series
Authors:
Xiaodong Luo,
Tomomichi Nakamura,
Michael Small
Abstract:
In this communication a new algorithm is proposed to produce surrogates for pseudoperiodic time series. By imposing a few constraints on the noise components of pseudoperiodic data sets, we devise an effective method to generate surrogates. Unlike other algorithms, this method properly copes with pseudoperiodic orbits contaminated with linear colored observational noise. We will demonstrate the…
▽ More
In this communication a new algorithm is proposed to produce surrogates for pseudoperiodic time series. By imposing a few constraints on the noise components of pseudoperiodic data sets, we devise an effective method to generate surrogates. Unlike other algorithms, this method properly copes with pseudoperiodic orbits contaminated with linear colored observational noise. We will demonstrate the ability of this algorithm to distinguish chaotic orbits from pseudoperiodic orbits through simulation data sets from theRössler system. As an example of application of this algorithm, we will also employ it to investigate a human electrocardiogram (ECG) record.
△ Less
Submitted 6 January, 2005; v1 submitted 29 April, 2004;
originally announced April 2004.
-
Geometric measures of redundance and irrelevance tradeoff exponent to choose suitable delay times for continuous systems
Authors:
Xiaodong Luo,
Michael Small
Abstract:
Using the concept of the geometric measures of redundance and irrelevance tradeoff exponent (RITE)}, we present a new method to determine suitable delay times for continuous systems. After applying the RITE algorithm to both simulation and experimental observations, we find the results obtained are close to those obtained from the criterion of the average mutual information (AMI), while the RITE…
▽ More
Using the concept of the geometric measures of redundance and irrelevance tradeoff exponent (RITE)}, we present a new method to determine suitable delay times for continuous systems. After applying the RITE algorithm to both simulation and experimental observations, we find the results obtained are close to those obtained from the criterion of the average mutual information (AMI), while the RITE algorithm has the following advantages: simple implementation, reasonable computational cost and robust performance against observational noise.
△ Less
Submitted 10 December, 2003;
originally announced December 2003.
-
Optimal time delay embedding for nonlinear time series modeling
Authors:
Michael Small
Abstract:
When building linear or nonlinear models one is faced with the problem of selecting the best set of variable with which to predict the future dynamics. In nonlinear time series analysis the problem is to select the correct time delays in the time delay embedding. We propose a new technique which can quantify the suitability of a particular set of variables and we suggests a computationally effic…
▽ More
When building linear or nonlinear models one is faced with the problem of selecting the best set of variable with which to predict the future dynamics. In nonlinear time series analysis the problem is to select the correct time delays in the time delay embedding. We propose a new technique which can quantify the suitability of a particular set of variables and we suggests a computationally efficient scheme to determine the best non-uniform time delay embedding for modeling of time series. Our results are based on the assumption that, in general, the variables which give the best local constant model will also give the best nonlinear model. In a wide variety of experimental and simulated systems we find that this method produces dynamics that are more realistic and predictions that are more accurate than standard uniform embeddings.
△ Less
Submitted 5 December, 2003;
originally announced December 2003.
-
Optimal embedding parameters: A modelling paradigm
Authors:
Michael Small,
Chi K. Tse
Abstract:
Reconstruction of a dynamical system from a time series requires the selection of two parameters, the embedding dimension $d_e$ and the embedding lag $τ$. Many competing criteria to select these parameters exist, and all are heuristic. Within the context of modeling the evolution operator of the underlying dynamical system, we show that one only need be concerned with the product $d_eτ$. We intr…
▽ More
Reconstruction of a dynamical system from a time series requires the selection of two parameters, the embedding dimension $d_e$ and the embedding lag $τ$. Many competing criteria to select these parameters exist, and all are heuristic. Within the context of modeling the evolution operator of the underlying dynamical system, we show that one only need be concerned with the product $d_eτ$. We introduce an information theoretic criteria for the optimal selection of the embedding window $d_w=d_eτ$. For infinitely long time series this method is equivalent to selecting the embedding lag that minimises the nonlinear model prediction error. For short and noisy time series we find that the results of this new algorithm are data dependent and superior to estimation of embedding parameters with the standard techniques.
△ Less
Submitted 29 August, 2003;
originally announced August 2003.
-
Estimating the distribution of dynamic invariants: Illustrated with an application to human photo-plethysmographic time series
Authors:
Michael Small
Abstract:
Dynamic invariants are often estimated from experimental time series with the aim of differentiating between different physical states in the underlying system. The most popular schemes for estimating dynamic invariants are capable of estimating confidence intervals, however such confidence intervals do not reflect variability in the underlying dynamics. In this communication we propose a surrog…
▽ More
Dynamic invariants are often estimated from experimental time series with the aim of differentiating between different physical states in the underlying system. The most popular schemes for estimating dynamic invariants are capable of estimating confidence intervals, however such confidence intervals do not reflect variability in the underlying dynamics. In this communication we propose a surrogate based method to estimate the expected distribution of values under the null hypothesis that the underlying deterministic dynamics are stationary. We demonstrate the application of this method by considering four recordings of human pulse waveforms in differing physiological states and provide conclusive evidence that correlation dimension is capable of differentiating between three (but not all four) of these states.
△ Less
Submitted 29 August, 2003;
originally announced August 2003.
-
Detecting periodicity in experimental data using linear modeling techniques
Authors:
Michael Small,
Kevin Judd
Abstract:
Fourier spectral estimates and, to a lesser extent, the autocorrelation function are the primary tools to detect periodicities in experimental data in the physical and biological sciences. We propose a new method which is more reliable than traditional techniques, and is able to make clear identification of periodic behavior when traditional techniques do not. This technique is based on an infor…
▽ More
Fourier spectral estimates and, to a lesser extent, the autocorrelation function are the primary tools to detect periodicities in experimental data in the physical and biological sciences. We propose a new method which is more reliable than traditional techniques, and is able to make clear identification of periodic behavior when traditional techniques do not. This technique is based on an information theoretic reduction of linear (autoregressive) models so that only the essential features of an autoregressive model are retained. These models we call reduced autoregressive models (RARM). The essential features of reduced autoregressive models include any periodicity present in the data. We provide theoretical and numerical evidence from both experimental and artificial data, to demonstrate that this technique will reliably detect periodicities if and only if they are present in the data. There are strong information theoretic arguments to support the statement that RARM detects periodicities if they are present. Surrogate data techniques are used to ensure the converse. Furthermore, our calculations demonstrate that RARM is more robust, more accurate, and more sensitive, than traditional spectral techniques.
△ Less
Submitted 21 October, 1998; v1 submitted 13 October, 1998;
originally announced October 1998.
