-
Leveraging chaos in the training of artificial neural networks
Authors:
Pedro Jiménez-González,
Miguel C. Soriano,
Lucas Lacasa
Abstract:
Traditional algorithms to optimize artificial neural networks when confronted with a supervised learning task are usually exploitation-type relaxational dynamics such as gradient descent (GD). Here, we explore the dynamics of the neural network trajectory along training for unconventionally large learning rates. We show that for a region of values of the learning rate, the GD optimization shifts a…
▽ More
Traditional algorithms to optimize artificial neural networks when confronted with a supervised learning task are usually exploitation-type relaxational dynamics such as gradient descent (GD). Here, we explore the dynamics of the neural network trajectory along training for unconventionally large learning rates. We show that for a region of values of the learning rate, the GD optimization shifts away from purely exploitation-like algorithm into a regime of exploration-exploitation balance, as the neural network is still capable of learning but the trajectory shows sensitive dependence on initial conditions -- as characterized by positive network maximum Lyapunov exponent --. Interestingly, the characteristic training time required to reach an acceptable accuracy in the test set reaches a minimum precisely in such learning rate region, further suggesting that one can accelerate the training of artificial neural networks by locating at the onset of chaos. Our results -- initially illustrated for the MNIST classification task -- qualitatively hold for a range of supervised learning tasks, learning architectures and other hyperparameters, and showcase the emergent, constructive role of transient chaotic dynamics in the training of artificial neural networks.
△ Less
Submitted 10 June, 2025;
originally announced June 2025.
-
Dynamical stability and chaos in artificial neural network trajectories along training
Authors:
Kaloyan Danovski,
Miguel C. Soriano,
Lucas Lacasa
Abstract:
The process of training an artificial neural network involves iteratively adapting its parameters so as to minimize the error of the network's prediction, when confronted with a learning task. This iterative change can be naturally interpreted as a trajectory in network space -- a time series of networks -- and thus the training algorithm (e.g. gradient descent optimization of a suitable loss func…
▽ More
The process of training an artificial neural network involves iteratively adapting its parameters so as to minimize the error of the network's prediction, when confronted with a learning task. This iterative change can be naturally interpreted as a trajectory in network space -- a time series of networks -- and thus the training algorithm (e.g. gradient descent optimization of a suitable loss function) can be interpreted as a dynamical system in graph space. In order to illustrate this interpretation, here we study the dynamical properties of this process by analyzing through this lens the network trajectories of a shallow neural network, and its evolution through learning a simple classification task. We systematically consider different ranges of the learning rate and explore both the dynamical and orbital stability of the resulting network trajectories, finding hints of regular and chaotic behavior depending on the learning rate regime. Our findings are put in contrast to common wisdom on convergence properties of neural networks and dynamical systems theory. This work also contributes to the cross-fertilization of ideas between dynamical systems theory, network theory and machine learning
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
An effective theory of collective deep learning
Authors:
Lluís Arola-Fernández,
Lucas Lacasa
Abstract:
Unraveling the emergence of collective learning in systems of coupled artificial neural networks points to broader implications for machine learning, neuroscience, and society. Here we introduce a minimal model that condenses several recent decentralized algorithms by considering a competition between two terms: the local learning dynamics in the parameters of each neural network unit, and a diffu…
▽ More
Unraveling the emergence of collective learning in systems of coupled artificial neural networks points to broader implications for machine learning, neuroscience, and society. Here we introduce a minimal model that condenses several recent decentralized algorithms by considering a competition between two terms: the local learning dynamics in the parameters of each neural network unit, and a diffusive coupling among units that tends to homogenize the parameters of the ensemble. We derive an effective theory for linear networks to show that the coarse-grained behavior of our system is equivalent to a deformed Ginzburg-Landau model with quenched disorder. This framework predicts depth-dependent disorder-order-disorder phase transitions in the parameters' solutions that reveal a depth-delayed onset of a collective learning phase and a low-rank microscopic learning path. We validate the theory in coupled ensembles of realistic neural networks trained on the MNIST dataset under privacy constraints. Interestingly, experiments confirm that individual networks -- trained on private data -- can fully generalize to unseen data classes when the collective learning phase emerges. Our work establishes the physics of collective learning and contributes to the mechanistic interpretability of deep learning in decentralized settings.
△ Less
Submitted 9 November, 2023; v1 submitted 19 October, 2023;
originally announced October 2023.
-
Higher-order correlations reveal complex memory in temporal hypergraphs
Authors:
Luca Gallo,
Lucas Lacasa,
Vito Latora,
Federico Battiston
Abstract:
Many real-world complex systems are characterized by interactions in groups that change in time. Current temporal network approaches, however, are unable to describe group dynamics, as they are based on pairwise interactions only. Here, we use time-varying hypergraphs to describe such systems, and we introduce a framework based on higher-order correlations to characterize their temporal organizati…
▽ More
Many real-world complex systems are characterized by interactions in groups that change in time. Current temporal network approaches, however, are unable to describe group dynamics, as they are based on pairwise interactions only. Here, we use time-varying hypergraphs to describe such systems, and we introduce a framework based on higher-order correlations to characterize their temporal organization. We analyze various social systems, finding that groups of different sizes have typical patterns of long-range temporal correlations. Moreover, our method reveals the presence of non-trivial temporal interdependencies between different group sizes. We introduce a model of temporal hypergraphs with non-Markovian group interactions, which reveals complex memory as a fundamental mechanism underlying the pattern in the data.
△ Less
Submitted 16 March, 2023;
originally announced March 2023.
-
Chaotic renormalization group flow and entropy gradients over Haros graphs
Authors:
Jorge Calero-Sanz,
Bartolo Luque,
Lucas Lacasa
Abstract:
Haros graphs have been recently introduced as a set of graphs bijectively related to real numbers in the unit interval. Here we consider the iterated dynamics of a graph operator $\cal R$ over the set of Haros graphs. This operator was previously defined in the realm of graph-theoretical characterisation of low-dimensional nonlinear dynamics, and has a renormalization group (RG) structure. We find…
▽ More
Haros graphs have been recently introduced as a set of graphs bijectively related to real numbers in the unit interval. Here we consider the iterated dynamics of a graph operator $\cal R$ over the set of Haros graphs. This operator was previously defined in the realm of graph-theoretical characterisation of low-dimensional nonlinear dynamics, and has a renormalization group (RG) structure. We find that the dynamics of $\cal R$ over Haros graphs is complex and includes unstable periodic orbits or arbitrary period and non-mixing aperiodic orbits, overall portraiting a chaotic RG flow. We identify a single RG stable fixed point whose basin of attraction is the set of rational numbers, associate periodic RG orbits with (pure) quadratic irrationals and aperiodic RG orbits with (non-mixing) families of non-quadratic algebraic irrationals and trascendental numbers. Finally, we show that the entropy gradients inside periodic RG orbits are constant. We discuss the possible physical interpretation of such chaotic RG flow and speculate on the entropy-constant periodic orbits as a possible confirmation of a (quantum field-theoretic) $c$-theorem applied inside the invariant set of a RG flow.
△ Less
Submitted 13 December, 2022;
originally announced December 2022.
-
Network bypasses sustain complexity
Authors:
Ernesto Estrada,
Jesús Gómez-Gardeñes,
Lucas Lacasa
Abstract:
Real-world networks are neither regular nor random, a fact elegantly explained by mechanisms such as the Watts-Strogatz or the Barabasi-Albert models, among others. Both mechanisms naturally create shortcuts and hubs, which while enhancing network's connectivity, also might yield several undesired navigational effects: they tend to be overused during geodesic navigational processes -- making the n…
▽ More
Real-world networks are neither regular nor random, a fact elegantly explained by mechanisms such as the Watts-Strogatz or the Barabasi-Albert models, among others. Both mechanisms naturally create shortcuts and hubs, which while enhancing network's connectivity, also might yield several undesired navigational effects: they tend to be overused during geodesic navigational processes -- making the networks fragile -- and provide suboptimal routes for diffusive-like navigation. Why, then, networks with complex topologies are ubiquitous? Here we unveil that these models also entropically generate network bypasses: alternative routes to shortest paths which are topologically longer but easier to navigate. We develop a mathematical theory that elucidates the emergence and consolidation of network bypasses and measure their navigability gain. We apply our theory to a wide range of real-world networks and find that they sustain complexity by different amounts of network bypasses. At the top of this complexity ranking we found the human brain, which points out the importance of these results to understand the plasticity of complex systems.
△ Less
Submitted 30 June, 2023; v1 submitted 14 July, 2022;
originally announced July 2022.
-
Haros graphs: an exotic representation of real numbers
Authors:
Jorge Calero-Sanz,
Bartolo Luque,
Lucas Lacasa
Abstract:
This paper introduces Haros graphs, a construction which provides a graph-theoretical representation of real numbers in the unit interval reached via paths in the Farey binary tree. We show how the topological structure of Haros graphs yields a natural classification of the reals numbers into a hierarchy of families. To unveil such classification, we introduce an entropic functional on these graph…
▽ More
This paper introduces Haros graphs, a construction which provides a graph-theoretical representation of real numbers in the unit interval reached via paths in the Farey binary tree. We show how the topological structure of Haros graphs yields a natural classification of the reals numbers into a hierarchy of families. To unveil such classification, we introduce an entropic functional on these graphs and show that it can be expressed, thanks to its fractal nature, in terms of a generalised de Rham curve. We show that this entropy reaches a global maximum at the reciprocal of the Golden number and otherwise displays a rich hierarchy of local maxima and minima that relate to specific families of irrationals (noble numbers) and rationals, overall providing an exotic classification and representation of the reals numbers according to entropic principles. We close the paper with a number of conjectures and outline a research programme on Haros graphs.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
-
Visibility graphs of animal foraging trajectories
Authors:
Leticia R. Paiva,
Sidiney G. Alves,
Lucas Lacasa,
Og DeSouza,
Octavio Miramontes
Abstract:
The study of self-propelled particles is a fast-growing research topic where biologically inspired movement is increasingly becoming of much interest. A relevant example is the collective motion of social insects, whose variety and complexity offer fertile grounds for theoretical abstractions. It has been demonstrated that the collective motion involved in the searching behavior of termites is con…
▽ More
The study of self-propelled particles is a fast-growing research topic where biologically inspired movement is increasingly becoming of much interest. A relevant example is the collective motion of social insects, whose variety and complexity offer fertile grounds for theoretical abstractions. It has been demonstrated that the collective motion involved in the searching behavior of termites is consistent with self-similarity, anomalous diffusion and Lévy walks. In this work, we use visibility graphs -- a method that maps time series into graphs and quantifies the signal complexity via graph topological metrics -- in the context of social insects foraging trajectories extracted from experiments. Our analysis indicates that the patterns observed for isolated termites change qualitatively when the termite density is increased, and such change cannot be explained by jamming effects only, pointing to collective effects emerging due to non-trivial foraging interactions between insects as the cause. Moreover, we find that such an onset of complexity is maximized for intermediate termite densities.
△ Less
Submitted 25 April, 2022;
originally announced April 2022.
-
Time reversibility from visibility graphs of non-stationary processes
Authors:
Lucas Lacasa,
Ryan Flanagan
Abstract:
Visibility algorithms are a family of methods to map time series into networks, with the aim of describing the structure of time series and their underlying dynamical properties in graph-theoretical terms. Here we explore some properties of both natural and horizontal visibility graphs associated to several non-stationary processes, and we pay particular attention to their capacity to assess time…
▽ More
Visibility algorithms are a family of methods to map time series into networks, with the aim of describing the structure of time series and their underlying dynamical properties in graph-theoretical terms. Here we explore some properties of both natural and horizontal visibility graphs associated to several non-stationary processes, and we pay particular attention to their capacity to assess time irreversibility. Non-stationary signals are (infinitely) irreversible by definition (independently of whether the process is Markovian or producing entropy at a positive rate), and thus the link between entropy production and time series irreversibility has only been explored in non-equilibrium stationary states. Here we show that the visibility formalism naturally induces a new working definition of time irreversibility, which allows to quantify several degrees of irreversibility for stationary and non-stationary series, yielding finite values that can be used to efficiently assess the presence of memory and off-equilibrium dynamics in non-stationary processes without needs to differentiate or detrend them. We provide rigorous results complemented by extensive numerical simulations on several classes of stochastic processes.
△ Less
Submitted 5 October, 2015;
originally announced October 2015.
-
Network structure of multivariate time series
Authors:
Lucas Lacasa,
Vincenzo Nicosia,
Vito Latora
Abstract:
Our understanding of a variety of phenomena in physics, biology and economics crucially depends on the analysis of multivariate time series. While a wide range of tools and techniques for time series analysis already exist, the increasing availability of massive data structures calls for new approaches for multidimensional signal processing. We present here a non-parametric method to analyse multi…
▽ More
Our understanding of a variety of phenomena in physics, biology and economics crucially depends on the analysis of multivariate time series. While a wide range of tools and techniques for time series analysis already exist, the increasing availability of massive data structures calls for new approaches for multidimensional signal processing. We present here a non-parametric method to analyse multivariate time series, based on the mapping of a multidimensional time series into a multilayer network, which allows to extract information on a high dimensional dynamical system through the analysis of the structure of the associated multiplex network. The method is simple to implement, general, scalable, does not require ad hoc phase space partitioning, and is thus suitable for the analysis of large, heterogeneous and non-stationary time series. We show that simple structural descriptors of the associated multiplex networks allow to extract and quantify nontrivial properties of coupled chaotic maps, including the transition between different dynamical phases and the onset of various types of synchronization. As a concrete example we then study financial time series, showing that a multiplex network analysis can efficiently discriminate crises from periods of financial stability, where standard methods based on time-series symbolization often fail.
△ Less
Submitted 26 October, 2015; v1 submitted 5 August, 2014;
originally announced August 2014.
-
Phase transitions in Number Theory: from the Birthday Problem to Sidon Sets
Authors:
Bartolo Luque,
Ivan G. Torre,
Lucas Lacasa
Abstract:
In this work, we show how number theoretical problems can be fruitfully approached with the tools of statistical physics. We focus on g-Sidon sets, which describe sequences of integers whose pairwise sums are different, and propose a random decision problem which addresses the probability of a random set of k integers to be g-Sidon. First, we provide numerical evidence showing that there is a cros…
▽ More
In this work, we show how number theoretical problems can be fruitfully approached with the tools of statistical physics. We focus on g-Sidon sets, which describe sequences of integers whose pairwise sums are different, and propose a random decision problem which addresses the probability of a random set of k integers to be g-Sidon. First, we provide numerical evidence showing that there is a crossover between satisfiable and unsatisfiable phases which converts to an abrupt phase transition in a properly defined thermodynamic limit. Initially assuming independence, we then develop a mean field theory for the g-Sidon decision problem. We further improve the mean field theory, which is only qualitatively correct, by incorporating deviations from independence, yielding results in good quantitative agreement with the numerics for both finite systems and in the thermodynamic limit. Connections between the generalized birthday problem in probability theory, the number theory of Sidon sets and the properties of q-Potts models in condensed matter physics are briefly discussed.
△ Less
Submitted 12 October, 2013;
originally announced October 2013.
-
Horizontal Visibility graphs generated by type-I intermittency
Authors:
Ángel M. Núñez,
Bartolo Luque,
Lucas Lacasa,
José Patricio Gómez,
Alberto Robledo
Abstract:
The type-I intermittency route to (or out of) chaos is investigated within the Horizontal Visibility graph theory. For that purpose, we address the trajectories generated by unimodal maps close to an inverse tangent bifurcation and construct, according to the Horizontal Visibility algorithm, their associated graphs. We show how the alternation of laminar episodes and chaotic bursts has a fingerpri…
▽ More
The type-I intermittency route to (or out of) chaos is investigated within the Horizontal Visibility graph theory. For that purpose, we address the trajectories generated by unimodal maps close to an inverse tangent bifurcation and construct, according to the Horizontal Visibility algorithm, their associated graphs. We show how the alternation of laminar episodes and chaotic bursts has a fingerprint in the resulting graph structure. Accordingly, we derive a phenomenological theory that predicts quantitative values of several network parameters. In particular, we predict that the characteristic power law scaling of the mean length of laminar trend sizes is fully inherited in the variance of the graph degree distribution, in good agreement with the numerics. We also report numerical evidence on how the characteristic power-law scaling of the Lyapunov exponent as a function of the distance to the tangent bifurcation is inherited in the graph by an analogous scaling of the block entropy over the degree distribution. Furthermore, we are able to recast the full set of HV graphs generated by intermittent dynamics into a renormalization group framework, where the fixed points of its graph-theoretical RG flow account for the different types of dynamics. We also establish that the nontrivial fixed point of this flow coincides with the tangency condition and that the corresponding invariant graph exhibit extremal entropic properties.
△ Less
Submitted 21 January, 2013;
originally announced January 2013.
-
Correlation dimension of complex networks
Authors:
Lucas Lacasa,
Jesus Gomez-Gardeñes
Abstract:
We propose a new measure to characterize the dimension of complex networks based on the ergodic theory of dynamical systems. This measure is derived from the correlation sum of a trajectory generated by a random walker navigating the network, and extends the classical Grassberger-Procaccia algorithm to the context of complex networks. The method is validated with reliable results for both syntheti…
▽ More
We propose a new measure to characterize the dimension of complex networks based on the ergodic theory of dynamical systems. This measure is derived from the correlation sum of a trajectory generated by a random walker navigating the network, and extends the classical Grassberger-Procaccia algorithm to the context of complex networks. The method is validated with reliable results for both synthetic networks and real-world networks such as the world air-transportation network or urban networks, and provides a computationally fast way for estimating the dimensionality of networks which only relies on the local information provided by the walkers.
△ Less
Submitted 11 April, 2013; v1 submitted 8 November, 2012;
originally announced November 2012.
-
Phase transition in the Countdown problem
Authors:
Lucas Lacasa,
Bartolo Luque
Abstract:
Here we present a combinatorial decision problem, inspired by the celebrated quiz show called the countdown, that involves the computation of a given target number T from a set of k randomly chosen integers along with a set of arithmetic operations. We find that the probability of winning the game evidences a threshold phenomenon that can be understood in the terms of an algorithmic phase transiti…
▽ More
Here we present a combinatorial decision problem, inspired by the celebrated quiz show called the countdown, that involves the computation of a given target number T from a set of k randomly chosen integers along with a set of arithmetic operations. We find that the probability of winning the game evidences a threshold phenomenon that can be understood in the terms of an algorithmic phase transition as a function of the set size k. Numerical simulations show that such probability sharply transitions from zero to one at some critical value of the control parameter, hence separating the algorithm's parameter space in different phases. We also find that the system is maximally efficient close to the critical point. We then derive analytical expressions that match the numerical results for finite size and permit us to extrapolate the behavior in the thermodynamic limit.
△ Less
Submitted 13 June, 2012;
originally announced June 2012.
-
Feigenbaum graphs at the onset of chaos
Authors:
Bartolo Luque,
Lucas Lacasa,
Alberto Robledo
Abstract:
We analyze the properties of the self-similar network obtained from the trajectories of unimodal maps at the transition to chaos via the horizontal visibility (HV) algorithm. We first show that this network is uniquely determined by the encoded sequence of positions in the dynamics within the Feigenbaum attractor and it is universal in that it is independent of the shape and nonlinearity of the ma…
▽ More
We analyze the properties of the self-similar network obtained from the trajectories of unimodal maps at the transition to chaos via the horizontal visibility (HV) algorithm. We first show that this network is uniquely determined by the encoded sequence of positions in the dynamics within the Feigenbaum attractor and it is universal in that it is independent of the shape and nonlinearity of the maps in this class. We then find that the network degrees fluctuate at all scales with an amplitude that increases as the size of the network grows. This suggests the definition of a graph-theoretical Lyapunov exponent that measures the expansion rate of trajectories in network space. On good agreement with the map's counterpart, while at the onset of chaos this exponent vanishes, the subexponential expansion and contraction of network degrees can be fully described via a Tsallis-type scalar deformation of the expansion rate, that yields a discrete spectrum of non-null generalized exponents. We further explore the possibility of defining an entropy growth rate that describes the amount of information created along the trajectories in network space. Making use of the trajectory distributions in the map's accumulation point and the scaling properties of the associated network, we show that such entropic growth rate coincides with the spectrum of graph-theoretical exponents, what appears as a set of Pesin-like identities in the network.
△ Less
Submitted 31 October, 2012; v1 submitted 9 May, 2012;
originally announced May 2012.
-
Approximate entropy of network parameters
Authors:
James West,
Lucas Lacasa,
Simone Severini,
Andrew Teschendorff
Abstract:
We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural entropy obtained by computing the approximate entropy of the so called slide sequence. This is a surrogate of the degree sequence and it is suggested by the fre…
▽ More
We study the notion of approximate entropy within the framework of network theory. Approximate entropy is an uncertainty measure originally proposed in the context of dynamical systems and time series. We firstly define a purely structural entropy obtained by computing the approximate entropy of the so called slide sequence. This is a surrogate of the degree sequence and it is suggested by the frequency partition of a graph. We examine this quantity for standard scale-free and Erdős-Rényi networks. By using classical results of Pincus, we show that our entropy measure converges with network size to a certain binary Shannon entropy. On a second step, with specific attention to networks generated by dynamical processes, we investigate approximate entropy of horizontal visibility graphs. Visibility graphs permit to naturally associate to a network the notion of temporal correlations, therefore providing the measure a dynamical garment. We show that approximate entropy distinguishes visibility graphs generated by processes with different complexity. The result probes to a greater extent these networks for the study of dynamical systems. Applications to certain biological data arising in cancer genomics are finally considered in the light of both approaches.
△ Less
Submitted 29 December, 2011;
originally announced January 2012.
-
Feigenbaum graphs: a complex network perspective of chaos
Authors:
Bartolo Luque,
Lucas Lacasa,
Fernando J. Ballesteros,
Alberto Robledo
Abstract:
The recently formulated theory of horizontal visibility graphs transforms time series into graphs and allows the possibility of studying dynamical systems through the characterization of their associated networks. This method leads to a natural graph-theoretical description of nonlinear systems with qualities in the spirit of symbolic dynamics. We support our claim via the case study of the period…
▽ More
The recently formulated theory of horizontal visibility graphs transforms time series into graphs and allows the possibility of studying dynamical systems through the characterization of their associated networks. This method leads to a natural graph-theoretical description of nonlinear systems with qualities in the spirit of symbolic dynamics. We support our claim via the case study of the period-doubling and band-splitting attractor cascades that characterize unimodal maps. We provide a universal analytical description of this classic scenario in terms of the horizontal visibility graphs associated with the dynamics within the attractors, that we call Feigenbaum graphs, independent of map nonlinearity or other particulars. We derive exact results for their degree distribution and related quantities, recast them in the context of the renormalization group and find that its fixed points coincide with those of network entropy optimization. Furthermore, we show that the network entropy mimics the Lyapunov exponent of the map independently of its sign, hinting at a Pesin-like relation equally valid out of chaos.
△ Less
Submitted 6 September, 2011;
originally announced September 2011.
-
Time series irreversibility: a visibility graph approach
Authors:
Lucas Lacasa,
Ángel M. Núñez,
Édgar Roldán,
Juan M. R. Parrondo,
Bartolo Luque
Abstract:
We propose a method to measure real-valued time series irreversibility which combines two differ- ent tools: the horizontal visibility algorithm and the Kullback-Leibler divergence. This method maps a time series to a directed network according to a geometric criterion. The degree of irreversibility of the series is then estimated by the Kullback-Leibler divergence (i.e. the distinguishability) be…
▽ More
We propose a method to measure real-valued time series irreversibility which combines two differ- ent tools: the horizontal visibility algorithm and the Kullback-Leibler divergence. This method maps a time series to a directed network according to a geometric criterion. The degree of irreversibility of the series is then estimated by the Kullback-Leibler divergence (i.e. the distinguishability) between the in and out degree distributions of the associated graph. The method is computationally effi- cient, does not require any ad hoc symbolization process, and naturally takes into account multiple scales. We find that the method correctly distinguishes between reversible and irreversible station- ary time series, including analytical and numerical studies of its performance for: (i) reversible stochastic processes (uncorrelated and Gaussian linearly correlated), (ii) irreversible stochastic pro- cesses (a discrete flashing ratchet in an asymmetric potential), (iii) reversible (conservative) and irreversible (dissipative) chaotic maps, and (iv) dissipative chaotic maps in the presence of noise. Two alternative graph functionals, the degree and the degree-degree distributions, can be used as the Kullback-Leibler divergence argument. The former is simpler and more intuitive and can be used as a benchmark, but in the case of an irreversible process with null net current, the degree-degree distribution has to be considered to identifiy the irreversible nature of the series.
△ Less
Submitted 8 August, 2011;
originally announced August 2011.
-
Critical behavior of a Ginzburg-Landau model with additive quenched noise
Authors:
Niko Komin,
Lucas Lacasa,
Raul Toral
Abstract:
We address a mean-field zero-temperature Ginzburg-Landau, or φ^4, model subjected to quenched additive noise, which has been used recently as a framework for analyzing collective effects induced by diversity. We first make use of a self-consistent theory to calculate the phase diagram of the system, predicting the onset of an order-disorder critical transition at a critical value σc of the quenche…
▽ More
We address a mean-field zero-temperature Ginzburg-Landau, or φ^4, model subjected to quenched additive noise, which has been used recently as a framework for analyzing collective effects induced by diversity. We first make use of a self-consistent theory to calculate the phase diagram of the system, predicting the onset of an order-disorder critical transition at a critical value σc of the quenched noise intensity σ, with critical exponents that follow Landau theory of thermal phase transitions. We subsequently perform a numerical integration of the system's dynamical variables in order to compare the analytical results (valid in the thermodynamic limit and associated to the ground state of the global Lyapunov potential) with the stationary state of the (finite size) system. In the region of the parameter space where metastability is absent (and therefore the stationary state coincide with the ground state of the Lyapunov potential), a finite-size scaling analysis of the order parameter fluctuations suggests that the magnetic susceptibility diverges quadratically in the vicinity of the transition, what constitutes a violation of the fluctuation-dissipation relation. We derive an effective Hamiltonian and accordingly argue that its functional form does not allow to straightforwardly relate the order parameter fluctuations to the linear response of the system, at odds with equilibrium theory. In the region of the parameter space where the system is susceptible to have a large number of metastable states (and therefore the stationary state does not necessarily correspond to the ground state of the global Lyapunov potential), we numerically find a phase diagram that strongly depends on the initial conditions of the dynamical variables.
△ Less
Submitted 29 September, 2010; v1 submitted 23 September, 2010;
originally announced September 2010.
-
Horizontal visibility graphs: exact results for random time series
Authors:
Bartolo Luque,
Lucas Lacasa,
Fernando Ballesteros,
Jordi Luque
Abstract:
The visibility algorithm has been recently introduced as a mapping between time series and complex networks. This procedure allows to apply methods of complex network theory for characterizing time series. In this work we present the horizontal visibility algorithm, a geometrically simpler and analytically solvable version of our former algorithm, focusing on the mapping of random series (series…
▽ More
The visibility algorithm has been recently introduced as a mapping between time series and complex networks. This procedure allows to apply methods of complex network theory for characterizing time series. In this work we present the horizontal visibility algorithm, a geometrically simpler and analytically solvable version of our former algorithm, focusing on the mapping of random series (series of independent identically distributed random variables). After presenting some properties of the algorithm, we present exact results on the topological properties of graphs associated to random series, namely the degree distribution, clustering coefficient, and mean path length. We show that the horizontal visibility algorithm stands as a simple method to discriminate randomness in time series, since any random series maps to a graph with an exponential degree distribution of the shape P(k) = (1/3)(2/3)**(k-2), independently of the probability distribution from which the series was generated. Accordingly, visibility graphs with other P(k) are related to non-random series. Numerical simulations confirm the accuracy of the theorems for finite series. In a second part, we show that the method is able to distinguish chaotic series from i.i.d. theory, studying the following situations: (i) noise-free low-dimensional chaotic series, (ii) low-dimensional noisy chaotic series, even in the presence of large amounts of noise, and (iii) high-dimensional chaotic series (coupled map lattice), without needs for additional techniques such as surrogate data or noise reduction methods. Finally, heuristic arguments are given to explain the topological properties of chaotic series and several sequences which are conjectured to be random are analyzed.
△ Less
Submitted 24 February, 2010;
originally announced February 2010.
-
Number theoretic example of scale-free topology inducing self-organized criticality
Authors:
Bartolo Luque,
Octavio Miramontes,
Lucas Lacasa
Abstract:
In this work we present a general mechanism by which simple dynamics running on networks become self-organized critical for scale free topologies. We illustrate this mechanism with a simple arithmetic model of division between integers, the division model. This is the simplest self-organized critical model advanced so far, and in this sense it may help to elucidate the mechanism of self-organiza…
▽ More
In this work we present a general mechanism by which simple dynamics running on networks become self-organized critical for scale free topologies. We illustrate this mechanism with a simple arithmetic model of division between integers, the division model. This is the simplest self-organized critical model advanced so far, and in this sense it may help to elucidate the mechanism of self-organization to criticality. Its simplicity allows analytical tractability, characterizing several scaling relations. Furthermore, its mathematical nature brings about interesting connections between statistical physics and number theoretical concepts. We show how this model can be understood as a self-organized stochastic process embedded on a network, where the onset of criticality is induced by the topology.
△ Less
Submitted 17 September, 2008; v1 submitted 12 September, 2008;
originally announced September 2008.
-
Self-overlap as a method of analysis in Ising models
Authors:
A. Ferrera,
B. Luque,
L. Lacasa,
E. Valero
Abstract:
The damage spreading method (DS) provided a useful tool to obtain analytical results of the thermodynamics and stability of the 2D Ising model --amongst many others--, but it suffered both from ambiguities in its results and from large computational costs. In this paper we propose an alternative method, the so called self-overlap method, based on the study of correlation functions measured at su…
▽ More
The damage spreading method (DS) provided a useful tool to obtain analytical results of the thermodynamics and stability of the 2D Ising model --amongst many others--, but it suffered both from ambiguities in its results and from large computational costs. In this paper we propose an alternative method, the so called self-overlap method, based on the study of correlation functions measured at subsequent time steps as the system evolves towards its equilibrium. Applying markovian and mean field approximations to a 2D Ising system we obtain both analytical and numerical results on the thermodynamics that agree with the expected behavior. We also provide some analytical results on the stability of the system. Since only a single replica of the system needs to be studied, this method would seem to be free from the ambiguities that afflicted DS. It also seems to be numerically more efficient and analytically simpler.
△ Less
Submitted 14 May, 2007;
originally announced May 2007.