Showing 1–30 of 30 results for author: Mendes, J

Survey on Deep Fuzzy Systems in regression applications: a view on interpretability

Authors: Jorge S. S. Júnior, Jérôme Mendes, Francisco Souza, Cristiano Premebida

Abstract: Regression problems have been more and more embraced by deep learning (DL) techniques. The increasing number of papers recently published in this domain, including surveys and reviews, shows that deep regression has captured the attention of the community due to efficiency and good accuracy in systems with high-dimensional data. However, many DL methodologies have complex structures that are not r… ▽ More Regression problems have been more and more embraced by deep learning (DL) techniques. The increasing number of papers recently published in this domain, including surveys and reviews, shows that deep regression has captured the attention of the community due to efficiency and good accuracy in systems with high-dimensional data. However, many DL methodologies have complex structures that are not readily transparent to human users. Accessing the interpretability of these models is an essential factor for addressing problems in sensitive areas such as cyber-security systems, medical, financial surveillance, and industrial processes. Fuzzy logic systems (FLS) are inherently interpretable models, well known in the literature, capable of using nonlinear representations for complex systems through linguistic terms with membership degrees mimicking human thought. Within an atmosphere of explainable artificial intelligence, it is necessary to consider a trade-off between accuracy and interpretability for developing intelligent models. This paper aims to investigate the state-of-the-art on existing methodologies that combine DL and FLS, namely deep fuzzy systems, to address regression problems, configuring a topic that is currently not sufficiently explored in the literature and thus deserves a comprehensive survey. △ Less

Submitted 9 September, 2022; originally announced September 2022.

Efficient hypothesis testing for community detection in heterogeneous networks

Authors: Xin-Jian Xu, Cheng Chen, J. F. F. Mendes

Abstract: Identifying communities in networks is a fundamental and challenging problem of practical importance in many fields of science. Current methods either ignore the heterogeneous distribution of nodal degrees or assume prior knowledge of the number of communities. Here we propose an efficient hypothesis test for community detection based on quantifying dissimilarities between graphs. Given a random g… ▽ More Identifying communities in networks is a fundamental and challenging problem of practical importance in many fields of science. Current methods either ignore the heterogeneous distribution of nodal degrees or assume prior knowledge of the number of communities. Here we propose an efficient hypothesis test for community detection based on quantifying dissimilarities between graphs. Given a random graph, the null hypothesis is that it is of degree-corrected Erdös-Rényi type. We compare the dissimilarity between them by a measure incorporating the vertex distance distribution, the clustering coefficient distribution, and the alpha-centrality distribution, which is used for our hypothesis test. We design a two-stage bipartitioning algorithm to uncover the number of communities and the corresponding structure simultaneously. Experiments on synthetic and real networks show that our method outperforms state-of-the-art ones. △ Less

Submitted 20 December, 2021; v1 submitted 20 May, 2021; originally announced May 2021.

Comments: a algorithm has been added

Effect of the initial configuration of weights on the training and function of artificial neural networks

Authors: R. J. Jesus, M. L. Antunes, R. A. da Costa, S. N. Dorogovtsev, J. F. F. Mendes, R. L. Aguiar

Abstract: The function and performance of neural networks is largely determined by the evolution of their weights and biases in the process of training, starting from the initial configuration of these parameters to one of the local minima of the loss function. We perform the quantitative statistical characterization of the deviation of the weights of two-hidden-layer ReLU networks of various sizes trained… ▽ More The function and performance of neural networks is largely determined by the evolution of their weights and biases in the process of training, starting from the initial configuration of these parameters to one of the local minima of the loss function. We perform the quantitative statistical characterization of the deviation of the weights of two-hidden-layer ReLU networks of various sizes trained via Stochastic Gradient Descent (SGD) from their initial random configuration. We compare the evolution of the distribution function of this deviation with the evolution of the loss during training. We observed that successful training via SGD leaves the network in the close neighborhood of the initial configuration of its weights. For each initial weight of a link we measured the distribution function of the deviation from this value after training and found how the moments of this distribution and its peak depend on the initial weight. We explored the evolution of these deviations during training and observed an abrupt increase within the overfitting region. This jump occurs simultaneously with a similarly abrupt increase recorded in the evolution of the loss function. Our results suggest that SGD's ability to efficiently find local minima is restricted to the vicinity of the random initial configuration of weights. △ Less

Submitted 4 December, 2020; originally announced December 2020.

Comments: 12 pages, 8 figures

Journal ref: Mathematics 9, 2246 (2021)

Proceedings of the 5th International Workshop on Software Engineering Methods in Spreadsheets (SEMS'18)

Authors: Birgit Hofer, Jorge Mendes

Abstract: Proceedings of the 5th International Workshop on Software Engineering Methods in Spreadsheets (SEMS'18), held on October 1st, 2018, in Lisbon, Portugal, and co-located with the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). Proceedings of the 5th International Workshop on Software Engineering Methods in Spreadsheets (SEMS'18), held on October 1st, 2018, in Lisbon, Portugal, and co-located with the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). △ Less

Submitted 28 August, 2018; originally announced August 2018.

Targeted Damage to Interdependent Networks

Authors: G. J. Baxter, G. Timár, J. F. F. Mendes

Abstract: The giant mutually connected component (GMCC) of an interdependent or multiplex network collapses with a discontinuous hybrid transition under random damage to the network. If the nodes to be damaged are selected in a targeted way, the collapse of the GMCC may occur significantly sooner. Finding the minimal damage set which destroys the largest mutually connected component of a given interdependen… ▽ More The giant mutually connected component (GMCC) of an interdependent or multiplex network collapses with a discontinuous hybrid transition under random damage to the network. If the nodes to be damaged are selected in a targeted way, the collapse of the GMCC may occur significantly sooner. Finding the minimal damage set which destroys the largest mutually connected component of a given interdependent network is a computationally prohibitive simultaneous optimization problem. We introduce a simple heuristic strategy -- Effective Multiplex Degree -- for targeted attack on interdependent networks that leverages the indirect damage inherent in multiplex networks to achieve a damage set smaller than that found by any other non computationally intensive algorithm. We show that the intuition from single layer networks that decycling (damage of the $2$-core) is the most effective way to destroy the giant component, does not carry over to interdependent networks, and in fact such approaches are worse than simply removing the highest degree nodes. △ Less

Submitted 24 September, 2018; v1 submitted 12 February, 2018; originally announced February 2018.

Comments: 9 pages, 9 figures

Journal ref: Phys. Rev. E 98, 032307 (2018)

Finding the optimal nets for self-folding Kirigami

Authors: N. A. M. Araújo, R. A. da Costa, S. N. Dorogovtsev, J. F. F. Mendes

Abstract: Three-dimensional shells can be synthesized from the spontaneous self-folding of two-dimensional templates of interconnected panels, called nets. However, some nets are more likely to self-fold into the desired shell under random movements. The optimal nets are the ones that maximize the number of vertex connections, i.e., vertices that have only two of its faces cut away from each other in the ne… ▽ More Three-dimensional shells can be synthesized from the spontaneous self-folding of two-dimensional templates of interconnected panels, called nets. However, some nets are more likely to self-fold into the desired shell under random movements. The optimal nets are the ones that maximize the number of vertex connections, i.e., vertices that have only two of its faces cut away from each other in the net. Previous methods for finding such nets are based on random search and thus do not guarantee the optimal solution. Here, we propose a deterministic procedure. We map the connectivity of the shell into a shell graph, where the nodes and links of the graph represent the vertices and edges of the shell, respectively. Identifying the nets that maximize the number of vertex connections corresponds to finding the set of maximum leaf spanning trees of the shell graph. This method allows not only to design the self-assembly of much larger shell structures but also to apply additional design criteria, as a complete catalog of the maximum leaf spanning trees is obtained. △ Less

Submitted 7 July, 2018; v1 submitted 2 October, 2017; originally announced October 2017.

Comments: 6 pages, 5 figures, Supplemental Material, Source Code

Journal ref: Phys. Rev. Lett. 120, 188001 (2018)

Tabula: A Language to Model Spreadsheet Tables

Authors: Jorge Mendes, João Saraiva

Abstract: Spreadsheets provide a flexible and easy to use software development environment, but that leads to error proneness. Work has been done to prevent errors in spreadsheets, including using models to specify distinct parts of a spreadsheet as it is done with model-driven software development. Previous model languages for spreadsheets offer a limited expressiveness, and cannot model several features p… ▽ More Spreadsheets provide a flexible and easy to use software development environment, but that leads to error proneness. Work has been done to prevent errors in spreadsheets, including using models to specify distinct parts of a spreadsheet as it is done with model-driven software development. Previous model languages for spreadsheets offer a limited expressiveness, and cannot model several features present in most real world spreadsheets. In this paper, the modeling language Tabula is introduced. It extends previous spreadsheet models with features like type constraints and nested classes with repetitions. Tabula is not only more expressive than other models but it can also be extended with more features. Moreover, Tabula includes a bidirectional transformation engine that guarantees synchronization after an update either in the model or spreadsheet. △ Less

Submitted 10 July, 2017; originally announced July 2017.

Comments: In Proceedings of the 4th Workshop on Software Engineering Methods in Spreadsheets

Net2Vec: Deep Learning for the Network

Authors: Roberto Gonzalez, Filipe Manco, Alberto Garcia-Duran, Jose Mendes, Felipe Huici, Saverio Niccolini, Mathias Niepert

Abstract: We present Net2Vec, a flexible high-performance platform that allows the execution of deep learning algorithms in the communication network. Net2Vec is able to capture data from the network at more than 60Gbps, transform it into meaningful tuples and apply predictions over the tuples in real time. This platform can be used for different purposes ranging from traffic classification to network perfo… ▽ More We present Net2Vec, a flexible high-performance platform that allows the execution of deep learning algorithms in the communication network. Net2Vec is able to capture data from the network at more than 60Gbps, transform it into meaningful tuples and apply predictions over the tuples in real time. This platform can be used for different purposes ranging from traffic classification to network performance analysis. Finally, we showcase the use of Net2Vec by implementing and testing a solution able to profile network users at line rate using traces coming from a real network. We show that the use of deep learning for this case outperforms the baseline method both in terms of accuracy and performance. △ Less

Submitted 10 May, 2017; originally announced May 2017.

Ranking scientists

Authors: S. N. Dorogovtsev, J. F. F. Mendes

Abstract: Currently the ranking of scientists is based on the $h$-index, which is widely perceived as an imprecise and simplistic though still useful metric. We find that the $h$-index actually favours modestly performing researchers and propose a simple criterion for proper ranking. Currently the ranking of scientists is based on the $h$-index, which is widely perceived as an imprecise and simplistic though still useful metric. We find that the $h$-index actually favours modestly performing researchers and propose a simple criterion for proper ranking. △ Less

Submitted 4 November, 2015; originally announced November 2015.

Comments: 3 pages, 2 figures, the original version

Journal ref: Nature Physics 11, 882 (2015)

Towards the Design and Implementation of Aspect-Oriented Programming for Spreadsheets

Authors: Pedro Maia, Jorge Mendes, Jácome Cunha, Henrique Rebêlo, João Saraiva

Abstract: A spreadsheet usually starts as a simple and single-user software artifact, but, as frequent as in other software systems, quickly evolves into a complex system developed by many actors. Often, different users work on different aspects of the same spreadsheet: while a secretary may be only involved in adding plain data to the spreadsheet, an accountant may define new business rules, while an engin… ▽ More A spreadsheet usually starts as a simple and single-user software artifact, but, as frequent as in other software systems, quickly evolves into a complex system developed by many actors. Often, different users work on different aspects of the same spreadsheet: while a secretary may be only involved in adding plain data to the spreadsheet, an accountant may define new business rules, while an engineer may need to adapt the spreadsheet content so it can be used by other software systems. Unfortunately, spreadsheet systems do not offer modular mechanisms, and as a consequence, some of the previous tasks may be defined by adding intrusive "code" to the spreadsheet. In this paper we go through the design and implementation of an aspect-oriented language for spreadsheets so that users can work on different aspects of a spreadsheet in a modular way. For example, aspects can be defined in order to introduce new business rules to an existing spreadsheet, or to manipulate the spreadsheet data to be ported to another system. Aspects are defined as aspect-oriented program specifications that are dynamically woven into the underlying spreadsheet by an aspect weaver. In this aspect-oriented style of spreadsheet development, different users develop, or reuse, aspects without adding intrusive code to the original spreadsheet. Such code is added/executed by the spreadsheet weaving mechanism proposed in this paper. △ Less

Submitted 11 March, 2015; originally announced March 2015.

Comments: In Proceedings of the 2nd Workshop on Software Engineering Methods in Spreadsheets (http://spreadsheetlab.org/sems15/)

Giant components in directed multiplex networks

Authors: N. Azimi-Tafreshi, S. N. Dorogovtsev, J. F. F. Mendes

Abstract: We describe the complex global structure of giant components in directed multiplex networks which generalizes the well-known bow-tie structure, generic for ordinary directed networks. By definition, a directed multiplex network contains vertices of one type and directed edges of $m$ different types. In directed multiplex networks, we distinguish a set of different giant components based on the exi… ▽ More We describe the complex global structure of giant components in directed multiplex networks which generalizes the well-known bow-tie structure, generic for ordinary directed networks. By definition, a directed multiplex network contains vertices of one type and directed edges of $m$ different types. In directed multiplex networks, we distinguish a set of different giant components based on the existence of directed paths of different types between their vertices, such that for each type of edges, the paths run entirely through only edges of that type. If, in particular, $m=2$, we define a strongly viable component as a set of vertices, in which for each type of edges, each two vertices are interconnected by at least two directed paths in both directions, running through the edges of only this type. We show that in this case, a directed multiplex network contains, in total, $9$ different giant components including the strongly viable component. In general, the total number of giant components is $3^m$. For uncorrelated directed multiplex networks, we obtain exactly the size and the emergence point of the strongly viable component and estimate the sizes of other giant components. △ Less

Submitted 1 November, 2014; v1 submitted 17 July, 2014; originally announced July 2014.

Comments: 8 pages, 9 figures

Journal ref: Phys. Rev. E 90, 052809 (2014)

Mutually connected component of network of networks with replica nodes

Authors: Ginestra Bianconi, Sergey N. Dorogovtsev, José F. F. Mendes

Abstract: We describe the emergence of the giant mutually connected component in networks of networks in which each node has a single replica node in any layer and can be interdependent only on its replica nodes in the interdependent layers. We prove that if in these networks, all the nodes of one network (layer) are interdependent on the nodes of the same other interconnected layer, then, remarkably, the m… ▽ More We describe the emergence of the giant mutually connected component in networks of networks in which each node has a single replica node in any layer and can be interdependent only on its replica nodes in the interdependent layers. We prove that if in these networks, all the nodes of one network (layer) are interdependent on the nodes of the same other interconnected layer, then, remarkably, the mutually connected component does not depend on the topology of the network of networks. This component coincides with the mutual component of the fully connected network of networks constructed from the same set of layers, i.e., a multiplex network. △ Less

Submitted 23 December, 2014; v1 submitted 2 February, 2014; originally announced February 2014.

Comments: (9 pages, 2 figures )

Journal ref: Phys. Rev. E. 91, 012804 (2015)

Weak percolation on multiplex networks

Authors: Gareth J. Baxter, Sergey N. Dorogovtsev, José F. F. Mendes, Davide Cellai

Abstract: Bootstrap percolation is a simple but non-trivial model. It has applications in many areas of science and has been explored on random networks for several decades. In single layer (simplex) networks, it has been recently observed that bootstrap percolation, which is defined as an incremental process, can be seen as the opposite of pruning percolation, where nodes are removed according to a connect… ▽ More Bootstrap percolation is a simple but non-trivial model. It has applications in many areas of science and has been explored on random networks for several decades. In single layer (simplex) networks, it has been recently observed that bootstrap percolation, which is defined as an incremental process, can be seen as the opposite of pruning percolation, where nodes are removed according to a connectivity rule. Here we propose models of both bootstrap and pruning percolation for multiplex networks. We collectively refer to these two models with the concept of "weak" percolation, to distinguish them from the somewhat classical concept of ordinary ("strong") percolation. While the two models coincide in simplex networks, we show that they decouple when considering multiplexes, giving rise to a wealth of critical phenomena. Our bootstrap model constitutes the simplest example of a contagion process on a multiplex network and has potential applications in critical infrastructure recovery and information security. Moreover, we show that our pruning percolation model may provide a way to diagnose missing layers in a multiplex network. Finally, our analytical approach allows us to calculate critical behavior and characterize critical clusters. △ Less

Submitted 13 April, 2014; v1 submitted 13 December, 2013; originally announced December 2013.

Comments: 14 pages, 12 figures

Journal ref: Phys. Rev. E 89, 042801 (2014)

Core organization of directed complex networks

Authors: N. Azimi-Tafreshi, S. N. Dorogovtsev, J. F. F. Mendes

Abstract: The recursive removal of leaves (dead end vertices) and their neighbors from an undirected network results, when this pruning algorithm stops, in a so-called core of the network. This specific subgraph should be distinguished from $k$-cores, which are principally different subgraphs in networks. If the vertex mean degree of a network is sufficiently large, the core is a giant cluster containing a… ▽ More The recursive removal of leaves (dead end vertices) and their neighbors from an undirected network results, when this pruning algorithm stops, in a so-called core of the network. This specific subgraph should be distinguished from $k$-cores, which are principally different subgraphs in networks. If the vertex mean degree of a network is sufficiently large, the core is a giant cluster containing a finite fraction of vertices. We find that generalization of this pruning algorithm to directed networks provides a significantly more complex picture of cores. By implementing a rate equation approach to this pruning procedure for directed uncorrelated networks, we identify a set of cores progressively embedded into each other in a network and describe their birth points and structure. △ Less

Submitted 10 March, 2013; v1 submitted 24 December, 2012; originally announced December 2012.

Comments: 10 pages, 7 figures

Journal ref: Phys. Rev. E 87, 032815 (2013)

Localization and Spreading of Diseases in Complex Networks

Authors: A. V. Goltsev, S. N. Dorogovtsev, J. G. Oliveira, J. F. F. Mendes

Abstract: Using the SIS model on unweighted and weighted networks, we consider the disease localization phenomenon. In contrast to the well-recognized point of view that diseases infect a finite fraction of vertices right above the epidemic threshold, we show that diseases can be localized on a finite number of vertices, where hubs and edges with large weights are centers of localization. Our results follow… ▽ More Using the SIS model on unweighted and weighted networks, we consider the disease localization phenomenon. In contrast to the well-recognized point of view that diseases infect a finite fraction of vertices right above the epidemic threshold, we show that diseases can be localized on a finite number of vertices, where hubs and edges with large weights are centers of localization. Our results follow from the analysis of standard models of networks and empirical data for real-world networks. △ Less

Submitted 5 August, 2012; v1 submitted 20 February, 2012; originally announced February 2012.

Comments: 5 pages, 3 figures

Journal ref: Phys. Rev. Lett. 109, 128702 (2012)

Evolution of spatially embedded branching trees with interacting nodes

Authors: F. L. Forgerini, N. Crokidakis, S. N. Dorogovtsev, J. F. F. Mendes

Abstract: We study the evolution of branching trees embedded in Euclidean spaces with suppressed branching of spatially close nodes. This cooperative branching process accounts for the effect of overcrowding of nodes in the embedding space and mimics the evolution of life processes (the so-called "tree of life") in which a new level of complexity emerges as a short transition followed by a long period of gr… ▽ More We study the evolution of branching trees embedded in Euclidean spaces with suppressed branching of spatially close nodes. This cooperative branching process accounts for the effect of overcrowding of nodes in the embedding space and mimics the evolution of life processes (the so-called "tree of life") in which a new level of complexity emerges as a short transition followed by a long period of gradual evolution or even complete extinction. We consider the models of branching trees in which each new node can produce up to two twigs within a unit distance from the node in the Euclidean space, but this branching is suppressed if the newborn node is closer than at distance $a$ from one of the previous generation nodes. This results in an explosive (exponential) growth in the initial period, and, after some crossover time $t_x \sim \ln(1/a)$ for small $a$, in a slow (power-law) growth. This special point is also a transition from "small" to "large words" in terms of network science. We show that if the space is restricted, then this evolution may end by extinction. △ Less

Submitted 14 October, 2011; originally announced October 2011.

Comments: 13 pages, 9 figures, submitted

Belief-propagation algorithm and the Ising model on networks with arbitrary distributions of motifs

Authors: S. Yoon, A. V. Goltsev, S. N. Dorogovtsev, J. F. F. Mendes

Abstract: We generalize the belief-propagation algorithm to sparse random networks with arbitrary distributions of motifs (triangles, loops, etc.). Each vertex in these networks belongs to a given set of motifs (generalization of the configuration model). These networks can be treated as sparse uncorrelated hypergraphs in which hyperedges represent motifs. Here a hypergraph is a generalization of a graph, w… ▽ More We generalize the belief-propagation algorithm to sparse random networks with arbitrary distributions of motifs (triangles, loops, etc.). Each vertex in these networks belongs to a given set of motifs (generalization of the configuration model). These networks can be treated as sparse uncorrelated hypergraphs in which hyperedges represent motifs. Here a hypergraph is a generalization of a graph, where a hyperedge can connect any number of vertices. These uncorrelated hypergraphs are tree-like (hypertrees), which crucially simplify the problem and allow us to apply the belief-propagation algorithm to these loopy networks with arbitrary motifs. As natural examples, we consider motifs in the form of finite loops and cliques. We apply the belief-propagation algorithm to the ferromagnetic Ising model on the resulting random networks. We obtain an exact solution of this model on networks with finite loops or cliques as motifs. We find an exact critical temperature of the ferromagnetic phase transition and demonstrate that with increasing the clustering coefficient and the loop size, the critical temperature increases compared to ordinary tree-like complex networks. Our solution also gives the birth point of the giant connected component in these loopy networks. △ Less

Submitted 6 August, 2012; v1 submitted 24 June, 2011; originally announced June 2011.

Comments: 9 pages, 4 figures

Journal ref: Physical Review E 84, 041144 (2011)

Critical behavior and correlations on scale-free small-world networks. Application to network design

Authors: M. Ostilli, A. L. Ferreira, J. F. F. Mendes

Abstract: We analyze critical phenomena on networks generated as the union of hidden variables models (networks with any desired degree sequence) with arbitrary graphs. The resulting networks are general small-worlds similar to those a` la Watts and Strogatz but with a heterogeneous degree distribution. We prove that the critical behavior (thermal or percolative) remains completely unchanged by the presence… ▽ More We analyze critical phenomena on networks generated as the union of hidden variables models (networks with any desired degree sequence) with arbitrary graphs. The resulting networks are general small-worlds similar to those a` la Watts and Strogatz but with a heterogeneous degree distribution. We prove that the critical behavior (thermal or percolative) remains completely unchanged by the presence of finite loops (or finite clustering). Then, we show that, in large but finite networks, correlations of two given spins may be strong, i.e., approximately power law like, at any temperature. Quite interestingly, if $γ$ is the exponent for the power law distribution of the vertex degree, for $γ\leq 3$ and with or without short-range couplings, such strong correlations persist even in the thermodynamic limit, contradicting the common opinion that in mean-field models correlations always disappear in this limit. Finally, we provide the optimal choice of rewiring under which percolation phenomena in the rewired network are best performed; a natural criterion to reach best communication features, at least in non congested regimes. △ Less

Submitted 28 June, 2011; v1 submitted 1 January, 2011; originally announced January 2011.

Comments: 23 pages, 4 figures, added 2 Tables

Journal ref: Phys. Rev. E 83, 061149 (2011)

Organization of modular networks

Authors: S. N. Dorogovtsev, J. F. F. Mendes, A. N. Samukhin, A. Y. Zyuzin

Abstract: We examine the global organization of heterogeneous equilibrium networks consisting of a number of well distinguished interconnected parts--``communities'' or modules. We develop an analytical approach allowing us to obtain the statistics of connected components and an intervertex distance distribution in these modular networks, and to describe their global organization and structure. In particu… ▽ More We examine the global organization of heterogeneous equilibrium networks consisting of a number of well distinguished interconnected parts--``communities'' or modules. We develop an analytical approach allowing us to obtain the statistics of connected components and an intervertex distance distribution in these modular networks, and to describe their global organization and structure. In particular, we study the evolution of the intervertex distance distribution with an increasing number of interlinks connecting two infinitely large uncorrelated networks. We demonstrate that even a relatively small number of shortcuts unite the networks into one. In more precise terms, if the number of the interlinks is any finite fraction of the total number of connections, then the intervertex distance distribution approaches a delta-function peaked form, and so the network is united. △ Less

Submitted 24 March, 2008; v1 submitted 24 March, 2008; originally announced March 2008.

Comments: 9 pages, 3 figures

Journal ref: Phys. Rev. E 78, 056106 (2008)

Transition from small to large world in growing networks

Authors: S. N. Dorogovtsev, P. L. Krapivsky, J. F. F. Mendes

Abstract: We examine the global organization of growing networks in which a new vertex is attached to already existing ones with a probability depending on their age. We find that the network is infinite- or finite-dimensional depending on whether the attachment probability decays slower or faster than $(age)^{-1}$. The network becomes one-dimensional when the attachment probability decays faster than… ▽ More We examine the global organization of growing networks in which a new vertex is attached to already existing ones with a probability depending on their age. We find that the network is infinite- or finite-dimensional depending on whether the attachment probability decays slower or faster than $(age)^{-1}$. The network becomes one-dimensional when the attachment probability decays faster than $(age)^{-2}$. We describe structural characteristics of these phases and transitions between them. △ Less

Submitted 23 November, 2007; v1 submitted 19 September, 2007; originally announced September 2007.

Comments: 5 pages

Journal ref: EPL 81, 30004 (2008)

Critical phenomena in complex networks

Authors: S. N. Dorogovtsev, A. V. Goltsev, J. F. F. Mendes

Abstract: The combination of the compactness of networks, featuring small diameters, and their complex architectures results in a variety of critical effects dramatically different from those in cooperative systems on lattices. In the last few years, researchers have made important steps toward understanding the qualitatively new critical phenomena in complex networks. We review the results, concepts, and… ▽ More The combination of the compactness of networks, featuring small diameters, and their complex architectures results in a variety of critical effects dramatically different from those in cooperative systems on lattices. In the last few years, researchers have made important steps toward understanding the qualitatively new critical phenomena in complex networks. We review the results, concepts, and methods of this rapidly developing field. Here we mostly consider two closely related classes of these critical phenomena, namely structural phase transitions in the network architectures and transitions in cooperative models on networks as substrates. We also discuss systems where a network and interacting agents on it influence each other. We overview a wide range of critical phenomena in equilibrium and growing networks including the birth of the giant connected component, percolation, k-core percolation, phenomena near epidemic thresholds, condensation transitions, critical phenomena in spin models placed on networks, synchronization, and self-organized criticality effects in interacting systems on networks. We also discuss strong finite size effects in these systems and highlight open problems and perspectives. △ Less

Submitted 16 November, 2007; v1 submitted 30 April, 2007; originally announced May 2007.

Comments: Review article, 79 pages, 43 figures, 1 table, 508 references, extended

Journal ref: Rev. Mod. Phys. 80, 1275 (2008)

k-core (bootstrap) percolation on complex networks: Critical phenomena and nonlocal effects

Authors: A. V. Goltsev, S. N. Dorogovtsev, J. F. F. Mendes

Abstract: We develop the theory of the k-core (bootstrap) percolation on uncorrelated random networks with arbitrary degree distributions. We show that the k-core percolation is an unusual, hybrid phase transition with a jump emergence of the k-core as at a first order phase transition but also with a critical singularity as at a continuous transition. We describe the properties of the k-core, explain the… ▽ More We develop the theory of the k-core (bootstrap) percolation on uncorrelated random networks with arbitrary degree distributions. We show that the k-core percolation is an unusual, hybrid phase transition with a jump emergence of the k-core as at a first order phase transition but also with a critical singularity as at a continuous transition. We describe the properties of the k-core, explain the meaning of the order parameter for the k-core percolation, and reveal the origin of the specific critical phenomena. We demonstrate that a so-called ``corona'' of the k-core plays a crucial role (corona is a subset of vertices in the k-core which have exactly k neighbors in the k-core). It turns out that the k-core percolation threshold is at the same time the percolation threshold of finite corona clusters. The mean separation of vertices in corona clusters plays the role of the correlation length and diverges at the critical point. We show that a random removal of even one vertex from the k-core may result in the collapse of a vast region of the k-core around the removed vertex. The mean size of this region diverges at the critical point. We find an exact mapping of the k-core percolation to a model of cooperative relaxation. This model undergoes critical relaxation with a divergent rate at some critical moment. △ Less

Submitted 28 February, 2006; v1 submitted 26 February, 2006; originally announced February 2006.

Comments: 11 pages, 8 figures

Journal ref: Phys. Rev. E 73, 056101 (2006)

k-core organization of complex networks

Authors: S. N. Dorogovtsev, A. V. Goltsev, J. F. F. Mendes

Abstract: We analytically describe the architecture of randomly damaged uncorrelated networks as a set of successively enclosed substructures -- k-cores. The k-core is the largest subgraph where vertices have at least k interconnections. We find the structure of k-cores, their sizes, and their birth points -- the bootstrap percolation thresholds. We show that in networks with a finite mean number z_2 of t… ▽ More We analytically describe the architecture of randomly damaged uncorrelated networks as a set of successively enclosed substructures -- k-cores. The k-core is the largest subgraph where vertices have at least k interconnections. We find the structure of k-cores, their sizes, and their birth points -- the bootstrap percolation thresholds. We show that in networks with a finite mean number z_2 of the second-nearest neighbors, the emergence of a k-core is a hybrid phase transition. In contrast, if z_2 diverges, the networks contain an infinite sequence of k-cores which are ultra-robust against random damage. △ Less

Submitted 28 February, 2006; v1 submitted 5 September, 2005; originally announced September 2005.

Comments: 5 pages, 3 figures

Journal ref: Phys. Rev. Lett. 96, 040601 (2006)

Correlations in interacting systems with a network topology

Authors: S. N. Dorogovtsev, A. V. Goltsev, J. F. F. Mendes

Abstract: We study pair correlations in cooperative systems placed on complex networks. We show that usually in these systems, the correlations between two interacting objects (e.g., spins), separated by a distance $\ell$, decay, on average, faster than $1/(\ell z_\ell)$. Here $z_\ell$ is the mean number of the $\ell$-th nearest neighbors of a vertex in a network. This behavior, in particular, leads to a… ▽ More We study pair correlations in cooperative systems placed on complex networks. We show that usually in these systems, the correlations between two interacting objects (e.g., spins), separated by a distance $\ell$, decay, on average, faster than $1/(\ell z_\ell)$. Here $z_\ell$ is the mean number of the $\ell$-th nearest neighbors of a vertex in a network. This behavior, in particular, leads to a dramatic weakening of correlations between second and more distant neighbors on networks with fat-tailed degree distributions, which have a divergent number $z_2$ in the infinite network limit. In this case, only the pair correlations between the nearest neighbors are observable. We obtain the pair correlation function of the Ising model on a complex network and also derive our results in the framework of a phenomenological approach. △ Less

Submitted 31 May, 2005; originally announced June 2005.

Comments: 5 pages

Journal ref: Phys. Rev. E 72, 066130 (2005)

Organization of complex networks without multiple connections

Authors: S. N. Dorogovtsev, J. F. F. Mendes, A. M. Povolotsky, A. N. Samukhin

Abstract: We find a new structural feature of equilibrium complex random networks without multiple and self-connections. We show that if the number of connections is sufficiently high, these networks contain a core of highly interconnected vertices. The number of vertices in this core varies in the range between $const N^{1/2}$ and $const N^{2/3}$, where $N$ is the number of vertices in a network. At the… ▽ More We find a new structural feature of equilibrium complex random networks without multiple and self-connections. We show that if the number of connections is sufficiently high, these networks contain a core of highly interconnected vertices. The number of vertices in this core varies in the range between $const N^{1/2}$ and $const N^{2/3}$, where $N$ is the number of vertices in a network. At the birth point of the core, we obtain the size-dependent cut-off of the distribution of the number of connections and find that its position differs from earlier estimates. △ Less

Submitted 23 September, 2005; v1 submitted 8 May, 2005; originally announced May 2005.

Comments: 5 pages, 2 figures

Journal ref: Phys.Rev.Lett. 95 (2005) 195701

Frequency of occurrence of numbers in the World Wide Web

Authors: S. N. Dorogovtsev, J. F. F. Mendes, J. G. Oliveira

Abstract: The distribution of numbers in human documents is determined by a variety of diverse natural and human factors, whose relative significance can be evaluated by studying the numbers' frequency of occurrence. Although it has been studied since the 1880's, this subject remains poorly understood. Here, we obtain the detailed statistics of numbers in the World Wide Web, finding that their distributio… ▽ More The distribution of numbers in human documents is determined by a variety of diverse natural and human factors, whose relative significance can be evaluated by studying the numbers' frequency of occurrence. Although it has been studied since the 1880's, this subject remains poorly understood. Here, we obtain the detailed statistics of numbers in the World Wide Web, finding that their distribution is a heavy-tailed dependence which splits in a set of power-law ones. In particular, we find that the frequency of numbers associated to western calendar years shows an uneven behavior: 2004 represents a `singular critical' point, appearing with a strikingly high frequency; as we move away from it, the decreasing frequency allows us to compare the amounts of existing information on the past and on the future. Moreover, while powers of ten occur extremely often, allowing us to obtain statistics up to the huge 10^127, `non-round' numbers occur in a much more limited range, the variations of their frequencies being dramatically different from standard statistical fluctuations. These findings provide a view of the array of numbers used by humans as a highly non-equilibrium and inhomogeneous system, and shed a new light on an issue that, once fully investigated, could lead to a better understanding of many sociological and psychological phenomena. △ Less

Submitted 29 April, 2005; v1 submitted 26 April, 2005; originally announced April 2005.

Comments: 5 pages, 4 figures

Journal ref: Physica A 360, 548 (2006)

The shortest path to complex networks

Authors: S. N. Dorogovtsev, J. F. F. Mendes

Abstract: 1. The birth of network science. 2. What are random networks? 3. Adjacency matrix. 4. Degree distribution. 5. What are simple networks? Classical random graphs. 6. Birth of the giant component. 7. Topology of the Web. 8.Uncorrelated networks. 9. What are small worlds? 10. Real networks are mesoscopic objects. 11. What are complex networks? 12. The configuration model. 13. The absence of degree--… ▽ More 1. The birth of network science. 2. What are random networks? 3. Adjacency matrix. 4. Degree distribution. 5. What are simple networks? Classical random graphs. 6. Birth of the giant component. 7. Topology of the Web. 8.Uncorrelated networks. 9. What are small worlds? 10. Real networks are mesoscopic objects. 11. What are complex networks? 12. The configuration model. 13. The absence of degree--degree correlations. 14.Networks with correlated degrees.15.Clustering. 16. What are small-world networks? 17. `Small worlds' is not the same as `small-world networks'. 18. Fat-tailed degree distributions. 19.Reasons for the fat-tailed degree distributions. 20. Preferential linking. 21. Condensation of edges. 22. Cut-offs of degree distributions. 23. Reasons for correlations in networks. 24. Classical random graphs cannot be used for comparison with real networks. 25. How to measure degree--degree correlations. 26. Assortative and disassortative mixing. 27. Disassortative mixing does not mean that vertices of high degrees rarely connect to each other. 28. Reciprocal links in directed nets. 29. Ultra-small-world effect. 30. Tree ansatz. 31.Ultraresilience against random failures. 32. When correlated nets are ultraresilient. 33. Vulnerability of complex networks. 34. The absence of an epidemic threshold. 35. Search based on local information. 36.Ultraresilience disappears in finite nets. 37.Critical behavior of cooperative models on networks. 38. Berezinskii-Kosterlitz-Thouless phase transitions in networks. 39.Cascading failures. 40.Cliques & communities. 41. Betweenness. 42.Extracting communities. 43. Optimal paths. 44.Distributions of the shortest-path length & of the loop's length are narrow. 45. Diffusion on networks. 46. What is modularity? 47.Hierarchical organization of networks. 48. Convincing modelling of real-world networks:Is it possible? 49. The small Web.. △ Less

Submitted 24 July, 2004; v1 submitted 24 April, 2004; originally announced April 2004.

Comments: 25 pages, a contribution to `Complex Systems and Inter-disciplinary Science', v.1, eds. N. Johnson, J. Efstathiou, and F. Reed-Tsochas (World Scientific, 2004), to be published

Principles of statistical mechanics of random networks

Authors: S. N. Dorogovtsev, J. F. F. Mendes, A. N. Samukhin

Abstract: We develop a statistical mechanics approach for random networks with uncorrelated vertices. We construct equilibrium statistical ensembles of such networks and obtain their partition functions and main characteristics. We find simple dynamical construction procedures that produce equilibrium uncorrelated random graphs with an arbitrary degree distribution. In particular, we show that in equilibr… ▽ More We develop a statistical mechanics approach for random networks with uncorrelated vertices. We construct equilibrium statistical ensembles of such networks and obtain their partition functions and main characteristics. We find simple dynamical construction procedures that produce equilibrium uncorrelated random graphs with an arbitrary degree distribution. In particular, we show that in equilibrium uncorrelated networks, fat-tailed degree distributions may exist only starting from some critical average number of connections of a vertex, in a phase with a condensate of edges. △ Less

Submitted 29 December, 2002; v1 submitted 4 April, 2002; originally announced April 2002.

Comments: 14 pages, an extended version

Journal ref: Nucl.Phys. B666 (2003) 396-416

Accelerated growth of networks

Authors: S. N. Dorogovtsev, J. F. F. Mendes

Abstract: In many real growing networks the mean number of connections per vertex increases with time. The Internet, the Word Wide Web, collaboration networks, and many others display this behavior. Such a growth can be called {\em accelerated}. We show that this acceleration influences distribution of connections and may determine the structure of a network. We discuss general consequences of the acceler… ▽ More In many real growing networks the mean number of connections per vertex increases with time. The Internet, the Word Wide Web, collaboration networks, and many others display this behavior. Such a growth can be called {\em accelerated}. We show that this acceleration influences distribution of connections and may determine the structure of a network. We discuss general consequences of the acceleration and demonstrate its features applying simple illustrating examples. In particular, we show that the accelerated growth fairly well explains the structure of the Word Web (the network of interacting words of human language). Also, we use the models of the accelerated growth of networks to describe a wealth condensation transition in evolving societies. △ Less

Submitted 4 April, 2002; originally announced April 2002.

Comments: 29 pages, 11 figures, a brief review of the accelerated growth including applications to econophysics, Contribution to `Handbook of Graphs and Networks: From the Genome to the Internet', eds. S. Bornholdt and H.G. Schuster (Wiley-VCH, Berlin, 2002), to be published

Ising Model on Networks with an Arbitrary Distribution of Connections

Authors: S. N. Dorogovtsev, A. V. Goltsev, J. F. F. Mendes

Abstract: We find the exact critical temperature $T_c$ of the nearest-neighbor ferromagnetic Ising model on an `equilibrium' random graph with an arbitrary degree distribution $P(k)$. We observe an anomalous behavior of the magnetization, magnetic susceptibility and specific heat, when $P(k)$ is fat-tailed, or, loosely speaking, when the fourth moment of the distribution diverges in infinite networks. Whe… ▽ More We find the exact critical temperature $T_c$ of the nearest-neighbor ferromagnetic Ising model on an `equilibrium' random graph with an arbitrary degree distribution $P(k)$. We observe an anomalous behavior of the magnetization, magnetic susceptibility and specific heat, when $P(k)$ is fat-tailed, or, loosely speaking, when the fourth moment of the distribution diverges in infinite networks. When the second moment becomes divergent, $T_c$ approaches infinity, the phase transition is of infinite order, and size effect is anomalously strong. △ Less

Submitted 11 April, 2002; v1 submitted 11 March, 2002; originally announced March 2002.

Comments: 5 pages

Journal ref: Phys.Rev.E66:016104,2002