Showing 1–50 of 130 results for author: Newman, J

Endoscopic fiber-coupled diamond magnetometer for cancer surgery

Authors: A. J. Newman, S. M. Graham, C. J. Stephen, A. M. Edmonds, M. L. Markham, G. W. Morley

Abstract: Interoperative measurements using magnetic sensors is a valuable technique in cancer surgery for finding magnetic tracers. Here we present a fiber-coupled nitrogen-vacancy (N-V) center magnetometer capable of detecting iron oxide suspension (MagTrace from Endomagnetics Ltd.) used in breast cancer surgeries. Detection of an iron mass as low as 0.56~mg has been demonstrated, 100 times less than that… ▽ More Interoperative measurements using magnetic sensors is a valuable technique in cancer surgery for finding magnetic tracers. Here we present a fiber-coupled nitrogen-vacancy (N-V) center magnetometer capable of detecting iron oxide suspension (MagTrace from Endomagnetics Ltd.) used in breast cancer surgeries. Detection of an iron mass as low as 0.56~mg has been demonstrated, 100 times less than that of a recommended dose at a maximum distance of 5.8~mm. Detection of an iron concentration as low as 2.8 mg/ml has also been demonstrated, 20 times less than a recommended dose. The maximum working distance from the sensor can be as large as 14.6~mm for higher concentrations. The sensor head has a maximum diameter of 10~mm which would allow it to be used for endoscopy, laparoscopy and interoperative surgery. △ Less

Submitted 8 April, 2025; originally announced April 2025.

Comments: 9 pages, 15 figures

Mutual information and the encoding of contingency tables

Authors: Maximilian Jerdee, Alec Kirkley, M. E. J. Newman

Abstract: Mutual information is commonly used as a measure of similarity between competing labelings of a given set of objects, for example to quantify performance in classification and community detection tasks. As argued recently, however, the mutual information as conventionally defined can return biased results because it neglects the information cost of the so-called contingency table, a crucial compon… ▽ More Mutual information is commonly used as a measure of similarity between competing labelings of a given set of objects, for example to quantify performance in classification and community detection tasks. As argued recently, however, the mutual information as conventionally defined can return biased results because it neglects the information cost of the so-called contingency table, a crucial component of the similarity calculation. In principle the bias can be rectified by subtracting the appropriate information cost, leading to the modified measure known as the reduced mutual information, but in practice one can only ever compute an upper bound on this information cost, and the value of the reduced mutual information depends crucially on how good a bound is established. In this paper we describe an improved method for encoding contingency tables that gives a substantially better bound in typical use cases, and approaches the ideal value in the common case where the labelings are closely similar, as we demonstrate with extensive numerical results. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Comments: 18 pages, 9 figures

On the Road with a Diamond Magnetometer

Authors: S. M. Graham, A. J. Newman, C. J. Stephen, A. M. Edmonds, D. J. Twitchen, M. L. Markham, G. W. Morley

Abstract: Nitrogen vacancy centres in diamond can be used for vector magnetometry. In this work we present a portable vector diamond magnetometer. Its vector capability, combined with feedback control and robust structure enables operation on moving platforms. While placed on a trolley, magnetic mapping of a room is demonstrated and the magnetometer is also shown to be operational in a moving van with the m… ▽ More Nitrogen vacancy centres in diamond can be used for vector magnetometry. In this work we present a portable vector diamond magnetometer. Its vector capability, combined with feedback control and robust structure enables operation on moving platforms. While placed on a trolley, magnetic mapping of a room is demonstrated and the magnetometer is also shown to be operational in a moving van with the measured magnetic field shifts for the x, y, and z axes being tagged with GPS coordinates. These magnetic field measurements are in agreement with measurements taken simultaneously with a fluxgate magnetometer. △ Less

Submitted 31 January, 2024; v1 submitted 29 January, 2024; originally announced January 2024.

Comments: 25 pages, 32 figures

Tensor gradiometry with a diamond magnetometer

Authors: A. J. Newman, S. M. Graham, A. M. Edmonds, D. J. Twitchen, M. L. Markham, G. W. Morley

Abstract: Vector magnetometry provides more information than scalar measurements for magnetic surveys utilized in space, defense, medical, geological and industrial applications. These areas would benefit from a mobile vector magnetometer that can operate in extreme conditions. Here we present a scanning fiber-coupled nitrogen vacancy (NV) center vector magnetometer. Feedback control of the microwave excita… ▽ More Vector magnetometry provides more information than scalar measurements for magnetic surveys utilized in space, defense, medical, geological and industrial applications. These areas would benefit from a mobile vector magnetometer that can operate in extreme conditions. Here we present a scanning fiber-coupled nitrogen vacancy (NV) center vector magnetometer. Feedback control of the microwave excitation frequency is employed to improve dynamic range and maintain sensitivity during movement of the sensor head. Tracking of the excitation frequency shifts for all four orientations of the NV center allow us to image the vector magnetic field of a damaged steel plate. We calculate the magnetic tensor gradiometry images in real time, and they allow us to detect smaller damage than is possible with vector or scalar imaging. △ Less

Submitted 11 July, 2023; originally announced July 2023.

Comments: 6 pages, 5 figures

Journal ref: Physical Review Applied 21, 014003 (2024)

Hierarchical core-periphery structure in networks

Authors: Austin Polanco, M. E. J. Newman

Abstract: We study core-periphery structure in networks using inference methods based on a flexible network model that allows for traditional onion-like cores within cores, but also for hierarchical tree-like structures and more general non-nested types of structure. We propose an efficient Monte Carlo scheme for fitting the model to observed networks and report results for a selection of real-world data se… ▽ More We study core-periphery structure in networks using inference methods based on a flexible network model that allows for traditional onion-like cores within cores, but also for hierarchical tree-like structures and more general non-nested types of structure. We propose an efficient Monte Carlo scheme for fitting the model to observed networks and report results for a selection of real-world data sets. Among other things, we observe an empirical distinction between networks showing traditional core-periphery structure with a dense core weakly connected to a sparse periphery, and an alternative structure in which the core is strongly connected both within itself and to the periphery. Networks vary in whether they are better represented by one type of structure or the other. We also observe structures that are a hybrid between core-periphery structure and community structure, in which networks have a set of non-overlapping cores that correspond roughly to communities, surrounded by a single undifferentiated periphery. Computer code implementing our methods is available. △ Less

Submitted 9 January, 2023; originally announced January 2023.

Comments: code available: https://github.com/apolanco115/hcp

Journal ref: Phys. Rev. E 108, 024311 (2023)

Fiber-coupled Diamond Magnetometry with an Unshielded 30 pT/$\sqrt{\textrm{Hz}}$ Sensitivity

Authors: S. M. Graham, A. T. M. A. Rahman, L. Munn, R. L. Patel, A. J. Newman, C. J. Stephen, G. Colston, A. Nikitin, A. M. Edmonds, D. J. Twitchen, M. L. Markham, G. W. Morley

Abstract: Ensembles of nitrogen vacancy centres (NVCs) in diamond can be employed for sensitive magnetometry. In this work we present a fiber-coupled NVC magnetometer with an unshielded sensitivity of (30 $\pm$ 10) pT/$\sqrt{\textrm{Hz}}$ in a (10 - 500)-Hz frequency range. This sensitivity is enabled by a relatively high green-to-red photon conversion efficiency, the use of a [100] bias field alignment, mi… ▽ More Ensembles of nitrogen vacancy centres (NVCs) in diamond can be employed for sensitive magnetometry. In this work we present a fiber-coupled NVC magnetometer with an unshielded sensitivity of (30 $\pm$ 10) pT/$\sqrt{\textrm{Hz}}$ in a (10 - 500)-Hz frequency range. This sensitivity is enabled by a relatively high green-to-red photon conversion efficiency, the use of a [100] bias field alignment, microwave and lock-in amplifier (LIA) parameter optimisation, as well as a balanced hyperfine excitation scheme. Furthermore, a silicon carbide (SiC) heat spreader is used for microwave delivery, alongside low-strain $^{12}\textrm{C}$ diamonds, one of which is placed in a second magnetically insensitive fluorescence collecting sensor head for common-mode noise cancellation. The magnetometer is capable of detecting signals from sources such as a vacuum pump up to 2 m away, with some orientation dependence but no complete dead zones, demonstrating its potential for use in remote sensing applications. △ Less

Submitted 23 March, 2023; v1 submitted 16 November, 2022; originally announced November 2022.

Comments: 21 pages, 19 figures, correction to data analysis

Journal ref: Physical Review Applied 19, 044042 (2023)

Message passing methods on complex networks

Authors: M. E. J. Newman

Abstract: Networks and network computations have become a primary mathematical tool for analyzing the structure of many kinds of complex systems, ranging from the Internet and transportation networks to biochemical interactions and social networks. A common task in network analysis is the calculation of quantities that reside on the nodes of a network, such as centrality measures, probabilities, or model st… ▽ More Networks and network computations have become a primary mathematical tool for analyzing the structure of many kinds of complex systems, ranging from the Internet and transportation networks to biochemical interactions and social networks. A common task in network analysis is the calculation of quantities that reside on the nodes of a network, such as centrality measures, probabilities, or model states. In this review article we discuss message passing methods, a family of techniques for performing such calculations, based on the propagation of information between the nodes of a network. We introduce the message passing approach with a series of examples, give some illustrative applications and results, and discuss the deep connections between message passing and phase transitions in networks. We also point out some limitations of the message passing approach and describe some recently-introduced methods that address these limitations. △ Less

Submitted 9 November, 2022; originally announced November 2022.

Comments: 16 pages and 16 figures

Journal ref: Proc. R. Soc. London A 479, 20220774 (2023)

Belief propagation for networks with loops

Authors: Alec Kirkley, George T. Cantwell, M. E. J. Newman

Abstract: Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works poorly in the common case of networks that contain short loops. Here we provide a solution to this long-standing problem, deriving a belief propagation method th… ▽ More Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works poorly in the common case of networks that contain short loops. Here we provide a solution to this long-standing problem, deriving a belief propagation method that allows for fast calculation of probability distributions in systems with short loops, potentially with high density, as well as giving expressions for the entropy and partition function, which are notoriously difficult quantities to compute. Using the Ising model as an example, we show that our approach gives excellent results on both real and synthetic networks, improving significantly on standard message passing methods. We also discuss potential applications of our method to a variety of other problems. △ Less

Submitted 24 April, 2021; v1 submitted 23 September, 2020; originally announced September 2020.

Journal ref: Science Advances 7, eabf1211 (2021)

Advanced chemical state studies of oxide films by lab-based HAXPES combining soft and hard X-ray sources

Authors: S. Siol, J. Mann, J. Newman, T. Miyayama, K. Watanabe, P. Schmutz, C. Cancellieri, L. P. H. Jeurgens

Abstract: The greater information depth provided in Hard X-ray Photoelectron Spectroscopy (HAXPES) enables non-destructive analyses of the chemistry and electronic structure of buried interfaces. Moreover, for industrially relevant elements like Al, Si and Ti, the combined access to the Al 1s, Si 1s or Ti 1s photoelectron line and its associated Al KLL, Si KLL or Ti KLL Auger transition, as required for loc… ▽ More The greater information depth provided in Hard X-ray Photoelectron Spectroscopy (HAXPES) enables non-destructive analyses of the chemistry and electronic structure of buried interfaces. Moreover, for industrially relevant elements like Al, Si and Ti, the combined access to the Al 1s, Si 1s or Ti 1s photoelectron line and its associated Al KLL, Si KLL or Ti KLL Auger transition, as required for local chemical state analysis on the basis of the Auger parameter, is only possible with hard X-rays. Until now, such photoemission studies were only possible at synchrotron facilities. Recently however, the first commercial XPS/HAXPES systems, equipped with both soft and hard X-ray sources, have entered the market, providing unique opportunities for monitoring the local chemical state of all constituent ions in functional oxides at different probing depths, in a routine laboratory environment. Bulk-sensitive shallow core-levels can be excited using either the hard or soft X-ray source, whereas more surface-sensitive deep core-level photoelectron lines and associated Auger transitions can be measured using the hard X-ray source. As demonstrated for thin Al2O3, SiO2 and TiO2 films, the local chemical state of the constituting ions in the oxide may even be probed at near constant probing depth by careful selection of sets of photoelectron and Auger lines, as excited with the combined soft and hard X-ray sources. We highlight the potential of lab-based HAXPES for the research on functional oxides and also discuss relevant technical details regarding the calibration of the kinetic binding energy scale. △ Less

Submitted 1 November, 2019; originally announced November 2019.

An effective mean field theory for the coexistence of anti-ferromagnetism and superconductivity: Applications to iron-based superconductors and cold Bose-Fermi atomic mixtures

Authors: Jeremy Brackett, Joseph Newman, Theja N. De Silva

Abstract: We study an effective fermion model on a square lattice to investigate the cooperation and competition of superconductivity and anti-ferromagnetism. In addition to particle tunneling and on-site interaction, a bosonic excitation mediated attractive interaction is also included in the model. We assume that the attractive interaction is mediated by spin fluctuations and excitations of Bose-Einstein… ▽ More We study an effective fermion model on a square lattice to investigate the cooperation and competition of superconductivity and anti-ferromagnetism. In addition to particle tunneling and on-site interaction, a bosonic excitation mediated attractive interaction is also included in the model. We assume that the attractive interaction is mediated by spin fluctuations and excitations of Bose-Einstein condensation (BEC) in electronic systems and Bose-Fermi mixtures on optical lattices, respectively. Using an effective mean-field theory to treat both superconductivity and anti-ferromagnetism at equal footing, we study the model within the Landau energy functional approach and a linearized theory. Within our approaches, we find possible co-existence of superconductivity and anti-ferromagnetism for both electronic and cold-atomic models. Our linearized theory shows while spin fluctuations favor d-wave superconductivity and BEC excitations favor s-wave superconductivity. △ Less

Submitted 30 August, 2016; v1 submitted 23 May, 2016; originally announced May 2016.

Comments: Published version (Physics Letters A)

Journal ref: Physics Letters A 380, 3421 (2016)

Multiway spectral community detection in networks

Authors: Xiao Zhang, M. E. J. Newman

Abstract: One of the most widely used methods for community detection in networks is the maximization of the quality function known as modularity. Of the many maximization techniques that have been used in this context, some of the most conceptually attractive are the spectral methods, which are based on the eigenvectors of the modularity matrix. Spectral algorithms have, however, been limited by and large… ▽ More One of the most widely used methods for community detection in networks is the maximization of the quality function known as modularity. Of the many maximization techniques that have been used in this context, some of the most conceptually attractive are the spectral methods, which are based on the eigenvectors of the modularity matrix. Spectral algorithms have, however, been limited by and large to the division of networks into only two or three communities, with divisions into more than three being achieved by repeated two-way division. Here we present a spectral algorithm that can directly divide a network into any number of communities. The algorithm makes use of a mapping from modularity maximization to a vector partitioning problem, combined with a fast heuristic for vector partitioning. We compare the performance of this spectral algorithm with previous approaches and find it to give superior results, particularly in cases where community sizes are unbalanced. We also give demonstrative applications of the algorithm to two real-world networks and find that it produces results in good agreement with expectations for the networks studied. △ Less

Submitted 22 June, 2015; originally announced July 2015.

Comments: 10 pages, 5 figures

Journal ref: Phys. Rev. E 92, 052808 (2015)

Structural inference for uncertain networks

Authors: Travis Martin, Brian Ball, M. E. J. Newman

Abstract: In the study of networked systems such as biological, technological, and social networks the available data are often uncertain. Rather than knowing the structure of a network exactly, we know the connections between nodes only with a certain probability. In this paper we develop methods for the analysis of such uncertain data, focusing particularly on the problem of community detection. We give a… ▽ More In the study of networked systems such as biological, technological, and social networks the available data are often uncertain. Rather than knowing the structure of a network exactly, we know the connections between nodes only with a certain probability. In this paper we develop methods for the analysis of such uncertain data, focusing particularly on the problem of community detection. We give a principled maximum-likelihood method for inferring community structure and demonstrate how the results can be used to make improved estimates of the true structure of the network. Using computer-generated benchmark networks we demonstrate that our methods are able to reconstruct known communities more accurately than previous approaches based on data thresholding. We also give an example application to the detection of communities in a protein-protein interaction network. △ Less

Submitted 17 June, 2015; originally announced June 2015.

Comments: 12 pages, 4 figures

Journal ref: Phys. Rev. E 93, 012306 (2016)

Generalized communities in networks

Authors: M. E. J. Newman, Tiago P. Peixoto

Abstract: A substantial volume of research has been devoted to studies of community structure in networks, but communities are not the only possible form of large-scale network structure. Here we describe a broad extension of community structure that encompasses traditional communities but includes a wide range of generalized structural patterns as well. We describe a principled method for detecting this ge… ▽ More A substantial volume of research has been devoted to studies of community structure in networks, but communities are not the only possible form of large-scale network structure. Here we describe a broad extension of community structure that encompasses traditional communities but includes a wide range of generalized structural patterns as well. We describe a principled method for detecting this generalized structure in empirical network data and demonstrate with real-world examples how it can be used to learn new things about the shape and meaning of networks. △ Less

Submitted 27 May, 2015; originally announced May 2015.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. Lett. 115, 088701 (2015)

Identification of core-periphery structure in networks

Authors: Xiao Zhang, Travis Martin, M. E. J. Newman

Abstract: Many networks can be usefully decomposed into a dense core plus an outlying, loosely-connected periphery. Here we propose an algorithm for performing such a decomposition on empirical network data using methods of statistical inference. Our method fits a generative model of core-periphery structure to observed data using a combination of an expectation--maximization algorithm for calculati… ▽ More Many networks can be usefully decomposed into a dense core plus an outlying, loosely-connected periphery. Here we propose an algorithm for performing such a decomposition on empirical network data using methods of statistical inference. Our method fits a generative model of core-periphery structure to observed data using a combination of an expectation--maximization algorithm for calculating the parameters of the model and a belief propagation algorithm for calculating the decomposition itself. We find the method to be efficient, scaling easily to networks with a million or more nodes and we test it on a range of networks, including real-world examples as well as computer-generated benchmarks, for which it successfully identifies known core-periphery structure with low error rate. We also demonstrate that the method is immune from the detectability transition observed in the related community detection problem, which prevents the detection of community structure when that structure is too weak. There is no such transition for core-periphery structure, which is detectable, albeit with some statistical error, no matter how weak it is. △ Less

Submitted 16 September, 2014; originally announced September 2014.

Equitable random graphs

Authors: M. E. J. Newman, Travis Martin

Abstract: Random graph models have played a dominant role in the theoretical study of networked systems. The Poisson random graph of Erdos and Renyi, in particular, as well as the so-called configuration model, have served as the starting point for numerous calculations. In this paper we describe another large class of random graph models, which we call equitable random graphs and which are flexible enough… ▽ More Random graph models have played a dominant role in the theoretical study of networked systems. The Poisson random graph of Erdos and Renyi, in particular, as well as the so-called configuration model, have served as the starting point for numerous calculations. In this paper we describe another large class of random graph models, which we call equitable random graphs and which are flexible enough to represent networks with diverse degree distributions and many nontrivial types of structure, including community structure, bipartite structure, degree correlations, stratification, and others, yet are exactly solvable for a wide range of properties in the limit of large graph size, including percolation properties, complete spectral density, and the behavior of homogeneous dynamical systems, such as coupled oscillators or epidemic models. △ Less

Submitted 6 May, 2014; originally announced May 2014.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. E 90, 052824 (2014)

Percolation on sparse networks

Authors: Brian Karrer, M. E. J. Newman, Lenka Zdeborová

Abstract: We study percolation on networks, which is used as a model of the resilience of networked systems such as the Internet to attack or failure and as a simple model of the spread of disease over human contact networks. We reformulate percolation as a message passing process and demonstrate how the resulting equations can be used to calculate, among other things, the size of the percolating cluster an… ▽ More We study percolation on networks, which is used as a model of the resilience of networked systems such as the Internet to attack or failure and as a simple model of the spread of disease over human contact networks. We reformulate percolation as a message passing process and demonstrate how the resulting equations can be used to calculate, among other things, the size of the percolating cluster and the average cluster size. The calculations are exact for sparse networks when the number of short loops in the network is small, but even on networks with many short loops we find them to be highly accurate when compared with direct numerical simulations. By considering the fixed points of the message passing process, we also show that the percolation threshold on a network with few loops is given by the inverse of the leading eigenvalue of the so-called non-backtracking matrix. △ Less

Submitted 7 October, 2014; v1 submitted 2 May, 2014; originally announced May 2014.

Comments: 6 pages, 1 figure, 1 table. This version includes a Supplemental Information section and some changes to the proofs and results in the main paper

Journal ref: Phys. Rev. Lett. 113, 208702 (2014)

Localization and centrality in networks

Authors: Travis Martin, Xiao Zhang, M. E. J. Newman

Abstract: Eigenvector centrality is a common measure of the importance of nodes in a network. Here we show that under common conditions the eigenvector centrality displays a localization transition that causes most of the weight of the centrality to concentrate on a small number of nodes in the network. In this regime the measure is no longer useful for distinguishing among the remaining nodes and its effic… ▽ More Eigenvector centrality is a common measure of the importance of nodes in a network. Here we show that under common conditions the eigenvector centrality displays a localization transition that causes most of the weight of the centrality to concentrate on a small number of nodes in the network. In this regime the measure is no longer useful for distinguishing among the remaining nodes and its efficacy as a network metric is impaired. As a remedy, we propose an alternative centrality measure based on the nonbacktracking matrix, which gives results closely similar to the standard eigenvector centrality in dense networks where the latter is well behaved, but avoids localization and gives useful results in regimes where the standard centrality fails. △ Less

Submitted 3 January, 2015; v1 submitted 20 January, 2014; originally announced January 2014.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. E 90, 052808 (2014)

Spectra of random graphs with community structure and arbitrary degrees

Authors: Xiao Zhang, Raj Rao Nadakuditi, M. E. J. Newman

Abstract: Using methods from random matrix theory researchers have recently calculated the full spectra of random networks with arbitrary degrees and with community structure. Both reveal interesting spectral features, including deviations from the Wigner semicircle distribution and phase transitions in the spectra of community structured networks. In this paper we generalize both calculations, giving a pre… ▽ More Using methods from random matrix theory researchers have recently calculated the full spectra of random networks with arbitrary degrees and with community structure. Both reveal interesting spectral features, including deviations from the Wigner semicircle distribution and phase transitions in the spectra of community structured networks. In this paper we generalize both calculations, giving a prescription for calculating the spectrum of a network with both community structure and an arbitrary degree distribution. In general the spectrum has two parts, a continuous spectral band, which can depart strongly from the classic semicircle form, and a set of outlying eigenvalues that indicate the presence of communities. △ Less

Submitted 30 September, 2013; originally announced October 2013.

Comments: 9 pages, 3 figures

Journal ref: Phys. Rev. E 89, 042816 (2014)

Spectral community detection in sparse networks

Authors: M. E. J. Newman

Abstract: Spectral methods based on the eigenvectors of matrices are widely used in the analysis of network data, particularly for community detection and graph partitioning. Standard methods based on the adjacency matrix and related matrices, however, break down for very sparse networks, which includes many networks of practical interest. As a solution to this problem it has been recently proposed that we… ▽ More Spectral methods based on the eigenvectors of matrices are widely used in the analysis of network data, particularly for community detection and graph partitioning. Standard methods based on the adjacency matrix and related matrices, however, break down for very sparse networks, which includes many networks of practical interest. As a solution to this problem it has been recently proposed that we focus instead on the spectrum of the non-backtracking matrix, an alternative matrix representation of a network that shows better behavior in the sparse limit. Inspired by this suggestion, we here make use of a relaxation method to derive a spectral community detection algorithm that works well even in the sparse regime where other methods break down. Interestingly, however, the matrix at the heart of the method, it turns out, is not exactly the non-backtracking matrix, but a variant of it with a somewhat different definition. We study the behavior of this variant matrix for both artificial and real-world networks and find it to have desirable properties, especially in the common case of networks with broad degree distributions, for which it appears to have a better behaved spectrum and eigenvectors than the original non-backtracking matrix. △ Less

Submitted 29 August, 2013; originally announced August 2013.

Comments: 6 pages, 2 figures

Spectral methods for network community detection and graph partitioning

Authors: M. E. J. Newman

Abstract: We consider three distinct and well studied problems concerning network structure: community detection by modularity maximization, community detection by statistical inference, and normalized-cut graph partitioning. Each of these problems can be tackled using spectral algorithms that make use of the eigenvectors of matrix representations of the network. We show that with certain choices of the fre… ▽ More We consider three distinct and well studied problems concerning network structure: community detection by modularity maximization, community detection by statistical inference, and normalized-cut graph partitioning. Each of these problems can be tackled using spectral algorithms that make use of the eigenvectors of matrix representations of the network. We show that with certain choices of the free parameters appearing in these spectral algorithms the algorithms for all three problems are, in fact, identical, and hence that, at least within the spectral approximations used here, there is no difference between the modularity- and inference-based community detection methods, or between either and graph partitioning. △ Less

Submitted 29 July, 2013; originally announced July 2013.

Comments: 11 pages, 5 figures

Journal ref: Phys. Rev. E 88, 042822 (2013)

Spectra of random graphs with arbitrary expected degrees

Authors: Raj Rao Nadakuditi, M. E. J. Newman

Abstract: We study random graphs with arbitrary distributions of expected degree and derive expressions for the spectra of their adjacency and modularity matrices. We give a complete prescription for calculating the spectra that is exact in the limit of large network size and large vertex degrees. We also study the effect on the spectra of hubs in the network, vertices of unusually high degree, and show tha… ▽ More We study random graphs with arbitrary distributions of expected degree and derive expressions for the spectra of their adjacency and modularity matrices. We give a complete prescription for calculating the spectra that is exact in the limit of large network size and large vertex degrees. We also study the effect on the spectra of hubs in the network, vertices of unusually high degree, and show that these produce isolated eigenvalues outside the main spectral band, akin to impurity states in condensed matter systems, with accompanying eigenvectors that are strongly localized around the hubs. We also give numerical results that confirm our analytic expressions. △ Less

Submitted 6 August, 2012; originally announced August 2012.

Comments: 14 pages, 5 figures

Journal ref: Phys. Rev. E 87, 012803 (2013)

Graph spectra and the detectability of community structure in networks

Authors: Raj Rao Nadakuditi, M. E. J. Newman

Abstract: We study networks that display community structure -- groups of nodes within which connections are unusually dense. Using methods from random matrix theory, we calculate the spectra of such networks in the limit of large size, and hence demonstrate the presence of a phase transition in matrix methods for community detection, such as the popular modularity maximization method. The transition separa… ▽ More We study networks that display community structure -- groups of nodes within which connections are unusually dense. Using methods from random matrix theory, we calculate the spectra of such networks in the limit of large size, and hence demonstrate the presence of a phase transition in matrix methods for community detection, such as the popular modularity maximization method. The transition separates a regime in which such methods successfully detect the community structure from one in which the structure is present but is not detected. By comparing these results with recent analyses of maximum-likelihood methods we are able to show that spectral modularity maximization is an optimal detection method in the sense that no other method will succeed in the regime where the modularity method fails. △ Less

Submitted 8 May, 2012; originally announced May 2012.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. Lett. 108, 188701 (2012)

Analysis of Lithiation and Delithiation Kinetics in Silicon

Authors: Vijay A. Sethuraman, Venkat Srinivasan, John Newman

Abstract: Analysis of lithiation and delithiation kinetics in pulse-laser-deposited crystalline thin-film silicon (Si) electrodes is presented. Data from open-circuit relaxation experiments are used in conjunction with a model based on Tafel kinetics and double-layer capacitance to estimate the apparent transfer coefficients (αa, αc), and exchange current density to capacitance ratio (i0/Cdl) for lithiation… ▽ More Analysis of lithiation and delithiation kinetics in pulse-laser-deposited crystalline thin-film silicon (Si) electrodes is presented. Data from open-circuit relaxation experiments are used in conjunction with a model based on Tafel kinetics and double-layer capacitance to estimate the apparent transfer coefficients (αa, αc), and exchange current density to capacitance ratio (i0/Cdl) for lithiation and delithiation reactions in a lithiated silicon (LixSi) system. Parameters estimated from data sets obtained during first-cycle amorphization of crystalline Si, as well as from cycled crystalline Si and amorphous Si thin-film electrodes do not show much variation, indicating that they are intrinsic to lithiation/delithiation in Si. A methodology to estimate the side-reaction rate and its role in the evolution of the open-circuit potential of the LixSi system are discussed. We conclude that the large potential offset between lithiation and delithiation reactions at any given state of charge is partially caused by a large kinetic resistance (i.e., small i0). Using the estimated parameters, the model is shown to predict successfully the behavior of the system under galvanostatic lithiation and delithiation. △ Less

Submitted 6 January, 2012; originally announced January 2012.

Comments: 35 pages, 14 figures

Journal ref: Journal of The Electrochemical Society, 160 (2), A394-A403 2013

Complex Systems: A Survey

Authors: M. E. J. Newman

Abstract: A complex system is a system composed of many interacting parts, often called agents, which displays collective behavior that does not follow trivially from the behaviors of the individual parts. Examples include condensed matter systems, ecosystems, stock markets and economies, biological evolution, and indeed the whole of human society. Substantial progress has been made in the quantitative unde… ▽ More A complex system is a system composed of many interacting parts, often called agents, which displays collective behavior that does not follow trivially from the behaviors of the individual parts. Examples include condensed matter systems, ecosystems, stock markets and economies, biological evolution, and indeed the whole of human society. Substantial progress has been made in the quantitative understanding of complex systems, particularly since the 1980s, using a combination of basic theory, much of it derived from physics, and computer simulation. The subject is a broad one, drawing on techniques and ideas from a wide range of areas. Here I give a survey of the main themes and methods of complex systems science and an annotated bibliography of resources, ranging from classic papers to recent books and reviews. △ Less

Submitted 6 December, 2011; originally announced December 2011.

Comments: 10 pages

Journal ref: Am. J. Phys. 79, 800-810 (2011)

Competing epidemics on complex networks

Authors: Brian Karrer, M. E. J. Newman

Abstract: Human diseases spread over networks of contacts between individuals and a substantial body of recent research has focused on the dynamics of the spreading process. Here we examine a model of two competing diseases spreading over the same network at the same time, where infection with either disease gives an individual subsequent immunity to both. Using a combination of analytic and numerical metho… ▽ More Human diseases spread over networks of contacts between individuals and a substantial body of recent research has focused on the dynamics of the spreading process. Here we examine a model of two competing diseases spreading over the same network at the same time, where infection with either disease gives an individual subsequent immunity to both. Using a combination of analytic and numerical methods, we derive the phase diagram of the system and estimates of the expected final numbers of individuals infected with each disease. The system shows an unusual dynamical transition between dominance of one disease and dominance of the other as a function of their relative rates of growth. Close to this transition the final outcomes show strong dependence on stochastic fluctuations in the early stages of growth, dependence that decreases with increasing network size, but does so sufficiently slowly as still to be easily visible in systems with millions or billions of individuals. In most regions of the phase diagram we find that one disease eventually dominates while the other reaches only a vanishing fraction of the network, but the system also displays a significant coexistence regime in which both diseases reach epidemic proportions and infect an extensive fraction of the network. △ Less

Submitted 17 May, 2011; originally announced May 2011.

Comments: 14 pages, 5 figures

Journal ref: Phys. Rev. E 84, 036106 (2011)

An efficient and principled method for detecting communities in networks

Authors: Brian Ball, Brian Karrer, M. E. J. Newman

Abstract: A fundamental problem in the analysis of network data is the detection of network communities, groups of densely interconnected nodes, which may be overlapping or disjoint. Here we describe a method for finding overlapping communities based on a principled statistical approach using generative network models. We show how the method can be implemented using a fast, closed-form expectation-maximizat… ▽ More A fundamental problem in the analysis of network data is the detection of network communities, groups of densely interconnected nodes, which may be overlapping or disjoint. Here we describe a method for finding overlapping communities based on a principled statistical approach using generative network models. We show how the method can be implemented using a fast, closed-form expectation-maximization algorithm that allows us to analyze networks of millions of nodes in reasonable running times. We test the method both on real-world networks and on synthetic benchmarks and find that it gives results competitive with previous methods. We also show that the same approach can be used to extract nonoverlapping community divisions via a relaxation method, and demonstrate that the algorithm is competitively fast and accurate for the nonoverlapping problem. △ Less

Submitted 18 April, 2011; originally announced April 2011.

Comments: 14 pages, 5 figures, 1 table

Journal ref: Phys. Rev. E 84, 036103 (2011)

Stochastic blockmodels and community structure in networks

Authors: Brian Karrer, M. E. J. Newman

Abstract: Stochastic blockmodels have been proposed as a tool for detecting community structure in networks as well as for generating synthetic networks for use as benchmarks. Most blockmodels, however, ignore variation in vertex degree, making them unsuitable for applications to real-world networks, which typically display broad degree distributions that can significantly distort the results. Here we demon… ▽ More Stochastic blockmodels have been proposed as a tool for detecting community structure in networks as well as for generating synthetic networks for use as benchmarks. Most blockmodels, however, ignore variation in vertex degree, making them unsuitable for applications to real-world networks, which typically display broad degree distributions that can significantly distort the results. Here we demonstrate how the generalization of blockmodels to incorporate this missing element leads to an improved objective function for community detection in complex networks. We also propose a heuristic algorithm for community detection using this objective function or its non-degree-corrected counterpart and show that the degree-corrected version dramatically outperforms the uncorrected one in both real-world and synthetic networks. △ Less

Submitted 23 August, 2010; originally announced August 2010.

Comments: 11 pages, 3 figures

Journal ref: Phys. Rev. E 83, 016107 (2011)

Random graphs containing arbitrary distributions of subgraphs

Authors: Brian Karrer, M. E. J. Newman

Abstract: Traditional random graph models of networks generate networks that are locally tree-like, meaning that all local neighborhoods take the form of trees. In this respect such models are highly unrealistic, most real networks having strongly non-tree-like neighborhoods that contain short loops, cliques, or other biconnected subgraphs. In this paper we propose and analyze a new class of random graph… ▽ More Traditional random graph models of networks generate networks that are locally tree-like, meaning that all local neighborhoods take the form of trees. In this respect such models are highly unrealistic, most real networks having strongly non-tree-like neighborhoods that contain short loops, cliques, or other biconnected subgraphs. In this paper we propose and analyze a new class of random graph models that incorporates general subgraphs, allowing for non-tree-like neighborhoods while still remaining solvable for many fundamental network properties. Among other things we give solutions for the size of the giant component, the position of the phase transition at which the giant component appears, and percolation properties for both site and bond percolation on networks generated by the model. △ Less

Submitted 10 May, 2010; originally announced May 2010.

Comments: 12 pages, 6 figures, 1 table

Journal ref: Phys. Rev. E 82, 066118 (2010)

A message passing approach for general epidemic models

Authors: Brian Karrer, M. E. J. Newman

Abstract: In most models of the spread of disease over contact networks it is assumed that the probabilities per unit time of disease transmission and recovery from disease are constant, implying exponential distributions of the time intervals for transmission and recovery. Time intervals for real diseases, however, have distributions that in most cases are far from exponential, which leads to disagreements… ▽ More In most models of the spread of disease over contact networks it is assumed that the probabilities per unit time of disease transmission and recovery from disease are constant, implying exponential distributions of the time intervals for transmission and recovery. Time intervals for real diseases, however, have distributions that in most cases are far from exponential, which leads to disagreements, both qualitative and quantitative, with the models. In this paper, we study a generalized version of the SIR (susceptible-infected-recovered) model of epidemic disease that allows for arbitrary distributions of transmission and recovery times. Standard differential equation approaches cannot be used for this generalized model, but we show that the problem can be reformulated as a time-dependent message passing calculation on the appropriate contact network. The calculation is exact on trees (i.e., loopless networks) or locally tree-like networks (such as random graphs) in the large system size limit. On non-tree-like networks we show that the calculation gives a rigorous bound on the size of disease outbreaks. We demonstrate the method with applications to two specific models and the results compare favorably with numerical simulations. △ Less

Submitted 22 July, 2010; v1 submitted 29 March, 2010; originally announced March 2010.

Comments: 10 pages, 3 figures

Journal ref: Phys. Rev. E 82, 016101 (2010)

Random graph models for directed acyclic networks

Authors: Brian Karrer, M. E. J. Newman

Abstract: We study random graph models for directed acyclic graphs, an important class of networks that includes citation networks, food webs, and feed-forward neural networks among others. We propose two specific models, roughly analogous to the fixed edge number and fixed edge probability variants of traditional undirected random graphs. We calculate a number of properties of these models, including par… ▽ More We study random graph models for directed acyclic graphs, an important class of networks that includes citation networks, food webs, and feed-forward neural networks among others. We propose two specific models, roughly analogous to the fixed edge number and fixed edge probability variants of traditional undirected random graphs. We calculate a number of properties of these models, including particularly the probability of connection between a given pair of vertices, and compare the results with real-world acyclic network data finding that theory and measurements agree surprisingly well -- far better than the often poor agreement of other random graph models with their corresponding real-world networks. △ Less

Submitted 24 July, 2009; originally announced July 2009.

Comments: 14 pages, 5 figures

Journal ref: Phys. Rev. E 80, 046110 (2009)

Random graphs with clustering

Authors: M. E. J. Newman

Abstract: We offer a solution to a long-standing problem in the physics of networks, the creation of a plausible, solvable model of a network that displays clustering or transitivity -- the propensity for two neighbors of a network node also to be neighbors of one another. We show how standard random graph models can be generalized to incorporate clustering and give exact solutions for various properties… ▽ More We offer a solution to a long-standing problem in the physics of networks, the creation of a plausible, solvable model of a network that displays clustering or transitivity -- the propensity for two neighbors of a network node also to be neighbors of one another. We show how standard random graph models can be generalized to incorporate clustering and give exact solutions for various properties of the resulting networks, including sizes of network components, size of the giant component if there is one, position of the phase transition at which the giant component forms, and position of the phase transition for percolation on the network. △ Less

Submitted 23 March, 2009; originally announced March 2009.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. Lett. 103, 058701 (2009)

Random acyclic networks

Authors: Brian Karrer, M. E. J. Newman

Abstract: Directed acyclic graphs are a fundamental class of networks that includes citation networks, food webs, and family trees, among others. Here we define a random graph model for directed acyclic graphs and give solutions for a number of the model's properties, including connection probabilities and component sizes, as well as a fast algorithm for simulating the model on a computer. We compare the… ▽ More Directed acyclic graphs are a fundamental class of networks that includes citation networks, food webs, and family trees, among others. Here we define a random graph model for directed acyclic graphs and give solutions for a number of the model's properties, including connection probabilities and component sizes, as well as a fast algorithm for simulating the model on a computer. We compare the predictions of the model to a real-world network of citations between physics papers and find surprisingly good agreement, suggesting that the structure of the real network may be quite well described by the random graph. △ Less

Submitted 23 February, 2009; originally announced February 2009.

Comments: 4 pages, 2 figures

Journal ref: Phys. Rev. Lett. 102, 128701 (2009)

Robustness of community structure in networks

Authors: Brian Karrer, Elizaveta Levina, M. E. J. Newman

Abstract: The discovery of community structure is a common challenge in the analysis of network data. Many methods have been proposed for finding community structure, but few have been proposed for determining whether the structure found is statistically significant or whether, conversely, it could have arisen purely as a result of chance. In this paper we show that the significance of community structure… ▽ More The discovery of community structure is a common challenge in the analysis of network data. Many methods have been proposed for finding community structure, but few have been proposed for determining whether the structure found is statistically significant or whether, conversely, it could have arisen purely as a result of chance. In this paper we show that the significance of community structure can be effectively quantified by measuring its robustness to small perturbations in network structure. We propose a suitable method for perturbing networks and a measure of the resulting change in community structure and use them to assess the significance of community structure in a variety of networks, both real and computer generated. △ Less

Submitted 13 September, 2007; originally announced September 2007.

Comments: 10 pages, 2 figures

Journal ref: Phys. Rev. E 77, 046119 (2008)

Bicomponents and the robustness of networks to failure

Authors: M. E. J. Newman, Gourab Ghoshal

Abstract: A common definition of a robust connection between two nodes in a network such as a communication network is that there should be at least two independent paths connecting them, so that the failure of no single node in the network causes them to become disconnected. This definition leads us naturally to consider bicomponents, subnetworks in which every node has a robust connection of this kind t… ▽ More A common definition of a robust connection between two nodes in a network such as a communication network is that there should be at least two independent paths connecting them, so that the failure of no single node in the network causes them to become disconnected. This definition leads us naturally to consider bicomponents, subnetworks in which every node has a robust connection of this kind to every other. Here we study bicomponents in both real and model networks using a combination of exact analytic techniques and numerical methods. We show that standard network models predict there to be essentially no small bicomponents in most networks, but there may be a giant bicomponent, whose presence coincides with the presence of the ordinary giant component, and we find that real networks seem by and large to follow this pattern, although there are some interesting exceptions. We study the size of the giant bicomponent as nodes in the network fail, using a specially developed computer algorithm based on data trees, and find in some cases that our networks are quite robust to failure, with large bicomponents persisting until almost all vertices have been removed. △ Less

Submitted 20 August, 2007; originally announced August 2007.

Comments: 5 pages, 1 figure, 1 table

Journal ref: Phys. Rev. Lett. 100, 138701 (2008)

Component sizes in networks with arbitrary degree distributions

Authors: M. E. J. Newman

Abstract: We give an exact solution for the complete distribution of component sizes in random networks with arbitrary degree distributions. The solution tells us the probability that a randomly chosen node belongs to a component of size s, for any s. We apply our results to networks with the three most commonly studied degree distributions -- Poisson, exponential, and power-law -- as well as to the calcu… ▽ More We give an exact solution for the complete distribution of component sizes in random networks with arbitrary degree distributions. The solution tells us the probability that a randomly chosen node belongs to a component of size s, for any s. We apply our results to networks with the three most commonly studied degree distributions -- Poisson, exponential, and power-law -- as well as to the calculation of cluster sizes for bond percolation on networks, which correspond to the sizes of outbreaks of SIR epidemic processes on the same networks. For the particular case of the power-law degree distribution, we show that the component size distribution itself follows a power law everywhere below the phase transition at which a giant component forms, but takes an exponential form when a giant component is present. △ Less

Submitted 30 June, 2007; originally announced July 2007.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. E 76, 045101 (2007)

Power-law distributions in empirical data

Authors: Aaron Clauset, Cosma Rohilla Shalizi, M. E. J. Newman

Abstract: Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena. Unfortunately, the detection and characterization of power laws is complicated by the large fluctuations that occur in the tail of the distribution -- the part of the distribution representing large but rare events -- and by the diffic… ▽ More Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena. Unfortunately, the detection and characterization of power laws is complicated by the large fluctuations that occur in the tail of the distribution -- the part of the distribution representing large but rare events -- and by the difficulty of identifying the range over which power-law behavior holds. Commonly used methods for analyzing power-law data, such as least-squares fitting, can produce substantially inaccurate estimates of parameters for power-law distributions, and even in cases where such methods return accurate answers they are still unsatisfactory because they give no indication of whether the data obey a power law at all. Here we present a principled statistical framework for discerning and quantifying power-law behavior in empirical data. Our approach combines maximum-likelihood fitting methods with goodness-of-fit tests based on the Kolmogorov-Smirnov statistic and likelihood ratios. We evaluate the effectiveness of the approach with tests on synthetic data and give critical comparisons to previous approaches. We also apply the proposed methods to twenty-four real-world data sets from a range of different disciplines, each of which has been conjectured to follow a power-law distribution. In some cases we find these conjectures to be consistent with the data while in others the power law is ruled out. △ Less

Submitted 2 February, 2009; v1 submitted 7 June, 2007; originally announced June 2007.

Comments: 43 pages, 11 figures, 7 tables, 4 appendices; code available at http://www.santafe.edu/~aaronc/powerlaws/

Journal ref: SIAM Review 51, 661-703 (2009)

Large-scale structure of time evolving citation networks

Authors: E. A. Leicht, Gavin Clarkson, Kerby Shedden, M. E. J. Newman

Abstract: In this paper we examine a number of methods for probing and understanding the large-scale structure of networks that evolve over time. We focus in particular on citation networks, networks of references between documents such as papers, patents, or court cases. We describe three different methods of analysis, one based on an expectation-maximization algorithm, one based on modularity optimizati… ▽ More In this paper we examine a number of methods for probing and understanding the large-scale structure of networks that evolve over time. We focus in particular on citation networks, networks of references between documents such as papers, patents, or court cases. We describe three different methods of analysis, one based on an expectation-maximization algorithm, one based on modularity optimization, and one based on eigenvector centrality. Using the network of citations between opinions of the United States Supreme Court as an example, we demonstrate how each of these methods can reveal significant structural divisions in the network, and how, ultimately, the combination of all three can help us develop a coherent overall picture of the network's shape. △ Less

Submitted 5 June, 2007; v1 submitted 31 May, 2007; originally announced June 2007.

Comments: 10 pages, 6 figures; journal names for 4 references fixed

Journal ref: Eur. Phys. J. B 59, 75-83 (2007)

Mixture models and exploratory analysis in networks

Authors: M. E. J. Newman, E. A. Leicht

Abstract: Networks are widely used in the biological, physical, and social sciences as a concise mathematical representation of the topology of systems of interacting components. Understanding the structure of these networks is one of the outstanding challenges in the study of complex systems. Here we describe a general technique for detecting structural features in large-scale network data which works by… ▽ More Networks are widely used in the biological, physical, and social sciences as a concise mathematical representation of the topology of systems of interacting components. Understanding the structure of these networks is one of the outstanding challenges in the study of complex systems. Here we describe a general technique for detecting structural features in large-scale network data which works by dividing the nodes of a network into classes such that the members of each class have similar patterns of connection to other nodes. Using the machinery of probabilistic mixture models and the expectation-maximization algorithm, we show that it is possible to detect, without prior knowledge of what we are looking for, a very broad range of types of structure in networks. We give a number of examples demonstrating how the method can be used to shed light on the properties of real-world networks, including social and information networks. △ Less

Submitted 31 May, 2007; v1 submitted 15 November, 2006; originally announced November 2006.

Comments: 8 pages, 4 figures, two new examples in this version plus minor corrections

Journal ref: Proc. Natl. Acad. Sci. USA 104, 9564-9569 (2007)

Finding community structure in networks using the eigenvectors of matrices

Authors: M. E. J. Newman

Abstract: We consider the problem of detecting communities or modules in networks, groups of vertices with a higher-than-average density of edges connecting them. Previous work indicates that a robust approach to this problem is the maximization of the benefit function known as "modularity" over possible divisions of a network. Here we show that this maximization process can be written in terms of the eig… ▽ More We consider the problem of detecting communities or modules in networks, groups of vertices with a higher-than-average density of edges connecting them. Previous work indicates that a robust approach to this problem is the maximization of the benefit function known as "modularity" over possible divisions of a network. Here we show that this maximization process can be written in terms of the eigenspectrum of a matrix we call the modularity matrix, which plays a role in community detection similar to that played by the graph Laplacian in graph partitioning calculations. This result leads us to a number of possible algorithms for detecting community structure, as well as several other results, including a spectral measure of bipartite structure in networks and a new centrality measure that identifies those vertices that occupy central positions within the communities to which they belong. The algorithms and measures proposed are illustrated with applications to a variety of real-world complex networks. △ Less

Submitted 23 July, 2006; v1 submitted 10 May, 2006; originally announced May 2006.

Comments: 22 pages, 8 figures, minor corrections in this version

Journal ref: Phys. Rev. E 74, 036104 (2006)

Amplified biochemical oscillations in cellular systems

Authors: A. J. McKane, J. D. Nagy, T. J. Newman, M. O. Stefanini

Abstract: We describe a mechanism for pronounced biochemical oscillations, relevant to microscopic systems, such as the intracellular environment. This mechanism operates for reaction schemes which, when modeled using deterministic rate equations, fail to exhibit oscillations for any values of rate constants. The mechanism relies on amplification of the underlying stochasticity of reaction kinetics within… ▽ More We describe a mechanism for pronounced biochemical oscillations, relevant to microscopic systems, such as the intracellular environment. This mechanism operates for reaction schemes which, when modeled using deterministic rate equations, fail to exhibit oscillations for any values of rate constants. The mechanism relies on amplification of the underlying stochasticity of reaction kinetics within a narrow window of frequencies. This amplification allows fluctuations to beat the central limit theorem, having a dominant effect even though the number of molecules in the system is relatively large. The mechanism is quantitatively studied within simple models of self-regulatory gene expression, and glycolytic oscillations. △ Less

Submitted 2 April, 2006; originally announced April 2006.

Comments: 35 pages, 6 figures

Exact solutions for models of evolving networks with addition and deletion of nodes

Authors: Cristopher Moore, Gourab Ghoshal, M. E. J. Newman

Abstract: There has been considerable recent interest in the properties of networks, such as citation networks and the worldwide web, that grow by the addition of vertices, and a number of simple solvable models of network growth have been studied. In the real world, however, many networks, including the web, not only add vertices but also lose them. Here we formulate models of the time evolution of such… ▽ More There has been considerable recent interest in the properties of networks, such as citation networks and the worldwide web, that grow by the addition of vertices, and a number of simple solvable models of network growth have been studied. In the real world, however, many networks, including the web, not only add vertices but also lose them. Here we formulate models of the time evolution of such networks and give exact solutions for a number of cases of particular interest. For the case of net growth and so-called preferential attachment -- in which newly appearing vertices attach to previously existing ones in proportion to vertex degree -- we show that the resulting networks have power-law degree distributions, but with an exponent that diverges as the growth rate vanishes. We conjecture that the low exponent values observed in real-world networks are thus the result of vigorous growth in which the rate of addition of vertices far exceeds the rate of removal. Were growth to slow in the future, for instance in a more mature future version of the web, we would expect to see exponents increase, potentially without bound. △ Less

Submitted 4 April, 2006; originally announced April 2006.

Comments: 9 pages, 3 figures

Journal ref: Phys. Rev. E 74, 036121 (2006)

Nonequilibrium phase transition in the coevolution of networks and opinions

Authors: Petter Holme, M. E. J. Newman

Abstract: Models of the convergence of opinion in social systems have been the subject of a considerable amount of recent attention in the physics literature. These models divide into two classes, those in which individuals form their beliefs based on the opinions of their neighbors in a social network of personal acquaintances, and those in which, conversely, network connections form between individuals… ▽ More Models of the convergence of opinion in social systems have been the subject of a considerable amount of recent attention in the physics literature. These models divide into two classes, those in which individuals form their beliefs based on the opinions of their neighbors in a social network of personal acquaintances, and those in which, conversely, network connections form between individuals of similar beliefs. While both of these processes can give rise to realistic levels of agreement between acquaintances, practical experience suggests that opinion formation in the real world is not a result of one process or the other, but a combination of the two. Here we present a simple model of this combination, with a single parameter controlling the balance of the two processes. We find that the model undergoes a continuous phase transition as this parameter is varied, from a regime in which opinions are arbitrarily diverse to one in which most individuals hold the same opinion. We characterize the static and dynamical properties of this transition. △ Less

Submitted 9 March, 2006; v1 submitted 3 March, 2006; originally announced March 2006.

Journal ref: Phys. Rev. E 74, 056108 (2006)

Optimal design of spatial distribution networks

Authors: Michael T. Gastner, M. E. J. Newman

Abstract: We consider the problem of constructing public facilities, such as hospitals, airports, or malls, in a country with a non-uniform population density, such that the average distance from a person's home to the nearest facility is minimized. Approximate analytic arguments suggest that the optimal distribution of facilities should have a density that increases with population density, but does so s… ▽ More We consider the problem of constructing public facilities, such as hospitals, airports, or malls, in a country with a non-uniform population density, such that the average distance from a person's home to the nearest facility is minimized. Approximate analytic arguments suggest that the optimal distribution of facilities should have a density that increases with population density, but does so slower than linearly, as the two-thirds power. This result is confirmed numerically for the particular case of the United States with recent population data using two independent methods, one a straightforward regression analysis, the other based on density dependent map projections. We also consider strategies for linking the facilities to form a spatial network, such as a network of flights between airports, so that the combined cost of maintenance of and travel on the network is minimized. We show specific examples of such optimal networks for the case of the United States. △ Less

Submitted 9 March, 2006; originally announced March 2006.

Comments: 6 pages, 5 figures

Journal ref: Physical Review E 74, 016117 (2006)

Modularity and community structure in networks

Authors: M. E. J. Newman

Abstract: Many networks of interest in the sciences, including a variety of social and biological networks, are found to divide naturally into communities or modules. The problem of detecting and characterizing this community structure has attracted considerable recent attention. One of the most sensitive detection methods is optimization of the quality function known as "modularity" over the possible div… ▽ More Many networks of interest in the sciences, including a variety of social and biological networks, are found to divide naturally into communities or modules. The problem of detecting and characterizing this community structure has attracted considerable recent attention. One of the most sensitive detection methods is optimization of the quality function known as "modularity" over the possible divisions of a network, but direct application of this method using, for instance, simulated annealing is computationally costly. Here we show that the modularity can be reformulated in terms of the eigenvectors of a new characteristic matrix for the network, which we call the modularity matrix, and that this reformulation leads to a spectral algorithm for community detection that returns results of better quality than competing methods in noticeably shorter running times. We demonstrate the algorithm with applications to several network data sets. △ Less

Submitted 17 February, 2006; originally announced February 2006.

Comments: 7 pages, 3 figures

Journal ref: Proc. Natl. Acad. Sci. USA 103, 8577-8582 (2006)

Community Structure in the United States House of Representatives

Authors: Mason A. Porter, Peter J. Mucha, M. E. J. Newman, A. J. Friend

Abstract: We investigate the networks of committee and subcommittee assignments in the United States House of Representatives from the 101st--108th Congresses, with the committees connected by ``interlocks'' or common membership. We examine the community structure in these networks using several methods, revealing strong links between certain committees as well as an intrinsic hierarchical structure in th… ▽ More We investigate the networks of committee and subcommittee assignments in the United States House of Representatives from the 101st--108th Congresses, with the committees connected by ``interlocks'' or common membership. We examine the community structure in these networks using several methods, revealing strong links between certain committees as well as an intrinsic hierarchical structure in the House as a whole. We identify structural changes, including additional hierarchical levels and higher modularity, resulting from the 1994 election, in which the Republican party earned majority status in the House for the first time in more than forty years. We also combine our network approach with analysis of roll call votes using singular value decomposition to uncover correlations between the political and organizational structure of House committees. △ Less

Submitted 19 July, 2007; v1 submitted 4 February, 2006; originally announced February 2006.

Comments: 44 pages, 13 figures (some with multiple parts and most in color), 9 tables, to appear in Physica A; new figures and revised discussion (including extra introductory material) for this version

Vertex similarity in networks

Authors: E. A. Leicht, Petter Holme, M. E. J. Newman

Abstract: We consider methods for quantifying the similarity of vertices in networks. We propose a measure of similarity based on the concept that two vertices are similar if their immediate neighbors in the network are themselves similar. This leads to a self-consistent matrix formulation of similarity that can be evaluated iteratively using only a knowledge of the adjacency matrix of the network. We tes… ▽ More We consider methods for quantifying the similarity of vertices in networks. We propose a measure of similarity based on the concept that two vertices are similar if their immediate neighbors in the network are themselves similar. This leads to a self-consistent matrix formulation of similarity that can be evaluated iteratively using only a knowledge of the adjacency matrix of the network. We test our similarity measure on computer-generated networks for which the expected results are known, and on a number of real-world networks. △ Less

Submitted 14 October, 2005; originally announced October 2005.

Journal ref: Phys. Rev. E 73, 026120 (2006)

A network-based ranking system for American college football

Authors: Juyong Park, M. E. J. Newman

Abstract: American college football faces a conflict created by the desire to stage national championship games between the best teams of a season when there is no conventional playoff system to decide which those teams are. Instead, ranking of teams is based on their record of wins and losses during the season, but each team plays only a small fraction of eligible opponents, making the system underdeterm… ▽ More American college football faces a conflict created by the desire to stage national championship games between the best teams of a season when there is no conventional playoff system to decide which those teams are. Instead, ranking of teams is based on their record of wins and losses during the season, but each team plays only a small fraction of eligible opponents, making the system underdetermined or contradictory or both. It is an interesting challenge to create a ranking system that at once is mathematically well-founded, gives results in general accord with received wisdom concerning the relative strengths of the teams, and is based upon intuitive principles, allowing it to be accepted readily by fans and experts alike. Here we introduce a one-parameter ranking method that satisfies all of these requirements and is based on a network representation of college football schedules. △ Less

Submitted 31 October, 2005; v1 submitted 24 May, 2005; originally announced May 2005.

Comments: 15 pages, 3 figures

Journal ref: Journal of Statistical Mechanics, P10014 (2005)

Threshold effects for two pathogens spreading on a network

Authors: M. E. J. Newman

Abstract: Diseases spread through host populations over the networks of contacts between individuals, and a number of results about this process have been derived in recent years by exploiting connections between epidemic processes and bond percolation on networks. Here we investigate the case of two pathogens in a single population, which has been the subject of recent interest among epidemiologists. We… ▽ More Diseases spread through host populations over the networks of contacts between individuals, and a number of results about this process have been derived in recent years by exploiting connections between epidemic processes and bond percolation on networks. Here we investigate the case of two pathogens in a single population, which has been the subject of recent interest among epidemiologists. We demonstrate that two pathogens competing for the same hosts can both spread through a population only for intermediate values of the bond occupation probability that lie above the classic epidemic threshold and below a second higher value, which we call the coexistence threshold, corresponding to a distinct topological phase transition in networked systems. △ Less

Submitted 4 October, 2005; v1 submitted 15 February, 2005; originally announced February 2005.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. Lett. 95, 108701 (2005)

Accurate discretization of advection-diffusion equations

Authors: R. Grima, T. J. Newman

Abstract: We present an exact mathematical transformation which converts a wide class of advection-diffusion equations into a form allowing simple and direct spatial discretization in all dimensions, and thus the construction of accurate and more efficient numerical algorithms. These discretized forms can also be viewed as master equations which provides an alternative mesoscopic interpretation of advecti… ▽ More We present an exact mathematical transformation which converts a wide class of advection-diffusion equations into a form allowing simple and direct spatial discretization in all dimensions, and thus the construction of accurate and more efficient numerical algorithms. These discretized forms can also be viewed as master equations which provides an alternative mesoscopic interpretation of advection-diffusion processes in terms of diffusion with spatially varying hopping rates. △ Less

Submitted 13 December, 2004; originally announced December 2004.

Journal ref: Physical Review E 70, #036703 (2004)

Solution for the properties of a clustered network

Authors: Juyong Park, M. E. J. Newman

Abstract: We study Strauss's model of a network with clustering and present an analytic mean-field solution which is exact in the limit of large network size. Previous computer simulations have revealed a degenerate region in the model's parameter space in which triangles of adjacent edges clump together to form unrealistically dense subgraphs, and perturbation calculations have been found to break down i… ▽ More We study Strauss's model of a network with clustering and present an analytic mean-field solution which is exact in the limit of large network size. Previous computer simulations have revealed a degenerate region in the model's parameter space in which triangles of adjacent edges clump together to form unrealistically dense subgraphs, and perturbation calculations have been found to break down in this region at all orders. Our analytic solution shows that this region corresponds to a classic symmetry-broken phase and that the onset of the degeneracy corresponds to a first-order phase transition in the density of the network. △ Less

Submitted 18 October, 2005; v1 submitted 21 December, 2004; originally announced December 2004.

Comments: 5 pages, 2 figures

Journal ref: Phys. Rev. E 72, 026136 (2005)