Showing 1–20 of 20 results for author: van Mourik, J

Heterogeneity in Outcomes of Repeated Instances of Percolation Experiments

Authors: Reimer Kuehn, Jort van Mourik

Abstract: We investigate the heterogeneity of outcomes of repeated instances of percolation experiments in complex networks using a message passing approach to evaluate heterogeneous, node dependent probabilities of belonging to the giant or percolating cluster, i.e. the set of mutually connected nodes whose size scales linearly with the size of the system. We evaluate these both for large finite single ins… ▽ More We investigate the heterogeneity of outcomes of repeated instances of percolation experiments in complex networks using a message passing approach to evaluate heterogeneous, node dependent probabilities of belonging to the giant or percolating cluster, i.e. the set of mutually connected nodes whose size scales linearly with the size of the system. We evaluate these both for large finite single instances, and for synthetic networks in the configuration model class in the thermodynamic limit. For the latter, we consider both Erdos-Renyi and scale free networks as examples of networks with narrow and broad degree distributions respectively. For real-world networks we use an undirected version of a Gnutella peer-to-peer file-sharing network with $N=62,568$ nodes as an example. We derive the theory for multiple instances of both uncorrelated and correlated percolation processes. For the uncorrelated case, we also obtain a closed form approximation for the large mean degree limit of Erdos-Renyi networks. △ Less

Submitted 13 September, 2020; originally announced September 2020.

Comments: 14 pages, 6 multipart figures

Journal ref: Phys. Rev. E102, 032302 (2020)

Palette-colouring: a belief-propagation approach

Authors: Alessandro Pelizzola, Marco Pretti, Jort van Mourik

Abstract: We consider a variation of the prototype combinatorial-optimisation problem known as graph-colouring. Our optimisation goal is to colour the vertices of a graph with a fixed number of colours, in a way to maximise the number of different colours present in the set of nearest neighbours of each given vertex. This problem, which we pictorially call "palette-colouring", has been recently addressed as… ▽ More We consider a variation of the prototype combinatorial-optimisation problem known as graph-colouring. Our optimisation goal is to colour the vertices of a graph with a fixed number of colours, in a way to maximise the number of different colours present in the set of nearest neighbours of each given vertex. This problem, which we pictorially call "palette-colouring", has been recently addressed as a basic example of problem arising in the context of distributed data storage. Even though it has not been proved to be NP complete, random search algorithms find the problem hard to solve. Heuristics based on a naive belief propagation algorithm are observed to work quite well in certain conditions. In this paper, we build upon the mentioned result, working out the correct belief propagation algorithm, which needs to take into account the many-body nature of the constraints present in this problem. This method improves the naive belief propagation approach, at the cost of increased computational effort. We also investigate the emergence of a satisfiable to unsatisfiable "phase transition" as a function of the vertex mean degree, for different ensembles of sparse random graphs in the large size ("thermodynamic") limit. △ Less

Submitted 20 April, 2011; originally announced April 2011.

Comments: 22 pages, 7 figures

Spectra of Modular and Small-World Matrices

Authors: R. Kuehn, J. M. van Mourik

Abstract: We compute spectra of symmetric random matrices describing graphs with general modular structure and arbitrary inter- and intra-module degree distributions, subject only to the constraint of finite mean connectivities. We also evaluate spectra of a certain class of small-world matrices generated from random graphs by introducing short-cuts via additional random connectivity components. Both adjace… ▽ More We compute spectra of symmetric random matrices describing graphs with general modular structure and arbitrary inter- and intra-module degree distributions, subject only to the constraint of finite mean connectivities. We also evaluate spectra of a certain class of small-world matrices generated from random graphs by introducing short-cuts via additional random connectivity components. Both adjacency matrices and the associated graph Laplacians are investigated. For the Laplacians, we find Lifshitz type singular behaviour of the spectral density in a localised region of small $|λ|$ values. In the case of modular networks, we can identify contributions local densities of state from individual modules. For small-world networks, we find that the introduction of short cuts can lead to the creation of satellite bands outside the central band of extended states, exhibiting only localised states in the band-gaps. Results for the ensemble in the thermodynamic limit are in excellent agreement with those obtained via a cavity approach for large finite single instances, and with direct diagonalisation results. △ Less

Submitted 2 December, 2010; originally announced December 2010.

Comments: 18 pages, 5 figures

Finitely coordinated models for low-temperature phases of amorphous systems

Authors: Reimer Kuehn, Jort van Mourik, Martin Weigt, Annette Zippelius

Abstract: We introduce models of heterogeneous systems with finite connectivity defined on random graphs to capture finite-coordination effects on the low-temperature behavior of finite dimensional systems. Our models use a description in terms of small deviations of particle coordinates from a set of reference positions, particularly appropriate for the description of low-temperature phenomena. A Born-vo… ▽ More We introduce models of heterogeneous systems with finite connectivity defined on random graphs to capture finite-coordination effects on the low-temperature behavior of finite dimensional systems. Our models use a description in terms of small deviations of particle coordinates from a set of reference positions, particularly appropriate for the description of low-temperature phenomena. A Born-von-Karman type expansion with random coefficients is used to model effects of frozen heterogeneities. The key quantity appearing in the theoretical description is a full distribution of effective single-site potentials which needs to be determined self-consistently. If microscopic interactions are harmonic, the effective single-site potentials turn out to be harmonic as well, and the distribution of these single-site potentials is equivalent to a distribution of localization lengths used earlier in the description of chemical gels. For structural glasses characterized by frustration and anharmonicities in the microscopic interactions, the distribution of single-site potentials involves anharmonicities of all orders, and both single-well and double well potentials are observed, the latter with a broad spectrum of barrier heights. The appearance of glassy phases at low temperatures is marked by the appearance of asymmetries in the distribution of single-site potentials, as previously observed for fully connected systems. Double-well potentials with a broad spectrum of barrier heights and asymmetries would give rise to the well known universal glassy low temperature anomalies when quantum effects are taken into account. △ Less

Submitted 20 March, 2007; originally announced March 2007.

Comments: 35 pages, 8 Figures

Colouring random graphs and maximising local diversity

Authors: S. Bounkong, J. van Mourik, D. Saad

Abstract: We study a variation of the graph colouring problem on random graphs of finite average connectivity. Given the number of colours, we aim to maximise the number of different colours at neighbouring vertices (i.e. one edge distance) of any vertex. Two efficient algorithms, belief propagation and Walksat are adapted to carry out this task. We present experimental results based on two types of rando… ▽ More We study a variation of the graph colouring problem on random graphs of finite average connectivity. Given the number of colours, we aim to maximise the number of different colours at neighbouring vertices (i.e. one edge distance) of any vertex. Two efficient algorithms, belief propagation and Walksat are adapted to carry out this task. We present experimental results based on two types of random graphs for different system sizes and identify the critical value of the connectivity for the algorithms to find a perfect solution. The problem and the suggested algorithms have practical relevance since various applications, such as distributed storage, can be mapped onto this problem. △ Less

Submitted 25 July, 2005; originally announced July 2005.

Comments: 10 pages, 10 figures

The polynomial error probability for LDPC codes

Authors: J. van Mourik, Y. Kabashima

Abstract: We obtain exact expressions for the asymptotic behaviour of the average probability of the block decoding error for ensembles of regular low density parity check error correcting codes, by employing diagrammatic techniques. Furthermore, we show how imposing simple constraints on the code ensemble (that can be practically implemented in linear time), allows one to suppress the error probability f… ▽ More We obtain exact expressions for the asymptotic behaviour of the average probability of the block decoding error for ensembles of regular low density parity check error correcting codes, by employing diagrammatic techniques. Furthermore, we show how imposing simple constraints on the code ensemble (that can be practically implemented in linear time), allows one to suppress the error probability for codes with more than 2 checks per bit, to an arbitrarily low power of $N$. As such we provide a practical route to a (sub-optimal){\em expurgated} ensemble. △ Less

Submitted 8 October, 2003; originally announced October 2003.

Comments: 15 pages 13 figures

Average and reliability error exponents in low-density parity-check codes

Authors: N. S. Skantzos, J. van Mourik, D. Saad, Y. Kabashima

Abstract: We present a theoretical method for a direct evaluation of the average and reliability error exponents in low-density parity-check error-correcting codes using methods of statistical physics. Results for the binary symmetric channel (BSC) are presented for codes of both finite and infinite connectivity. We present a theoretical method for a direct evaluation of the average and reliability error exponents in low-density parity-check error-correcting codes using methods of statistical physics. Results for the binary symmetric channel (BSC) are presented for codes of both finite and infinite connectivity. △ Less

Submitted 23 April, 2003; originally announced April 2003.

Comments: 13 pages, 5 figures

Journal ref: J Phys A, (2003) 36 11131-11141

Magnetization enumerator of real-valued symmetric channels in Gallager error-correcting codes

Authors: N. S. Skantzos, J. van Mourik, D. Saad

Abstract: Using the magnetization enumerator method, we evaluate the practical and theoretical limitations of symmetric channels with real outputs. Results are presented for several regular Gallager code constructions. Using the magnetization enumerator method, we evaluate the practical and theoretical limitations of symmetric channels with real outputs. Results are presented for several regular Gallager code constructions. △ Less

Submitted 24 January, 2003; originally announced January 2003.

Comments: 5 pages, 1 figure, to appear as Brief Report in Physical Review E

Random Graph Coloring - a Statistical Physics Approach

Authors: J. van Mourik, D. Saad

Abstract: The problem of vertex coloring in random graphs is studied using methods of statistical physics and probability. Our analytical results are compared to those obtained by exact enumeration and Monte-Carlo simulations. We critically discuss the merits and shortcomings of the various methods, and interpret the results obtained. We present an exact analytical expression for the 2-coloring problem as… ▽ More The problem of vertex coloring in random graphs is studied using methods of statistical physics and probability. Our analytical results are compared to those obtained by exact enumeration and Monte-Carlo simulations. We critically discuss the merits and shortcomings of the various methods, and interpret the results obtained. We present an exact analytical expression for the 2-coloring problem as well as general replica symmetric approximated solutions for the thermodynamics of the graph coloring problem with p colors and K-body edges. △ Less

Submitted 18 July, 2002; originally announced July 2002.

Comments: 17 pages, 9 figures

Critical Noise Levels for LDPC decoding

Authors: J. van Mourik, D. Saad, Y. Kabashima

Abstract: We determine the critical noise level for decoding low density parity check error correcting codes based on the magnetization enumerator ($\cM$), rather than on the weight enumerator ($\cW$) employed in the information theory literature. The interpretation of our method is appealingly simple, and the relation between the different decoding schemes such as typical pairs decoding, MAP, and finite… ▽ More We determine the critical noise level for decoding low density parity check error correcting codes based on the magnetization enumerator ($\cM$), rather than on the weight enumerator ($\cW$) employed in the information theory literature. The interpretation of our method is appealingly simple, and the relation between the different decoding schemes such as typical pairs decoding, MAP, and finite temperature decoding (MPM) becomes clear. In addition, our analysis provides an explanation for the difference in performance between MN and Gallager codes. Our results are more optimistic than those derived via the methods of information theory and are in excellent agreement with recent results from another statistical physics approach. △ Less

Submitted 7 March, 2002; originally announced March 2002.

Comments: 9 pages, 5 figures

Weight vs Magnetization Enumerator for Gallager Codes

Authors: J. van Mourik, D. Saad, Y. Kabashima

Abstract: We propose a method to determine the critical noise level for decoding Gallager type low density parity check error correcting codes. The method is based on the magnetization enumerator ($\cM$), rather than on the weight enumerator ($\cW$) presented recently in the information theory literature. The interpretation of our method is appealingly simple, and the relation between the different decodi… ▽ More We propose a method to determine the critical noise level for decoding Gallager type low density parity check error correcting codes. The method is based on the magnetization enumerator ($\cM$), rather than on the weight enumerator ($\cW$) presented recently in the information theory literature. The interpretation of our method is appealingly simple, and the relation between the different decoding schemes such as typical pairs decoding, MAP, and finite temperature decoding (MPM) becomes clear. Our results are more optimistic than those derived via the methods of information theory and are in excellent agreement with recent results from another statistical physics approach. △ Less

Submitted 1 October, 2001; originally announced October 2001.

Comments: 10 pages, 4 figures, 8th IMA int. conf. on cryptography and Coding

Statistical mechanics of typical set decoding

Authors: Yoshiyuki Kabashima, Kazutaka Nakamura, Jort van Mourik

Abstract: The performance of ``typical set (pairs) decoding'' for ensembles of Gallager's linear code is investigated using statistical physics. In this decoding, error happens when the information transmission is corrupted by an untypical noise or two or more typical sequences satisfy the parity check equation provided by the received codeword for which a typical noise is added. We show that the average… ▽ More The performance of ``typical set (pairs) decoding'' for ensembles of Gallager's linear code is investigated using statistical physics. In this decoding, error happens when the information transmission is corrupted by an untypical noise or two or more typical sequences satisfy the parity check equation provided by the received codeword for which a typical noise is added. We show that the average error rate for the latter case over a given code ensemble can be tightly evaluated using the replica method, including the sensitivity to the message length. Our approach generally improves the existing analysis known in information theory community, which was reintroduced by MacKay (1999) and believed as most accurate to date. △ Less

Submitted 16 June, 2001; originally announced June 2001.

Comments: 7 pages

Solvable Lattice Gas Models of Random Heteropolymers at Finite Density: II. Dynamics and Transitions to Compact States

Authors: H. Chakravorty, J. van Mourik, A. C. C. Coolen

Abstract: In this paper we analyse both the dynamics and the high density physics of the infinite dimensional lattice gas model for random heteropolymers recently introduced in \cite{jort}. Restricting ourselves to site-disordered heteropolymers, we derive exact closed deterministic evolution equations for a suitable set of dynamic order parameters (in the thermodynamic limit), and use these to study the… ▽ More In this paper we analyse both the dynamics and the high density physics of the infinite dimensional lattice gas model for random heteropolymers recently introduced in \cite{jort}. Restricting ourselves to site-disordered heteropolymers, we derive exact closed deterministic evolution equations for a suitable set of dynamic order parameters (in the thermodynamic limit), and use these to study the dynamics of the system for different choices of the monomer polarity parameters. We also study the equilibrium properties of the system in the high density limit, which leads to a phase diagram exhibiting transitions between swollen states, compact states, and regions with partial compactification. Our results find excellent verification in numerical simulations, and have a natural and appealing interpretation in terms of real heteropolymers. △ Less

Submitted 4 July, 2001; v1 submitted 24 February, 2001; originally announced February 2001.

Comments: 12 pages, 8 eps figures, revised version (to be published in EPJ)

A Solvable Model of Secondary Structure Formation in Random Hetero-Polymers

Authors: N. S. Skantzos, J. van Mourik, A. C. C. Coolen

Abstract: We propose and solve a simple model describing secondary structure formation in random hetero-polymers. It describes monomers with a combination of one-dimensional short-range interactions (representing steric forces and hydrogen bonds) and infinite range interactions (representing polarity forces). We solve our model using a combination of mean field and random field techniques, leading to phas… ▽ More We propose and solve a simple model describing secondary structure formation in random hetero-polymers. It describes monomers with a combination of one-dimensional short-range interactions (representing steric forces and hydrogen bonds) and infinite range interactions (representing polarity forces). We solve our model using a combination of mean field and random field techniques, leading to phase diagrams exhibiting second-order transitions between folded, partially folded and unfolded states, including regions where folding depends on initial conditions. Our theoretical results, which are in excellent agreement with numerical simulations, lead to an appealing physical picture of the folding process: the polarity forces drive the transition to a collapsed state, the steric forces introduce monomer specificity, and the hydrogen bonds stabilise the conformation by damping the frustration-induced multiplicity of states. △ Less

Submitted 31 January, 2001; originally announced January 2001.

Comments: 24 pages, 14 figures

Journal ref: J. Phys. A, 34 (2001) 4437

Cluster derivation of Parisi's RSB solution for disordered systems

Authors: J. van Mourik, A. C. C. Coolen

Abstract: We propose a general scheme in which disordered systems are allowed to sacrifice energy equi-partitioning and separate into a hierarchy of ergodic sub-systems (clusters) with different characteristic time-scales and temperatures. The details of the break-up follow from the requirement of stationarity of the entropy of the slower cluster, at every level in the hierarchy. We apply our ideas to the… ▽ More We propose a general scheme in which disordered systems are allowed to sacrifice energy equi-partitioning and separate into a hierarchy of ergodic sub-systems (clusters) with different characteristic time-scales and temperatures. The details of the break-up follow from the requirement of stationarity of the entropy of the slower cluster, at every level in the hierarchy. We apply our ideas to the Sherrington-Kirkpatrick model, and show how the Parisi solution can be {\it derived} quantitatively from plausible physical principles. Our approach gives new insight into the physics behind Parisi's solution and its relations with other theories, numerical experiments, and short range models. △ Less

Submitted 11 September, 2000; originally announced September 2000.

Comments: 7 pages 5 figures

Cluster Derivation of the Parisi Scheme for Disordered Systems

Authors: A. C. C. Coolen, J. van Mourik

Abstract: We propose a general quantitative scheme in which systems are given the freedom to sacrifice energy equi-partitioning on the relevant time-scales of observation, and have phase transitions by separating autonomously into ergodic sub-systems (clusters) with different characteristic time-scales and temperatures. The details of the break-up follow uniquely from the requirement of zero entropy for t… ▽ More We propose a general quantitative scheme in which systems are given the freedom to sacrifice energy equi-partitioning on the relevant time-scales of observation, and have phase transitions by separating autonomously into ergodic sub-systems (clusters) with different characteristic time-scales and temperatures. The details of the break-up follow uniquely from the requirement of zero entropy for the slower cluster. Complex systems, such as the Sherrington-Kirkpatrick model, are found to minimise their free energy by spontaneously decomposing into a hierarchy of ergodically equilibrating degrees of freedom at different (effective) temperatures. This leads exactly and uniquely to Parisi's replica symmetry breaking scheme. Our approach, which is somewhat akin to an earlier one by Sompolinsky, gives new insight into the physical interpretation of the Parisi scheme and its relations with other approaches, numerical experiments, and short range models. Furthermore, our approach shows that the Parisi scheme can be derived quantitatively and uniquely from plausible physical principles. △ Less

Submitted 19 July, 2000; originally announced July 2000.

Comments: 6 pages, 3 figures, proceedings of international conference on "Disordered And Complex Systems", 10-14 July 2000 King's College London

Solvable Models of Random Hetero-Polymers at Finite Density: I. Statics

Authors: Jort van Mourik

Abstract: We introduce $\infty$-dimensional versions of three common models of random hetero-polymers, in which both the polymer density and the density of the polymer-solvent mixture are finite. These solvable models give valuable insight into the problems related to the (quenched) average over the randomness in statistical mechanical models of proteins, without having to deal with the hard geometrical c… ▽ More We introduce $\infty$-dimensional versions of three common models of random hetero-polymers, in which both the polymer density and the density of the polymer-solvent mixture are finite. These solvable models give valuable insight into the problems related to the (quenched) average over the randomness in statistical mechanical models of proteins, without having to deal with the hard geometrical constraints occurring in finite dimensional models. Our exact solution, which is specific to the $\infty$-dimensional case, is compared to the results obtained by a saddle-point analysis and by the grand ensemble approach, both of which canalso be applied to models of finite dimension. We find, somewhat surprisingly, that the saddle-point analysis can lead to qualitatively incorrect results. △ Less

Submitted 16 June, 1999; originally announced June 1999.

Comments: 16 pages, 17 figures

Phase Transition in a Noise Reduction Model: Shrinking or Percolation?

Authors: J. van Mourik, K. Y. Michael Wong, D. Bolle'

Abstract: A model of noise reduction (NR) for signal processing is introduced. Each noise source puts a symmetric constraint on the space of the signal vector within a tolerable overlap. When the number of noise sources increases, sequences of transitions take place, causing the solution space to vanish. We found that the transition from an extended solution space to a shrunk space is retarded because of… ▽ More A model of noise reduction (NR) for signal processing is introduced. Each noise source puts a symmetric constraint on the space of the signal vector within a tolerable overlap. When the number of noise sources increases, sequences of transitions take place, causing the solution space to vanish. We found that the transition from an extended solution space to a shrunk space is retarded because of the symmetry of the constraints, in contrast to the analogous problem of pattern storage. For low tolerance, the solution space vanishes by volume reduction, whereas for high tolerance, the vanishing becomes more and more like percolation. The model is studied in the replica symmetric, first step and full replica symmetry breaking schemes. △ Less

Submitted 9 April, 1998; originally announced April 1998.

Comments: 4 pages, 2 figures

Swollen-Collapsed Transition in Random Hetero-Polymers

Authors: A. Trovato, J. van Mourik, A. Maritan

Abstract: A lattice model of a hetero-polymer with random hydrophilic-hydrophobic charges interacting with the solvent is introduced, whose continnuum counterpart has been proposed by T. Garel, L. Leibler and H. Orland {J. Phys. II France 4, 2139 (1994)]. The transfer matrix technique is used to study various constrained annealed systems which approximate at various degrees of accuracy the original quench… ▽ More A lattice model of a hetero-polymer with random hydrophilic-hydrophobic charges interacting with the solvent is introduced, whose continnuum counterpart has been proposed by T. Garel, L. Leibler and H. Orland {J. Phys. II France 4, 2139 (1994)]. The transfer matrix technique is used to study various constrained annealed systems which approximate at various degrees of accuracy the original quenched model. For highly hydrophobic chains an ordinary $θ$-point transition is found from a high temperature swollen phase to a low temperature compact phase. Depending on the type of constrained averages, at very low temperatures a swollen phase or a coexistence between compact and swollen phases are found. The results are carefully compared with the corresponding ones obtained in the continuum limit, and various improvements in the original calculations are discussed. △ Less

Submitted 27 July, 1998; v1 submitted 8 April, 1998; originally announced April 1998.

Comments: 13 pages, 8 figures; revised version with minor changes, accepted for publication in European Physical Journal B

Determination of Interaction Potentials of Amino Acids from Native Protein Structures: Test on Simple Lattice Models

Authors: Jort van Mourik, Cecilia Clementi, Amos Maritan, Flavio Seno, J. R. Banavar

Abstract: We propose a novel method for the determination of the effective interaction potential between the amino acids of a protein. The strategy is based on the combination of a new optimization procedure and a geometrical argument, which also uncovers the shortcomings of any optimization procedure. The strategy can be applied on any data set of native structures such as those available from the Protei… ▽ More We propose a novel method for the determination of the effective interaction potential between the amino acids of a protein. The strategy is based on the combination of a new optimization procedure and a geometrical argument, which also uncovers the shortcomings of any optimization procedure. The strategy can be applied on any data set of native structures such as those available from the Protein Data Bank (PDB). In this work, however, we explain and test our approach on simple lattice models, where the true interactions are known a priori. Excellent agreement is obtained between the extracted and the true potentials even for modest numbers of protein structures in the PDB. Comparisons with other methods are also discussed. △ Less

Submitted 15 January, 1998; v1 submitted 14 January, 1998; originally announced January 1998.

Comments: 24 pages, 4 figures