-
Exact joint distributions of three global characteristic times for Brownian motion
Authors:
Alexander K. Hartmann,
Satya N. Majumdar
Abstract:
We consider three global characteristic times for a one-dimensional Brownian motion $x(τ)$ in the interval $τ\in [0,t]$: the occupation time $t_{\rm o}$ denoting the cumulative time where $x(τ)>0$, the time $t_{\rm m}$ at which the process achieves its global maximum in $[0,t]$ and the last-passage time $t_l$ through the origin before $t$. All three random variables have the same marginal distribu…
▽ More
We consider three global characteristic times for a one-dimensional Brownian motion $x(τ)$ in the interval $τ\in [0,t]$: the occupation time $t_{\rm o}$ denoting the cumulative time where $x(τ)>0$, the time $t_{\rm m}$ at which the process achieves its global maximum in $[0,t]$ and the last-passage time $t_l$ through the origin before $t$. All three random variables have the same marginal distribution given by Lévy's arcsine law. We compute exactly the pairwise joint distributions of these three times and show that they are quite different from each other. The joint distributions display rather rich and nontrivial correlations between these times. Our analytical results are verified by numerical simulations.
△ Less
Submitted 30 April, 2025; v1 submitted 12 December, 2024;
originally announced December 2024.
-
Numerical Aspects of Large Deviations
Authors:
Alexander K. Hartmann
Abstract:
An introduction to numerical large-deviation sampling is provided. First, direct biasing with a known distribution is explained. As simple example, the Bernoulli experiment is used throughout the text. Next, Markov chain Monte Carlo (MCMC) simulations are introduced. In particular, the Metropolis-Hastings algorithm is explained. As first implementation of MCMC, sampling of the plain Bernoulli mode…
▽ More
An introduction to numerical large-deviation sampling is provided. First, direct biasing with a known distribution is explained. As simple example, the Bernoulli experiment is used throughout the text. Next, Markov chain Monte Carlo (MCMC) simulations are introduced. In particular, the Metropolis-Hastings algorithm is explained. As first implementation of MCMC, sampling of the plain Bernoulli model is shown. Next, an exponential bias is used for the same model, which allows one to obtain the tails of the distribution of a measurable quantity. This approach is generalized to MCMC simulations, where the states are vectors of $U(0,1)$ random entries. This allows one to use the exponential or any other bias to access the large-deviation properties of rather arbitrary random processes. Finally, some recent research applications to study more complex models are discussed.
△ Less
Submitted 5 December, 2024;
originally announced December 2024.
-
Numerical Estimation of Limiting Large-Deviation Rate Functions
Authors:
Peter Werner,
Alexander K. Hartmann
Abstract:
For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in the limiting rate function for infinite system sizes, first, several system sizes have to be studied numerically. Here, rare-event algorithms using biased ensembl…
▽ More
For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in the limiting rate function for infinite system sizes, first, several system sizes have to be studied numerically. Here, rare-event algorithms using biased ensembles give access to the low-probability region. Second, some kind of system-size extrapolation has to be performed.
Here we demonstrate how rare-event importance sampling schemes can be combined with multi-histogram reweighting, which allows for rather general applicability of the approach, independent of specific sampling algorithms. We study two ways of performing the system-size extrapolation, either directly acting on the empirical rate functions, or on the scaled cumulant generating functions, to obtain the infinite-size limit. The presented method is demonstrated for a binomial distributed variable and the largest connected component in Erdös-Rényi random graphs. Analytical solutions are available in both cases for direct comparison. It is observed in particular that phase transitions appearing in the biased ensembles can lead to systematic deviations from the true result.
△ Less
Submitted 5 December, 2024;
originally announced December 2024.
-
Non-universality for Crossword Puzzle Percolation
Authors:
Alexander K. Hartmann
Abstract:
A percolation model inspired by crossword puzzle games is introduced. A game proceeds by solving words, which are segments of sites in a two-dimensional lattice. As test case, the \emph{iid} variant allows for independently occupying sites with letters, only the percolation criterion depends on the existence of solved words. For the \emph{game} variant, inspired by real crossword puzzles, it becom…
▽ More
A percolation model inspired by crossword puzzle games is introduced. A game proceeds by solving words, which are segments of sites in a two-dimensional lattice. As test case, the \emph{iid} variant allows for independently occupying sites with letters, only the percolation criterion depends on the existence of solved words. For the \emph{game} variant, inspired by real crossword puzzles, it becomes more likely to solve crossing words which share sites with the already solved words. In this way avalanches of solved words may occur. Both model variants exhibit a percolation transition as function of the a-priori site or word solving probability, respectively. The \emph{iid} variant is in the universality class of standard two-dimensional percolation. The \emph{game} variant exhibits a non-universal critical exponent $ν$ of the correlation length. The actual value of $ν$ depends on the function which controls how much solved words accelerate the solved of crossing words.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
The Griffiths phase and beyond: A large deviations study of the magnetic susceptibility of the two-dimensional bond-diluted Ising model
Authors:
Lambert Münster,
Alexander K. Hartmann,
Martin Weigel
Abstract:
The Griffiths phase in systems with quenched disorder occurs below the ordering transition of the pure system down to the ordering transition of the actual disordered system. While it does not exhibit long-range order, large fluctuations in the disorder degrees of freedom result in exponentially rare, long-range ordered states and hence the occurrence of broad distributions in response functions.…
▽ More
The Griffiths phase in systems with quenched disorder occurs below the ordering transition of the pure system down to the ordering transition of the actual disordered system. While it does not exhibit long-range order, large fluctuations in the disorder degrees of freedom result in exponentially rare, long-range ordered states and hence the occurrence of broad distributions in response functions. Inside the Griffiths phase of the two-dimensional bond-diluted Ising model the distribution of the magnetic susceptibility is expected to have such a broad, exponential tail. A large-deviations Monte Carlo algorithm is used to sample this distribution and the exponential tail is extracted over a wide range of the support down to very small probabilities of the order of $10^{-300}$. We study the behavior of the susceptibility distribution across the full phase diagram, from the paramagnetic state through the Griffiths phase to the ferromagnetically ordered system and down to the zero-temperature point. We extract the rate function of large-deviation theory as well as its finite-size scaling behavior and we reveal interesting differences and similarities between the cases. A connection between the fraction of ferromagnetic bonds in a given disorder sample and the size of the magnetic susceptibility is demonstrated numerically.
△ Less
Submitted 13 November, 2024; v1 submitted 5 May, 2024;
originally announced May 2024.
-
Work Distribution for Unzipping Processes
Authors:
P. Werner,
A. K. Hartmann,
S. N. Majumdar
Abstract:
A simple zipper model is introduced, representing in a simplified way, e.g., the folded DNA double helix or hairpin structures in RNA. The double stranded hairpin is connected to a heat bath at temperature $T$ and subject to an external force $f$, which couples to the free length $L$ of the unzipped sequence. Increasing the force, leads to an zipping/unzipping first-order phase transition at a cri…
▽ More
A simple zipper model is introduced, representing in a simplified way, e.g., the folded DNA double helix or hairpin structures in RNA. The double stranded hairpin is connected to a heat bath at temperature $T$ and subject to an external force $f$, which couples to the free length $L$ of the unzipped sequence. Increasing the force, leads to an zipping/unzipping first-order phase transition at a critical force $f_c(T)$ in the thermodynamic limit of a very large chain. We compute analytically, as a function of temperature $T$ and force $f$, the full distribution $P(L)$ of free lengths in the thermodynamic limit and show that it is qualitatively very different for $f<f_c$, $f=f_c$ and $f>f_c$. Next we consider quasistatic work processes where the force is incremented according to a linear protocol. Having obtained $P(L)$ already allows us to derive an analytical expression for the work distribution $P(W)$ in the zipped phase $f<f_c$ for a long chain. We compute the large-deviation tails of the work distribution explicitly. Our analytical result for the work distribution is compared over a large range of the support down to probabilities as small as $10^{-200}$ with numerical simulations, which were performed by applying sophisticated large-deviation algorithms.
△ Less
Submitted 17 January, 2024;
originally announced January 2024.
-
Rare Events of Host Switching for Diseases using a SIR Model with Mutations
Authors:
Yannick Feld,
Alexander K. Hartmann
Abstract:
We numerically study disease dynamics that lead to the disease switching from one host species to another, resulting in diseases gaining the ability to infect, e.g., humans. Unlike previous studies that focused on branching processes starting with the first infected humans, we begin by considering a disease pathogen that initially cannot infect humans. We model the entire process, starting from an…
▽ More
We numerically study disease dynamics that lead to the disease switching from one host species to another, resulting in diseases gaining the ability to infect, e.g., humans. Unlike previous studies that focused on branching processes starting with the first infected humans, we begin by considering a disease pathogen that initially cannot infect humans. We model the entire process, starting from an infection in the animal population, including mutations that eventually enable the disease to cause an epidemic outbreak in the human population. We use an SIR model on a network consisting of 132 dog and 1320 human nodes, with a single parameter representing the gene of the pathogen.
We use numerical large-deviation techniques, specifically the $1/t$ Wang-Landau algorithm, to calculate the potentially very small probability of the host switching event. With this approach we are able to resolve probabilities as small as $10^{-120}$. Additionally the $1/t$ Wang-Landau algorithm allows us to obtain the complete probability density function $P(C)$ of the cumulative fraction $C$ of infected humans, which is an indicator for the severity of the disease in the human population.
We also calculate correlations of $C$ with selected quantities $q$ that characterize the outbreak. Due to the application of the rare-event algorithm, this is possible for the entire range of $C$ values.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Non-Analytic Behaviour in Large-deviations of the SIR model under the influence of Lockdowns
Authors:
Leo Patrick Mulholland,
Yannick Feld,
Alexander K. Hartmann
Abstract:
We numerically investigate the dynamics of an SIR model with infection level-based lockdowns on Small-World networks. Using a large-deviation approach, namely the Wang-Landau algorithm, we study the distribution of the cumulative fraction of infected individuals. We are able to resolve the density of states for values as low as $10^{-85}$. Hence, we measure the distribution on its full support giv…
▽ More
We numerically investigate the dynamics of an SIR model with infection level-based lockdowns on Small-World networks. Using a large-deviation approach, namely the Wang-Landau algorithm, we study the distribution of the cumulative fraction of infected individuals. We are able to resolve the density of states for values as low as $10^{-85}$. Hence, we measure the distribution on its full support giving a complete characterization of this quantity. The lockdowns are implemented by severing a certain fraction of the edges in the Small-World network, and are initiated and released at different levels of infection, which are varied within this study. We observe points of non-analytical behaviour for the pdf and discontinuous transitions for correlations with other quantities such as the maximum fraction of infected and the duration of outbreaks. Further, empirical rate functions were calculated for different system sizes, for which a convergence is clearly visible indicating that the large-deviation principle is valid for the system with lockdowns.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Time-dependent probability density function for partial resetting dynamics
Authors:
C. Di Bello,
A. V. Chechkin,
A. K. Hartmann,
Z. Palmowski,
R. Metzler
Abstract:
Stochastic resetting is a rapidly developing topic in the field of stochastic processes and their applications. It denotes the occasional reset of a diffusing particle to its starting point and effects, inter alia, optimal first-passage times to a target. Recently the concept of partial resetting, in which the particle is reset to a given fraction of the current value of the process, has been esta…
▽ More
Stochastic resetting is a rapidly developing topic in the field of stochastic processes and their applications. It denotes the occasional reset of a diffusing particle to its starting point and effects, inter alia, optimal first-passage times to a target. Recently the concept of partial resetting, in which the particle is reset to a given fraction of the current value of the process, has been established and the associated search behaviour analysed. Here we go one step further and we develop a general technique to determine the time-dependent probability density function (PDF) for Markov processes with partial resetting. We obtain an exact representation of the PDF in the case of general symmetric Lévy flights with stable index $0<α\le2$. For Cauchy and Brownian motions (i.e., $α=1,2$), this PDF can be expressed in terms of elementary functions in position space. We also determine the stationary PDF. Our numerical analysis of the PDF demonstrates intricate crossover behaviours as function of time.
△ Less
Submitted 24 May, 2023; v1 submitted 23 May, 2023;
originally announced May 2023.
-
Energy landscapes of some matching-problem ensembles
Authors:
Till Kahlke,
Alexander K. Hartmann
Abstract:
The maximum-weight matching problem and the behavior of its energy landscape is numerically investigated. We apply a perturbation method adapted from the analysis of spin glasses. This gives inside into the complexity of the energy landscape of different ensembles. Erdös-Renyi graphs and ring graphs with randomly added edges are considered and two types of distributions for the random edge weighs…
▽ More
The maximum-weight matching problem and the behavior of its energy landscape is numerically investigated. We apply a perturbation method adapted from the analysis of spin glasses. This gives inside into the complexity of the energy landscape of different ensembles. Erdös-Renyi graphs and ring graphs with randomly added edges are considered and two types of distributions for the random edge weighs are used. For maximum-weight matching, fast and scalable algorithms exist, such that we can study large graphs of more than $10^5$ nodes. Our results show that the structure of the energy landscape for standard ensembles of matching is simple, comparable to the energy landscape of a ferromagnet. Nonetheless, for some of the here presented ensembles our results allow for the presence of complex energy landscapes in the spirit of Replica-Symmetry Breaking.
△ Less
Submitted 3 April, 2023;
originally announced April 2023.
-
Simulated annealing, optimization, searching for ground states
Authors:
Sergio Caracciolo,
Alexander K. Hartmann,
Scott Kirkpatrick,
Martin Weigel
Abstract:
The chapter starts with a historical summary of first attempts to optimize the spin glass Hamiltonian, comparing it to recent results on searching largest cliques in random graphs. Exact algorithms to find ground states in generic spin glass models are then explored in Section 1.2, while Section 1.3 is dedicated to the bidimensional case where polynomial algorithms exist and allow for the study of…
▽ More
The chapter starts with a historical summary of first attempts to optimize the spin glass Hamiltonian, comparing it to recent results on searching largest cliques in random graphs. Exact algorithms to find ground states in generic spin glass models are then explored in Section 1.2, while Section 1.3 is dedicated to the bidimensional case where polynomial algorithms exist and allow for the study of much larger systems. Finally Section 1.4 presents a summary of results for the assignment problem where the finite size corrections for the ground state can be studied in great detail.
△ Less
Submitted 2 January, 2023;
originally announced January 2023.
-
Replica symmetry breaking for Ulam's problem
Authors:
P. Krabbe,
H. Schawe,
A. K. Hartmann
Abstract:
We study increasing subsequences (IS) for an ensemble of sequences given by permutation of numbers {1,2,...,n}. We consider a Boltzmann ensemble at temperature T. Thus each IS appears with the corresponding Boltzmann probability where the energy is the negative length -l of the IS. For T -> 0, only ground states, i.e. longest IS (LIS) contribute, also called Ulam's problem. We introduce an algorit…
▽ More
We study increasing subsequences (IS) for an ensemble of sequences given by permutation of numbers {1,2,...,n}. We consider a Boltzmann ensemble at temperature T. Thus each IS appears with the corresponding Boltzmann probability where the energy is the negative length -l of the IS. For T -> 0, only ground states, i.e. longest IS (LIS) contribute, also called Ulam's problem. We introduce an algorithm which allows us to directly sample IS in perfect equilibrium in polynomial time, for any given sequence and any temperature. Thus, we can study very large sizes. We obtain averages for the first and second moments of number of IS as function of $n$ and confirm analytical predictions. Furthermore, we analyze for low temperature $T$ the sampled ISs by computing the distribution of overlaps and performing hierarchical cluster analyses. In the thermodynamic limit the distribution of overlaps stays broad and the configuration landscape remains complex. Thus, Ulam's problem exhibits replica symmetry breaking. This means it constitutes a model with complex behavior which can be studied numerically exactly in a highly efficient way, in contrast to other RSB-showing models, like spin glasses or NP-hard optimization problems, where no fast exact algorithms are known.
△ Less
Submitted 31 August, 2022;
originally announced August 2022.
-
Cutting-Plane Algorithms and Solution Whitening for the Vertex-Cover Problem
Authors:
G. Claussen,
A. K. Hartmann
Abstract:
The phase-transition behavior of the NP-hard vertex-cover (VC) combinatorial optimization problem is studied numerically by linear programming (LP) on ensembles of random graphs. As the basic Simplex (SX) algorithm suitable for such LPs may produce incomplete solutions for sufficiently complex graphs, the application of cutting-plane (CP) methods is sought. We consider Gomory and {0,1/2} cuts. We…
▽ More
The phase-transition behavior of the NP-hard vertex-cover (VC) combinatorial optimization problem is studied numerically by linear programming (LP) on ensembles of random graphs. As the basic Simplex (SX) algorithm suitable for such LPs may produce incomplete solutions for sufficiently complex graphs, the application of cutting-plane (CP) methods is sought. We consider Gomory and {0,1/2} cuts. We measure the probability of obtaining complete solutions with these approaches as a function of the average node degree c and observe transition between typically complete and incomplete phase regions. While not generally complete solutions are obtained for graphs of arbitrarily high complexity, the CP approaches still advance the boundary in comparison to the pure SX algorithm, beyond the known replica-symmetry breaking (RSB) transition at c=e=2.718... . In fact, our results provide evidence for another algorithmic transition at c=2.90(2).
Besides this, we quantify the transition between easy and hard solvability of the VC problem also in terms of numerical effort. Further we study the so-called whitening of the solution, which is a measure for the degree of freedom that single vertices experience with respect to degenerate solutions. Inspection of the quantities related to clusters of white vertices reveals that whitening is affected, only slightly but measurably, by the RSB transition.
△ Less
Submitted 31 May, 2022;
originally announced May 2022.
-
Phase transition in the bipartite z-matching
Authors:
Till Kahlke,
Martin Fränzle,
Alexander K. Hartmann
Abstract:
We study numerically the maximum $z$-matching problems on ensembles of bipartite random graphs. The $z$-matching problems describes the matching between two types of nodes, users and servers, where each server may serve up to $z$ users at the same time. By using a mapping to standard maximum-cardinality matching, and because for the latter there exists a polynomial-time exact algorithm, we can stu…
▽ More
We study numerically the maximum $z$-matching problems on ensembles of bipartite random graphs. The $z$-matching problems describes the matching between two types of nodes, users and servers, where each server may serve up to $z$ users at the same time. By using a mapping to standard maximum-cardinality matching, and because for the latter there exists a polynomial-time exact algorithm, we can study large system sizes of up to $10^6$ nodes. We measure the capacity and the energy of the resulting optimum matchings. First, we confirm previous analytical results for bipartite regular graphs. Next, we study the finite-size behaviour of the matching capacity and find the same scaling behaviour as before for standard matching, which indicates the universality of the problem. Finally, we investigate for bipartite Erdős-Rényi random graphs the saturability as a function of the average degree, i.e., whether the network allows as many customers as possible to be served, i.e. exploiting the servers in an optimal way. We find phase transitions between unsaturable and saturable phases. These coincide with a strong change of the running time of the exact matching algorithm, as well with the point where a minimum-degree heuristic algorithm starts to fail.
△ Less
Submitted 6 October, 2021;
originally announced October 2021.
-
Large-deviations of the SIR model around the epidemic threshold
Authors:
Yannick Feld,
Alexander K. Hartmann
Abstract:
We numerically study the dynamics of the SIR disease model on small-world networks by using a large-deviation approach. This allows us to obtain the probability density function of the total fraction of infected nodes and of the maximum fraction of simultaneously infected nodes down to very small probability densities like $10^{-2500}$. We analyze the structure of the disease dynamics and observed…
▽ More
We numerically study the dynamics of the SIR disease model on small-world networks by using a large-deviation approach. This allows us to obtain the probability density function of the total fraction of infected nodes and of the maximum fraction of simultaneously infected nodes down to very small probability densities like $10^{-2500}$. We analyze the structure of the disease dynamics and observed three regimes in all probability density functions, which correspond to quick mild, quick extremely severe and sustained severe dynamical evolutions, respectively. Furthermore, the mathematical rate functions of the densities are investigated. The results indicate that the so called large-deviation property hold for the SIR model. Finally, we measured correlations with other quantities like the duration of an outbreak or the peak position of the fraction of infections, also in the rare regions which are not accessible by standard simulation techniques.
△ Less
Submitted 4 March, 2022; v1 submitted 17 September, 2021;
originally announced September 2021.
-
Replica-symmetry breaking for directed polymers
Authors:
Alexander K. Hartmann
Abstract:
Directed polymers on 1+1 dimensional lattices coupled to a heat bath at temperature $T$ are studied numerically for three ensembles of the site disorder. In particular correlations of the disorder as well as fractal patterning are considered. Configurations are directly sampled in perfect thermal equilibrium for very large system sizes with up to $N=L^2= 32768 \times 32768 \approx 10^{9}$ sites. T…
▽ More
Directed polymers on 1+1 dimensional lattices coupled to a heat bath at temperature $T$ are studied numerically for three ensembles of the site disorder. In particular correlations of the disorder as well as fractal patterning are considered. Configurations are directly sampled in perfect thermal equilibrium for very large system sizes with up to $N=L^2= 32768 \times 32768 \approx 10^{9}$ sites. The phase-space structure is studied via the distribution of overlaps and hierarchical clustering of configurations. One ensemble shows a simple behavior like a ferromagnet. The other two ensembles exhibit indications for complex behavior reminiscent of multiple replica-symmetry breaking. Also results for the ultrametricity of the phase space and the phase transition behavior of $P(q)$ when varying the temperature $T$ are studied. In total, the present model ensembles offer convenient numerical accesses to comprehensively studying complex behavior.
△ Less
Submitted 22 August, 2021;
originally announced August 2021.
-
Ordering Behavior of the Two-Dimensional Ising Spin Glass with Long-Range Correlated Disorder
Authors:
L. Münster,
C. Norrenbrock,
A. P. Young,
A. K. Hartmann
Abstract:
The standard two-dimensional Ising spin glass does not exhibit an ordered phase at finite temperature. Here, we investigate whether long-range correlated bonds change this behavior. The bonds are drawn from a Gaussian distribution with a two-point correlation for bonds at distance r that decays as $(1+r^2)^{-a/2}$, $a>0$. We study numerically with exact algorithms the ground state and domain wall…
▽ More
The standard two-dimensional Ising spin glass does not exhibit an ordered phase at finite temperature. Here, we investigate whether long-range correlated bonds change this behavior. The bonds are drawn from a Gaussian distribution with a two-point correlation for bonds at distance r that decays as $(1+r^2)^{-a/2}$, $a>0$. We study numerically with exact algorithms the ground state and domain wall excitations. Our results indicate that the inclusion of bond correlations does not lead to a spin-glass order at any finite temperature. A further analysis reveals that bond correlations have a strong effect at local length scales, inducing ferro/antiferromagnetic domains into the system. The length scale of ferro/antiferromagnetic order diverges exponentially as the correlation exponent approaches a critical value, $a \to a_c = 0$. Thus, our results suggest that the system becomes a ferro/antiferromagnet only in the limit $a \to 0$.
△ Less
Submitted 1 February, 2021;
originally announced February 2021.
-
Extremely rare ultra-fast non-equilibrium processes can be close to equilibrium: RNA unfolding and refolding
Authors:
Peter Werner,
Alexander K. Hartmann
Abstract:
We study numerically the behavior of RNA secondary structures under influence of a varying external force. This allows to measure the work $W$ during the resulting fast unfolding and refolding processes. Here, we investigate a medium-size hairpin structure. Using a sophisticated large-deviation algorithm, we are able to measure work distributions with high precision down to probabilities as small…
▽ More
We study numerically the behavior of RNA secondary structures under influence of a varying external force. This allows to measure the work $W$ during the resulting fast unfolding and refolding processes. Here, we investigate a medium-size hairpin structure. Using a sophisticated large-deviation algorithm, we are able to measure work distributions with high precision down to probabilities as small as $10^{-46}$. Due to this precision and by comparison with exact free-energy calculations we are able to verify the theorems of Crooks and Jarzynski. Furthermore, we analyze force-extension curves and the configurations of the secondary structures during unfolding and refolding for typical equilibrium processes and non-equilibrium processes, conditioned to selected values of the measured work $W$, typical and rare ones. We find that the non-equilibrium processes where the work values are close to those which are most relevant for applying Crooks and Jarzynski theorems, respectively, are most and quite similar to the equilibrium processes. Thus, a similarity of equilibrium and non-equilibrium behavior with respect to a mere scalar variable, which occurs with a very small probability but can be generated in a controlled but non-targeted way, is related to a high similarity for the set of configurations sampled along the full dynamical trajectory.
△ Less
Submitted 24 November, 2020;
originally announced November 2020.
-
Phase transition for parameter learning of Hidden Markov Models
Authors:
Nikita Rau,
Jörg Lücke,
Alexander K. Hartmann
Abstract:
We study a phase transition in parameter learning of Hidden Markov Models (HMMs). We do this by generating sequences of observed symbols from given discrete HMMs with uniformly distributed transition probabilities and a noise level encoded in the output probabilities. By using the Baum-Welch (BW) algorithm, an Expectation-Maximization algorithm from the field of Machine Learning, we then try to es…
▽ More
We study a phase transition in parameter learning of Hidden Markov Models (HMMs). We do this by generating sequences of observed symbols from given discrete HMMs with uniformly distributed transition probabilities and a noise level encoded in the output probabilities. By using the Baum-Welch (BW) algorithm, an Expectation-Maximization algorithm from the field of Machine Learning, we then try to estimate the parameters of each investigated realization of an HMM. We study HMMs with n=4, 8 and 16 states. By changing the amount of accessible learning data and the noise level, we observe a phase-transition-like change in the performance of the learning algorithm. For bigger HMMs and more learning data, the learning behavior improves tremendously below a certain threshold in the noise strength. For a noise level above the threshold, learning is not possible. Furthermore, we use an overlap parameter applied to the results of a maximum-a-posteriori (Viterbi) algorithm to investigate the accuracy of the hidden state estimation around the phase transition.
△ Less
Submitted 25 March, 2020;
originally announced March 2020.
-
Large deviations of connected components in the stochastic block model
Authors:
Hendrik Schawe,
Alexander K. Hartmann
Abstract:
We study the stochastic block model which is often used to model community structures and study community-detection algorithms. We consider the case of two blocks in regard to its largest connected component and largest biconnected component, respectively. We are especially interested in the distributions of their sizes including the tails down to probabilities smaller than $10^{-800}$. For this p…
▽ More
We study the stochastic block model which is often used to model community structures and study community-detection algorithms. We consider the case of two blocks in regard to its largest connected component and largest biconnected component, respectively. We are especially interested in the distributions of their sizes including the tails down to probabilities smaller than $10^{-800}$. For this purpose we use sophisticated Markov chain Monte Carlo simulations to sample graphs from the stochastic block model ensemble. We use this data to study the large-deviation rate function and conjecture that the large-deviation principle holds. Further we compare the distribution to the well known Erdős-Rényi ensemble, where we notice subtle differences at and above the percolation threshold.
△ Less
Submitted 22 September, 2020; v1 submitted 6 March, 2020;
originally announced March 2020.
-
Probing the large deviations of the Kardar-Parisi-Zhang equation at short time with an importance sampling of directed polymers in random media
Authors:
Alexander K. Hartmann,
Alexandre Krajenbrink,
Pierre Le Doussal
Abstract:
The one-point distribution of the height for the continuum Kardar-Parisi-Zhang (KPZ) equation is determined numerically using the mapping to the directed polymer in a random potential at high temperature. Using an importance sampling approach, the distribution is obtained over a large range of values, down to a probability density as small as $10^{-1000}$ in the tails. The short time behavior is i…
▽ More
The one-point distribution of the height for the continuum Kardar-Parisi-Zhang (KPZ) equation is determined numerically using the mapping to the directed polymer in a random potential at high temperature. Using an importance sampling approach, the distribution is obtained over a large range of values, down to a probability density as small as $10^{-1000}$ in the tails. The short time behavior is investigated and compared with recent analytical predictions for the large-deviation forms of the probability of rare fluctuations, showing a spectacular agreement with the analytical expressions. The flat and stationary initial conditions are studied in the full space, together with the droplet initial condition in the half-space.
△ Less
Submitted 9 September, 2019;
originally announced September 2019.
-
Rare-Event Properties of the Nagel-Schreckenberg Model
Authors:
Wiebke Staffeldt,
Alexander K. Hartmann
Abstract:
We have studied the distribution of traffic flow $q$ for the Nagel-Schreckenberg model by computer simulations. We applied a large-deviation approach, which allowed us to obtain the distribution $P(q)$ over more than one hundred decades in probability, down to probabilities like $10^{-140}$. This allowed us to characterize the flow distribution over a large range of the support and identify the ch…
▽ More
We have studied the distribution of traffic flow $q$ for the Nagel-Schreckenberg model by computer simulations. We applied a large-deviation approach, which allowed us to obtain the distribution $P(q)$ over more than one hundred decades in probability, down to probabilities like $10^{-140}$. This allowed us to characterize the flow distribution over a large range of the support and identify the characteristics of rare and even very rare traffic situations. We observe a change of the distribution shape when increasing the density of cars from the free flow to the congestion phase. Furthermore, we characterize typical and rare traffic situations by measuring correlations of $q$ to other quantities like density of standing cars or number and size of traffic jams.
△ Less
Submitted 13 August, 2019;
originally announced August 2019.
-
Percolation of Fortuin-Kasteleyn clusters for the random-bond Ising model
Authors:
Hauke Fajen,
Alexander K. Hartmann,
A. Peter Young
Abstract:
We apply generalisations of the Swendson-Wang and Wolff cluster algorithms, which are based on the construction of Fortuin-Kasteleyn clusters, to the three-dimensional $\pm 1$ random-bond Ising model. The behaviour of the model is determined by the temperature $T$ and the concentration $p$ of negative (anti-ferromagnetic) bonds. The ground state is ferromagnetic for $0 \le p<p_c$, and a spin glass…
▽ More
We apply generalisations of the Swendson-Wang and Wolff cluster algorithms, which are based on the construction of Fortuin-Kasteleyn clusters, to the three-dimensional $\pm 1$ random-bond Ising model. The behaviour of the model is determined by the temperature $T$ and the concentration $p$ of negative (anti-ferromagnetic) bonds. The ground state is ferromagnetic for $0 \le p<p_c$, and a spin glass for $p_c < p \le 0.5$ where $p_c \simeq 0.222$. We investigate the percolation transition of the Fortuin-Kasteleyn clusters as function of temperature. Except for $p=0$ the Fortuin-Kasteleyn percolation transition occurs at a higher temperature than the magnetic ordering temperature. This was known before for $p=1/2$ but here we provide evidence for a difference in transition temperatures even for $p$ arbitrarily small. Furthermore, for all values of $p>0$, our data suggest that the percolation transition is universal, irrespective of whether the ground state exhibits ferromagnetic or spin-glass order, and is in the universality class of standard percolation. This shows that correlations in the bond occupancy of the Fortuin-Kasteleyn clusters are irrelevant, except for $p=0$ where the clusters are tied to Ising correlations so the percolation transition is in the Ising universality class.
△ Less
Submitted 10 May, 2019;
originally announced May 2019.
-
Large-deviation properties of the largest biconnected component for random graphs
Authors:
Hendrik Schawe,
Alexander K. Hartmann
Abstract:
We study the size of the largest biconnected components in sparse Erdős-Rényi graphs with finite connectivity and Barabási-Albert graphs with non-integer mean degree. Using a statistical-mechanics inspired Monte Carlo approach we obtain numerically the distributions for different sets of parameters over almost their whole support, especially down to the rare-event tails with probabilities far less…
▽ More
We study the size of the largest biconnected components in sparse Erdős-Rényi graphs with finite connectivity and Barabási-Albert graphs with non-integer mean degree. Using a statistical-mechanics inspired Monte Carlo approach we obtain numerically the distributions for different sets of parameters over almost their whole support, especially down to the rare-event tails with probabilities far less than $10^{-100}$. This enables us to observe a qualitative difference in the behavior of the size of the largest biconnected component and the largest $2$-core in the region of very small components, which is unreachable using simple sampling methods. Also, we observe a convergence to a rate function even for small sizes, which is a hint that the large deviation principle holds for these distributions.
△ Less
Submitted 12 November, 2018;
originally announced November 2018.
-
Large Deviations of Convex Hulls of the "True" Self-Avoiding Random Walk
Authors:
Hendrik Schawe,
Alexander K. Hartmann
Abstract:
We study the distribution of the area and perimeter of the convex hull of the "true" self-avoiding random walk in a plane. Using a Markov chain Monte Carlo sampling method, we obtain the distributions also in their far tails, down to probabilities like $10^{-800}$. This enables us to test previous conjectures regarding the scaling of the distribution and the large-deviation rate function $Φ$. In p…
▽ More
We study the distribution of the area and perimeter of the convex hull of the "true" self-avoiding random walk in a plane. Using a Markov chain Monte Carlo sampling method, we obtain the distributions also in their far tails, down to probabilities like $10^{-800}$. This enables us to test previous conjectures regarding the scaling of the distribution and the large-deviation rate function $Φ$. In previous studies, e.g., for standard random walks, the whole distribution was governed by the Flory exponent $ν$. We confirm this in the present study by considering expected logarithmic corrections. On the other hand, the behavior of the rate function deviates from the expected form. For this exception we give a qualitative reasoning.
△ Less
Submitted 31 August, 2018;
originally announced August 2018.
-
Large Deviations of Convex Hulls of Self-Avoiding Random Walks
Authors:
Hendrik Schawe,
Alexander K. Hartmann,
Satya N. Majumdar
Abstract:
A global picture of a random particle movement is given by the convex hull of the visited points. We obtained numerically the probability distributions of the volume and surface of the convex hulls of a selection of three types of self-avoiding random walks, namely the classical Self-Avoiding Walk, the Smart-Kinetic Self-Avoiding Walk, and the Loop-Erased Random Walk. To obtain a comprehensive des…
▽ More
A global picture of a random particle movement is given by the convex hull of the visited points. We obtained numerically the probability distributions of the volume and surface of the convex hulls of a selection of three types of self-avoiding random walks, namely the classical Self-Avoiding Walk, the Smart-Kinetic Self-Avoiding Walk, and the Loop-Erased Random Walk. To obtain a comprehensive description of the measured random quantities, we applied sophisticated large-deviation techniques, which allowed us to obtain the distributions over a large range of the support down to probabilities far smaller than $P = 10^{-100}$ . We give an approximate closed form of the so-called large-deviation rate function $Φ$ which generalizes above the upper critical dimension to the previously studied case of the standard random walk. Further we show correlations between the two observables also in the limits of atypical large or small values.
△ Less
Submitted 6 April, 2018;
originally announced April 2018.
-
Vertebrate pollinators: phase transition in a time-dependent generalized traveling-salesperson problem
Authors:
M. Jungsbluth,
J. Thiele,
Y. Winter,
H. Schawe,
A. K. Hartmann
Abstract:
We introduce a model for the global optimization problem of nectar harvesting by flower visitors, e.g., nectar-feeding bats, as a generalization of the (multiple) traveling-salesperson problem (TSP). The model includes multiple independent animals and many flowers with time-dependent content. This provides an ensemble of realistic combinatorial optimization problems, in contrast to previously stud…
▽ More
We introduce a model for the global optimization problem of nectar harvesting by flower visitors, e.g., nectar-feeding bats, as a generalization of the (multiple) traveling-salesperson problem (TSP). The model includes multiple independent animals and many flowers with time-dependent content. This provides an ensemble of realistic combinatorial optimization problems, in contrast to previously studied models like random Satisfiability or standard TSP.
We numerically studied the optimum harvesting of these foragers, with parameters obtained from experiments, by using genetic algorithms. For the distribution of travel distances, we find a power-law (or Lévy) distribution, as often found for natural foragers. Note, in contrast to many models, we make no assumption about the nature of the flight-distance distribution, the power law just emerges. This is in contrast to the TSP, where we find in the present study an exponential tail.
Furthermore, the optimization problem exhibits a {phase transition}, similar to the TSP, at a critical value for the amount of nectar which can be harvested. This phase transition coincides with a dramatic increase in the typical running time of the optimization algorithm. For the value of the critical exponent nu, describing the divergence of the correlation length, we find nu=1.7(4), which is on the other hand compatible with the value found for the TSP.
Finally, we also present data from field experiments in Costa Rica for the resource use for freely visiting flower bats. We found that the temporal patterns in experiments and model agree remarkably, confirming our model. Also the data show that the bats are able to memorize the positions of food sources and optimize, at least partially, their routes.
△ Less
Submitted 21 March, 2018;
originally announced March 2018.
-
Large-deviation properties of the extended Moran model
Authors:
Alexander K. Hartmann,
Thierry E. Huillet
Abstract:
The distributions of the times to the first common ancestor t_mrca is numerically studied for an ecological population model, the extended Moran model. This model has a fixed population size N. The number of descendants is drawn from a beta distribution Beta(alpha, 2-alpha) for various choices of alpha. This includes also the classical Moran model (alpha->0) as well as the uniform distribution (al…
▽ More
The distributions of the times to the first common ancestor t_mrca is numerically studied for an ecological population model, the extended Moran model. This model has a fixed population size N. The number of descendants is drawn from a beta distribution Beta(alpha, 2-alpha) for various choices of alpha. This includes also the classical Moran model (alpha->0) as well as the uniform distribution (alpha=1). Using a statistical mechanics-based large-deviation approach, the distributions can be studied over an extended range of the support, down to probabilities like 10^{-70}, which allowed us to study the change of the tails of the distribution when varying the value of alpha in [0,2]. We find exponential distributions p(t_mrca)~ delta^{t_mrca} in all cases, with systematically varying values for the base delta. Only for the cases alpha=0 and alpha=1, analytical results are known, i.e., delta=\exp(-2/N^2) and delta=2/3, respectively. We recover these values, confirming the validity of our approach. Finally, we also study the correlations between t_mrca and the number of descendants.
△ Less
Submitted 27 October, 2018; v1 submitted 20 October, 2017;
originally announced October 2017.
-
Convex Hulls of Random Walks in Higher Dimensions: A Large Deviation Study
Authors:
Hendrik Schawe,
Alexander K. Hartmann,
Satya N. Majumdar
Abstract:
The distribution of the hypervolume $V$ and surface $\partial V$ of convex hulls of (multiple) random walks in higher dimensions are determined numerically, especially containing probabilities far smaller than $P = 10^{-1000}$ to estimate large deviation properties. For arbitrary dimensions and large walk lengths $T$, we suggest a scaling behavior of the distribution with the length of the walk…
▽ More
The distribution of the hypervolume $V$ and surface $\partial V$ of convex hulls of (multiple) random walks in higher dimensions are determined numerically, especially containing probabilities far smaller than $P = 10^{-1000}$ to estimate large deviation properties. For arbitrary dimensions and large walk lengths $T$, we suggest a scaling behavior of the distribution with the length of the walk $T$ similar to the two-dimensional case, and behavior of the distributions in the tails. We underpin both with numerical data in $d=3$ and $d=4$ dimensions. Further, we confirm the analytically known means of those distributions and calculate their variances for large $T$.
△ Less
Submitted 8 September, 2017;
originally announced September 2017.
-
Convex Hulls of Multiple Random Walks: A Large-Deviation Study
Authors:
Timo Dewenter,
Gunnar Claussen,
Alexander K. Hartmann,
Satya N. Majumdar
Abstract:
We study the polygons governing the convex hull of a point set created by the steps of $n$ independent two-dimensional random walkers. Each such walk consists of $T$ discrete time steps, where $x$ and $y$ increments are i.i.d. Gaussian. We analyze area $A$ and perimeter $L$ of the convex hulls. We obtain probability densities for these two quantities over a large range of the support by using a la…
▽ More
We study the polygons governing the convex hull of a point set created by the steps of $n$ independent two-dimensional random walkers. Each such walk consists of $T$ discrete time steps, where $x$ and $y$ increments are i.i.d. Gaussian. We analyze area $A$ and perimeter $L$ of the convex hulls. We obtain probability densities for these two quantities over a large range of the support by using a large-deviation approach allowing us to study densities below $10^{-900}$. We find that the densities exhibit a universal scaling behavior as a function of $A/T$ and $L/\sqrt{T}$, respectively. As in the case of one walker ($n=1$), the densities follow Gaussian distributions for $L$ and $\sqrt{A}$, respectively. We also obtained the rate functions for the area and perimeter, rescaled with the scaling behavior of their maximum possible values, and found limiting functions for $T \rightarrow \infty$, revealing that the densities follow the large-deviation principle. These rate functions can be described by a power law for $n \rightarrow \infty$ as found in the $n=1$ case. We also investigated the behavior of the averages as a function of the number of walks $n$ and found good agreement with the predicted behavior.
△ Less
Submitted 23 May, 2016;
originally announced May 2016.
-
Practical Introduction to Clustering Data
Authors:
Alexander K. Hartmann
Abstract:
Data clustering is an approach to seek for structure in sets of complex data, i.e., sets of "objects". The main objective is to identify groups of objects which are similar to each other, e.g., for classification. Here, an introduction to clustering is given and three basic approaches are introduced: the k-means algorithm, neighbour-based clustering, and an agglomerative clustering method. For all…
▽ More
Data clustering is an approach to seek for structure in sets of complex data, i.e., sets of "objects". The main objective is to identify groups of objects which are similar to each other, e.g., for classification. Here, an introduction to clustering is given and three basic approaches are introduced: the k-means algorithm, neighbour-based clustering, and an agglomerative clustering method. For all cases, C source code examples are given, allowing for an easy implementation.
△ Less
Submitted 16 February, 2016;
originally announced February 2016.
-
Fragmentation properties of two-dimensional Proximity Graphs considering random failures and targeted attacks
Authors:
Christoph Norrenbrock,
Oliver Melchert,
Alexander K. Hartmann
Abstract:
The pivotal quality of proximity graphs is connectivity, i.e. all nodes in the graph are connected to one another either directly or via intermediate nodes. These types of graphs are robust, i.e., they are able to function well even if they are subject to limited removal of elementary building blocks, as it may occur for random failures or targeted attacks. Here, we study how the structure of thes…
▽ More
The pivotal quality of proximity graphs is connectivity, i.e. all nodes in the graph are connected to one another either directly or via intermediate nodes. These types of graphs are robust, i.e., they are able to function well even if they are subject to limited removal of elementary building blocks, as it may occur for random failures or targeted attacks. Here, we study how the structure of these graphs is affected when nodes get removed successively until an extensive fraction is removed such that the graphs fragment. We study different types of proximity graphs for various node removal strategies. We use different types of observables to monitor the fragmentation process, simple ones like number and sizes of connected components, and more complex ones like the hop diameter and the backup capacity, which is needed to make a network N-1 resilient. The actual fragmentation turns out to be described by a second order phase transition. Using finite-size scaling analyses we numerically assess the threshold fraction of removed nodes, which is characteristic for the particular graph type and node deletion scheme, that suffices to decompose the underlying graphs.
△ Less
Submitted 14 September, 2015;
originally announced September 2015.
-
Non-equilibrium evolution of window overlaps in spin glasses
Authors:
Markus Manssen,
Alexander K. Hartmann,
A. P. Young
Abstract:
We investigate numerically the time dependence of "window" overlaps in a three-dimensional Ising spin glass below its transition temperature after a rapid quench. Using an efficient GPU implementation, we are able to study large systems up to lateral length $L=128$ and up to long times of $t=10^8$ sweeps. We find that the data scales according to the ratio of the window size $W$ to the non-equilib…
▽ More
We investigate numerically the time dependence of "window" overlaps in a three-dimensional Ising spin glass below its transition temperature after a rapid quench. Using an efficient GPU implementation, we are able to study large systems up to lateral length $L=128$ and up to long times of $t=10^8$ sweeps. We find that the data scales according to the ratio of the window size $W$ to the non-equilibrium coherence length $ξ(t)$. We also show a substantial change in behavior if the system is run for long enough that it globally equilibrates, i.e. $ξ(t) \approx L/2$, where $L$ is the lattice size. This indicates that the local behavior of a spin glass depends on the spin configurations (and presumably also the bonds) far away. We compare with similar simulations for the Ising ferromagnet. Based on these results, we speculate on a connection between the non-equilibrium dynamics discussed here and averages computed theoretically using the "metastate".
△ Less
Submitted 8 April, 2015; v1 submitted 27 January, 2015;
originally announced January 2015.
-
Convex Hulls of Random Walks: Large-Deviation Properties
Authors:
Gunnar Claussen,
Alexander K. Hartmann,
Satya N. Majumdar
Abstract:
We study the convex hull of the set of points visited by a two-dimensional random walker of T discrete time steps. Two natural observables that characterize the convex hull in two dimensions are its perimeter L and area A. While the mean perimeter <L> and the mean area <A> have been studied before, analytically and numerically, and exact results are known for large T (Brownian motion limit), littl…
▽ More
We study the convex hull of the set of points visited by a two-dimensional random walker of T discrete time steps. Two natural observables that characterize the convex hull in two dimensions are its perimeter L and area A. While the mean perimeter <L> and the mean area <A> have been studied before, analytically and numerically, and exact results are known for large T (Brownian motion limit), little is known about the full distributions P(A) and P(L). In this paper, we provide numerical results for these distributions. We use a sophisticated large-deviation approach that allows us to study the distributions over a larger range of the support, where the probabilities P(A) and P(L) are as small as 10^{-300}. We analyze (open) random walks as well as (closed) Brownian bridges on the two-dimensional discrete grid as well as in the two-dimensional plane. The resulting distributions exhibit, for large T, a universal scaling behavior (independent of the details of the jump distributions) as a function of A/T and L/\sqrt{T}, respectively. We are also able to obtain the rate function, describing rare events at the tails of these distributions, via a numerical extrapolation scheme and find a linear and square dependence as a function of the rescaled perimeter and the rescaled area, respectively.
△ Less
Submitted 5 January, 2015;
originally announced January 2015.
-
Ageing at the Spin-Glass/Ferromagnet Transition: Monte Carlo Simulation using GPUs
Authors:
Markus Manssen,
Alexander K. Hartmann
Abstract:
We study the the non-equilibrium ageing behaviour of the +/-J Edwards-Anderson model in three dimensions for samples of size up to N=128^3 and for up to 10^8 Monte Carlo sweeps. In particular we are interested in the change of the ageing when crossing from the spin-glass phase to the ferromagnetic phase. The necessary long simulation times are reached by employing a CUDA-based GPU implementation,…
▽ More
We study the the non-equilibrium ageing behaviour of the +/-J Edwards-Anderson model in three dimensions for samples of size up to N=128^3 and for up to 10^8 Monte Carlo sweeps. In particular we are interested in the change of the ageing when crossing from the spin-glass phase to the ferromagnetic phase. The necessary long simulation times are reached by employing a CUDA-based GPU implementation, which allows for single-spin flip times as small as 8ps. We measure typical spin glass correlation functions in space and time to determine the growing length scale and extract the constituting exponents. We observe a clear signature of the disorder-driven equilibrium transition in the non-equilibrium behavior.
△ Less
Submitted 20 November, 2014;
originally announced November 2014.
-
Large-deviation properties of resilience of power grids
Authors:
Timo Dewenter,
Alexander K. Hartmann
Abstract:
We study the distributions of the resilience of power flow models against transmission line failures via a so-called backup capacity. We consider three ensembles of random networks and in addition, the topology of the British transmission power grid. The three ensembles are Erdős-Rényi random graphs, Erdős-Rényi random graphs with a fixed number of links, and spatial networks where the nodes are e…
▽ More
We study the distributions of the resilience of power flow models against transmission line failures via a so-called backup capacity. We consider three ensembles of random networks and in addition, the topology of the British transmission power grid. The three ensembles are Erdős-Rényi random graphs, Erdős-Rényi random graphs with a fixed number of links, and spatial networks where the nodes are embedded in a two dimensional plane. We investigate numerically the probability density functions (pdfs) down to the tails to gain insight in very resilient and very vulnerable networks. This is achieved via large-deviation techniques which allow us to study very rare values which occur with probability densities below $10^{-160}$. We find that the right tail of the pdfs towards larger backup capacities follows an exponential with a strong curvature. This is confirmed by the rate function which approaches a limiting curve for increasing network sizes. Very resilient networks are basically characterized by a small diameter and a large power sign ratio. In addition, networks can be made typically more resilient by adding more links.
△ Less
Submitted 29 January, 2015; v1 submitted 19 November, 2014;
originally announced November 2014.
-
Analysis of the phase transition in the $2D$ Ising ferromagnet using a Lempel-Ziv string parsing scheme and black-box data-compression utilities
Authors:
O. Melchert,
A. K. Hartmann
Abstract:
In this work we consider information-theoretical observables to analyze short symbolic sequences, comprising time-series that represent the orientation of a single spin in a $2D$ Ising ferromagnet on a square lattice of size $L^2=128^2$, for different system temperatures $T$. The latter were chosen from an interval enclosing the critical point $T_{\rm c}$ of the model. At small temperatures the se…
▽ More
In this work we consider information-theoretical observables to analyze short symbolic sequences, comprising time-series that represent the orientation of a single spin in a $2D$ Ising ferromagnet on a square lattice of size $L^2=128^2$, for different system temperatures $T$. The latter were chosen from an interval enclosing the critical point $T_{\rm c}$ of the model. At small temperatures the sequences are thus very regular, at high temperatures they are maximally random. In the vicinity of the critical point, nontrivial, long-range correlations appear. Here, we implement estimators for the entropy rate, excess entropy (i.e. "complexity") and multi-information. First, we implement a Lempel-Ziv string parsing scheme, providing seemingly elaborate entropy rate and multi-information estimates and an approximate estimator for the excess entropy. Furthermore, we apply easy-to-use black-box data compression utilities, providing approximate estimators only. For comparison and to yield results for benchmarking purposes we implement the information-theoretic observables also based on the well-established M-block Shannon entropy, which is more tedious to apply compared to the the first two "algorithmic" entropy estimation procedures. To test how well one can exploit the potential of such data compression techniques, we aim at detecting the critical point of the $2D$ Ising ferromagnet. Among the above observables, the multi-information, which is known to exhibit an isolated peak at the critical point, is very easy to replicate by means of both efficient algorithmic entropy estimation procedures. Finally, we assess how good the various algorithmic entropy estimates compare to the more conventional block entropy estimates and illustrate a simple modification that yields enhanced results.
△ Less
Submitted 5 June, 2014;
originally announced June 2014.
-
Large-deviation properties of resilience of transportation networks
Authors:
Alexander K. Hartmann
Abstract:
Distributions of the resilience of transport networks are studied numerically, in particular the large-deviation tails. Thus, not only typical quantities like average or variance but the distributions over the (almost) full support can be studied. For a proof of principle, a simple transport model based on the edge-betweenness and three abstract yet widely studied random network ensembles are cons…
▽ More
Distributions of the resilience of transport networks are studied numerically, in particular the large-deviation tails. Thus, not only typical quantities like average or variance but the distributions over the (almost) full support can be studied. For a proof of principle, a simple transport model based on the edge-betweenness and three abstract yet widely studied random network ensembles are considered here: Erdoes-Renyi random networks with finite connectivity, small world networks and spatial networks embedded in a two-dimensional plane. Using specific numerical large-deviation techniques, probability densities as small as 10^(-80) are obtained here. This allows one to study typical but also the most and the least resilient networks. The resulting distributions fulfill the mathematical large-deviation principle, i.e., can be well described by rate functions in the thermodynamic limit. The analysis of the limiting rate function reveals that the resilience follows an exponential distribution almost everywhere. An analysis of the structure of the network shows that the most-resilient networks can be obtained, as a rule of thumb, by minimizing the diameter of a network. Also, trivially, by including more links a network can typically be made more resilient. On the other hand, the least-resilient networks are very rare and characterized by one (or few) small core(s) to which all other nodes are connected. In total, the spatial network ensemble turns out to be most suitable for obtaining and studying resilience of real mostly finite-dimensional networks. Studying this ensemble in combination with the presented large-deviation approach for more realistic, in particular dynamic transport networks appears to be very promising.
△ Less
Submitted 3 February, 2014;
originally announced February 2014.
-
Spin glasses: the game
Authors:
Alexander K. Hartmann
Abstract:
This document presents the rules of a tactical two-player board game which is inspired by spin glasses. The aim is, while placing bonds and spins, to achieve a majority of the spins facing the chosen direction of each player. The game has been already successfully used in university teaching but should be accessible to players from age 10 and up. (Note that there is a non-physics version of the ru…
▽ More
This document presents the rules of a tactical two-player board game which is inspired by spin glasses. The aim is, while placing bonds and spins, to achieve a majority of the spins facing the chosen direction of each player. The game has been already successfully used in university teaching but should be accessible to players from age 10 and up. (Note that there is a non-physics version of the rules available at www.compphys.uni-oldenburg.de which formulates the game in terms of a comptetion between party hosts.) Material is included such that a cheap version of the board game can be made using a color printer, scissors and glue.
△ Less
Submitted 6 December, 2013;
originally announced December 2013.
-
Biased and greedy random walks on two-dimensional lattices with quenched randomness: the "greedy" ant within a disordered environment
Authors:
T. L. Mitran,
O. Melchert,
A. K. Hartmann
Abstract:
The principle characteristics of biased greedy random walks (BGRWs) on two-dimensional lattices with real-valued quenched disorder on the lattice edges are studied. Here, the disorder allows for negative edge-weights. In previous studies, considering the negative-weight percolation (NWP) problem, this was shown to change the universality class of the existing, static percolation transition. In the…
▽ More
The principle characteristics of biased greedy random walks (BGRWs) on two-dimensional lattices with real-valued quenched disorder on the lattice edges are studied. Here, the disorder allows for negative edge-weights. In previous studies, considering the negative-weight percolation (NWP) problem, this was shown to change the universality class of the existing, static percolation transition. In the presented study, four different types of BGRWs and an algorithm based on the ant colony optimization (ACO) heuristic were considered. Regarding the BGRWs, the precise configurations of the lattice walks constructed during the numerical simulations were influenced by two parameters: a disorder parameter rho that controls the amount of negative edge weights on the lattice and a bias strength B that governs the drift of the walkers along a certain lattice direction. Here, the pivotal observable is the probability that, after termination, a lattice walk exhibits a total negative weight, which is here considered as percolating. The behavior of this observable as function of rho for different bias strengths B is put under scrutiny. Upon tuning rho, the probability to find such a feasible lattice walk increases from zero to one. This is the key feature of the percolation transition in the NWP model. Here, we address the question how well the transition point rho_c, resulting from numerically exact and "static" simulations in terms of the NWP model can be resolved using simple dynamic algorithms that have only local information available, one of the basic questions in the physics of glassy systems.
△ Less
Submitted 20 August, 2013;
originally announced August 2013.
-
Exact ground states of one-dimensional long-range random-field Ising magnets
Authors:
Timo Dewenter,
Alexander K. Hartmann
Abstract:
We investigate the one-dimensional long-range random-field Ising magnet with Gaussian distribution of the random fields. In this model, a ferromagnetic bond between two spins is placed with a probability $p \sim r^{-1-σ}$, where $r$ is the distance between these spins and $σ$ is a parameter to control the effective dimension of the model. Exact ground states at zero temperature are calculated for…
▽ More
We investigate the one-dimensional long-range random-field Ising magnet with Gaussian distribution of the random fields. In this model, a ferromagnetic bond between two spins is placed with a probability $p \sim r^{-1-σ}$, where $r$ is the distance between these spins and $σ$ is a parameter to control the effective dimension of the model. Exact ground states at zero temperature are calculated for system sizes up to $L = 2^{19}$ via graph theoretical algorithms for four different values of $σ\in \{0.25,0.4,0.5,1.0\}$ while varying the strength $h$ of the random fields. For each of these values several independent physical observables are calculated, i.e., magnetization, Binder parameter, susceptibility and a specific-heat-like quantity. The ferromagnet-paramagnet transitions at critical values $h_c(σ)$ as well as the corresponding critical exponents are obtained. The results agree well with theory and interestingly we find for $σ= 1/2$ the data is compatible with a critical random-field strength $h_c > 0$.
△ Less
Submitted 19 November, 2014; v1 submitted 15 July, 2013;
originally announced July 2013.
-
Generalized black-box large deviation simulations: High-precision work distributions for extreme non-equilibrium processes in large systems
Authors:
Alexander K. Hartmann
Abstract:
The distributions of work for strongly non-equilibrium processes are studied using a very general form of a large-deviation approach, which allows one to study distributions of almost arbitrary quantities of interest for equilibrium, non-equilibrium stationary and even non-stationary processes. The method is applied to varying quickly the external field in a wide range B=3 <-> 0 for critical (T=2.…
▽ More
The distributions of work for strongly non-equilibrium processes are studied using a very general form of a large-deviation approach, which allows one to study distributions of almost arbitrary quantities of interest for equilibrium, non-equilibrium stationary and even non-stationary processes. The method is applied to varying quickly the external field in a wide range B=3 <-> 0 for critical (T=2.269) two-dimensional Ising system of size LxL=128x128. To obtain free energy differences from the work distributions, they must be studied in ranges where the probabilities are as small as 10^{-240}, which is not possible using direct simulation approaches. By comparison with the exact free energies, which are available for this model for the zero-field case, one sees that the present approach allows one to obtain the free energy with a very high relative precision of 10^{-4}. This works well also for non-zero field, i.e., for a case where standard umbrella-sampling methods seem to be not so efficient to calculate free energies. Furthermore, for the present case it is verified that the resulting distributions of work for forward and backward process fulfill Crooks theorem with high precision. Finally, the free energy for the Ising magnet as a function of the field strength is obtained.
△ Less
Submitted 6 May, 2013;
originally announced May 2013.
-
Sampling fractional Brownian motion in presence of absorption: a Markov Chain method
Authors:
Alexander K. Hartmann,
Satya N. Majumdar,
Alberto Rosso
Abstract:
We study fractional Brownian motion (fBm) characterized by the Hurst exponent H. Using a Monte Carlo sampling technique, we are able to numerically generate fBm processes with an absorbing boundary at the origin at discrete times for a large number of 10^7 time steps even for small values like H=1/4. The results are compatible with previous analytical results that the distribution of (rescaled) en…
▽ More
We study fractional Brownian motion (fBm) characterized by the Hurst exponent H. Using a Monte Carlo sampling technique, we are able to numerically generate fBm processes with an absorbing boundary at the origin at discrete times for a large number of 10^7 time steps even for small values like H=1/4. The results are compatible with previous analytical results that the distribution of (rescaled) endpoints y follow a power law P(y) y^φwith φ=(1-H)/H, even for small values of H. Furthermore, for the case H=0.5 we also study analytically the finite-length corrections to the first order, namely a plateau of P(y) for y->0 which decreases with increasing process length. These corrections are compatible with the numerical results.
△ Less
Submitted 29 May, 2013; v1 submitted 7 March, 2013;
originally announced March 2013.
-
Typical and large-deviation properties of minimum-energy paths on disordered hierarchical lattices
Authors:
O. Melchert,
A. K. Hartmann
Abstract:
We perform numerical simulations to study the optimal path problem on disordered hierarchical graphs with effective dimension d=2.32. Therein, edge energies are drawn from a disorder distribution that allows for positive and negative energies. This induces a behavior which is fundamentally different from the case where all energies are positive, only. Upon changing the subtleties of the distributi…
▽ More
We perform numerical simulations to study the optimal path problem on disordered hierarchical graphs with effective dimension d=2.32. Therein, edge energies are drawn from a disorder distribution that allows for positive and negative energies. This induces a behavior which is fundamentally different from the case where all energies are positive, only. Upon changing the subtleties of the distribution, the scaling of the minimum energy path length exhibits a transition from self-affine to self-similar. We analyze the precise scaling of the path length and the associated ground-state energy fluctuations in the vincinity of the disorder critical point, using a decimation procedure for huge graphs. Further, using an importance sampling procedure in the disorder we compute the negative-energy tails of the ground-state energy distribution up to 12 standard deviations away from its mean. We find that the asymptotic behavior of the negative-energy tail is in agreement with a Tracy-Widom distribution. Further, the characteristic scaling of the tail can be related to the ground-state energy flucutations, similar as for the directed polymer in a random medium.
△ Less
Submitted 26 February, 2013;
originally announced February 2013.
-
Information theoretic approach to ground-state phase transitions for two and three-dimensional frustrated spin systems
Authors:
O. Melchert,
A. K. Hartmann
Abstract:
The information theoretic observables entropy (a measure of disorder), excess entropy (a measure of complexity) and multi information are used to analyze ground-state spin configurations for disordered and frustrated model systems in 2D and 3D. For both model systems, ground-state spin configurations can be obtained in polynomial time via exact combinatorial optimization algorithms, which allowed…
▽ More
The information theoretic observables entropy (a measure of disorder), excess entropy (a measure of complexity) and multi information are used to analyze ground-state spin configurations for disordered and frustrated model systems in 2D and 3D. For both model systems, ground-state spin configurations can be obtained in polynomial time via exact combinatorial optimization algorithms, which allowed us to study large systems with high numerical accuracy. Both model systems exhibit a continuous transition from an ordered to a disordered ground state as a model parameter is varied. By using the above information theoretic observables it is possible to detect changes in the spatial structure of the ground states as the critical point is approached. It is further possible to quantify the scaling behavior of the information theoretic observables in the vicinity of the critical point. For both model systems considered, the estimates of critical properties for the ground-state phase transitions are in good agreement with existing results reported in the literature.
△ Less
Submitted 19 November, 2012;
originally announced November 2012.
-
A computational mechanics approach to estimate entropy and (approximate) complexity for the dynamics of the 2D Ising Ferromagnet
Authors:
O. Melchert,
A. K. Hartmann
Abstract:
We present a numerical analysis of the entropy rate and statistical complexity related to the spin flip dynamics of the 2D Ising Ferromagnet at different temperatures T. We follow an information theoretic approach and test three different entropy estimation algorithms to asses entropy rate and statistical complexity of binary sequences. The latter are obtained by monitoring the orientation of a si…
▽ More
We present a numerical analysis of the entropy rate and statistical complexity related to the spin flip dynamics of the 2D Ising Ferromagnet at different temperatures T. We follow an information theoretic approach and test three different entropy estimation algorithms to asses entropy rate and statistical complexity of binary sequences. The latter are obtained by monitoring the orientation of a single spin on a square lattice of side-length L=256 at a given temperature parameter over time. The different entropy estimation procedures are based on the M-block Shannon entropy (a well established method that yields results for benchmarking purposes), non-sequential recursive pair substitution (providing an elaborate and an approximate estimator) and a convenient data compression algorithm contained in the zlib-library (providing an approximate estimator only). We propose an approximate measure of statistical complexity that emphasizes on correlations within the sequence and which is easy to implement, even by means of black-box data compression algorithms. Regarding the 2D Ising Ferromagnet simulated using Metropolis dynamics and for binary sequences of finite length, the proposed approximate complexity measure is peaked close to the critical temperature. For the approximate estimators, a finite-size scaling analysis reveals that the peak approaches the critical temperature as the sequence length increases. Results obtained using different spin-flip dynamics are briefly discussed. The suggested complexity measure can be extended to non-binary sequences in a straightforward manner.
△ Less
Submitted 29 June, 2012;
originally announced June 2012.
-
Random number generators for massively parallel simulations on GPU
Authors:
Markus Manssen,
Martin Weigel,
Alexander K. Hartmann
Abstract:
High-performance streams of (pseudo) random numbers are crucial for the efficient implementation for countless stochastic algorithms, most importantly, Monte Carlo simulations and molecular dynamics simulations with stochastic thermostats. A number of implementations of random number generators has been discussed for GPU platforms before and some generators are even included in the CUDA supporting…
▽ More
High-performance streams of (pseudo) random numbers are crucial for the efficient implementation for countless stochastic algorithms, most importantly, Monte Carlo simulations and molecular dynamics simulations with stochastic thermostats. A number of implementations of random number generators has been discussed for GPU platforms before and some generators are even included in the CUDA supporting libraries. Nevertheless, not all of these generators are well suited for highly parallel applications where each thread requires its own generator instance. For this specific situation encountered, for instance, in simulations of lattice models, most of the high-quality generators with large states such as Mersenne twister cannot be used efficiently without substantial changes. We provide a broad review of existing CUDA variants of random-number generators and present the CUDA implementation of a new massively parallel high-quality, high-performance generator with a small memory load overhead.
△ Less
Submitted 27 April, 2012;
originally announced April 2012.
-
Phase transition for cutting-plane approach to vertex-cover problem
Authors:
Timo Dewenter,
Alexander K. Hartmann
Abstract:
We study the vertex-cover problem which is an NP-hard optimization problem and a prototypical model exhibiting phase transitions on random graphs, e.g., Erdoes-Renyi (ER) random graphs. These phase transitions coincide with changes of the solution space structure, e.g, for the ER ensemble at connectivity c=e=2.7183 from replica symmetric to replica-symmetry broken. For the vertex-cover problem, al…
▽ More
We study the vertex-cover problem which is an NP-hard optimization problem and a prototypical model exhibiting phase transitions on random graphs, e.g., Erdoes-Renyi (ER) random graphs. These phase transitions coincide with changes of the solution space structure, e.g, for the ER ensemble at connectivity c=e=2.7183 from replica symmetric to replica-symmetry broken. For the vertex-cover problem, also the typical complexity of exact branch-and-bound algorithms, which proceed by exploring the landscape of feasible configurations, change close to this phase transition from "easy" to "hard". In this work, we consider an algorithm which has a completely different strategy: The problem is mapped onto a linear programming problem augmented by a cutting-plane approach, hence the algorithm operates in a space OUTSIDE the space of feasible configurations until the final step, where a solution is found. Here we show that this type of algorithm also exhibits an "easy-hard" transition around c=e, which strongly indicates that the typical hardness of a problem is fundamental to the problem and not due to a specific representation of the problem.
△ Less
Submitted 9 January, 2012;
originally announced January 2012.
-
Excitations in high-dimensional random-field Ising magnets
Authors:
Bjoern Ahrens,
Alexander K. Hartmann
Abstract:
Domain walls and droplet-like excitation of the random-field Ising magnet are studied in d={3,4,5,6,7} dimensions by means of exact numerical ground-state calculations. They are obtained using the established mapping to the graph-theoretical maximum-flow problem. This allows to study large system sizes of more than five million spins in exact thermal equilibrium. All simulations are carried out at…
▽ More
Domain walls and droplet-like excitation of the random-field Ising magnet are studied in d={3,4,5,6,7} dimensions by means of exact numerical ground-state calculations. They are obtained using the established mapping to the graph-theoretical maximum-flow problem. This allows to study large system sizes of more than five million spins in exact thermal equilibrium. All simulations are carried out at the critical point for the strength h of the random fields, h=h_c(d), respectively. Using finite-size scaling, energetic and geometric properties like stiffness exponents and fractal dimensions are calculated. Using these results, we test (hyper) scaling relations, which seem to be fulfilled below the upper critical dimension d_u=6. Also, for d<d_u, the stiffness exponent can be obtained from the scaling of the ground-state energy.
△ Less
Submitted 2 January, 2012;
originally announced January 2012.
-
Critical behavior of the Random-Field Ising Magnet with long range correlated disorder
Authors:
Björn Ahrens,
Alexander K. Hartmann
Abstract:
We study the correlated-disorder driven zero-temperature phase transition of the Random-Field Ising Magnet using exact numerical ground-state calculations for cubic lattices. We consider correlations of the quenched disorder decaying proportional to r^a, where r is the distance between two lattice sites and a<0. To obtain exact ground states, we use a well established mapping to the graph-theoreti…
▽ More
We study the correlated-disorder driven zero-temperature phase transition of the Random-Field Ising Magnet using exact numerical ground-state calculations for cubic lattices. We consider correlations of the quenched disorder decaying proportional to r^a, where r is the distance between two lattice sites and a<0. To obtain exact ground states, we use a well established mapping to the graph-theoretical maximum-flow problem, which allows us to study large system sizes of more than two million spins. We use finite-size scaling analyses for values a={-1,-2,-3,-7} to calculate the critical point and the critical exponents characterizing the behavior of the specific heat, magnetization, susceptibility and of the correlation length close to the critical point. We find basically the same critical behavior as for the RFIM with delta-correlated disorder, except for the finite-size exponent of the susceptibility and for the case a=-1, where the results are also compatible with a phase transition at infinitesimal disorder strength.
A summary of this work can be found at the papercore database at www.papercore.org.
△ Less
Submitted 30 June, 2011;
originally announced June 2011.