-
Sharp threshold for the ballisticity of the random walk on the exclusion process
Authors:
Guillaume Conchon--Kerjan,
Daniel Kious,
Pierre-François Rodriguez
Abstract:
We study a non-reversible random walk advected by the symmetric simple exclusion process, so that the walk has a local drift of opposite sign when sitting atop an occupied or an empty site. We prove that the back-tracking probability of the walk exhibits a sharp transition as the density $ρ$ of particles in the underlying exclusion process varies across a critical density $ρ_c$. Our results imply…
▽ More
We study a non-reversible random walk advected by the symmetric simple exclusion process, so that the walk has a local drift of opposite sign when sitting atop an occupied or an empty site. We prove that the back-tracking probability of the walk exhibits a sharp transition as the density $ρ$ of particles in the underlying exclusion process varies across a critical density $ρ_c$. Our results imply that the speed $v=v(ρ)$ of the walk is a strictly monotone function and that the zero-speed regime is either absent or collapses to a single point, $ρ_c$, thus solving a conjecture of arXiv:1906.03167. The proof proceeds by exhibiting a quantitative monotonicity result for the speed of a truncated model, in which the environment is renewed after a finite time horizon $L$. The truncation parameter $L$ is subsequently pitted against the density $ρ$ to carry estimates over to the full model. Our strategy is somewhat reminiscent of certain techniques recently used to prove sharpness results in percolation problems. A key instrument is a combination of renormalisation arguments with refined couplings of environments at slightly different densities, which we develop in this article. Our results hold in fact in greater generality and apply to a class of environments with possibly egregious features, outside perturbative regimes.
△ Less
Submitted 3 September, 2024;
originally announced September 2024.
-
Aging and sub-aging for one-dimensional random walks amongst random conductances
Authors:
David A. Croydon,
Daniel Kious,
Carlo Scali
Abstract:
We consider random walks amongst random conductances in the cases where the conductances can be arbitrarily small, with a heavy-tailed distribution at 0, and where the conductances may or may not have a heavy-tailed distribution at infinity. We study the long time behaviour of these processes and prove aging statements. When the heavy tail is only at 0, we prove that aging can be observed for the…
▽ More
We consider random walks amongst random conductances in the cases where the conductances can be arbitrarily small, with a heavy-tailed distribution at 0, and where the conductances may or may not have a heavy-tailed distribution at infinity. We study the long time behaviour of these processes and prove aging statements. When the heavy tail is only at 0, we prove that aging can be observed for the maximum of the process, i.e. the same maximal value is attained repeatedly over long time-scales. When there are also heavy tails at infinity, we prove a classical aging result for the position of the walker, as well as a sub-aging result that occurs on a shorter time-scale.
△ Less
Submitted 15 February, 2024; v1 submitted 4 August, 2023;
originally announced August 2023.
-
Fluctuation bounds for symmetric random walks on dynamic environments via Russo-Seymour-Welsh
Authors:
Rangel Baldasso,
Marcelo R. Hilario,
Daniel Kious,
Augusto Teixeira
Abstract:
In this article, we prove a lower bound for the fluctuations of symmetric random walks on dynamic random environments in dimension $1 + 1$ in the perturbative regime where the walker is weakly influenced by the environment. We suppose that the random environment is invariant with respect to translations and reflections, satisfies the FKG inequality and a mild mixing condition. The techniques emplo…
▽ More
In this article, we prove a lower bound for the fluctuations of symmetric random walks on dynamic random environments in dimension $1 + 1$ in the perturbative regime where the walker is weakly influenced by the environment. We suppose that the random environment is invariant with respect to translations and reflections, satisfies the FKG inequality and a mild mixing condition. The techniques employed are inspired by percolation theory, including a Russo-Seymour-Welsh (RSW) inequality. To exemplify the generality of our results, we provide two families of fields that satisfy our hypotheses: a class of Gaussian fields and Confetti percolation models.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Scaling limit of critical random trees in random environment
Authors:
Guillaume Conchon--Kerjan,
Daniel Kious,
Cécile Mailler
Abstract:
We consider Bienaymé-Galton-Watson trees in random environment, where each generation $k$ is attributed a random offspring distribution $μ_k$, and $(μ_k)_{k\geq 0}$ is a sequence of independent and identically distributed random probability measures. We work in the ``strictly critical'' regime where, for all $k$, the average of $μ_k$ is assumed to be equal to $1$ almost surely, and the variance of…
▽ More
We consider Bienaymé-Galton-Watson trees in random environment, where each generation $k$ is attributed a random offspring distribution $μ_k$, and $(μ_k)_{k\geq 0}$ is a sequence of independent and identically distributed random probability measures. We work in the ``strictly critical'' regime where, for all $k$, the average of $μ_k$ is assumed to be equal to $1$ almost surely, and the variance of $μ_k$ has finite expectation. We prove that, for almost all realizations of the environment (more precisely, under some deterministic conditions that the random environment satisfies almost surely), the scaling limit of the tree in that environment, conditioned to be large, is the Brownian continuum random tree. The habitual techniques used for standard Bienaymé-Galton-Watson trees, or trees with exchangeable vertices, do not apply to this case. Our proof therefore provides alternative tools.
△ Less
Submitted 26 January, 2023; v1 submitted 22 September, 2022;
originally announced September 2022.
-
The trace-reinforced ants process does not find shortest paths
Authors:
Daniel Kious,
Cécile Mailler,
Bruno Schapira
Abstract:
In this paper, we study a probabilistic reinforcement-learning model for ants searching for the shortest path(s) between their nest and a source of food. In this model, the nest and the source of food are two distinguished nodes $N$ and $F$ in a finite graph $\mathcal G$. The ants perform a sequence of random walks on this graph, starting from the nest and stopped when first hitting the source of…
▽ More
In this paper, we study a probabilistic reinforcement-learning model for ants searching for the shortest path(s) between their nest and a source of food. In this model, the nest and the source of food are two distinguished nodes $N$ and $F$ in a finite graph $\mathcal G$. The ants perform a sequence of random walks on this graph, starting from the nest and stopped when first hitting the source of food. At each step of its random walk, the $n$-th ant chooses to cross a neighbouring edge with probability proportional to the number of preceding ants that crossed that edge at least once. We say that {\it the ants find the shortest path} if, almost surely as the number of ants grow to infinity, almost all the ants go from the nest to the source of food through one of the shortest paths, without loosing time on other edges of the graph.
Our contribution is three-fold: (1) We prove that, if $\mathcal G$ is a tree rooted at $N$ whose leaves have been merged into node $F$, and with one edge between $N$ and $F$, then the ants indeed find the shortest path. (2) In contrast, we provide three examples of graphs on which the ants do not find the shortest path, suggesting that in this model and in most graphs, ants do not find the shortest path. (3) In all these cases, we show that the sequence of normalised edge-weights converge to a {\it deterministic} limit, despite a linear-reinforcement mechanism, and we conjecture that this is a general fact which is valid on all finite graphs. To prove these results, we use stochastic approximation methods, and in particular the ODE method. One difficulty comes from the fact that this method relies on understanding the behaviour at large times of the solution of a non-linear, multi-dimensional ODE.
△ Less
Submitted 2 October, 2023; v1 submitted 19 June, 2021;
originally announced June 2021.
-
Finding geodesics on graphs using reinforcement learning
Authors:
Daniel Kious,
Cécile Mailler,
Bruno Schapira
Abstract:
It is well-known in biology that ants are able to find shortest paths between their nest and the food by successive random explorations, without any mean of communication other than the pheromones they leave behind them. This striking phenomenon has been observed experimentally and modelled by different mean-field reinforcement-learning models in the biology literature.
In this paper, we introdu…
▽ More
It is well-known in biology that ants are able to find shortest paths between their nest and the food by successive random explorations, without any mean of communication other than the pheromones they leave behind them. This striking phenomenon has been observed experimentally and modelled by different mean-field reinforcement-learning models in the biology literature.
In this paper, we introduce the first probabilistic reinforcement-learning model for this phenomenon. In this model, the ants explore a finite graph in which two nodes are distinguished as the nest and the source of food. The ants perform successive random walks on this graph, starting from the nest and stopped when first reaching the food, and the transition probabilities of each random walk depend on the realizations of all previous walks through some dynamic weighting of the graph. We discuss different variants of this model based on different reinforcement rules and show that slight changes in this reinforcement rule can lead to drastically different outcomes.
We prove that, in two variants of this model and when the underlying graph is, respectively, any series-parallel graph and a 5-edge non-series-parallel losange graph, the ants indeed eventually find the shortest path(s) between their nest and the food. Both proofs rely on the electrical network method for random walks on weighted graphs and on Rubin's embedding in continuous time. The proof in the series-parallel cases uses the recursive nature of this family of graphs, while the proof in the seemingly-simpler losange case turns out to be quite intricate: it relies on a fine analysis of some stochastic approximation, and on various couplings with standard and generalised Pólya urns.
△ Less
Submitted 9 October, 2020;
originally announced October 2020.
-
Random Memory Walk
Authors:
Alexander Fribergh,
Daniel Kious,
Vladas Sidoravicius,
Alexandre Stauffer
Abstract:
We present a simple model of a random walk with partial memory, which we call the \emph{random memory walk}. We introduce this model motivated by the belief that it mimics the behavior of the once-reinforced random walk in high dimensions and with small reinforcement. We establish the transience of the random memory walk in dimensions three and higher, and show that its scaling limit is a Brownian…
▽ More
We present a simple model of a random walk with partial memory, which we call the \emph{random memory walk}. We introduce this model motivated by the belief that it mimics the behavior of the once-reinforced random walk in high dimensions and with small reinforcement. We establish the transience of the random memory walk in dimensions three and higher, and show that its scaling limit is a Brownian motion.
△ Less
Submitted 21 April, 2020; v1 submitted 16 April, 2020;
originally announced April 2020.
-
Random walk on the simple symmetric exclusion process
Authors:
Marcelo R. Hilário,
Daniel Kious,
Augusto Teixeira
Abstract:
We investigate the long-term behavior of a random walker evolving on top of the simple symmetric exclusion process (SSEP) at equilibrium, in dimension one.
At each jump, the random walker is subject to a drift that depends on whether it is sitting on top of a particle or a hole, so that its asymptotic behavior is expected to depend on the density $ρ\in [0, 1]$ of the underlying SSEP.
Our first…
▽ More
We investigate the long-term behavior of a random walker evolving on top of the simple symmetric exclusion process (SSEP) at equilibrium, in dimension one.
At each jump, the random walker is subject to a drift that depends on whether it is sitting on top of a particle or a hole, so that its asymptotic behavior is expected to depend on the density $ρ\in [0, 1]$ of the underlying SSEP.
Our first result is a law of large numbers (LLN) for the random walker for all densities $ρ$ except for at most two values $ρ_-, ρ_+ \in [0, 1]$.
The asymptotic speed we obtain in our LLN is a monotone function of $ρ$.
Also, $ρ_-$ and $ρ_+$ are characterized as the two points at which the speed may jump to (or from) zero.
Furthermore, for all the values of densities where the random walk experiences a non-zero speed, we can prove that it satisfies a functional central limit theorem (CLT).
For the special case in which the density is $1/2$ and the jump distribution on an empty site and on an occupied site are symmetric to each other, we prove a LLN with zero limiting speed.
Finally, we prove similar LLN and CLT results for a different environment, given by a family of independent simple symmetric random walks in equilibrium.
△ Less
Submitted 7 June, 2019;
originally announced June 2019.
-
The branching-ruin number as critical parameter of random processes on trees
Authors:
Andrea Collevecchio,
Cong Bang Huynh,
Daniel Kious
Abstract:
The branching-ruin number of a tree, which describes its asymptotic growth and geometry, can be seen as a polynomial version of the branching number. This quantity was defined by Collevecchio, Kious and Sidoravicius (2018) in order to understand the phase transitions of the once-reinforced random walk (ORRW) on trees. Strikingly, this number was proved to be equal to the critical parameter of ORRW…
▽ More
The branching-ruin number of a tree, which describes its asymptotic growth and geometry, can be seen as a polynomial version of the branching number. This quantity was defined by Collevecchio, Kious and Sidoravicius (2018) in order to understand the phase transitions of the once-reinforced random walk (ORRW) on trees. Strikingly, this number was proved to be equal to the critical parameter of ORRW on trees. In this paper, we continue the investigation of the link between the branching-ruin number and the criticality of random processes on trees. First, we study random walks on random conductances on trees, when the conductances have an heavy tail at $0$, parametrized by some $p>1$, where $1/p$ is the exponent of the tail. We prove a phase transition recurrence/transience with respect to $p$ and identify the critical parameter to be equal to the branching-ruin number of the tree. Second, we study a multi-excited random walk on trees where each vertex has $M$ cookies and each cookie has an infinite strength towards the root. Here again, we prove a phase transition recurrence/transience and identify the critical number of cookies to be equal to the branching-ruin number of the tree, minus 1. This result extends a conjecture of Volkov (2003). Besides, we study a generalized version of this process and generalize results of Basdevant and Singh (2009).
△ Less
Submitted 19 November, 2018;
originally announced November 2018.
-
Once reinforced random walk on $\mathbb{Z}\times Γ$
Authors:
Daniel Kious,
Bruno Schapira,
Arvind Singh
Abstract:
We revisit an unpublished paper of Vervoort (2002) on the once reinforced random walk, and prove that this process is recurrent on any graph of the form $\mathbb{Z}\times Γ$, with $Γ$ a finite graph, for sufficiently large reinforcement parameter. We also obtain a shape theorem for the set of visited sites, and show that the fluctuations around this shape are of polynomial order. The proof involve…
▽ More
We revisit an unpublished paper of Vervoort (2002) on the once reinforced random walk, and prove that this process is recurrent on any graph of the form $\mathbb{Z}\times Γ$, with $Γ$ a finite graph, for sufficiently large reinforcement parameter. We also obtain a shape theorem for the set of visited sites, and show that the fluctuations around this shape are of polynomial order. The proof involves sharp general estimates on the time spent on subgraphs of the ambiant graph which might be of independent interest.
△ Less
Submitted 18 July, 2018;
originally announced July 2018.
-
Explicit formula for the density of local times of Markov Jump Processes
Authors:
Ruojun Huang,
Daniel Kious,
Vladas Sidoravicius,
Pierre Tarrès
Abstract:
In this note we show a simple formula for the joint density of local times, last exit tree and cycling numbers of continuous-time Markov Chains on finite graphs, which involves the modified Bessel function of the first type.
In this note we show a simple formula for the joint density of local times, last exit tree and cycling numbers of continuous-time Markov Chains on finite graphs, which involves the modified Bessel function of the first type.
△ Less
Submitted 26 March, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
-
The branching-ruin number and the critical parameter of once-reinforced random walk on trees
Authors:
Andrea Collevecchio,
Daniel Kious,
Vladas Sidoravicius
Abstract:
The motivation for this paper is the study of the phase transition for recurrence/transience of a class of self-interacting random walks on trees, which includes the once-reinforced random walk. For this purpose, we define a quantity, that we call the branching-ruin number of a tree, which provides (in the spirit of Furstenberg, 1970, and Lyons, 1990) a natural way to measure trees with polynomial…
▽ More
The motivation for this paper is the study of the phase transition for recurrence/transience of a class of self-interacting random walks on trees, which includes the once-reinforced random walk. For this purpose, we define a quantity, that we call the branching-ruin number of a tree, which provides (in the spirit of Furstenberg, 1970, and Lyons, 1990) a natural way to measure trees with polynomial growth. We prove that the branching-ruin number of a tree is equal to the critical parameter for the recurrence/transience of the once-reinforced random walk. We define a sharp and effective (i.e. computable) criterion characterizing the recurrence/transience of a larger class of self-interacting walks on trees, providing the complete picture for their phase transition.
△ Less
Submitted 17 October, 2018; v1 submitted 2 October, 2017;
originally announced October 2017.
-
On the speed of once-reinforced biased random walk on trees
Authors:
Andrea Collevecchio,
Mark Holmes,
Daniel Kious
Abstract:
We study the asymptotic behaviour of once-reinforced biased random walk (ORbRW) on Galton-Watson trees. Here the underlying (unreinforced) random walk has a bias towards or away from the root. We prove that in the setting of multiplicative once-reinforcement the ORbRW can be recurrent even when the underlying biased random walk is ballistic. We also prove that, on Galton-Watson trees without leave…
▽ More
We study the asymptotic behaviour of once-reinforced biased random walk (ORbRW) on Galton-Watson trees. Here the underlying (unreinforced) random walk has a bias towards or away from the root. We prove that in the setting of multiplicative once-reinforcement the ORbRW can be recurrent even when the underlying biased random walk is ballistic. We also prove that, on Galton-Watson trees without leaves, the speed is positive in the transient regime. Finally, we prove that, on regular trees, the speed of the ORbRW is monotone decreasing in the reinforcement parameter when the underlying random walk has high speed, and the reinforcement parameter is small.
△ Less
Submitted 6 August, 2018; v1 submitted 7 February, 2017;
originally announced February 2017.
-
Phase transition for the Once-reinforced random walk on $\mathbb{Z}^d$-like trees
Authors:
Daniel Kious,
Vladas Sidoravicius
Abstract:
In this short paper, we consider the Once-reinforced random walk with reinforcement parameter $a$ on trees with bounded degree which are transient for the simple random walk. On each of these trees, we prove that there exists an explicit critical parameter $a_0$ such that the Once-reinforced random walk is almost surely recurrent if $a>a_0$ and almost surely transient if $a<a_0$. This provides the…
▽ More
In this short paper, we consider the Once-reinforced random walk with reinforcement parameter $a$ on trees with bounded degree which are transient for the simple random walk. On each of these trees, we prove that there exists an explicit critical parameter $a_0$ such that the Once-reinforced random walk is almost surely recurrent if $a>a_0$ and almost surely transient if $a<a_0$. This provides the first examples of phase transition for the Once-reinforced random walk.
△ Less
Submitted 22 August, 2017; v1 submitted 26 April, 2016;
originally announced April 2016.
-
Scaling limits for sub-ballistic biased random walks in random conductances
Authors:
Alexander Fribergh,
Daniel Kious
Abstract:
We consider biased random walks in positive random conductances on the d-dimensional lattice in the zero-speed regime and study their scaling limits. We obtain a functional Law of Large Numbers for the position of the walker, properly rescaled. Moreover, we state a functional Central Limit Theorem where an atypical process, related to the Fractional Kinetics, appears in the limit.
We consider biased random walks in positive random conductances on the d-dimensional lattice in the zero-speed regime and study their scaling limits. We obtain a functional Law of Large Numbers for the position of the walker, properly rescaled. Moreover, we state a functional Central Limit Theorem where an atypical process, related to the Fractional Kinetics, appears in the limit.
△ Less
Submitted 6 September, 2016; v1 submitted 5 January, 2016;
originally announced January 2016.
-
Reinforcement learning in social networks
Authors:
Daniel Kious,
Pierre Tarrès
Abstract:
We propose a model of network formation based on reinforcement learning, which can be seen as a generalization as the one proposed by Skyrms for signaling games. On a discrete graph, whose vertices represent individuals, at any time step each of them picks one of its neighbors with a probability proportional to their past number of communications; independently, Nature chooses, with an independent…
▽ More
We propose a model of network formation based on reinforcement learning, which can be seen as a generalization as the one proposed by Skyrms for signaling games. On a discrete graph, whose vertices represent individuals, at any time step each of them picks one of its neighbors with a probability proportional to their past number of communications; independently, Nature chooses, with an independent identical distribution in time, which ones are allowed to communicate. Communications occur when any two neighbors mutually pick each other and are both allowed by Nature to communicate.
Our results generalize the ones obtained by Hu, Skyrms and Tarrès (2011). We prove that, up to an error term, the expected rate of communications increases in average, and thus a.s. converges. If we define the limit graph as the non-oriented subgraph on which edges are pairs of vertices communicating with a positive asymptotic rate, then, for stable configurations, within which every vertex is connected to at least another one, the connected components of this limit graph are star-shaped and satisfy a certain balance condition. Conversely, given any stable equilibrium $q$ whose associated graph satisfies that property, the occupation measure converges with positive probability to a stable equilibrium in a neighborhood of $q$ with the same limit graph.
△ Less
Submitted 5 February, 2016; v1 submitted 4 January, 2016;
originally announced January 2016.
-
Local trapping for elliptic random walks in random environments in $\mathbb{Z}^d$
Authors:
Alexander Fribergh,
Daniel Kious
Abstract:
We consider elliptic random walks in i.i.d. random environments on $\mathbb{Z}^d$. The main goal of this paper is to study under which ellipticity conditions local trapping occurs. Our main result is to exhibit an ellipticity criterion for ballistic behavior which extends previously known results. We also show that if the annealed expected exit time of a unit hypercube is infinite then the walk ha…
▽ More
We consider elliptic random walks in i.i.d. random environments on $\mathbb{Z}^d$. The main goal of this paper is to study under which ellipticity conditions local trapping occurs. Our main result is to exhibit an ellipticity criterion for ballistic behavior which extends previously known results. We also show that if the annealed expected exit time of a unit hypercube is infinite then the walk has zero asymptotic velocity.
△ Less
Submitted 29 June, 2015; v1 submitted 8 April, 2014;
originally announced April 2014.
-
Stuck walks: A conjecture of Erschler, Tóth and Werner
Authors:
Daniel Kious
Abstract:
In this paper, we work on a class of self-interacting nearest neighbor random walks, introduced in [Probab. Theory Related Fields 154 (2012) 149-163], for which there is competition between repulsion of neighboring edges and attraction of next-to-neighboring edges. Erschler, Tóth and Werner proved in [Probab. Theory Related Fields 154 (2012) 149-163] that, for any $L\ge1$, if the parameter $α$ bel…
▽ More
In this paper, we work on a class of self-interacting nearest neighbor random walks, introduced in [Probab. Theory Related Fields 154 (2012) 149-163], for which there is competition between repulsion of neighboring edges and attraction of next-to-neighboring edges. Erschler, Tóth and Werner proved in [Probab. Theory Related Fields 154 (2012) 149-163] that, for any $L\ge1$, if the parameter $α$ belongs to a certain interval $(α_{L+1},α_L)$, then such random walks localize on $L+2$ sites with positive probability. They also conjectured that this is the almost sure behavior. We prove this conjecture partially, stating that the walk localizes on $L+2$ or $L+3$ sites almost surely, under the same assumptions. We also prove that, if $α\in(1,+\infty)=(α_2,α_1)$, then the walk localizes a.s. on $3$ sites.
△ Less
Submitted 15 March, 2016; v1 submitted 6 September, 2013;
originally announced September 2013.
