-
Population growth on a time varying network
Authors:
Michel Benaïm,
Claude Lobry,
Tewfik Sari,
Edouard Strickler
Abstract:
We consider a population spreading across a finite number of sites. Individuals can move from one site to the other according to a network (oriented links between the sites) that vary periodically over time. On each site, the population experiences a growth rate which is also periodically time varying. Recently, this kind of models have been extensively studied, using various technical tools to de…
▽ More
We consider a population spreading across a finite number of sites. Individuals can move from one site to the other according to a network (oriented links between the sites) that vary periodically over time. On each site, the population experiences a growth rate which is also periodically time varying. Recently, this kind of models have been extensively studied, using various technical tools to derive precise necessary and sufficient conditions on the parameters of the system (ie the local growth rate on each site, the time period and the strength of migration between the sites) for the population to grow. In the present paper, we take a completely different approach: using elementary comparison results between linear systems, we give sufficient condition for the growth of the population This condition is easy to check and can be applied in a broad class of examples. In particular, in the case when all sites are sinks (ie, in the absence of migration, the population become extinct in each site), we prove that when our condition of growth if satisfied, the population grows when the time period is large and for values of the migration strength that are exponentially small with respect to the time period, which answers positively to a conjecture stated by Katriel.
△ Less
Submitted 12 November, 2024;
originally announced November 2024.
-
Dispersal-induced growth or decay in a time-periodic environment. The case of reducible migration matrices
Authors:
Michel Benaim,
Claude Lobry,
Tewfik Sari,
Edouard Strickler
Abstract:
This paper is a follow-up to a previous work where we considered populations with time-varying growth rates living in patches and irreducible migration matrix between the patches. Each population, when isolated, would become extinct. Dispersal-induced growth (DIG) occurs when the populations are able to persist and grow exponentially when dispersal among the populations is present. In this paper,…
▽ More
This paper is a follow-up to a previous work where we considered populations with time-varying growth rates living in patches and irreducible migration matrix between the patches. Each population, when isolated, would become extinct. Dispersal-induced growth (DIG) occurs when the populations are able to persist and grow exponentially when dispersal among the populations is present. In this paper, we consider the situation where the migration matrix is not necessarily irreducible. We provide a mathematical analysis of the DIG phenomenon, in the context of a deterministic model with periodic variation of growth rates and migration. Our results apply in the case, important for applications, where there is migration in one direction in one season and in the other direction in another season. We also consider dispersal-induced decay (DID), where each population, when isolated, grows exponentially, while populations die out when dispersal between populations is present.
△ Less
Submitted 10 June, 2025; v1 submitted 10 July, 2024;
originally announced July 2024.
-
Regularity of invariant densities for random switching between two linear odes in Rd
Authors:
Michel Benaim,
Améthyste Bichard
Abstract:
In a paper entitled singularities of invariant densities for random switching between two linear odes in 2D, Bakhtin et al [5], consider a Markov process obtained by random switching between two stable linear vector fields in the plane and characterize the singularities of the invariant density in terms of the switching and contraction rates. This paper considers a generalization of this model obt…
▽ More
In a paper entitled singularities of invariant densities for random switching between two linear odes in 2D, Bakhtin et al [5], consider a Markov process obtained by random switching between two stable linear vector fields in the plane and characterize the singularities of the invariant density in terms of the switching and contraction rates. This paper considers a generalization of this model obtained by random switching between two stable linear vector fields in Rd and provides sufficient conditions ensuring that the invariant distribution is absolutely continuous and has a Cr density. In dimension greater than 3 it provides, to the best of our knowledge, the first fully non-elliptic example of random switching for which quantitative conditions guaranteeing smoothness of the invariant density can be proved.
△ Less
Submitted 18 July, 2024; v1 submitted 25 June, 2024;
originally announced June 2024.
-
The asymptotic behavior of fraudulent algorithms
Authors:
Michel Benaïm,
Laurent Miclo
Abstract:
Let $U$ be a Morse function on a compact connected $m$-dimensional Riemannian manifold, $m \geq 2,$ satisfying $\min U=0$ and let $\mathcal{U} = \{x \in M \: : U(x) = 0\}$ be the set of global minimizers. Consider the stochastic algorithm $X^{(β)}:=(X^{(β)}(t))_{t\geq 0}$ defined on $N = M \setminus \mathcal{U},$ whose generator is$U Δ\cdot-β\langle \nabla U,\nabla \cdot\rangle$, where…
▽ More
Let $U$ be a Morse function on a compact connected $m$-dimensional Riemannian manifold, $m \geq 2,$ satisfying $\min U=0$ and let $\mathcal{U} = \{x \in M \: : U(x) = 0\}$ be the set of global minimizers. Consider the stochastic algorithm $X^{(β)}:=(X^{(β)}(t))_{t\geq 0}$ defined on $N = M \setminus \mathcal{U},$ whose generator is$U Δ\cdot-β\langle \nabla U,\nabla \cdot\rangle$, where $β\in\RR$ is a real parameter.We show that for $β>\frac{m}{2}-1,$ $X^{(β)}(t)$ converges a.s.\ as $t \rightarrow \infty$, toward a point $p \in \mathcal{U}$ and that each $p \in \mathcal{U}$ has a positive probability to be selected. On the other hand, for $β< \frac{m}{2}-1,$ the law of $(X^{(β)}(t))$ converges in total variation (at an exponential rate) toward the probability measure $π_β$ having density proportional to $U(x)^{-1-β}$ with respect to the Riemannian measure.
△ Less
Submitted 23 January, 2024;
originally announced January 2024.
-
When can a population spreading across sink habitats persist ?
Authors:
Michel Benaim,
Claude Lobry,
Tewfik Sari,
Edouard Strickler
Abstract:
We consider populations with time-varying growth rates living in sinks. Each population, when isolated, would become extinct. Dispersal-induced growth (DIG) occurs when the populations are able to persist and grow exponentially when dispersal among the populations is present. We provide a mathematical analysis of this surprising phenomenon, in the context of a deterministic model with periodic var…
▽ More
We consider populations with time-varying growth rates living in sinks. Each population, when isolated, would become extinct. Dispersal-induced growth (DIG) occurs when the populations are able to persist and grow exponentially when dispersal among the populations is present. We provide a mathematical analysis of this surprising phenomenon, in the context of a deterministic model with periodic variation of growth rates and non-symmetric migration which are assumed to be piecewise continuous. We also consider a stochastic model with random variation of growth rates and migration. This work extends existing results of the literature on the DIG effects obtained for periodic continuous growth rates and time independent symmetric migration.
△ Less
Submitted 9 November, 2023; v1 submitted 8 November, 2023;
originally announced November 2023.
-
On invariant distributions of Feller Markov chains with applications to dynamical systems with random switching
Authors:
Michel Benaïm,
Oliver Tough
Abstract:
We introduce simple conditions ensuring that invariant distributions of a Feller Markov chain on a compact Riemannian manifold are absolutely continuous with a lower semi-continuous, continuous or smooth density with respect to the Riemannian measure. This is applied to Markov chains obtained by random composition of maps and to piecewise deterministic Markov processes obtained by random switching…
▽ More
We introduce simple conditions ensuring that invariant distributions of a Feller Markov chain on a compact Riemannian manifold are absolutely continuous with a lower semi-continuous, continuous or smooth density with respect to the Riemannian measure. This is applied to Markov chains obtained by random composition of maps and to piecewise deterministic Markov processes obtained by random switching between flows.
△ Less
Submitted 24 October, 2024; v1 submitted 26 October, 2023;
originally announced October 2023.
-
A note on the top Lyapunov exponent of linear cooperative systems
Authors:
Michel Benaïm,
Claude Lobry,
Tewfik Sari,
Édouard Strickler
Abstract:
In a recent paper [Asymptotic of the largest Floquet multiplier for cooperative matrices Annales de la Faculté des Sciences de Toulouse, Tome XXXI, no 4 (2022)] P. Carmona gives an asymptotic formulae for the top Lyapunov exponent of a linear T-periodic cooperative differential equation, in the limit T goes to infinity. This short note discusses and extends this result.
In a recent paper [Asymptotic of the largest Floquet multiplier for cooperative matrices Annales de la Faculté des Sciences de Toulouse, Tome XXXI, no 4 (2022)] P. Carmona gives an asymptotic formulae for the top Lyapunov exponent of a linear T-periodic cooperative differential equation, in the limit T goes to infinity. This short note discusses and extends this result.
△ Less
Submitted 24 October, 2023; v1 submitted 12 February, 2023;
originally announced February 2023.
-
Regularity of the stationary density for systems with fast random switching
Authors:
Michel Benaïm,
Oliver Tough
Abstract:
We consider the piecewise-deterministic Markov process obtained by randomly switching between the flows generated by a finite set of smooth vector fields on a compact set. We obtain Hörmander-type conditions on the vector fields guaranteeing that the stationary density is: $C^k$ whenever the jump rates are sufficiently fast, for any $k<\infty$; unbounded whenever the jump rates are sufficiently sl…
▽ More
We consider the piecewise-deterministic Markov process obtained by randomly switching between the flows generated by a finite set of smooth vector fields on a compact set. We obtain Hörmander-type conditions on the vector fields guaranteeing that the stationary density is: $C^k$ whenever the jump rates are sufficiently fast, for any $k<\infty$; unbounded whenever the jump rates are sufficiently slow and lower semi-continuous regardless of the jump rates. Our proofs are probabilistic, relying on a novel application of stopping times.
△ Less
Submitted 12 February, 2023; v1 submitted 7 December, 2022;
originally announced December 2022.
-
Transcritical bifurcation for the conditional distribution of a diffusion process
Authors:
Michel Benaïm,
Nicolas Champagnat,
William Oçafrain,
Denis Villemonais
Abstract:
In this article, we describe a simple class of models of absorbed diffusion processes with parameter, whose conditional law exhibits a transcritical bifurcation. Our proofs are based on the description of the set of quasi-stationary distributions for general two-clusters reducible processes.
In this article, we describe a simple class of models of absorbed diffusion processes with parameter, whose conditional law exhibits a transcritical bifurcation. Our proofs are based on the description of the set of quasi-stationary distributions for general two-clusters reducible processes.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
Untangling the role of temporal and spatial variations in persistance of populations
Authors:
Michel Benaïm,
Claude Lobry,
Tewfik Sari,
Edouard Strickler
Abstract:
We consider a population distributed between two habitats, in each of which it experiences a growth rate that switches periodically between two values, $1- \varepsilon > 0$ or $ - (1 + \varepsilon) < 0$. We study the specific case where the growth rate is positive in one habitat and negative in the other one for the first half of the period, and conversely for the second half of the period, that w…
▽ More
We consider a population distributed between two habitats, in each of which it experiences a growth rate that switches periodically between two values, $1- \varepsilon > 0$ or $ - (1 + \varepsilon) < 0$. We study the specific case where the growth rate is positive in one habitat and negative in the other one for the first half of the period, and conversely for the second half of the period, that we refer as the $(\pm 1)$ model. In the absence of migration, the population goes to $0$ exponentially fast in each environment. In this paper, we show that, when the period is sufficiently large, a small dispersal between the two patches is able to produce a very high positive exponential growth rate for the whole population, a phenomena called inflation. We prove in particular that the threshold of the dispersal rate at which the inflation appears is exponentially small with the period. We show that inflation is robust to random perturbation, by considering a model where the values of the growth rate in each patch are switched at random times: we prove, using theory of Piecewise Deterministic Markov Processes (PDMP) that inflation occurs for low switching rate and small dispersal. Finally, we provide some extensions to more complicated models, especially epidemiological and density dependent models.
△ Less
Submitted 3 July, 2023; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Degenerate processes killed at the boundary of a domain
Authors:
Michel Benaïm,
Nicolas Champagnat,
William Oçafrain,
Denis Villemonais
Abstract:
We investigate certain properties of degenerate Feller processes that are killed when exiting a relatively compact set. Our main result provides general conditions ensuring that such a process possesses a (possibly non unique) quasi stationary distribution. Conditions ensuring uniqueness and exponential convergence are discussed. The results are applied to nonelliptic and hypoelliptic stochastic d…
▽ More
We investigate certain properties of degenerate Feller processes that are killed when exiting a relatively compact set. Our main result provides general conditions ensuring that such a process possesses a (possibly non unique) quasi stationary distribution. Conditions ensuring uniqueness and exponential convergence are discussed. The results are applied to nonelliptic and hypoelliptic stochastic differential equations.
△ Less
Submitted 20 August, 2024; v1 submitted 15 March, 2021;
originally announced March 2021.
-
Stochastic persistence in degenerate stochastic Lotka-Volterra food chains
Authors:
Michel Benaïm,
Antoine Bourquin,
Dang H. Nguyen
Abstract:
We consider a Lotka-Volterra food chain model with possibly intra-specific competition in a stochastic environment represented by stochastic differential equations. In the non-degenerate setting, this model has already been studied by A. Hening and D. Nguyen. They provided conditions for stochastic persistence and extinction. In this paper, we extend their results to the degenerate situation in wh…
▽ More
We consider a Lotka-Volterra food chain model with possibly intra-specific competition in a stochastic environment represented by stochastic differential equations. In the non-degenerate setting, this model has already been studied by A. Hening and D. Nguyen. They provided conditions for stochastic persistence and extinction. In this paper, we extend their results to the degenerate situation in which the top or the bottom species is subject to random perturbations. Under the persistence condition, there exists a unique invariant probability measure supported by the interior of $\mathbb{R}_+^n$ having a smooth density.
Moreover, we study a more general model, in which we give new conditions which make it possible to characterise the convergence of the semi-group towards the unique invariant probability measure either at an exponential rate or at a polynomial one. This will be used in the stochastic Lotka-Volterra food chain to see that if intra-specific competition occurs for all species, the rate of convergence is exponential while in the other cases it is polynomial.
△ Less
Submitted 17 November, 2021; v1 submitted 2 December, 2020;
originally announced December 2020.
-
Analysis of an Adaptive Biasing Force method based on self-interacting dynamics
Authors:
Michel Benaïm,
Charles-Edouard Bréhier,
Pierre Monmarché
Abstract:
This article fills a gap in the mathematical analysis of Adaptive Biasing algorithms, which are extensively used in molecular dynamics computations. Given a reaction coordinate, ideally, the bias in the overdamped Langevin dynamics would be given by the gradient of the associated free energy function, which is unknown. We consider an adaptive biased version of the overdamped dynamics, where the bi…
▽ More
This article fills a gap in the mathematical analysis of Adaptive Biasing algorithms, which are extensively used in molecular dynamics computations. Given a reaction coordinate, ideally, the bias in the overdamped Langevin dynamics would be given by the gradient of the associated free energy function, which is unknown. We consider an adaptive biased version of the overdamped dynamics, where the bias depends on the past of the trajectory and is designed to approximate the free energy.
The main result of this article is the consistency and efficiency of this approach. More precisely we prove the almost sure convergence of the bias as time goes to infinity, and that the limit is close to the ideal bias, as an auxiliary parameter of the algorithm goes to $0$.
The proof is based on interpreting the process as a self-interacting dynamics, and on the study of a non-trivial fixed point problem for the limiting flow obtained using the ODE method.
△ Less
Submitted 10 October, 2019;
originally announced October 2019.
-
Stochastic approximation of quasi-stationary distributions for diffusion processes in a bounded domain
Authors:
Michel Benaïm,
Nicolas Champagnat,
Denis Villemonais
Abstract:
We study a random process with reinforcement, which evolves following the dynamics of a given diffusion process in a bounded domain and is resampled according to its occupation measure when it reaches the boundary. We show that its occupation measure converges to the unique quasi-stationary distribution of the diffusion process absorbed at the boundary of the domain. Our proofs use recent results…
▽ More
We study a random process with reinforcement, which evolves following the dynamics of a given diffusion process in a bounded domain and is resampled according to its occupation measure when it reaches the boundary. We show that its occupation measure converges to the unique quasi-stationary distribution of the diffusion process absorbed at the boundary of the domain. Our proofs use recent results in the theory of quasi-stationary distributions and stochastic approximation techniques.
△ Less
Submitted 15 February, 2021; v1 submitted 18 April, 2019;
originally announced April 2019.
-
Persistence and extinction for stochastic ecological models with internal and external variables
Authors:
Michel Benaïm,
Sebastian J. Schreiber
Abstract:
The dynamics of species' densities depend both on internal and external variables. Internal variables include frequencies of individuals exhibiting different phenotypes or living in different spatial locations. External variables include abiotic factors or non-focal species. These internal or external variables may fluctuate due to stochastic fluctuations in environmental conditions. We prove theo…
▽ More
The dynamics of species' densities depend both on internal and external variables. Internal variables include frequencies of individuals exhibiting different phenotypes or living in different spatial locations. External variables include abiotic factors or non-focal species. These internal or external variables may fluctuate due to stochastic fluctuations in environmental conditions. We prove theorems for stochastic persistence and exclusion for stochastic ecological difference equations accounting for internal and external variables. Specifically, we use a stochastic analog of average Lyapunov functions to develop sufficient and necessary conditions for (i) all population densities spending little time at low densities, and (ii) population trajectories asymptotically approaching the extinction set with positive probability. For (i) and (ii), respectively, we provide quantitative estimates on the fraction of time that the system is near the extinction set, and the probability of asymptotic extinction as a function of the initial state of the system. Furthermore, we provide lower bounds for the expected time to escape neighborhoods of the extinction set. To illustrate the applicability of our results, we analyze stochastic models of evolutionary games, Lotka-Volterra dynamics, trait evolution, and spatially structured disease dynamics. Our analysis of these models demonstrates environmental stochasticity facilitates coexistence of strategies in the hawk-dove game, but inhibits coexistence in the rock-paper-scissors game and a Lotka-Volterra predator-prey model. Furthermore, environmental fluctuations with positive auto-correlations can promote persistence of evolving populations and persistence of diseases in patchy landscapes. While our results help close the gap between the persistence theories for deterministic and stochastic systems, we highlight challenges for future research.
△ Less
Submitted 26 March, 2019; v1 submitted 23 August, 2018;
originally announced August 2018.
-
Stochastic Persistence
Authors:
Michel Benaim
Abstract:
Let $(X_t)_{t \geq 0}$ be a continuous time Markov process on some metric space $M,$ leaving invariant a closed subset $M_0 \subset M,$ called the {\em extinction set}. We give general conditions ensuring either "Stochastic persistence" (Part I) : Limit points of the occupation measure are invariant probabilities over $M_+ = M \setminus M_0;$ or "Extinction" (Part II) : $X_t \rightarrow M_0$ a.s.…
▽ More
Let $(X_t)_{t \geq 0}$ be a continuous time Markov process on some metric space $M,$ leaving invariant a closed subset $M_0 \subset M,$ called the {\em extinction set}. We give general conditions ensuring either "Stochastic persistence" (Part I) : Limit points of the occupation measure are invariant probabilities over $M_+ = M \setminus M_0;$ or "Extinction" (Part II) : $X_t \rightarrow M_0$ a.s. In the persistence case we also discuss conditions ensuring the a.s convergence (respectively exponential convergence in total variation) of the occupation measure (respectively the distribution) of $(X_t)$ toward a unique probability on $M_+.$ These results extend and generalize previous results obtained for various stochastic models in population dynamics, given by stochastic differential equations, random differential equations, or pure jump processes.
△ Less
Submitted 25 October, 2023; v1 submitted 21 June, 2018;
originally announced June 2018.
-
A user-friendly condition for exponential ergodicity in randomly switched environments
Authors:
Michel Benaïm,
Tobias Hurth,
Edouard Strickler
Abstract:
We consider random switching between finitely many vector fields leaving positively invariant a compact set. Recently, Li, Liu and Cui showed that if one the vector fields has a globally asymptotically stable (G.A.S.) equilibrium from which one can reach a point satisfying a weak Hörmander-bracket condition, then the process converges in total variation to a unique invariant probability measure. I…
▽ More
We consider random switching between finitely many vector fields leaving positively invariant a compact set. Recently, Li, Liu and Cui showed that if one the vector fields has a globally asymptotically stable (G.A.S.) equilibrium from which one can reach a point satisfying a weak Hörmander-bracket condition, then the process converges in total variation to a unique invariant probability measure. In this note, adapting the proof of Li, Liu and Cui and using results of Benaïm, Le Borgne, Malrieu and Zitt, the assumption of a G.A.S. equilibrium is weakened to the existence of an accessible point at which a barycentric combination of the vector fields vanishes. Some examples are given which demonstrate the usefulness of this condition.
△ Less
Submitted 30 June, 2018; v1 submitted 9 March, 2018;
originally announced March 2018.
-
Convergence analysis of Adaptive Biasing Potential methods for diffusion processes
Authors:
Michel Benaïm,
Charles-Edouard Bréhier
Abstract:
This article is concerned with the mathematical analysis of a family of adaptive importance sampling algorithms applied to diffusion processes. These methods, referred to as Adaptive Biasing Potential methods, are designed to efficiently sample the invariant distribution of the diffusion process, thanks to the approximation of the associated free energy function (relative to a reaction coordinate)…
▽ More
This article is concerned with the mathematical analysis of a family of adaptive importance sampling algorithms applied to diffusion processes. These methods, referred to as Adaptive Biasing Potential methods, are designed to efficiently sample the invariant distribution of the diffusion process, thanks to the approximation of the associated free energy function (relative to a reaction coordinate). The bias which is introduced in the dynamics is computed adaptively; it depends on the past of the trajectory of the process through some time-averages.
We give a detailed and general construction of such methods. We prove the consistency of the approach (almost sure convergence of well-chosen weighted empirical probability distribution). We justify the efficiency thanks to several qualitative and quantitative additional arguments. To prove these results , we revisit and extend tools from stochastic approximation applied to self-interacting diffusions, in an original context.
△ Less
Submitted 9 May, 2018; v1 submitted 16 July, 2017;
originally announced July 2017.
-
Random Switching between Vector Fields Having a Common Zero
Authors:
Michel Benaïm,
Edouard Strickler
Abstract:
Let $E$ be a finite set, $\{F^i\}_{i \in E}$ a family of vector fields on $\mathbb{R}^d$ leaving positively invariant a compact set $M$ and having a common zero $p \in M.$ We consider a piecewise deterministic Markov process $(X,I)$ on $M \times E$ defined by $\dot{X}_t = F^{I_t}(X_t)$ where $I$ is a jump process controlled by $X:$…
▽ More
Let $E$ be a finite set, $\{F^i\}_{i \in E}$ a family of vector fields on $\mathbb{R}^d$ leaving positively invariant a compact set $M$ and having a common zero $p \in M.$ We consider a piecewise deterministic Markov process $(X,I)$ on $M \times E$ defined by $\dot{X}_t = F^{I_t}(X_t)$ where $I$ is a jump process controlled by $X:$ $\Pr(I_{t+s} = j | (X_u, I_u)_{u \leq t}) = a_{i j}(X_t) s + o(s)$ for $i \neq j$ on $\{I_t = i \}.$
We show that the behavior of $(X,I)$ is mainly determined by the behavior of the linearized process $(Y,J)$ where $\dot{Y}_t = A^{J_t} Y_t,$ $A^i$ is the Jacobian matrix of $F^i$ at $p$ and $J$ is the jump process with rates $(a_{ij}(p)).$
We introduce two quantities $Λ^-$ and $Λ^+$ respectively %called the {\em minimal} and {\em maximal average growth rate.} $Λ^-$ (respectively $Λ^+$) is defined as the {\em minimal} (respectively {\em maximal}) {\em growth rate} of $\|Y_t\|,$ where the minimum (respectively maximum) is taken over all the ergodic measures of the angular process $(Θ, J)$ with $Θ_t = \frac{Y_t}{\|Y_t\|}.$ It is shown that $Λ^+$ coincides with the top Lyapunov exponent (in the sense of ergodic theory) of $(Y,J)$ and that under general assumptions $Λ^- = Λ^+.$ We then prove that, under certain irreducibility conditions, $X_t \to p$ exponentially fast when $Λ^+ < 0$ and $(X,I)$ converges in distribution at an exponential rate toward a (unique) invariant measure supported by $M \setminus \{p\} \times E$ when $Λ^- > 0.$ Some applications to certain epidemic models in a fluctuating environment are discussed and illustrate our results.
△ Less
Submitted 2 July, 2018; v1 submitted 10 February, 2017;
originally announced February 2017.
-
On strict convergence of stochastic gradients
Authors:
Michel Benaim
Abstract:
We discuss conditions ensuring the (strict) convergence of stochastic gradient algorithms.
We discuss conditions ensuring the (strict) convergence of stochastic gradient algorithms.
△ Less
Submitted 11 October, 2016;
originally announced October 2016.
-
Stochastic approximation of quasi-stationary distributions on compact spaces and applications
Authors:
Michel Benaim,
Bertrand Cloez,
Fabien Panloup
Abstract:
In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to t…
▽ More
In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact metric space killed in finite time. The idea is to run the process until extinction and then to bring it back to life at a position randomly chosen according to the (possibly weighted) empirical occupation measure of its past positions. General conditions are given ensuring the convergence of this measure to the quasi-stationary distribution of the chain. We then apply this method to the numerical approximation of the quasi-stationary distribution of a diffusion process killed on the boundary of a compact set and to the estimation of the spectral gap of irreducible Markov processes. Finally, the sharpness of the assumptions is illustrated through the study of the algorithm in a non-irreducible setting.
△ Less
Submitted 13 November, 2017; v1 submitted 21 June, 2016;
originally announced June 2016.
-
Generic Behaviour of Strongly Reinforced Polya Urns : Convergence and Stability
Authors:
Arnab Basu,
Michel Benaim
Abstract:
We consider, as proposed and studied in Hofstad et.\ al.\ \cite{HHKR}, a class of graph-based "interacting urn"-type Polya urn model inspired by neuronal processing in the brain where a signal enters the brain at some (randomly) chosen neuron and is transmitted to a (random) single neighbouring neuron with a probability depending on the relative `efficiency' of the synapses connecting the neurons,…
▽ More
We consider, as proposed and studied in Hofstad et.\ al.\ \cite{HHKR}, a class of graph-based "interacting urn"-type Polya urn model inspired by neuronal processing in the brain where a signal enters the brain at some (randomly) chosen neuron and is transmitted to a (random) single neighbouring neuron with a probability depending on the relative `efficiency' of the synapses connecting the neurons, and in doing so the efficiency of the utilized synapse is improved/reinforced. We study the structures (or architectures) and relative efficiency of the neuronal networks that can arise from repeating this process a very large number of times in a "strong reinforcement regime". Under the most general conditions, we prove in the affirmative a part of the main open conjecture in \cite{HHKR} i.e. the zero probability of convergence of the corresponding "urn process" to any 'unstable' equilibrium. Under very generic conditions, i.e., for an open and dense subset of parameters with full measure, we also prove the full open conjecture by showing the finiteness of the equilibrium set and hence the unit probability of convergence of the "urn process" to some 'stable' equilibrium.
△ Less
Submitted 23 June, 2016; v1 submitted 14 June, 2016;
originally announced June 2016.
-
Supports of Invariant Measures for Piecewise Deterministic Markov Processes
Authors:
Michel Benaïm,
Fritz Colonius,
Lettau Ralph
Abstract:
For a class of piecewise deterministic Markov processes, the supports of the invariant measures are characterized. This is based on the analysis of controllability properties of an associated deterministic control system. Its invariant control sets determine the supports.
For a class of piecewise deterministic Markov processes, the supports of the invariant measures are characterized. This is based on the analysis of controllability properties of an associated deterministic control system. Its invariant control sets determine the supports.
△ Less
Submitted 22 June, 2017; v1 submitted 21 April, 2016;
originally announced April 2016.
-
Convergence of Adaptive Biasing Potential methods for diffusions
Authors:
Michel Benaïm,
Charles-Edouard Bréhier
Abstract:
We prove the consistency of an adaptive importance sampling strategy based on biasing the potential energy function $V$ of a diffusion process $dX_t^0=-\nabla V(X_t^0)dt+dW_t$; for the sake of simplicity, periodic boundary conditions are assumed, so that $X_t^0$ lives on the flat $d$-dimensional torus. The goal is to sample its invariant distribution $μ=Z^{-1}\exp\bigl(-V(x)\bigr)\,dx$. The bias…
▽ More
We prove the consistency of an adaptive importance sampling strategy based on biasing the potential energy function $V$ of a diffusion process $dX_t^0=-\nabla V(X_t^0)dt+dW_t$; for the sake of simplicity, periodic boundary conditions are assumed, so that $X_t^0$ lives on the flat $d$-dimensional torus. The goal is to sample its invariant distribution $μ=Z^{-1}\exp\bigl(-V(x)\bigr)\,dx$. The bias $V_t-V$, where $V_t$ is the new (random and time-dependent) potential function, acts only on some coordinates of the system, and is designed to flatten the corresponding empirical occupation measure of the diffusion $X$ in the large time regime.
The diffusion process writes $dX_t=-\nabla V_t(X_t)dt+dW_t$, where the bias $V_t-V$ is function of the key quantity $\overlineμ_t$: a probability occupation measure which depends on the past of the process, {\it i.e.} on $(X_s)_{s\in [0,t]}$. We are thus dealing with a self-interacting diffusion.
In this note, we prove that when $t$ goes to infinity, $\overlineμ_t$ almost surely converges to $μ$. Moreover, the approach is justified by the convergence of the bias to a limit which has an intepretation in terms of a free energy.
The main argument is a change of variables, which formally validates the consistency of the approach. The convergence is then rigorously proven adapting the ODE method from stochastic approximation.
△ Less
Submitted 26 March, 2016;
originally announced March 2016.
-
Ergodicity of inhomogeneous Markov chains through asymptotic pseudotrajectories
Authors:
Michel Benaïm,
Florian Bouguet,
Bertrand Cloez
Abstract:
In this work, we consider an inhomogeneous (discrete time) Markov chain and are interested in its long time behavior. We provide sufficient conditions to ensure that some of its asymptotic properties can be related to the ones of a homogeneous (continuous time) Markov process. Renowned examples such as a bandit algorithms, weighted random walks or decreasing step Euler schemes are included in our…
▽ More
In this work, we consider an inhomogeneous (discrete time) Markov chain and are interested in its long time behavior. We provide sufficient conditions to ensure that some of its asymptotic properties can be related to the ones of a homogeneous (continuous time) Markov process. Renowned examples such as a bandit algorithms, weighted random walks or decreasing step Euler schemes are included in our framework. Our results are related to functional limit theorems, but the approach differs from the standard "Tightness/Identification" argument; our method is unified and based on the notion of pseudotrajectories on the space of probability measures.
△ Less
Submitted 30 January, 2017; v1 submitted 23 January, 2016;
originally announced January 2016.
-
Self-repelling diffusions on a Riemannian manifold
Authors:
Michel Benaïm,
Carl-Erik Gauthier
Abstract:
Let M be a compact connected oriented Riemannian manifold. The purpose of this paper is to investigate the long time behavior of a degenerate stochastic differential equation on the state space $M\times \mathbb{R}^{n}$; which is obtained via a natural change of variable from a self-repelling diffusion taking the form $$dX_{t}= σdB_{t}(X_t) -\int_{0}^{t}\nabla V_{X_s}(X_{t})dsdt,\qquad X_{0}=x$$ wh…
▽ More
Let M be a compact connected oriented Riemannian manifold. The purpose of this paper is to investigate the long time behavior of a degenerate stochastic differential equation on the state space $M\times \mathbb{R}^{n}$; which is obtained via a natural change of variable from a self-repelling diffusion taking the form $$dX_{t}= σdB_{t}(X_t) -\int_{0}^{t}\nabla V_{X_s}(X_{t})dsdt,\qquad X_{0}=x$$ where $\{B_t\}$ is a Brownian vector field on $M$, $σ>0$ and $V_x(y) = V(x,y)$ is a diagonal Mercer kernel.
We prove that the induced semi-group enjoys the strong Feller property and has a unique invariant probability $μ$ given as the product of the normalized Riemannian measure on M and a Gaussian measure on $\mathbb{R}^{n}$. We then prove an exponential decay to this invariant probability in $L^{2}(μ)$ and in total variation.
△ Less
Submitted 27 April, 2016; v1 submitted 21 May, 2015;
originally announced May 2015.
-
Smale Strategies for Network Prisoner's Dilemma Games
Authors:
Kashi Behrstock,
Michel Benaïm,
Morris W. Hirsch
Abstract:
Smale's approach \cite{Smale80} to the classical two-players repeated Prisoner's Dilemma game is revisited here for $N$-players and Network games in the framework of Blackwell's approachability, stochastic approximations and differential inclusions.
Smale's approach \cite{Smale80} to the classical two-players repeated Prisoner's Dilemma game is revisited here for $N$-players and Network games in the framework of Blackwell's approachability, stochastic approximations and differential inclusions.
△ Less
Submitted 29 March, 2015;
originally announced March 2015.
-
Lotka Volterra in fluctuating environment or "how switching between beneficial environments can make survival harder"
Authors:
Michel Benaïm,
Claude Lobry
Abstract:
We consider two dimensional Lotka-Volterra systems in fluctuating environment. Relying on recent results on stochastic persistence and piecewise deterministic Markov processes, we show that random switching between two environments both favorable to the same species can lead to the extinction of this species or coexistence of the species.
We consider two dimensional Lotka-Volterra systems in fluctuating environment. Relying on recent results on stochastic persistence and piecewise deterministic Markov processes, we show that random switching between two environments both favorable to the same species can lead to the extinction of this species or coexistence of the species.
△ Less
Submitted 9 February, 2016; v1 submitted 2 December, 2014;
originally announced December 2014.
-
On Gradient like Properties of Population games, Learning models and Self Reinforced Processes
Authors:
Michel Benaim
Abstract:
We consider ordinary differential equations on the unit simplex of $\RR^n$ that naturally occur in population games, models of learning and self reinforced random processes. Generalizing and relying on an idea introduced in \cite{DF11}, we provide conditions ensuring that these dynamics are gradient like and satisfy a suitable "angle condition". This is used to prove that omega limit sets and chai…
▽ More
We consider ordinary differential equations on the unit simplex of $\RR^n$ that naturally occur in population games, models of learning and self reinforced random processes. Generalizing and relying on an idea introduced in \cite{DF11}, we provide conditions ensuring that these dynamics are gradient like and satisfy a suitable "angle condition". This is used to prove that omega limit sets and chain transitive sets (under certain smoothness assumptions) consist of equilibria; and that, in the real analytic case, every trajectory converges toward an equilibrium. In the reversible case, the dynamics are shown to be $C^1$ close to a gradient vector field. Properties of equilibria -with a special emphasis on potential games - and structural stability questions are also considered.
△ Less
Submitted 18 September, 2014; v1 submitted 14 September, 2014;
originally announced September 2014.
-
Self-repelling diffusions via an infinite dimensional approach
Authors:
Michel Benaim,
Ioana Ciotir,
Carl-Erik Gauthier
Abstract:
In the present work we study self-interacting diffusions following an infinite dimensional approach. First we prove existence and uniqueness of a solution with Markov property. Then we study the corresponding transition semigroup and, more precisely, we prove that it has Feller property and we give an explicit form of an invariant probability of the system.
In the present work we study self-interacting diffusions following an infinite dimensional approach. First we prove existence and uniqueness of a solution with Markov property. Then we study the corresponding transition semigroup and, more precisely, we prove that it has Feller property and we give an explicit form of an invariant probability of the system.
△ Less
Submitted 28 August, 2015; v1 submitted 27 August, 2014;
originally announced August 2014.
-
A stochastic approximation approach to quasi-stationary distributions on finite spaces
Authors:
Michel Benaïm,
Bertrand Cloez
Abstract:
This work is concerned with the analysis of a stochastic approximation algorithm for the simulation of quasi-stationary distributions on finite state spaces. This is a generalization of a method introduced by Aldous, Flannery and Palacios. It is shown that the asymptotic behavior of the empirical occupation measure of this process is precisely related to the asymptotic behavior of some determinist…
▽ More
This work is concerned with the analysis of a stochastic approximation algorithm for the simulation of quasi-stationary distributions on finite state spaces. This is a generalization of a method introduced by Aldous, Flannery and Palacios. It is shown that the asymptotic behavior of the empirical occupation measure of this process is precisely related to the asymptotic behavior of some deterministic dynamical system induced by a vector field on the unit simplex. This approach provides new proof of convergence as well as precise rates for this type of algorithm. We then compare this algorithm with particle system algorithms.
△ Less
Submitted 22 May, 2015; v1 submitted 2 May, 2014;
originally announced May 2014.
-
A generalized Polya's urn with graph based interactions
Authors:
Michel Benaim,
Itai Benjamini,
Jun Chen,
Yuri Lima
Abstract:
Given a finite connected graph G, place a bin at each vertex. Two bins are called a pair if they share an edge of G. At discrete times, a ball is added to each pair of bins. In a pair of bins, one of the bins gets the ball with probability proportional to its current number of balls raised by some fixed power a>0. We characterize the limiting behavior of the proportion of balls in the bins.
The…
▽ More
Given a finite connected graph G, place a bin at each vertex. Two bins are called a pair if they share an edge of G. At discrete times, a ball is added to each pair of bins. In a pair of bins, one of the bins gets the ball with probability proportional to its current number of balls raised by some fixed power a>0. We characterize the limiting behavior of the proportion of balls in the bins.
The proof uses a dynamical approach to relate the proportion of balls to a vector field. Our main result is that the limit set of the proportion of balls is contained in the equilibria set of the vector field. We also prove that if a<1 then there is a single point v=v(G,a) with nonzero entries such that the proportion converges to v almost surely.
A special case is when G is regular and a is at most 1. We show e.g. that if G is non-bipartite then the proportion of balls in the bins converges to the uniform measure almost surely.
△ Less
Submitted 23 September, 2013; v1 submitted 6 November, 2012;
originally announced November 2012.
-
Strongly Vertex-Reinforced-Random-Walk on the complete graph
Authors:
Michel Benaïm,
Olivier Raimond,
Bruno Schapira
Abstract:
We study Vertex-Reinforced-Random-Walk on the complete graph with weights of the form $w(n)=n^α$, with $α>1$. Unlike for the Edge-Reinforced-Random-Walk, which in this case localizes a.s. on 2 sites, here we observe various phase transitions, and in particular localization on arbitrary large sets is possible, provided $α$ is close enough to 1. Our proof relies on stochastic approximation technique…
▽ More
We study Vertex-Reinforced-Random-Walk on the complete graph with weights of the form $w(n)=n^α$, with $α>1$. Unlike for the Edge-Reinforced-Random-Walk, which in this case localizes a.s. on 2 sites, here we observe various phase transitions, and in particular localization on arbitrary large sets is possible, provided $α$ is close enough to 1. Our proof relies on stochastic approximation techniques. At the end of the paper, we also prove a general result ensuring that any strongly reinforced VRRW on any bounded degree graph localizes a.s. on a finite subgraph.
△ Less
Submitted 7 October, 2013; v1 submitted 31 August, 2012;
originally announced August 2012.
-
Qualitative properties of certain piecewise deterministic Markov processes
Authors:
Michel Benaïm,
Stéphane Le Borgne,
Florent Malrieu,
Pierre-André Zitt
Abstract:
We study a class of Piecewise Deterministic Markov Processes with state space Rd x E where E is a finite set. The continuous component evolves according to a smooth vector field that is switched at the jump times of the discrete coordinate. The jump rates may depend on the whole position of the process. Working under the general assumption that the process stays in a compact set, we detail a possi…
▽ More
We study a class of Piecewise Deterministic Markov Processes with state space Rd x E where E is a finite set. The continuous component evolves according to a smooth vector field that is switched at the jump times of the discrete coordinate. The jump rates may depend on the whole position of the process. Working under the general assumption that the process stays in a compact set, we detail a possible construction of the process and characterize its support, in terms of the solutions set of a differential inclusion. We establish results on the long time behaviour of the process, in relation to a certain set of accessible points, which is shown to be strongly linked to the support of invariant measures. Under Hörmander-type bracket conditions, we prove that there exists a unique invariant measure and that the processes converges to equilibrium in total variation. Finally we give examples where the bracket condition does not hold, and where there may be one or many invariant measures, depending on the jump rates between the flows.
△ Less
Submitted 7 April, 2014; v1 submitted 18 April, 2012;
originally announced April 2012.
-
Quantitative ergodicity for some switched dynamical systems
Authors:
Michel Benaïm,
Stéphane Le Borgne,
Florent Malrieu,
Pierre-André Zitt
Abstract:
We provide quantitative bounds for the long time behavior of a class of Piecewise Deterministic Markov Processes with state space Rd \times E where E is a finite set. The continuous component evolves according to a smooth vector field that switches at the jump times of the discrete coordinate. The jump rates may depend on the whole position of the process. Under regularity assumptions on the jump…
▽ More
We provide quantitative bounds for the long time behavior of a class of Piecewise Deterministic Markov Processes with state space Rd \times E where E is a finite set. The continuous component evolves according to a smooth vector field that switches at the jump times of the discrete coordinate. The jump rates may depend on the whole position of the process. Under regularity assumptions on the jump rates and stability conditions for the vector fields we provide explicit exponential upper bounds for the convergence to equilibrium in terms of Wasserstein distances. As an example, we obtain convergence results for a stochastic version of the Morris-Lecar model of neurobiology.
△ Less
Submitted 6 December, 2012; v1 submitted 9 April, 2012;
originally announced April 2012.
-
On the stability of planar randomly switched systems
Authors:
Michel Benaïm,
Stéphane Le Borgne,
Florent Malrieu,
Pierre-André Zitt
Abstract:
Consider the random process (Xt) solution of dXt/dt = A(It) Xt where (It) is a Markov process on {0,1} and A0 and A1 are real Hurwitz matrices on R2. Assuming that there exists lambda in (0, 1) such that (1 - λ)A0 + \lambdaA1 has a positive eigenvalue, we establish that the norm of Xt may converge to 0 or infinity, depending on the the jump rate of the process I. An application to product of rando…
▽ More
Consider the random process (Xt) solution of dXt/dt = A(It) Xt where (It) is a Markov process on {0,1} and A0 and A1 are real Hurwitz matrices on R2. Assuming that there exists lambda in (0, 1) such that (1 - λ)A0 + \lambdaA1 has a positive eigenvalue, we establish that the norm of Xt may converge to 0 or infinity, depending on the the jump rate of the process I. An application to product of random matrices is studied. This paper can be viewed as a probabilistic counterpart of the paper "A note on stability conditions for planar switched systems" by Balde, Boscain and Mason.
△ Less
Submitted 9 April, 2012;
originally announced April 2012.
-
On Mean Field Convergence and Stationary Regime
Authors:
Michel Benaim,
Jean-Yves Le Boudec
Abstract:
Assume that a family of stochastic processes on some Polish space $E$ converges to a deterministic process; the convergence is in distribution (hence in probability) at every fixed point in time. This assumption holds for a large family of processes, among which many mean field interaction models and is weaker than previously assumed. We show that any limit point of an invariant probability of the…
▽ More
Assume that a family of stochastic processes on some Polish space $E$ converges to a deterministic process; the convergence is in distribution (hence in probability) at every fixed point in time. This assumption holds for a large family of processes, among which many mean field interaction models and is weaker than previously assumed. We show that any limit point of an invariant probability of the stochastic process is an invariant probability of the deterministic process. The results are valid in discrete and in continuous time.
△ Less
Submitted 24 November, 2011;
originally announced November 2011.
-
Consistency of vanishing smooth fictitious play
Authors:
Michel Benaïm,
Mathieu Faure
Abstract:
We discuss consistency of Vanishing Smooth Fictitious Play, a strategy in the context of game theory, which can be regarded as a smooth fictitious play procedure, where the smoothing parameter is time-dependent and asymptotically vanishes. This answers a question initially raised by Drew Fudenberg and Satoru Takahashi.
We discuss consistency of Vanishing Smooth Fictitious Play, a strategy in the context of game theory, which can be regarded as a smooth fictitious play procedure, where the smoothing parameter is time-dependent and asymptotically vanishes. This answers a question initially raised by Drew Fudenberg and Satoru Takahashi.
△ Less
Submitted 21 November, 2012; v1 submitted 9 May, 2011;
originally announced May 2011.
-
Persistence in fluctuating environments
Authors:
Sebastian J. Schreiber,
Michel Benaïm,
Kolawolé A. S. Atchadé
Abstract:
Understanding under what conditions interacting populations, whether they be plants, animals, or viral particles, coexist is a question of theoretical and practical importance in population biology. Both biotic interactions and environmental fluctuations are key factors that can facilitate or disrupt coexistence. To better understand this interplay between these deterministic and stochastic forces…
▽ More
Understanding under what conditions interacting populations, whether they be plants, animals, or viral particles, coexist is a question of theoretical and practical importance in population biology. Both biotic interactions and environmental fluctuations are key factors that can facilitate or disrupt coexistence. To better understand this interplay between these deterministic and stochastic forces, we develop a mathematical theory extending the nonlinear theory of permanence for deterministic systems to stochastic difference and differential equations. Our condition for coexistence requires that there is a fixed set of weights associated with the interacting populations and this weighted combination of populations' invasion rates is positive for any (ergodic) stationary distribution associated with a subcollection of populations. Here, an invasion rate corresponds to an average per-capita growth rate along a stationary distribution. When this condition holds and there is sufficient noise in the system, we show that the populations approach a unique positive stationary distribution. Moreover, we show that our coexistence criterion is robust to small perturbations of the model functions. Using this theory, we illustrate that (i) environmental noise enhances or inhibits coexistence in communities with rock-paper-scissor dynamics depending on correlations between interspecific demographic rates, (ii) stochastic variation in mortality rates has no effect on the coexistence criteria for discrete-time Lotka-Volterra communities, and (iii) random forcing can promote genetic diversity in the presence of exploitative interactions.
△ Less
Submitted 14 May, 2010;
originally announced May 2010.
-
Stochastic Approximation, Cooperative Dynamics and Supermodular Games
Authors:
Michel Benaïm,
Mathieu Faure
Abstract:
This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the non convergence of this process toward a certain class of repulsive sets for the associated ordinary differential equation (ODE). We then use this result to derive the convergence of the process when the ODE is cooperative in the sense of…
▽ More
This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the non convergence of this process toward a certain class of repulsive sets for the associated ordinary differential equation (ODE). We then use this result to derive the convergence of the process when the ODE is cooperative in the sense of [Hirsch, 1985]. In particular, this allows us to extend significantly the main result of [Hofbauer and Sandholm, 2002] on the convergence of stochastic fictitious play in supermodular games.
△ Less
Submitted 27 January, 2010;
originally announced January 2010.
-
Self-interacting diffusions IV: Rate of convergence
Authors:
Michel Benaim,
Olivier Raimond
Abstract:
Self-interacting diffusions are processes living on a compact Riemannian manifold defined by a stochastic differential equation with a drift term depending on the past empirical measure of the process. The asymptotics of this measure is governed by a deterministic dynamical system and under certain conditions it converges almost surely towards a deterministic measure (see Benaïm, Ledoux, Raimond…
▽ More
Self-interacting diffusions are processes living on a compact Riemannian manifold defined by a stochastic differential equation with a drift term depending on the past empirical measure of the process. The asymptotics of this measure is governed by a deterministic dynamical system and under certain conditions it converges almost surely towards a deterministic measure (see Benaïm, Ledoux, Raimond (2002) and Benaïm, Raimond (2005)). We are interested here in the rate of this convergence. A central limit theorem is proved. In particular, this shows that greater is the interaction repelling faster is the convergence.
△ Less
Submitted 31 July, 2009;
originally announced July 2009.
-
Dynamics of vertex-reinforced random walks
Authors:
Michel Benaïm,
Pierre Tarrès
Abstract:
We generalize a result from Volkov [Ann. Probab. 29 (2001) 66--91] and prove that, on a large class of locally finite connected graphs of bounded degree $(G,\sim)$ and symmetric reinforcement matrices $a=(a_{i,j})_{i,j\in G}$, the vertex-reinforced random walk (VRRW) eventually localizes with positive probability on subsets which consist of a complete $d$-partite subgraph with possible loops plus…
▽ More
We generalize a result from Volkov [Ann. Probab. 29 (2001) 66--91] and prove that, on a large class of locally finite connected graphs of bounded degree $(G,\sim)$ and symmetric reinforcement matrices $a=(a_{i,j})_{i,j\in G}$, the vertex-reinforced random walk (VRRW) eventually localizes with positive probability on subsets which consist of a complete $d$-partite subgraph with possible loops plus its outer boundary. We first show that, in general, any stable equilibrium of a linear symmetric replicator dynamics with positive payoffs on a graph $G$ satisfies the property that its support is a complete $d$-partite subgraph of $G$ with possible loops, for some $d\ge1$. This result is used here for the study of VRRWs, but also applies to other contexts such as evolutionary models in population genetics and game theory. Next we generalize the result of Pemantle [Probab. Theory Related Fields 92 (1992) 117--136] and Bena\"{ı}m [Ann. Probab. 25 (1997) 361--392] relating the asymptotic behavior of the VRRW to replicator dynamics. This enables us to conclude that, given any neighborhood of a strictly stable equilibrium with support $S$, the following event occurs with positive probability: the walk localizes on $S\cup\partial S$ (where $\partial S$ is the outer boundary of $S$) and the density of occupation of the VRRW converges, with polynomial rate, to a strictly stable equilibrium in this neighborhood.
△ Less
Submitted 17 January, 2012; v1 submitted 16 September, 2008;
originally announced September 2008.
-
A class of non homogeneous self interacting random processes with applications to learning in games and vertex-reinforced random walks
Authors:
Michel Benaim,
Olivier Raimond
Abstract:
Using an approximation by a set-valued dynamical system, this paper studies a class of non Markovian and non homogeneous stochastic processes on a finite state space. It provides an unified approach to simulated annealing type processes. It permits to study new models of vertex reinforced random walks and new models of learning in games including Markovian fictitious play.
Using an approximation by a set-valued dynamical system, this paper studies a class of non Markovian and non homogeneous stochastic processes on a finite state space. It provides an unified approach to simulated annealing type processes. It permits to study new models of vertex reinforced random walks and new models of learning in games including Markovian fictitious play.
△ Less
Submitted 4 June, 2008;
originally announced June 2008.
-
Effective resistance on random electrical networks
Authors:
Michel Benaim,
Itai Benjamini,
Raphael Rossignol
Abstract:
This paper has been withdrawn. See v1 still available to understand the problem: Proposition 2.2 is false. The error in the proof is in claim (3). Then, the whole paper collapses. We do not have any correction for now. We apologize to everyone.
This paper has been withdrawn. See v1 still available to understand the problem: Proposition 2.2 is false. The error in the proof is in claim (3). Then, the whole paper collapses. We do not have any correction for now. We apologize to everyone.
△ Less
Submitted 31 July, 2007; v1 submitted 25 July, 2007;
originally announced July 2007.
-
Exponential concentration for First Passage Percolation through modified Poincare inequalities
Authors:
Michel Benaim,
Raphael Rossignol
Abstract:
We provide a new exponential concentration inequality for
First Passage Percolation valid for a wide class of edge times distributions. This improves and extends a result by Benjamini, Kalai and Schramm which gave a variance bound for Bernoulli edge times. Our approach is based on some functional inequalities extending the work of Rossignol and Falik and Samorodnitsky.
We provide a new exponential concentration inequality for
First Passage Percolation valid for a wide class of edge times distributions. This improves and extends a result by Benjamini, Kalai and Schramm which gave a variance bound for Bernoulli edge times. Our approach is based on some functional inequalities extending the work of Rossignol and Falik and Samorodnitsky.
△ Less
Submitted 20 March, 2007; v1 submitted 26 September, 2006;
originally announced September 2006.
-
A modified Poincare inequality and its application to First Passage Percolation
Authors:
Michel Benaim,
Raphael Rossignol
Abstract:
We extend a Gaussian functional inequality to a countable product of Gaussian measures. This inequality improves on the classical Poincare inequality for Gaussian measures. As an application, we prove that First Passage Percolation has sublinear variance when the edge times distribution belongs to a wide class of continuous distributions, including the exponential one. This extends a result by B…
▽ More
We extend a Gaussian functional inequality to a countable product of Gaussian measures. This inequality improves on the classical Poincare inequality for Gaussian measures. As an application, we prove that First Passage Percolation has sublinear variance when the edge times distribution belongs to a wide class of continuous distributions, including the exponential one. This extends a result by Benjamini, Kalai and Schramm, valid for positive Bernoulli edge times.
△ Less
Submitted 8 May, 2006; v1 submitted 22 February, 2006;
originally announced February 2006.
-
Generalized Urn Models of Evolutionary Processes
Authors:
Michel Benaim,
Sebastian J. Schreiber,
Pierre Tarres
Abstract:
Generalized Polya urn models can describe the dynamics of finite populations of interacting genotypes. Three basic questions these models can address are: Under what conditions does a population exhibit growth? On the event of growth, at what rate does the population increase? What is the long-term behavior of the distribution of genotypes? To address these questions, we associate a mean limit o…
▽ More
Generalized Polya urn models can describe the dynamics of finite populations of interacting genotypes. Three basic questions these models can address are: Under what conditions does a population exhibit growth? On the event of growth, at what rate does the population increase? What is the long-term behavior of the distribution of genotypes? To address these questions, we associate a mean limit ordinary differential equation (ODE) with the urn model. Previously, it has been shown that on the event of population growth, the limiting distribution of genotypes is a connected internally chain recurrent set for the mean limit ODE. To determine when growth and convergence occurs with positive probability, we prove two results. First, if the mean limit ODE has an ``attainable'' attractor at which growth is expected, then growth and convergence toward this attractor occurs with positive probability. Second, the population distribution almost surely does not converge to sets where growth is not expected
△ Less
Submitted 8 July, 2004;
originally announced July 2004.
-
Self-Interacting Diffusions : Symmetric Interactions
Authors:
Michel Benaim,
Olivier Raimond
Abstract:
Let $M$ be a compact Riemannian manifold. A {\em self-interacting diffusion} on $M$ is a stochastic process solution to $$dX_t = dW_t(X_t) - \frac{1}{t}(\int_0^t \nabla V_{X_s}(X_t)ds)dt$$ where $\{W_t\}$ is a Brownian vector field on $M$ and $V_x(y) = V(x,y)$ a smooth function. Let $μ_t = \frac{1}{t} \int_0^t δ_{X_s} ds$ denote the normalized occupation measure of $X_t$. We prove that, when…
▽ More
Let $M$ be a compact Riemannian manifold. A {\em self-interacting diffusion} on $M$ is a stochastic process solution to $$dX_t = dW_t(X_t) - \frac{1}{t}(\int_0^t \nabla V_{X_s}(X_t)ds)dt$$ where $\{W_t\}$ is a Brownian vector field on $M$ and $V_x(y) = V(x,y)$ a smooth function. Let $μ_t = \frac{1}{t} \int_0^t δ_{X_s} ds$ denote the normalized occupation measure of $X_t$. We prove that, when $V$ is symmetric, $μ_t$ converges almost surely to the critical set of a certain nonlinear free energy functional $J$. Furthermore, $J$ has generically finitely many critical points and $μ_t$ converges almost surely toward a local minimum of $J.$ Each local minimum having a positive probability to be selected.
△ Less
Submitted 22 September, 2003;
originally announced September 2003.
