-
Transience, Recurrence and the Speed of a Random Walk in a Site-Based Feedback Environment
Authors:
Ross G. Pinsky,
Nicholas F. Travers
Abstract:
We study a random walk on $\mathbb{Z}$ which evolves in a dynamic environment determined by its own trajectory. Sites flip back and forth between two modes, $p$ and $q$. $R$ consecutive right jumps from a site in the $q$-mode are required to switch it to the $p$-mode, and $L$ consecutive left jumps from a site in the $p$-mode are required to switch it to the $q$-mode. From a site in the $p$-mode t…
▽ More
We study a random walk on $\mathbb{Z}$ which evolves in a dynamic environment determined by its own trajectory. Sites flip back and forth between two modes, $p$ and $q$. $R$ consecutive right jumps from a site in the $q$-mode are required to switch it to the $p$-mode, and $L$ consecutive left jumps from a site in the $p$-mode are required to switch it to the $q$-mode. From a site in the $p$-mode the walk jumps right with probability $p$ and left with probability $1-p$, while from a site in the $q$-mode these probabilities are $q$ and $1-q$.
We prove a sharp cutoff for right/left transience of the random walk in terms of an explicit function of the parameters $α= α(p,q,R,L)$. For $α> 1/2$ the walk is transient to $+\infty$ for any initial environment, whereas for $α< 1/2$ the walk is transient to $-\infty$ for any initial environment. In the critical case, $α= 1/2$, the situation is more complicated and the behavior of the walk depends on the initial environment. Nevertheless, we are able to give a characterization of transience/recurrence in many instances, including when either $R=1$ or $L=1$ and when $R=L=2$. In the noncritical case, we also show that the walk has positive speed, and in some situations are able to give an explicit formula for this speed.
△ Less
Submitted 4 March, 2015; v1 submitted 30 October, 2014;
originally announced October 2014.
-
Inversions and Longest Increasing Subsequence for $k$-Card-Minimum Random Permutations
Authors:
Nicholas F. Travers
Abstract:
A random $n$-permutation may be generated by sequentially removing random cards $C_1,...,C_n$ from an $n$-card deck $D = \{1,...,n\}$. The permutation $σ$ is simply the sequence of cards in the order they are removed. This permutation is itself uniformly random, as long as each random card $C_t$ is drawn uniformly from the remaining set at time $t$. We consider, here, a variant of this simple proc…
▽ More
A random $n$-permutation may be generated by sequentially removing random cards $C_1,...,C_n$ from an $n$-card deck $D = \{1,...,n\}$. The permutation $σ$ is simply the sequence of cards in the order they are removed. This permutation is itself uniformly random, as long as each random card $C_t$ is drawn uniformly from the remaining set at time $t$. We consider, here, a variant of this simple procedure in which one is given a choice between $k$ random cards from the remaining set at each step, and selects the lowest numbered of these for removal. This induces a bias towards selecting lower numbered of the remaining cards at each step, and therefore leads to a final permutation which is more "ordered" than in the uniform case (i.e. closer to the identity permutation id $=(1,2,3,...,n)$).
We quantify this effect in terms of two natural measures of order: The number of inversions $I$ and the length of the longest increasing subsequence $L$. For inversions, we establish a weak law of large numbers and central limit theorem, both for fixed and growing $k$. For the longest increasing subsequence, we establish the rate of scaling, in general, and existence of a weak law in the case of growing $k$. We also show that the minimum strategy, of selecting the minimum of the $k$ given choices at each step, is optimal for minimizing the number of inversions in the space of all online $k$-card selection rules.
△ Less
Submitted 16 June, 2014;
originally announced June 2014.
-
Exponential Bounds for Convergence of Entropy Rate Approximations in Hidden Markov Models Satisfying a Path-Mergeability Condition
Authors:
Nicholas F. Travers
Abstract:
A hidden Markov model (HMM) is said to have path-mergeable states if for any two states i,j there exists a word w and state k such that it is possible to transition from both i and j to k while emitting w. We show that for a finite HMM with path-mergeable states the block estimates of the entropy rate converge exponentially fast. We also show that the path-mergeability property is asymptotically t…
▽ More
A hidden Markov model (HMM) is said to have path-mergeable states if for any two states i,j there exists a word w and state k such that it is possible to transition from both i and j to k while emitting w. We show that for a finite HMM with path-mergeable states the block estimates of the entropy rate converge exponentially fast. We also show that the path-mergeability property is asymptotically typical in the space of HMM topolgies and easily testable.
△ Less
Submitted 5 February, 2014; v1 submitted 26 November, 2012;
originally announced November 2012.
-
Equivalence of History and Generator Epsilon-Machines
Authors:
Nicholas F. Travers,
James P. Crutchfield
Abstract:
Epsilon-machines are minimal, unifilar presentations of stationary stochastic processes. They were originally defined in the history machine sense, as hidden Markov models whose states are the equivalence classes of infinite pasts with the same probability distribution over futures. In analyzing synchronization, though, an alternative generator definition was given: unifilar, edge-emitting hidden…
▽ More
Epsilon-machines are minimal, unifilar presentations of stationary stochastic processes. They were originally defined in the history machine sense, as hidden Markov models whose states are the equivalence classes of infinite pasts with the same probability distribution over futures. In analyzing synchronization, though, an alternative generator definition was given: unifilar, edge-emitting hidden Markov models with probabilistically distinct states. The key difference is that history epsilon-machines are defined by a process, whereas generator epsilon-machines define a process. We show here that these two definitions are equivalent in the finite-state case.
△ Less
Submitted 14 December, 2012; v1 submitted 18 November, 2011;
originally announced November 2011.
-
Infinite Excess Entropy Processes with Countable-State Generators
Authors:
Nicholas F. Travers,
James P. Crutchfield
Abstract:
We present two examples of finite-alphabet, infinite excess entropy processes generated by invariant hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. It appears these are the first constructions of processes of this type. Previous examples of infinite excess entropy processes over finite alphabets admit only invariant HMM presenta…
▽ More
We present two examples of finite-alphabet, infinite excess entropy processes generated by invariant hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. It appears these are the first constructions of processes of this type. Previous examples of infinite excess entropy processes over finite alphabets admit only invariant HMM presentations with uncountable state sets.
△ Less
Submitted 14 November, 2011;
originally announced November 2011.
-
Asymptotic Synchronization for Finite-State Sources
Authors:
Nicholas F. Travers,
James P. Crutchfield
Abstract:
We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find that an observer's average uncertainty in the source state vanishes exponentially fast and, as a consequence, an observer's average uncertainty in predicting f…
▽ More
We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find that an observer's average uncertainty in the source state vanishes exponentially fast and, as a consequence, an observer's average uncertainty in predicting future output converges exponentially fast to the source entropy rate.
△ Less
Submitted 3 January, 2011; v1 submitted 6 November, 2010;
originally announced November 2010.
-
Exact Synchronization for Finite-State Sources
Authors:
Nicholas F. Travers,
James P. Crutchfield
Abstract:
We analyze how an observer synchronizes to the internal state of a finite-state information source, using the epsilon-machine causal representation. Here, we treat the case of exact synchronization, when it is possible for the observer to synchronize completely after a finite number of observations. The more difficult case of strictly asymptotic synchronization is treated in a sequel. In both case…
▽ More
We analyze how an observer synchronizes to the internal state of a finite-state information source, using the epsilon-machine causal representation. Here, we treat the case of exact synchronization, when it is possible for the observer to synchronize completely after a finite number of observations. The more difficult case of strictly asymptotic synchronization is treated in a sequel. In both cases, we find that an observer, on average, will synchronize to the source state exponentially fast and that, as a result, the average accuracy in an observer's predictions of the source output approaches its optimal level exponentially fast as well. Additionally, we show here how to analytically calculate the synchronization rate for exact epsilon-machines and provide an efficient polynomial-time algorithm to test epsilon-machines for exactness.
△ Less
Submitted 3 January, 2011; v1 submitted 24 August, 2010;
originally announced August 2010.
