Showing 1–4 of 4 results for author: Travers, N F

Equivalence of History and Generator Epsilon-Machines

Authors: Nicholas F. Travers, James P. Crutchfield

Abstract: Epsilon-machines are minimal, unifilar presentations of stationary stochastic processes. They were originally defined in the history machine sense, as hidden Markov models whose states are the equivalence classes of infinite pasts with the same probability distribution over futures. In analyzing synchronization, though, an alternative generator definition was given: unifilar, edge-emitting hidden… ▽ More Epsilon-machines are minimal, unifilar presentations of stationary stochastic processes. They were originally defined in the history machine sense, as hidden Markov models whose states are the equivalence classes of infinite pasts with the same probability distribution over futures. In analyzing synchronization, though, an alternative generator definition was given: unifilar, edge-emitting hidden Markov models with probabilistically distinct states. The key difference is that history epsilon-machines are defined by a process, whereas generator epsilon-machines define a process. We show here that these two definitions are equivalent in the finite-state case. △ Less

Submitted 14 December, 2012; v1 submitted 18 November, 2011; originally announced November 2011.

Comments: 23 pages, 5 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/hgem.htm; Expanded literature review, additional examples and figures

Infinite Excess Entropy Processes with Countable-State Generators

Authors: Nicholas F. Travers, James P. Crutchfield

Abstract: We present two examples of finite-alphabet, infinite excess entropy processes generated by invariant hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. It appears these are the first constructions of processes of this type. Previous examples of infinite excess entropy processes over finite alphabets admit only invariant HMM presenta… ▽ More We present two examples of finite-alphabet, infinite excess entropy processes generated by invariant hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. It appears these are the first constructions of processes of this type. Previous examples of infinite excess entropy processes over finite alphabets admit only invariant HMM presentations with uncountable state sets. △ Less

Submitted 14 November, 2011; originally announced November 2011.

Comments: 13 pages, 3 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/ieepcsg.htm

Asymptotic Synchronization for Finite-State Sources

Authors: Nicholas F. Travers, James P. Crutchfield

Abstract: We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find that an observer's average uncertainty in the source state vanishes exponentially fast and, as a consequence, an observer's average uncertainty in predicting f… ▽ More We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find that an observer's average uncertainty in the source state vanishes exponentially fast and, as a consequence, an observer's average uncertainty in predicting future output converges exponentially fast to the source entropy rate. △ Less

Submitted 3 January, 2011; v1 submitted 6 November, 2010; originally announced November 2010.

Comments: 13 pages, 4 figures: http://cse.ucdavis.edu/~cmg/compmech/pubs/asfs.htm; updates and corrections added

Exact Synchronization for Finite-State Sources

Authors: Nicholas F. Travers, James P. Crutchfield

Abstract: We analyze how an observer synchronizes to the internal state of a finite-state information source, using the epsilon-machine causal representation. Here, we treat the case of exact synchronization, when it is possible for the observer to synchronize completely after a finite number of observations. The more difficult case of strictly asymptotic synchronization is treated in a sequel. In both case… ▽ More We analyze how an observer synchronizes to the internal state of a finite-state information source, using the epsilon-machine causal representation. Here, we treat the case of exact synchronization, when it is possible for the observer to synchronize completely after a finite number of observations. The more difficult case of strictly asymptotic synchronization is treated in a sequel. In both cases, we find that an observer, on average, will synchronize to the source state exponentially fast and that, as a result, the average accuracy in an observer's predictions of the source output approaches its optimal level exponentially fast as well. Additionally, we show here how to analytically calculate the synchronization rate for exact epsilon-machines and provide an efficient polynomial-time algorithm to test epsilon-machines for exactness. △ Less

Submitted 3 January, 2011; v1 submitted 24 August, 2010; originally announced August 2010.

Comments: 9 pages, 6 figures; now includes analytical calculation of the synchronization rate; updates and corrections added