Showing 1–1 of 1 results for author: Ewald, B D

Computing expected transition events in reducible Markov chains

Authors: Brian D. Ewald, Jeffrey Humpherys, Jeremy West

Abstract: We present a closed-form, computable expression for the expected number of times any transition event occurs during the transient phase of a reducible Markov chain. Examples of events include time to absorption, number of visits to a state, traversals of a particular transition, loops from a state to itself, and arrivals to a state from a particular subset of states. We give an analogous express… ▽ More We present a closed-form, computable expression for the expected number of times any transition event occurs during the transient phase of a reducible Markov chain. Examples of events include time to absorption, number of visits to a state, traversals of a particular transition, loops from a state to itself, and arrivals to a state from a particular subset of states. We give an analogous expression for time-average events, which describe the steady-state behavior of reducible chains as well as the long-term behavior of irreducible chains. △ Less

Submitted 30 June, 2009; v1 submitted 7 June, 2008; originally announced June 2008.

Comments: 15 pages, 1 table. Added numerical analysis and changed formatting. Fixed several errors

MSC Class: 60J22; 15A09