-
Mode-locking in advection-reaction-diffusion systems: an invariant manifold perspective
Authors:
Rory A. Locke,
John R. Mahoney,
Kevin A. Mitchell
Abstract:
Fronts propagating in two-dimensional advection-reaction-diffusion (ARD) systems exhibit rich topological structure. When the underlying fluid flow is periodic in space and time, the reaction front can lock to the driving frequency. We explain this mode-locking phenomenon using so-called burning invariant manifolds (BIMs). In fact, the mode-locked profile is delineated by a BIM attached to a relat…
▽ More
Fronts propagating in two-dimensional advection-reaction-diffusion (ARD) systems exhibit rich topological structure. When the underlying fluid flow is periodic in space and time, the reaction front can lock to the driving frequency. We explain this mode-locking phenomenon using so-called burning invariant manifolds (BIMs). In fact, the mode-locked profile is delineated by a BIM attached to a relative periodic orbit (RPO) of the front element dynamics. Changes in the type (and loss) of mode-locking can be understood in terms of local and global bifurcations of the RPOs and their BIMs. We illustrate these concepts numerically using a chain of alternating vortices in a channel geometry.
△ Less
Submitted 15 September, 2017;
originally announced September 2017.
-
Prediction and Generation of Binary Markov Processes: Can a Finite-State Fox Catch a Markov Mouse?
Authors:
J. Ruebeck,
R. G. James,
J. R. Mahoney,
J. P. Crutchfield
Abstract:
Understanding the generative mechanism of a natural system is a vital component of the scientific method. Here, we investigate one of the fundamental steps toward this goal by presenting the minimal generator of an arbitrary binary Markov process. This is a class of processes whose predictive model is well known. Surprisingly, the generative model requires three distinct topologies for different r…
▽ More
Understanding the generative mechanism of a natural system is a vital component of the scientific method. Here, we investigate one of the fundamental steps toward this goal by presenting the minimal generator of an arbitrary binary Markov process. This is a class of processes whose predictive model is well known. Surprisingly, the generative model requires three distinct topologies for different regions of parameter space. We show that a previously proposed generator for a particular set of binary Markov processes is, in fact, not minimal. Our results shed the first quantitative light on the relative (minimal) costs of prediction and generation. We find, for instance, that the difference between prediction and generation is maximized when the process is approximately independently, identically distributed.
△ Less
Submitted 31 July, 2017;
originally announced August 2017.
-
Trimming the Independent Fat: Sufficient Statistics, Mutual Information, and Predictability from Effective Channel States
Authors:
Ryan G. James,
John R. Mahoney,
James P. Crutchfield
Abstract:
One of the most fundamental questions one can ask about a pair of random variables X and Y is the value of their mutual information. Unfortunately, this task is often stymied by the extremely large dimension of the variables. We might hope to replace each variable by a lower-dimensional representation that preserves the relationship with the other variable. The theoretically ideal implementation i…
▽ More
One of the most fundamental questions one can ask about a pair of random variables X and Y is the value of their mutual information. Unfortunately, this task is often stymied by the extremely large dimension of the variables. We might hope to replace each variable by a lower-dimensional representation that preserves the relationship with the other variable. The theoretically ideal implementation is the use of minimal sufficient statistics, where it is well-known that either X or Y can be replaced by their minimal sufficient statistic about the other while preserving the mutual information. While intuitively reasonable, it is not obvious or straightforward that both variables can be replaced simultaneously. We demonstrate that this is in fact possible: the information X's minimal sufficient statistic preserves about Y is exactly the information that Y's minimal sufficient statistic preserves about X. As an important corollary, we consider the case where one variable is a stochastic process' past and the other its future and the present is viewed as a memoryful channel. In this case, the mutual information is the channel transmission rate between the channel's effective states. That is, the past-future mutual information (the excess entropy) is the amount of information about the future that can be predicted using the past. Translating our result about minimal sufficient statistics, this is equivalent to the mutual information between the forward- and reverse-time causal states of computational mechanics. We close by discussing multivariate extensions to this use of minimal sufficient statistics.
△ Less
Submitted 6 February, 2017;
originally announced February 2017.
-
Finite-time barriers to front propagation in two-dimensional fluid flows
Authors:
John R. Mahoney,
Kevin A. Mitchell
Abstract:
Recent theoretical and experimental investigations have demonstrated the role of certain invariant manifolds, termed burning invariant manifolds (BIMs), as one-way dynamical barriers to reaction fronts propagating within a flowing fluid. These barriers form one-dimensional curves in a two-dimensional fluid flow. In prior studies, the fluid velocity field was required to be either time-independent…
▽ More
Recent theoretical and experimental investigations have demonstrated the role of certain invariant manifolds, termed burning invariant manifolds (BIMs), as one-way dynamical barriers to reaction fronts propagating within a flowing fluid. These barriers form one-dimensional curves in a two-dimensional fluid flow. In prior studies, the fluid velocity field was required to be either time-independent or time-periodic. In the present study, we develop an approach to identify prominent one-way barriers based only on fluid velocity data over a finite time interval, which may have arbitrary time-dependence. We call such a barrier a burning Lagrangian coherent structure (bLCS) in analogy to Lagrangian coherent structures (LCSs) commonly used in passive advection. Our approach is based on the variational formulation of LCSs using curves of stationary "Lagrangian shear", introduced by Farazmand, Blazevski, and Haller [Physica D 278-279, 44 (2014)] in the context of passive advection. We numerically validate our technique by demonstrating that the bLCS closely tracks the BIM for a time-independent, double-vortex channel flow with an opposing "wind".
△ Less
Submitted 27 March, 2015;
originally announced March 2015.
-
Frozen reaction fronts in steady flows: a burning-invariant-manifold perspective
Authors:
John R. Mahoney,
John Li,
Carleen Boyer,
Tom Solomon,
Kevin A. Mitchell
Abstract:
The dynamics of fronts, such as chemical reaction fronts, propagating in two-dimensional fluid flows can be remarkably rich and varied. For time-invariant flows, the front dynamics may simplify, settling in to a steady state in which the reacted domain is static, and the front appears "frozen". Our central result is that these frozen fronts in the two-dimensional fluid are composed of segments of…
▽ More
The dynamics of fronts, such as chemical reaction fronts, propagating in two-dimensional fluid flows can be remarkably rich and varied. For time-invariant flows, the front dynamics may simplify, settling in to a steady state in which the reacted domain is static, and the front appears "frozen". Our central result is that these frozen fronts in the two-dimensional fluid are composed of segments of burning invariant manifolds---invariant manifolds of front-element dynamics in $xyθ$-space, where $θ$ is the front orientation. Burning invariant manifolds (BIMs) have been identified previously as important local barriers to front propagation in fluid flows. The relevance of BIMs for frozen fronts rests in their ability, under appropriate conditions, to form global barriers, separating reacted domains from nonreacted domains for all time. The second main result of this paper is an understanding of bifurcations that lead from a nonfrozen state to a frozen state, as well as bifurcations that change the topological structure of the frozen front. Though the primary results of this study apply to general fluid flows, our analysis focuses on a chain of vortices in a channel flow with an imposed wind. For this system, we present both experimental and numerical studies that support the theoretical analysis developed here.
△ Less
Submitted 27 March, 2015;
originally announced March 2015.
-
A turnstile mechanism for fronts propagating in fluid flows
Authors:
John R. Mahoney,
Kevin A. Mitchell
Abstract:
We consider the propagation of fronts in a periodically driven flowing medium. It is shown that the progress of fronts in these systems may be mediated by a turnstile mechanism akin to that found in chaotic advection. We first define the modified ("active") turnstile lobes according to the evolution of point sources across a transport boundary. We then show that the lobe boundaries may be construc…
▽ More
We consider the propagation of fronts in a periodically driven flowing medium. It is shown that the progress of fronts in these systems may be mediated by a turnstile mechanism akin to that found in chaotic advection. We first define the modified ("active") turnstile lobes according to the evolution of point sources across a transport boundary. We then show that the lobe boundaries may be constructed from stable and unstable \emph{burning invariant manifolds}---one-way barriers to front propagation analogous to traditional invariant manifolds for passive advection. Because the burning invariant manifolds (BIMs) are one-dimensional curves in a three-dimensional ($xyθ$) phase space, their projection into $xy$-space exhibits several key differences from their advective counterparts: (lobe) areas are not preserved, BIMs may self-intersect, and an intersection between stable and unstable BIMs does not map to another such intersection. These differences must be accommodated in the correct construction of the new turnstile. As an application, we consider a lobe-based treatment protocol for protecting an ocean bay from an invading algae bloom.
△ Less
Submitted 21 May, 2013;
originally announced May 2013.
-
Invariant manifolds and the geometry of front propagation in fluid flows
Authors:
Kevin A. Mitchell,
John R. Mahoney
Abstract:
Recent theoretical and experimental work has demonstrated the existence of one-sided, invariant barriers to the propagation of reaction-diffusion fronts in quasi-two-dimensional periodically-driven fluid flows. These barriers were called burning invariant manifolds (BIMs). We provide a detailed theoretical analysis of BIMs, providing criteria for their existence, a classification of their stabilit…
▽ More
Recent theoretical and experimental work has demonstrated the existence of one-sided, invariant barriers to the propagation of reaction-diffusion fronts in quasi-two-dimensional periodically-driven fluid flows. These barriers were called burning invariant manifolds (BIMs). We provide a detailed theoretical analysis of BIMs, providing criteria for their existence, a classification of their stability, a formalization of their barrier property, and mechanisms by which the barriers can be circumvented. This analysis assumes the sharp front limit and negligible feedback of the front on the fluid velocity. A low-dimensional dynamical systems analysis provides the core of our results.
△ Less
Submitted 6 May, 2012;
originally announced May 2012.
-
How Hidden are Hidden Processes? A Primer on Crypticity and Entropy Convergence
Authors:
John R. Mahoney,
Christopher J. Ellison,
Ryan G. James,
James P. Crutchfield
Abstract:
We investigate a stationary process's crypticity---a measure of the difference between its hidden state information and its observed information---using the causal states of computational mechanics. Here, we motivate crypticity and cryptic order as physically meaningful quantities that monitor how hidden a hidden process is. This is done by recasting previous results on the convergence of block en…
▽ More
We investigate a stationary process's crypticity---a measure of the difference between its hidden state information and its observed information---using the causal states of computational mechanics. Here, we motivate crypticity and cryptic order as physically meaningful quantities that monitor how hidden a hidden process is. This is done by recasting previous results on the convergence of block entropy and block-state entropy in a geometric setting, one that is more intuitive and that leads to a number of new results. For example, we connect crypticity to how an observer synchronizes to a process. We show that the block-causal-state entropy is a convex function of block length. We give a complete analysis of spin chains. We present a classification scheme that surveys stationary processes in terms of their possible cryptic and Markov orders. We illustrate related entropy convergence behaviors using a new form of foliated information diagram. Finally, along the way, we provide a variety of interpretations of crypticity and cryptic order to establish their naturalness and pervasiveness. Hopefully, these will inspire new applications in spatially extended and network dynamical systems.
△ Less
Submitted 6 August, 2011;
originally announced August 2011.
-
Information Symmetries in Irreversible Processes
Authors:
Christopher J. Ellison,
John R. Mahoney,
Ryan G. James,
James P. Crutchfield,
Joerg Reichardt
Abstract:
We study dynamical reversibility in stationary stochastic processes from an information theoretic perspective. Extending earlier work on the reversibility of Markov chains, we focus on finitary processes with arbitrarily long conditional correlations. In particular, we examine stationary processes represented or generated by edge-emitting, finite-state hidden Markov models. Surprisingly, we find p…
▽ More
We study dynamical reversibility in stationary stochastic processes from an information theoretic perspective. Extending earlier work on the reversibility of Markov chains, we focus on finitary processes with arbitrarily long conditional correlations. In particular, we examine stationary processes represented or generated by edge-emitting, finite-state hidden Markov models. Surprisingly, we find pervasive temporal asymmetries in the statistics of such stationary processes with the consequence that the computational resources necessary to generate a process in the forward and reverse temporal directions are generally not the same. In fact, an exhaustive survey indicates that most stationary processes are irreversible. We study the ensuing relations between model topology in different representations, the process's statistical properties, and its reversibility in detail. A process's temporal asymmetry is efficiently captured using two canonical unifilar representations of the generating model, the forward-time and reverse-time epsilon-machines. We analyze example irreversible processes whose epsilon-machine presentations change size under time reversal, including one which has a finite number of recurrent causal states in one direction, but an infinite number in the opposite. From the forward-time and reverse-time epsilon-machines, we are able to construct a symmetrized, but nonunifilar, generator of a process---the bidirectional machine. Using the bidirectional machine, we show how to directly calculate a process's fundamental information properties, many of which are otherwise only poorly approximated via process samples. The tools we introduce and the insights we offer provide a better understanding of the many facets of reversibility and irreversibility in stochastic processes.
△ Less
Submitted 11 July, 2011;
originally announced July 2011.
-
Many Roads to Synchrony: Natural Time Scales and Their Algorithms
Authors:
Ryan G. James,
John R. Mahoney,
Christopher J. Ellison,
James P. Crutchfield
Abstract:
We consider two important time scales---the Markov and cryptic orders---that monitor how an observer synchronizes to a finitary stochastic process. We show how to compute these orders exactly and that they are most efficiently calculated from the epsilon-machine, a process's minimal unifilar model. Surprisingly, though the Markov order is a basic concept from stochastic process theory, it is not a…
▽ More
We consider two important time scales---the Markov and cryptic orders---that monitor how an observer synchronizes to a finitary stochastic process. We show how to compute these orders exactly and that they are most efficiently calculated from the epsilon-machine, a process's minimal unifilar model. Surprisingly, though the Markov order is a basic concept from stochastic process theory, it is not a probabilistic property of a process. Rather, it is a topological property and, moreover, it is not computable from any finite-state model other than the epsilon-machine. Via an exhaustive survey, we close by demonstrating that infinite Markov and infinite cryptic orders are a dominant feature in the space of finite-memory processes. We draw out the roles played in statistical mechanical spin systems by these two complementary length scales.
△ Less
Submitted 20 December, 2013; v1 submitted 26 October, 2010;
originally announced October 2010.
-
Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation
Authors:
James P. Crutchfield,
Christopher J. Ellison,
Ryan G. James,
John R. Mahoney
Abstract:
We adapt tools from information theory to analyze how an observer comes to synchronize with the hidden states of a finitary, stationary stochastic process. We show that synchronization is determined by both the process's internal organization and by an observer's model of it. We analyze these components using the convergence of state-block and block-state entropies, comparing them to the previousl…
▽ More
We adapt tools from information theory to analyze how an observer comes to synchronize with the hidden states of a finitary, stationary stochastic process. We show that synchronization is determined by both the process's internal organization and by an observer's model of it. We analyze these components using the convergence of state-block and block-state entropies, comparing them to the previously known convergence properties of the Shannon block entropy. Along the way, we introduce a hierarchy of information quantifiers as derivatives and integrals of these entropies, which parallels a similar hierarchy introduced for block entropy. We also draw out the duality between synchronization properties and a process's controllability. The tools lead to a new classification of a process's alternative representations in terms of minimality, synchronizability, and unifilarity.
△ Less
Submitted 29 July, 2010;
originally announced July 2010.
