-
Master List of Examples in Complexity Theory of Finite Semigroup Theory
Authors:
Stuart Margolis,
John Rhodes
Abstract:
This document gives a list of finite semigroups that are interesting from the point of view of Krohn-Rhodes complexity theory. The list will be expanded and updates as "time goes by".
This document gives a list of finite semigroups that are interesting from the point of view of Krohn-Rhodes complexity theory. The list will be expanded and updates as "time goes by".
△ Less
Submitted 2 February, 2025; v1 submitted 30 January, 2025;
originally announced January 2025.
-
Complexity of Finite Semigroups: History and Decidability
Authors:
StuarT Margolis,
John Rhodes,
Anne Schilling
Abstract:
In recent papers, Margolis, Rhodes and Schilling proved that the complexity of a finite semigroup is computable. This solved a problem that had been open for more than 50 years. The purpose of this paper is to survey the basic results of Krohn-Rhodes complexity of finite semigroups and to outline the proof of its computability.
In recent papers, Margolis, Rhodes and Schilling proved that the complexity of a finite semigroup is computable. This solved a problem that had been open for more than 50 years. The purpose of this paper is to survey the basic results of Krohn-Rhodes complexity of finite semigroups and to outline the proof of its computability.
△ Less
Submitted 1 January, 2025;
originally announced January 2025.
-
Aperiodic Flows on Finite Semigroups: Foundations and First Examples
Authors:
Stuart Margolis,
John Rhodes
Abstract:
The theory of flows was used as a crucial tool in the recent proof by Margolis, Rhodes and Schilling that Krohn-Rhodes complexity is decidable. In this paper we begin a systematic study of aperiodic flows. We give the foundations of the theory of flows and give a unified approach to the Presentation Lemma and its relations to flows and the Slice Theorem. We completely describe semigroups having a…
▽ More
The theory of flows was used as a crucial tool in the recent proof by Margolis, Rhodes and Schilling that Krohn-Rhodes complexity is decidable. In this paper we begin a systematic study of aperiodic flows. We give the foundations of the theory of flows and give a unified approach to the Presentation Lemma and its relations to flows and the Slice Theorem. We completely describe semigroups having a flow over the trivial semigroup and connect this to classical results in inverse semigroup theory. We reinterpret Tilson's Theorem on the complexity of small monoids in terms of flows. We conclude with examples of semigroups built from the character table of Abelian Groups that have an aperiodic flows.
△ Less
Submitted 2 February, 2025; v1 submitted 9 October, 2024;
originally announced October 2024.
-
Decidability of Krohn-Rhodes complexity for all finite semigroups and automata
Authors:
Stuart Margolis,
John Rhodes,
Anne Schilling
Abstract:
The Krohn-Rhodes Theorem proves that a finite semigroup divides a wreath product of groups and aperiodic semigroups. Krohn-Rhodes complexity equals the minimal number of groups that are needed. Determining an algorithm to compute complexity has been an open problem for more than 50 years. The main result of this paper proves that it is decidable whether a semigroup has complexity k for any k great…
▽ More
The Krohn-Rhodes Theorem proves that a finite semigroup divides a wreath product of groups and aperiodic semigroups. Krohn-Rhodes complexity equals the minimal number of groups that are needed. Determining an algorithm to compute complexity has been an open problem for more than 50 years. The main result of this paper proves that it is decidable whether a semigroup has complexity k for any k greater than or equal to 0. This builds on our previous work for complexity 1. In that paper we proved using profinite methods and results on free Burnside semigroups by McCammond and others that the lower bound from a 2012 paper by Henckell, Rhodes and Steinberg is precise for complexity 1. In this paper we define an improved version of the lower bound from the 2012 paper and prove that it is exact for arbitrary complexity.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
Identifying circular orders for blobs in phylogenetic networks
Authors:
John A. Rhodes,
Hector Banos,
Jingcheng Xu,
Cécile Ané
Abstract:
Interest in the inference of evolutionary networks relating species or populations has grown with the increasing recognition of the importance of hybridization, gene flow and admixture, and the availability of large-scale genomic data. However, what network features may be validly inferred from various data types under different models remains poorly understood. Previous work has largely focused o…
▽ More
Interest in the inference of evolutionary networks relating species or populations has grown with the increasing recognition of the importance of hybridization, gene flow and admixture, and the availability of large-scale genomic data. However, what network features may be validly inferred from various data types under different models remains poorly understood. Previous work has largely focused on level-1 networks, in which reticulation events are well separated, and on a general network's tree of blobs, the tree obtained by contracting every blob to a node. An open question is the identifiability of the topology of a blob of unknown level. We consider the identifiability of the circular order in which subnetworks attach to a blob, first proving that this order is well-defined for outer-labeled planar blobs. For this class of blobs, we show that the circular order information from 4-taxon subnetworks identifies the full circular order of the blob. Similarly, the circular order from 3-taxon rooted subnetworks identifies the full circular order of a rooted blob. We then show that subnetwork circular information is identifiable from certain data types and evolutionary models. This provides a general positive result for high-level networks, on the identifiability of the ordering in which taxon blocks attach to blobs in outer-labeled planar networks. Finally, we give examples of blobs with different internal structures which cannot be distinguished under many models and data types.
△ Less
Submitted 20 July, 2024; v1 submitted 18 February, 2024;
originally announced February 2024.
-
Identifiability of Level-1 Species Networks from Gene Tree Quartets
Authors:
Elizabeth S. Allman,
Hector Baños,
Marina Garrote-Lopez,
John A. Rhodes
Abstract:
When hybridization or other forms of lateral gene transfer have occurred, evolutionary relationships of species are better represented by phylogenetic networks than by trees. While inference of such networks remains challenging, several recently proposed methods are based on quartet concordance factors -- the probabilities that a tree relating a gene sampled from the species displays the possible…
▽ More
When hybridization or other forms of lateral gene transfer have occurred, evolutionary relationships of species are better represented by phylogenetic networks than by trees. While inference of such networks remains challenging, several recently proposed methods are based on quartet concordance factors -- the probabilities that a tree relating a gene sampled from the species displays the possible 4-taxon relationships. Building on earlier results, we investigate what level-1 network features are identifiable from concordance factors under the network multispecies coalescent model. We obtain results on both topological features of the network, and numerical parameters, uncovering a number of failures of identifiability related to 3-cycles in the network.
△ Less
Submitted 11 January, 2024;
originally announced January 2024.
-
Topics in Boolean Representable Simplicial Complexes
Authors:
Stuart Margolis,
John Rhodes,
Pedro V. Silva
Abstract:
We study a number of topics in the theory of Boolean Representable Simplicial Complexes (BRSC). These include various operators on BRSC. We look at shellability in higher dimensions and propose a number of new conjectures.
We study a number of topics in the theory of Boolean Representable Simplicial Complexes (BRSC). These include various operators on BRSC. We look at shellability in higher dimensions and propose a number of new conjectures.
△ Less
Submitted 14 September, 2023;
originally announced September 2023.
-
A generalized AIC for models with singularities and boundaries
Authors:
Jonathan D. Mitchell,
Elizabeth S. Allman,
John A. Rhodes
Abstract:
The Akaike information criterion (AIC) is a common tool for model selection. It is frequently used in violation of regularity conditions at parameter space singularities and boundaries. The expected AIC is generally not asymptotically equivalent to its target at singularities and boundaries, and convergence to the target at nearby parameter points may be slow. We develop a generalized AIC for cand…
▽ More
The Akaike information criterion (AIC) is a common tool for model selection. It is frequently used in violation of regularity conditions at parameter space singularities and boundaries. The expected AIC is generally not asymptotically equivalent to its target at singularities and boundaries, and convergence to the target at nearby parameter points may be slow. We develop a generalized AIC for candidate models with or without singularities and boundaries. We show that the expectation of this generalized form converges everywhere in the parameter space, and its convergence can be faster than that of the AIC. We illustrate the generalized AIC on example models from phylogenomics, showing that it can outperform the AIC and gives rise to an interpolated effective number of model parameters, which can differ substantially from the number of parameters near singularities and boundaries. We outline methods for estimating the often unknown generating parameter and bias correction term of the generalized AIC.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
Parameter Identifiability of a Multitype Pure-Birth Model of Speciation
Authors:
Dakota Dragomir,
Elizabeth S. Allman,
John A. Rhodes
Abstract:
Diversification models describe the random growth of evolutionary trees, modeling the historical relationships of species through speciation and extinction events. One class of such models allows for independently changing traits, or types, of the species within the tree, upon which speciation and extinction rates depend. Although identifiability of parameters is necessary to justify parameter est…
▽ More
Diversification models describe the random growth of evolutionary trees, modeling the historical relationships of species through speciation and extinction events. One class of such models allows for independently changing traits, or types, of the species within the tree, upon which speciation and extinction rates depend. Although identifiability of parameters is necessary to justify parameter estimation with a model, it has not been formally established for these models, despite their adoption for inference. This work establishes generic identifiability up to label swapping for the parameters of one of the simpler forms of such a model, a multitype pure birth model of speciation, from an asymptotic distribution derived from a single tree observation as its depth goes to infinity. Crucially for applications to available data, no observation of types is needed at any internal points in the tree, nor even at the leaves.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.
-
The Tree of Blobs of a Species Network: Identifiability under the Coalescent
Authors:
Elizabeth S. Allman,
Hector Baños,
Jonathan D. Mitchell,
John A. Rhodes
Abstract:
Inference of species networks from genomic data under the Network Multispecies Coalescent Model is currently severely limited by heavy computational demands. It also remains unclear how complicated networks can be for consistent inference to be possible. As a step toward inferring a general species network, this work considers its tree of blobs, in which non-cut edges are contracted to nodes, so o…
▽ More
Inference of species networks from genomic data under the Network Multispecies Coalescent Model is currently severely limited by heavy computational demands. It also remains unclear how complicated networks can be for consistent inference to be possible. As a step toward inferring a general species network, this work considers its tree of blobs, in which non-cut edges are contracted to nodes, so only tree-like relationships between the taxa are shown. An identifiability theorem, that most features of the unrooted tree of blobs can be determined from the distribution of gene quartet topologies, is established. This depends upon an analysis of gene quartet concordance factors under the model, together with a new combinatorial inference rule. The arguments for this theoretical result suggest a practical algorithm for tree of blobs inference, to be fully developed in a subsequent work.
△ Less
Submitted 6 May, 2022;
originally announced May 2022.
-
Decidability of Krohn-Rhodes complexity $c = 1$ of finite semigroups and automata
Authors:
Stuart Margolis,
John Rhodes,
Anne Schilling
Abstract:
When decomposing a finite semigroup into a wreath product of groups and aperiodic semigroups, complexity measures the minimal number of groups that are needed. Determining an algorithm to compute complexity has been an open problem for almost 60 years. The main result of this paper proves decidability of Krohn-Rhodes complexity $c = 1$ of finite semigroups and automata. This is achieved by showing…
▽ More
When decomposing a finite semigroup into a wreath product of groups and aperiodic semigroups, complexity measures the minimal number of groups that are needed. Determining an algorithm to compute complexity has been an open problem for almost 60 years. The main result of this paper proves decidability of Krohn-Rhodes complexity $c = 1$ of finite semigroups and automata. This is achieved by showing the lower bounds in work by Henckell, Rhodes and Steinberg from 2012 is sharp using profinite methods and results of McCammond from 1991 and 2001.
△ Less
Submitted 4 August, 2023; v1 submitted 20 October, 2021;
originally announced October 2021.
-
Identifiability of species network topologies from genomic sequences using the logDet distance
Authors:
Elizabeth S. Allman,
Hector Baños,
John A. Rhodes
Abstract:
Inference of network-like evolutionary relationships between species from genomic data must address the interwoven signals from both gene flow and incomplete lineage sorting. The heavy computational demands of standard approaches to this problem severely limit the size of datasets that may be analyzed, in both the number of species and the number of genetic loci. Here we provide a theoretical poin…
▽ More
Inference of network-like evolutionary relationships between species from genomic data must address the interwoven signals from both gene flow and incomplete lineage sorting. The heavy computational demands of standard approaches to this problem severely limit the size of datasets that may be analyzed, in both the number of species and the number of genetic loci. Here we provide a theoretical pointer to more efficient methods, by showing that logDet distances computed from genomic-scale sequences retain sufficient information to recover network relationships in the level-1 ultrametric case. This result is obtained under the Network Multispecies Coalescent model combined with a mixture of General Time-Reversible sequence evolution models across individual gene trees, but does not depend on partitioning sequences by genes. Thus under standard stochastic models statistically justifiable inference of network relationships from sequences can be accomplished without consideration of individual genes or gene trees.
△ Less
Submitted 3 August, 2021;
originally announced August 2021.
-
Upper bounds on mixing time of finite Markov chains
Authors:
John Rhodes,
Anne Schilling
Abstract:
We provide a general framework for computing upper bounds on mixing times of finite Markov chains when its minimal ideal is left zero. Our analysis is based on combining results by Brown and Diaconis with our previous work on stationary distributions of finite Markov chains. Stationary distributions can be computed from the Karnofsky--Rhodes and McCammond expansion of the right Cayley graph of the…
▽ More
We provide a general framework for computing upper bounds on mixing times of finite Markov chains when its minimal ideal is left zero. Our analysis is based on combining results by Brown and Diaconis with our previous work on stationary distributions of finite Markov chains. Stationary distributions can be computed from the Karnofsky--Rhodes and McCammond expansion of the right Cayley graph of the finite semigroup underlying the Markov chain. Using loop graphs, which are planar graphs consisting of a straight line with attached loops, there are rational expressions for the stationary distribution in the probabilities. From these we obtain bounds on the mixing time. In addition, we provide a new Markov chain on linear extension of a poset with $n$ vertices, inspired by but different from the promotion Markov chain of Ayyer, Klee and the last author. The mixing time of this Markov chain is $O(n \log n)$.
△ Less
Submitted 10 August, 2022; v1 submitted 17 October, 2020;
originally announced October 2020.
-
Holonomy theorem for finite semigroups
Authors:
John Rhodes,
Anne Schilling,
Pedro V. Silva
Abstract:
We provide a simple proof of the Holonomy Theorem using a new Lyndon-Chiswell length function on the Karnofsky-Rhodes expansion of a semigroup. Unexpectedly, we have both a left and a right action on the Chiswell tree by elliptic maps.
We provide a simple proof of the Holonomy Theorem using a new Lyndon-Chiswell length function on the Karnofsky-Rhodes expansion of a semigroup. Unexpectedly, we have both a left and a right action on the Chiswell tree by elliptic maps.
△ Less
Submitted 15 October, 2021; v1 submitted 30 July, 2020;
originally announced July 2020.
-
Markov chains through semigroup graph expansions (a survey)
Authors:
John Rhodes,
Anne Schilling
Abstract:
We review the recent approach to Markov chains using the Karnofksy-Rhodes and McCammond expansions in semigroup theory by the authors and illustrate them by two examples.
We review the recent approach to Markov chains using the Karnofksy-Rhodes and McCammond expansions in semigroup theory by the authors and illustrate them by two examples.
△ Less
Submitted 29 May, 2020;
originally announced June 2020.
-
Degree 2 Transformation Semigroups as Continuous Maps on Graphs: Foundations and Structure
Authors:
Stuart W. Margolis,
John Rhodes
Abstract:
We develop the theory of transformation semigroups that have degree 2, that is, act by partial functions on a finite set such that the inverse image of points have at most two elements. We show that the graph of fibers of such an action gives a deep connection between semigroup theory and graph theory. It is known that the Krohn-Rhodes complexity of a degree 2 action is at most 2. We show that the…
▽ More
We develop the theory of transformation semigroups that have degree 2, that is, act by partial functions on a finite set such that the inverse image of points have at most two elements. We show that the graph of fibers of such an action gives a deep connection between semigroup theory and graph theory. It is known that the Krohn-Rhodes complexity of a degree 2 action is at most 2. We show that the monoid of continuous maps on a graph is the translational hull of an appropriate 0-simple semigroup. We show how group mapping semigroups can be considered as regular covers of their right letter mapping image and relate this to their graph of fibers.
△ Less
Submitted 6 May, 2020;
originally announced May 2020.
-
NANUQ: A method for inferring species networks from gene trees under the coalescent model
Authors:
Elizabeth Allman,
Hector Banos,
John Rhodes
Abstract:
Species networks generalize the notion of species trees to allow for hybridization or other lateral gene transfer. Under the Network Multispecies Coalescent Model, individual gene trees arising from a network can have any topology, but arise with frequencies dependent on the network structure and numerical parameters. We propose a new algorithm for statistical inference of a level-1 species networ…
▽ More
Species networks generalize the notion of species trees to allow for hybridization or other lateral gene transfer. Under the Network Multispecies Coalescent Model, individual gene trees arising from a network can have any topology, but arise with frequencies dependent on the network structure and numerical parameters. We propose a new algorithm for statistical inference of a level-1 species network under this model, from data consisting of gene tree topologies, and provide the theoretical justification for it. The algorithm is based in an analysis of quartets displayed on gene trees, combining several statistical hypothesis tests with combinatorial ideas such as a quartet-based intertaxon distance appropriate to networks, the NeighborNet algorithm for circular split systems, and the Circular Network algorithm for constructing a splits graph.
△ Less
Submitted 16 May, 2019;
originally announced May 2019.
-
Truncated Boolean Representable Simplicial Complexes
Authors:
Stuart W. Margolis,
John Rhodes,
Pedro Silva
Abstract:
We extend, in significant ways, the theory of truncated boolean representable simplicial complexes introduced in 2015. This theory, which includes all matroids, represents the largest class of finite simplicial complexes for which combinatorial geometry can be meaningfully applied
We extend, in significant ways, the theory of truncated boolean representable simplicial complexes introduced in 2015. This theory, which includes all matroids, represents the largest class of finite simplicial complexes for which combinatorial geometry can be meaningfully applied
△ Less
Submitted 8 April, 2019;
originally announced April 2019.
-
On the Wilson Monoid of a Pairwise Balanced Design
Authors:
Stuart W. Margolis,
John Rhodes,
Pedro Silva
Abstract:
We give a new perspective of the relationship between simple matroids of rank 3 and pairwise balanced designs, connecting Wilson's theorems and tools with the theory of truncated boolean representable simplicial complexes. We also introduce the concept of Wilson monoid W(X) of a pairwise balanced design X. We present some general algebraic properties and study in detail the cases of Steiner triple…
▽ More
We give a new perspective of the relationship between simple matroids of rank 3 and pairwise balanced designs, connecting Wilson's theorems and tools with the theory of truncated boolean representable simplicial complexes. We also introduce the concept of Wilson monoid W(X) of a pairwise balanced design X. We present some general algebraic properties and study in detail the cases of Steiner triple systems up to 19 points, as well as the case where a single block has more than 2 elements
△ Less
Submitted 8 April, 2019;
originally announced April 2019.
-
Global local covers
Authors:
John L. Rhodes,
Benjamin Steinberg,
J. C. Birget
Abstract:
This paper gives a systematic construction of certain covers of finite semigroups. These covers will be used in future work on the complexity of finite semigroups.
This paper gives a systematic construction of certain covers of finite semigroups. These covers will be used in future work on the complexity of finite semigroups.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
Normal distributions of finite Markov chains
Authors:
John Rhodes,
Anne Schilling
Abstract:
We show that the stationary distribution of a finite Markov chain can be expressed as the sum of certain normal distributions. These normal distributions are associated to planar graphs consisting of a straight line with attached loops. The loops touch only at one vertex either of the straight line or of another attached loop. Our analysis is based on our previous work, which derives the stationar…
▽ More
We show that the stationary distribution of a finite Markov chain can be expressed as the sum of certain normal distributions. These normal distributions are associated to planar graphs consisting of a straight line with attached loops. The loops touch only at one vertex either of the straight line or of another attached loop. Our analysis is based on our previous work, which derives the stationary distribution of a finite Markov chain using semaphore codes on the Karnofsky--Rhodes and McCammond expansion of the right Cayley graph of the finite semigroup underlying the Markov chain.
△ Less
Submitted 4 February, 2019;
originally announced February 2019.
-
Hypothesis testing near singularities and boundaries
Authors:
Jonathan D. Mitchell,
Elizabeth S. Allman,
John A. Rhodes
Abstract:
The likelihood ratio statistic, with its asymptotic $χ^2$ distribution at regular model points, is often used for hypothesis testing. At model singularities and boundaries, however, the asymptotic distribution may not be $χ^2$, as highlighted by recent work of Drton. Indeed, poor behavior of a $χ^2$ for testing near singularities and boundaries is apparent in simulations, and can lead to conservat…
▽ More
The likelihood ratio statistic, with its asymptotic $χ^2$ distribution at regular model points, is often used for hypothesis testing. At model singularities and boundaries, however, the asymptotic distribution may not be $χ^2$, as highlighted by recent work of Drton. Indeed, poor behavior of a $χ^2$ for testing near singularities and boundaries is apparent in simulations, and can lead to conservative or anti-conservative tests. Here we develop a new distribution designed for use in hypothesis testing near singularities and boundaries, which asymptotically agrees with that of the likelihood ratio statistic. For two example trinomial models, arising in the context of inference of evolutionary trees, we show the new distributions outperform a $χ^2$.
△ Less
Submitted 21 June, 2018;
originally announced June 2018.
-
Unified theory for finite Markov chains
Authors:
John Rhodes,
Anne Schilling
Abstract:
We provide a unified framework to compute the stationary distribution of any finite irreducible Markov chain or equivalently of any irreducible random walk on a finite semigroup $S$. Our methods use geometric finite semigroup theory via the Karnofsky-Rhodes and the McCammond expansions of finite semigroups with specified generators; this does not involve any linear algebra. The original Tsetlin li…
▽ More
We provide a unified framework to compute the stationary distribution of any finite irreducible Markov chain or equivalently of any irreducible random walk on a finite semigroup $S$. Our methods use geometric finite semigroup theory via the Karnofsky-Rhodes and the McCammond expansions of finite semigroups with specified generators; this does not involve any linear algebra. The original Tsetlin library is obtained by applying the expansions to $P(n)$, the set of all subsets of an $n$ element set. Our set-up generalizes previous groundbreaking work involving left-regular bands (or $\mathscr{R}$-trivial bands) by Brown and Diaconis, extensions to $\mathscr{R}$-trivial semigroups by Ayyer, Steinberg, Thiéry and the second author, and important recent work by Chung and Graham. The Karnofsky-Rhodes expansion of the right Cayley graph of $S$ in terms of generators yields again a right Cayley graph. The McCammond expansion provides normal forms for elements in the expanded $S$. Using our previous results with Silva based on work by Berstel, Perrin, Reutenauer, we construct (infinite) semaphore codes on which we can define Markov chains. These semaphore codes can be lumped using geometric semigroup theory. Using normal forms and associated Kleene expressions, they yield formulas for the stationary distribution of the finite Markov chain of the expanded $S$ and the original $S$. Analyzing the normal forms also provides an estimate on the mixing time.
△ Less
Submitted 4 February, 2019; v1 submitted 29 November, 2017;
originally announced November 2017.
-
On the Dowling and Rhodes lattices and wreath products
Authors:
Stuart W. Margolis,
John Rhodes,
Pedro V. Silva
Abstract:
Dowling and Rhodes defined different lattices on the set of triples (Subset, Partition, Cross Section) over a fixed finite group G. Although the Rhodes lattice is not a geometric lattice, it defines a matroid in the sense of the theory of Boolean representable simplicial complexes. This turns out to be the direct sum of a complete matroid with a lift matroid of the complete biased graph over G. As…
▽ More
Dowling and Rhodes defined different lattices on the set of triples (Subset, Partition, Cross Section) over a fixed finite group G. Although the Rhodes lattice is not a geometric lattice, it defines a matroid in the sense of the theory of Boolean representable simplicial complexes. This turns out to be the direct sum of a complete matroid with a lift matroid of the complete biased graph over G. As is well known, the Dowling lattice defines the frame matroid over a similar biased graph. This gives a new perspective on both matroids and also an application of matroid theory to the theory of finite semigroups. We also make progress on an important question for these classical matroids: what are the minimal Boolean representations and the minimum degree of a Boolean matrix representation?
△ Less
Submitted 15 October, 2017;
originally announced October 2017.
-
Maximum likelihood estimation of the Latent Class Model through model boundary decomposition
Authors:
Elizabeth S. Allman,
Hector Baños Cervantes,
Robin Evans,
Serkan Hoşten,
Kaie Kubjas,
Daniel Lemke,
John A. Rhodes,
Piotr Zwiernik
Abstract:
The Expectation-Maximization (EM) algorithm is routinely used for the maximum likelihood estimation in the latent class analysis. However, the EM algorithm comes with no guarantees of reaching the global optimum. We study the geometry of the latent class model in order to understand the behavior of the maximum likelihood estimator. In particular, we characterize the boundary stratification of the…
▽ More
The Expectation-Maximization (EM) algorithm is routinely used for the maximum likelihood estimation in the latent class analysis. However, the EM algorithm comes with no guarantees of reaching the global optimum. We study the geometry of the latent class model in order to understand the behavior of the maximum likelihood estimator. In particular, we characterize the boundary stratification of the binary latent class model with a binary hidden variable. For small models, such as for three binary observed variables, we show that this stratification allows exact computation of the maximum likelihood estimator. In this case we use simulations to study the maximum likelihood estimation attraction basins of the various strata. Our theoretical study is complemented with a careful analysis of the EM fixed point ideal which provides an alternative method of studying the boundary stratification and maximizing the likelihood function. In particular, we compute the minimal primes of this ideal in the case of a binary latent class model with a binary or ternary hidden random variable.
△ Less
Submitted 20 August, 2018; v1 submitted 4 October, 2017;
originally announced October 2017.
-
On the subsemigroup complex of an aperiodic Brandt semigroup
Authors:
Stuart Margolis,
John Rhodes,
Pedro V. Silva
Abstract:
We introduce the subsemigroup complex of a finite semigroup S as a (boolean representable) simplicial complex defined through chains in the lattice of subsemigroups of S. We present a research program for such complexes, illustrated through the particular case of combinatorial Brandt semigroups. The results include alternative characterizations of faces and facets, asymptotical estimates on the nu…
▽ More
We introduce the subsemigroup complex of a finite semigroup S as a (boolean representable) simplicial complex defined through chains in the lattice of subsemigroups of S. We present a research program for such complexes, illustrated through the particular case of combinatorial Brandt semigroups. The results include alternative characterizations of faces and facets, asymptotical estimates on the number of facets, or establishing when the complex is pure or a matroid.
△ Less
Submitted 14 May, 2017;
originally announced May 2017.
-
Join irreducible semigroups
Authors:
Edmond W. H. Lee,
John Rhodes,
Benjamin Steinberg
Abstract:
We begin a systematic study of finite semigroups that generate join irreducible members of the lattice of pseudovarieties of finite semigroups, which are important for the spectral theory of this lattice. Finite semigroups $S$ that generate join irreducible pseudovarieties are characterized as follows: whenever $S$ divides a direct product $A \times B$ of finite semigroups, then $S$ divides either…
▽ More
We begin a systematic study of finite semigroups that generate join irreducible members of the lattice of pseudovarieties of finite semigroups, which are important for the spectral theory of this lattice. Finite semigroups $S$ that generate join irreducible pseudovarieties are characterized as follows: whenever $S$ divides a direct product $A \times B$ of finite semigroups, then $S$ divides either $A^n$ or $B^n$ for some $n \geq 1$. We present a new operator ${ \mathbf{V} \mapsto \mathbf{V}^\mathsf{bar} }$ that preserves the property of join irreducibility, as does the dual operator, and show that iteration of these operators on any nontrivial join irreducible pseudovariety leads to an infinite hierarchy of join irreducible pseudovarieties. We also describe all join irreducible pseudovarieties generated by a semigroup of order up to five. It turns out that there are $30$ such pseudovarieties, and there is a relatively easy way to remember them. In addition, we survey most results known about join irreducible pseudovarieties to date and generalize a number of results in Sec. 7.3 of The $q$-theory of Finite Semigroups, Springer Monographs in Mathematics (Springer, Berlin, 2009).
△ Less
Submitted 29 June, 2019; v1 submitted 13 February, 2017;
originally announced February 2017.
-
Species tree inference from gene splits by Unrooted STAR methods
Authors:
Elizabeth S. Allman,
James H. Degnan,
John A. Rhodes
Abstract:
The $\text{NJ}_{st}$ method was proposed by Liu and Yu to infer a species tree topology from unrooted topological gene trees. While its statistical consistency under the multispecies coalescent model was established only for a 4-taxon tree, simulations demonstrated its good performance on gene trees inferred from sequences for many taxa. Here we prove the statistical consistency of the method for…
▽ More
The $\text{NJ}_{st}$ method was proposed by Liu and Yu to infer a species tree topology from unrooted topological gene trees. While its statistical consistency under the multispecies coalescent model was established only for a 4-taxon tree, simulations demonstrated its good performance on gene trees inferred from sequences for many taxa. Here we prove the statistical consistency of the method for an arbitrarily large species tree. Our approach connects $\text{NJ}_{st}$ to a generalization of the STAR method of Liu, Pearl and Edwards, and a previous theoretical analysis of it. We further show $\text{NJ}_{st}$ utilizes only the distribution of splits in the gene trees, and not their individual topologies. Finally, we discuss how multiple samples per taxon per gene should be handled for statistical consistency.
△ Less
Submitted 18 April, 2016;
originally announced April 2016.
-
The semaphore codes attached to a Turing machine via resets and their various limits
Authors:
John Rhodes,
Anne Schilling,
Pedro V. Silva
Abstract:
We introduce semaphore codes associated to a Turing machine via resets. Semaphore codes provide an approximation theory for resets. In this paper we generalize the set-up of our previous paper "Random walks on semaphore codes and delay de Bruijn semigroups" to the infinite case by taking the profinite limit of $k$-resets to obtain $(-ω)$-resets. We mention how this opens new avenues to attack the…
▽ More
We introduce semaphore codes associated to a Turing machine via resets. Semaphore codes provide an approximation theory for resets. In this paper we generalize the set-up of our previous paper "Random walks on semaphore codes and delay de Bruijn semigroups" to the infinite case by taking the profinite limit of $k$-resets to obtain $(-ω)$-resets. We mention how this opens new avenues to attack the P versus NP problem.
△ Less
Submitted 4 April, 2016;
originally announced April 2016.
-
On the atoms of algebraic lattices arising in $q$-theory
Authors:
Attila Egri-Nagy,
Marcel Jackson,
John Rhodes,
Benjamin Steinberg
Abstract:
We determine many of the atoms of the algebraic lattices arising in $\mathfrak{q}$-theory of finite semigroups.
We determine many of the atoms of the algebraic lattices arising in $\mathfrak{q}$-theory of finite semigroups.
△ Less
Submitted 15 January, 2017; v1 submitted 5 January, 2016;
originally announced January 2016.
-
On the lattice of flats of a boolean representable simplicial complex
Authors:
Stuart Margolis,
John Rhodes,
Pedro V. Silva
Abstract:
It is shown that the lattices of flats of boolean representable simplicial complexes are always atomistic, but semimodular if and only if the complex is a matroid. A canonical construction is introduced for arbitrary finite atomistic lattices, providing a characterization of the lattices of flats of boolean representable simplicial complexes and a decidability condition. We remark that every finit…
▽ More
It is shown that the lattices of flats of boolean representable simplicial complexes are always atomistic, but semimodular if and only if the complex is a matroid. A canonical construction is introduced for arbitrary finite atomistic lattices, providing a characterization of the lattices of flats of boolean representable simplicial complexes and a decidability condition. We remark that every finite lattice occurs as the lattice of flats of some simplicial complex.
△ Less
Submitted 19 October, 2015;
originally announced October 2015.
-
On the topology of a boolean representable simplicial complex
Authors:
Stuart Margolis,
John Rhodes,
Pedro V. Silva
Abstract:
It is proved that fundamental groups of boolean representable simplicial complexes are free and the rank is determined by the number and nature of the connected components of their graph of flats for dimension $\geq 2$. In the case of dimension 2, it is shown that boolean representable simplicial complexes have the homotopy type of a wedge of spheres of dimensions 1 and 2. Also in the case of dime…
▽ More
It is proved that fundamental groups of boolean representable simplicial complexes are free and the rank is determined by the number and nature of the connected components of their graph of flats for dimension $\geq 2$. In the case of dimension 2, it is shown that boolean representable simplicial complexes have the homotopy type of a wedge of spheres of dimensions 1 and 2. Also in the case of dimension 2, necessary and sufficient conditions for shellability and being sequentially Cohen-Macaulay are determined. Complexity bounds are provided for all the algorithms involved.
△ Less
Submitted 17 October, 2015;
originally announced October 2015.
-
Random walks on semaphore codes and delay de Bruijn semigroups
Authors:
John Rhodes,
Anne Schilling,
Pedro V. Silva
Abstract:
We develop a new approach to random walks on de Bruijn graphs over the alphabet $A$ through right congruences on $A^k$, defined using the natural right action of $A^+$. A major role is played by special right congruences, which correspond to semaphore codes and allow an easier computation of the hitting time. We show how right congruences can be approximated by special right congruences.
We develop a new approach to random walks on de Bruijn graphs over the alphabet $A$ through right congruences on $A^k$, defined using the natural right action of $A^+$. A major role is played by special right congruences, which correspond to semaphore codes and allow an easier computation of the hitting time. We show how right congruences can be approximated by special right congruences.
△ Less
Submitted 4 April, 2016; v1 submitted 10 September, 2015;
originally announced September 2015.
-
Parameter identifiability of discrete Bayesian networks with hidden variables
Authors:
Elizabeth S. Allman,
John A. Rhodes,
Elena Stanghellini,
Marco Valtorta
Abstract:
Identifiability of parameters is an essential property for a statistical model to be useful in most settings. However, establishing parameter identifiability for Bayesian networks with hidden variables remains challenging. In the context of finite state spaces, we give algebraic arguments establishing identifiability of some special models on small DAGs. We also establish that, for fixed state spa…
▽ More
Identifiability of parameters is an essential property for a statistical model to be useful in most settings. However, establishing parameter identifiability for Bayesian networks with hidden variables remains challenging. In the context of finite state spaces, we give algebraic arguments establishing identifiability of some special models on small DAGs. We also establish that, for fixed state spaces, generic identifiability of parameters depends only on the Markov equivalence class of the DAG. To illustrate the use of these results, we investigate identifiability for all binary Bayesian networks with up to five variables, one of which is hidden and parental to all observable ones. Surprisingly, some of these models have parameterizations that are generically 4-to-one, and not 2-to-one as label swapping of the hidden states would suggest. This leads to interesting difficulties in interpreting causal effects.
△ Less
Submitted 2 June, 2014;
originally announced June 2014.
-
Tensors of Nonnegative Rank Two
Authors:
Elizabeth S. Allman,
John A. Rhodes,
Bernd Sturmfels,
Piotr Zwiernik
Abstract:
A nonnegative tensor has nonnegative rank at most 2 if and only if it is supermodular and has flattening rank at most 2. We prove this result, then explore the semialgebraic geometry of the general Markov model on phylogenetic trees with binary states, and comment on possible extensions to tensors of higher rank.
A nonnegative tensor has nonnegative rank at most 2 if and only if it is supermodular and has flattening rank at most 2. We prove this result, then explore the semialgebraic geometry of the general Markov model on phylogenetic trees with binary states, and comment on possible extensions to tensors of higher rank.
△ Less
Submitted 2 May, 2013;
originally announced May 2013.
-
A semialgebraic description of the general Markov model on phylogenetic trees
Authors:
Elizabeth S. Allman,
John A. Rhodes,
Amelia Taylor
Abstract:
Many of the stochastic models used in inference of phylogenetic trees from biological sequence data have polynomial parameterization maps. The image of such a map --- the collection of joint distributions for a model --- forms the model space. Since the parameterization is polynomial, the Zariski closure of the model space is an algebraic variety which is typically much larger than the model space…
▽ More
Many of the stochastic models used in inference of phylogenetic trees from biological sequence data have polynomial parameterization maps. The image of such a map --- the collection of joint distributions for a model --- forms the model space. Since the parameterization is polynomial, the Zariski closure of the model space is an algebraic variety which is typically much larger than the model space, but has been usefully studied with algebraic methods. Of ultimate interest, however, is not the full variety, but only the model space. Here we develop complete semialgebraic descriptions of the model space arising from the k-state general Markov model on a tree, with slightly restricted parameters. Our approach depends upon both recently-formulated analogs of Cayley's hyperdeterminant, and the construction of certain quadratic forms from the joint distribution whose positive (semi-)definiteness encodes information about parameter values. We additionally investigate the use of Sturm sequences for obtaining similar results.
△ Less
Submitted 5 December, 2012;
originally announced December 2012.
-
Tensor Rank, Invariants, Inequalities, and Applications
Authors:
Elizabeth S. Allman,
Peter D. Jarvis,
John A. Rhodes,
Jeremy G. Sumner
Abstract:
Though algebraic geometry over $\mathbb C$ is often used to describe the closure of the tensors of a given size and complex rank, this variety includes tensors of both smaller and larger rank. Here we focus on the $n\times n\times n$ tensors of rank $n$ over $\mathbb C$, which has as a dense subset the orbit of a single tensor under a natural group action. We construct polynomial invariants under…
▽ More
Though algebraic geometry over $\mathbb C$ is often used to describe the closure of the tensors of a given size and complex rank, this variety includes tensors of both smaller and larger rank. Here we focus on the $n\times n\times n$ tensors of rank $n$ over $\mathbb C$, which has as a dense subset the orbit of a single tensor under a natural group action. We construct polynomial invariants under this group action whose non-vanishing distinguishes this orbit from points only in its closure. Together with an explicit subset of the defining polynomials of the variety, this gives a semialgebraic description of the tensors of rank $n$ and multilinear rank $(n,n,n)$. The polynomials we construct coincide with Cayley's hyperdeterminant in the case $n=2$, and thus generalize it. Though our construction is direct and explicit, we also recast our functions in the language of representation theory for additional insights.
We give three applications in different directions: First, we develop basic topological understanding of how the real tensors of complex rank $n$ and multilinear rank $(n,n,n)$ form a collection of path-connected subsets, one of which contains tensors of real rank $n$. Second, we use the invariants to develop a semialgebraic description of the set of probability distributions that can arise from a simple stochastic model with a hidden variable, a model that is important in phylogenetics and other fields. Third, we construct simple examples of tensors of rank $2n-1$ which lie in the closure of those of rank $n$.
△ Less
Submitted 14 November, 2012;
originally announced November 2012.
-
Matroids, hereditary collections and simplicial complexes having boolean representations
Authors:
John Rhodes,
Pedro V. Silva
Abstract:
Inspired by the work of Izakhian and Rhodes, a theory of representation of hereditary collections by boolean matrices is developed. This corresponds to representation by finite $\vee$-generated lattices. The lattice of flats, defined for hereditary collections, lattices and matrices, plays a central role in the theory. The representations constitute a lattice and the minimal and strictly join irre…
▽ More
Inspired by the work of Izakhian and Rhodes, a theory of representation of hereditary collections by boolean matrices is developed. This corresponds to representation by finite $\vee$-generated lattices. The lattice of flats, defined for hereditary collections, lattices and matrices, plays a central role in the theory. The representations constitute a lattice and the minimal and strictly join irreducible elements are studied, as well as various closure operators.
△ Less
Submitted 26 October, 2012;
originally announced October 2012.
-
Species tree inference by the STAR method, and generalizations
Authors:
Elizabeth S. Allman,
James H. Degnan,
John A. Rhodes
Abstract:
The multispecies coalescent model describes the generation of gene trees from a rooted metric species tree, and thus provides a framework for the inference of species trees from sampled gene trees. We prove that the STAR method of Liu et al., and generalizations of it, are statistically consistent methods of topological species tree inference under this model. We discuss the impact of gene tree sa…
▽ More
The multispecies coalescent model describes the generation of gene trees from a rooted metric species tree, and thus provides a framework for the inference of species trees from sampled gene trees. We prove that the STAR method of Liu et al., and generalizations of it, are statistically consistent methods of topological species tree inference under this model. We discuss the impact of gene tree sampling schemes for species tree inference using generalized STAR methods, and reinterpret the original STAR as a consensus method based on clades.
△ Less
Submitted 19 April, 2012;
originally announced April 2012.
-
When Do Phylogenetic Mixture Models Mimic Other Phylogenetic Models?
Authors:
Elizabeth S. Allman,
John A. Rhodes,
Seth Sullivant
Abstract:
Phylogenetic mixture models, in which the sites in sequences undergo different substitution processes along the same or different trees, allow the description of heterogeneous evolutionary processes. As data sets consisting of longer sequences become available, it is important to understand such models, for both theoretical insights and use in statistical analyses. Some recent articles have highli…
▽ More
Phylogenetic mixture models, in which the sites in sequences undergo different substitution processes along the same or different trees, allow the description of heterogeneous evolutionary processes. As data sets consisting of longer sequences become available, it is important to understand such models, for both theoretical insights and use in statistical analyses. Some recent articles have highlighted disturbing "mimicking" behavior in which a distribution from a mixture model is identical to one arising on a different tree or trees. Other works have indicated such problems are unlikely to occur in practice, as they require very special parameter choices.
After surveying some of these works on mixture models, we give several new results. In general, if the number of components in a generating mixture is not too large and we disallow zero or infinite branch lengths, then it cannot mimic the behavior of a non-mixture on a different tree. On the other hand, if the mixture model is locally over-parameterized, it is possible for a phylogenetic mixture model to mimic distributions of another tree model. Though theoretical questions remain, these sorts of results can serve as a guide to when the use of mixture models in either ML or Bayesian frameworks is likely to lead to statistically consistent inference, and when mimicking due to heterogeneity should be considered a realistic possibility.
△ Less
Submitted 16 July, 2012; v1 submitted 10 February, 2012;
originally announced February 2012.
-
A new notion of vertex independence and rank for finite graphs
Authors:
John Rhodes,
Pedro V. Silva
Abstract:
A new notion of vertex independence and rank for a finite graph G is introduced. The independence of vertices is based on the boolean independence of columns of a natural boolean matrix associated to G. Rank is the cardinality of the largest set of independent columns. Some basic properties and some more advanced theorems are proved. Geometric properties of the graph are related to its rank and in…
▽ More
A new notion of vertex independence and rank for a finite graph G is introduced. The independence of vertices is based on the boolean independence of columns of a natural boolean matrix associated to G. Rank is the cardinality of the largest set of independent columns. Some basic properties and some more advanced theorems are proved. Geometric properties of the graph are related to its rank and independent sets.
△ Less
Submitted 13 February, 2012; v1 submitted 19 January, 2012;
originally announced January 2012.
-
C-independence and c-rank of posets and lattices
Authors:
Zur Izhakian,
John Rhodes
Abstract:
Continuing with the authors concept (and results) of defining independence for columns of a boolean and superboolean matrix, we apply this theory to finite lattices and finite posets, introducing boolean and superboolean matrix representations for these objects. These representations yield the new concept of c-independent subsets of lattices and posets, for which the notion of c-rank is determined…
▽ More
Continuing with the authors concept (and results) of defining independence for columns of a boolean and superboolean matrix, we apply this theory to finite lattices and finite posets, introducing boolean and superboolean matrix representations for these objects. These representations yield the new concept of c-independent subsets of lattices and posets, for which the notion of c-rank is determined as the cardinality of the largest c-independent subset. We characterize this c-rank and show that c-independent subsets have a very natural interpretation in term of the maximal chains of the Hasse diagram and the associated partitions of the lattice. This realization has direct important connections with chamber systems.
△ Less
Submitted 16 October, 2011;
originally announced October 2011.
-
Superboolean rank and the size of the largest triangular submatrix of a random matrix
Authors:
Zur Izhakian,
Svante Janson,
John Rhodes
Abstract:
We explore the size of the largest (permuted) triangular submatrix of a random matrix, and more precisely its asymptotical behavior as the size of the ambient matrix tends to infinity. The importance of such permuted triangular submatrices arises when dealing with certain combinatorial algebraic settings in which these submatrices determine the rank of the ambient matrix, and thus attract a specia…
▽ More
We explore the size of the largest (permuted) triangular submatrix of a random matrix, and more precisely its asymptotical behavior as the size of the ambient matrix tends to infinity. The importance of such permuted triangular submatrices arises when dealing with certain combinatorial algebraic settings in which these submatrices determine the rank of the ambient matrix, and thus attract a special attention.
△ Less
Submitted 26 September, 2011;
originally announced September 2011.
-
Boolean Representations of Matroids and Lattices
Authors:
Zur Izhakian,
John Rhodes
Abstract:
We introduce a new representation concept for lattices by boolean matrices, and utilize it to prove that any matroid is boolean representable. We show that such a representation can be easily extracted from a representation of the associated lattice of flats of the matroid, leading also to a tighter bound on the representation's size. Consequently, we obtain a linkage of boolean representations wi…
▽ More
We introduce a new representation concept for lattices by boolean matrices, and utilize it to prove that any matroid is boolean representable. We show that such a representation can be easily extracted from a representation of the associated lattice of flats of the matroid, leading also to a tighter bound on the representation's size. Consequently, we obtain a linkage of boolean representations with geometry in a very natural way.
△ Less
Submitted 31 January, 2012; v1 submitted 6 August, 2011;
originally announced August 2011.
-
Geometric Semigroup Theory
Authors:
Jon McCammond,
John Rhodes,
Benjamin Steinberg
Abstract:
Geometric semigroup theory is the systematic investigation of finitely-generated semigroups using the topology and geometry of their associated automata. In this article we show how a number of easily-defined expansions on finite semigroups and automata lead to simplifications of the graphs on which the corresponding finite semigroups act. We show in particular that every finite semigroup can be f…
▽ More
Geometric semigroup theory is the systematic investigation of finitely-generated semigroups using the topology and geometry of their associated automata. In this article we show how a number of easily-defined expansions on finite semigroups and automata lead to simplifications of the graphs on which the corresponding finite semigroups act. We show in particular that every finite semigroup can be finitely expanded so that the expansion acts on a labeled directed graph which resembles the right Cayley graph of a free Burnside semigroup in many respects.
△ Less
Submitted 12 April, 2011;
originally announced April 2011.
-
Further results on monoids acting on trees
Authors:
John Rhodes,
Pedro V. Silva
Abstract:
This paper further develops the theory of arbitrary semigroups acting on trees via elliptic mappings. A key tool is the Lyndon-Chiswell length function L for the semigroup S which allows one to construct a tree T and an action of S on T via elliptic maps. Improving on previous results, the length function of the action will also be L.
This paper further develops the theory of arbitrary semigroups acting on trees via elliptic mappings. A key tool is the Lyndon-Chiswell length function L for the semigroup S which allows one to construct a tree T and an action of S on T via elliptic maps. Improving on previous results, the length function of the action will also be L.
△ Less
Submitted 11 March, 2011;
originally announced March 2011.
-
New Representations of Matroids and Generalizations
Authors:
Zur Izhakian,
John Rhodes
Abstract:
We extend the notion of matroid representations by matrices over fields and consider new representations of matroids by matrices over finite semirings, more precisely over the boolean and the superboolean semirings. This idea of representations is generalized naturally to include also hereditary collections. We show that a matroid that can be directly decomposed as matroids, each of which is repre…
▽ More
We extend the notion of matroid representations by matrices over fields and consider new representations of matroids by matrices over finite semirings, more precisely over the boolean and the superboolean semirings. This idea of representations is generalized naturally to include also hereditary collections. We show that a matroid that can be directly decomposed as matroids, each of which is representable over a field, has a boolean representation, and more generally that any arbitrary hereditary collection is superboolean-representable.
△ Less
Submitted 2 March, 2011;
originally announced March 2011.
-
Determining species tree topologies from clade probabilities under the coalescent
Authors:
Elizabeth S. Allman,
James H. Degnan,
John A. Rhodes
Abstract:
One approach to estimating a species tree from a collection of gene trees is to first estimate probabilities of clades from the gene trees, and then to construct the species tree from the estimated clade probabilities. While a greedy consensus algorithm, which consecutively accepts the most probable clades compatible with previously accepted clades, can be used for this second stage, this method i…
▽ More
One approach to estimating a species tree from a collection of gene trees is to first estimate probabilities of clades from the gene trees, and then to construct the species tree from the estimated clade probabilities. While a greedy consensus algorithm, which consecutively accepts the most probable clades compatible with previously accepted clades, can be used for this second stage, this method is known to be statistically inconsistent under the multispecies coalescent model. This raises the question of whether it is theoretically possible to reconstruct the species tree from known probabilities of clades on gene trees. We investigate clade probabilities arising from the multispecies coalescent model, with an eye toward identifying features of the species tree. Clades on gene trees with probability greater than 1/3 are shown to reflect clades on the species tree, while those with smaller probabilities may not. Linear invariants of clade probabilities are studied both computationally and theoretically, with certain linear invariants giving insight into the clade structure of the species tree. For species trees with generic edge lengths, these invariants can be used to identify the species tree topology. These theoretical results both confirm that clade probabilities contain full information on the species tree topology and suggest future directions of study for developing statistically consistent inference methods from clade frequencies on gene trees.
△ Less
Submitted 2 March, 2011;
originally announced March 2011.
-
Identifiability of Large Phylogenetic Mixture Models
Authors:
John A. Rhodes,
Seth Sullivant
Abstract:
Phylogenetic mixture models are statistical models of character evolution allowing for heterogeneity. Each of the classes in some unknown partition of the characters may evolve by different processes, or even along different trees. The fundamental question of whether parameters of such a model are identifiable is difficult to address, due to the complexity of the parameterization. We analyze mixtu…
▽ More
Phylogenetic mixture models are statistical models of character evolution allowing for heterogeneity. Each of the classes in some unknown partition of the characters may evolve by different processes, or even along different trees. The fundamental question of whether parameters of such a model are identifiable is difficult to address, due to the complexity of the parameterization. We analyze mixture models on large trees, with many mixture components, showing that both numerical and tree parameters are indeed identifiable in these models when all trees are the same. We also explore the extent to which our algebraic techniques can be employed to extend the result to mixtures on different trees.
△ Less
Submitted 17 November, 2010;
originally announced November 2010.
-
Parameter identifiability in a class of random graph mixture models
Authors:
Elizabeth S. Allman,
Catherine Matias,
John A. Rhodes
Abstract:
We prove identifiability of parameters for a broad class of random graph mixture models. These models are characterized by a partition of the set of graph nodes into latent (unobservable) groups. The connectivities between nodes are independent random variables when conditioned on the groups of the nodes being connected. In the binary random graph case, in which edges are either present or absent,…
▽ More
We prove identifiability of parameters for a broad class of random graph mixture models. These models are characterized by a partition of the set of graph nodes into latent (unobservable) groups. The connectivities between nodes are independent random variables when conditioned on the groups of the nodes being connected. In the binary random graph case, in which edges are either present or absent, these models are known as stochastic blockmodels and have been widely used in the social sciences and, more recently, in biology. Their generalizations to weighted random graphs, either in parametric or non-parametric form, are also of interest in many areas. Despite a broad range of applications, the parameter identifiability issue for such models is involved, and previously has only been touched upon in the literature. We give here a thorough investigation of this problem. Our work also has consequences for parameter estimation. In particular, the estimation procedure proposed by Frank and Harary for binary affiliation models is revisited in this article.
△ Less
Submitted 4 June, 2010;
originally announced June 2010.
