-
Flow Models for Unbounded and Geometry-Aware Distributional Reinforcement Learning
Authors:
Simo Alami C.,
Rim Kaddah,
Jesse Read,
Marie-Paule Cani
Abstract:
We introduce a new architecture for Distributional Reinforcement Learning (DistRL) that models return distributions using normalizing flows. This approach enables flexible, unbounded support for return distributions, in contrast to categorical approaches like C51 that rely on fixed or bounded representations. It also offers richer modeling capacity to capture multi-modality, skewness, and tail beh…
▽ More
We introduce a new architecture for Distributional Reinforcement Learning (DistRL) that models return distributions using normalizing flows. This approach enables flexible, unbounded support for return distributions, in contrast to categorical approaches like C51 that rely on fixed or bounded representations. It also offers richer modeling capacity to capture multi-modality, skewness, and tail behavior than quantile based approaches. Our method is significantly more parameter-efficient than categorical approaches. Standard metrics used to train existing models like KL divergence or Wasserstein distance either are scale insensitive or have biased sample gradients, especially when return supports do not overlap. To address this, we propose a novel surrogate for the Cramèr distance, that is geometry-aware and computable directly from the return distribution's PDF, avoiding the costly CDF computation. We test our model on the ATARI-5 sub-benchmark and show that our approach outperforms PDF based models while remaining competitive with quantile based methods.
△ Less
Submitted 7 May, 2025;
originally announced May 2025.
-
A Joint introduction to Gaussian Processes and Relevance Vector Machines with Connections to Kalman filtering and other Kernel Smoothers
Authors:
Luca Martino,
Jesse Read
Abstract:
The expressive power of Bayesian kernel-based methods has led them to become an important tool across many different facets of artificial intelligence, and useful to a plethora of modern application domains, providing both power and interpretability via uncertainty analysis. This article introduces and discusses two methods which straddle the areas of probabilistic Bayesian schemes and kernel meth…
▽ More
The expressive power of Bayesian kernel-based methods has led them to become an important tool across many different facets of artificial intelligence, and useful to a plethora of modern application domains, providing both power and interpretability via uncertainty analysis. This article introduces and discusses two methods which straddle the areas of probabilistic Bayesian schemes and kernel methods for regression: Gaussian Processes and Relevance Vector Machines. Our focus is on developing a common framework with which to view these methods, via intermediate methods a probabilistic version of the well-known kernel ridge regression, and drawing connections among them, via dual formulations, and discussion of their application in the context of major tasks: regression, smoothing, interpolation, and filtering. Overall, we provide understanding of the mathematical concepts behind these models, and we summarize and discuss in depth different interpretations and highlight the relationship to other methods, such as linear kernel smoothers, Kalman filtering and Fourier approximations. Throughout, we provide numerous figures to promote understanding, and we make numerous recommendations to practitioners. Benefits and drawbacks of the different techniques are highlighted. To our knowledge, this is the most in-depth study of its kind to date focused on these two methods, and will be relevant to theoretical understanding and practitioners throughout the domains of data-science, signal processing, machine learning, and artificial intelligence in general.
△ Less
Submitted 11 July, 2021; v1 submitted 19 September, 2020;
originally announced September 2020.
-
Yang-Mills Theory and the ABC Conjecture
Authors:
Yang-Hui He,
Zhi Hu,
Malte Probst,
James Read
Abstract:
We establish a precise correspondence between the ABC Conjecture and N=4 super-Yang-Mills theory.
This is achieved by combining three ingredients: (i) Elkies' method of mapping ABC-triples to elliptic curves in his demonstration that ABC implies Mordell/Faltings; (ii) an explicit pair of elliptic curve and associated Belyi map given by Khadjavi-Scharaschkin; and (iii) the fact that the bipartite…
▽ More
We establish a precise correspondence between the ABC Conjecture and N=4 super-Yang-Mills theory.
This is achieved by combining three ingredients: (i) Elkies' method of mapping ABC-triples to elliptic curves in his demonstration that ABC implies Mordell/Faltings; (ii) an explicit pair of elliptic curve and associated Belyi map given by Khadjavi-Scharaschkin; and (iii) the fact that the bipartite brane-tiling/dimer model for a gauge theory with toric moduli space is a particular dessin d'enfant in the sense of Grothendieck.
We explore this correspondence for the highest quality ABC-triples as well as large samples of random triples. The Conjecture itself is mapped to a statement about the fundamental domain of the toroidal compactification of the string realization of N=4 SYM.
△ Less
Submitted 5 September, 2017; v1 submitted 4 February, 2016;
originally announced February 2016.
-
Dessins d'Enfants in $\mathcal{N}=2$ Generalised Quiver Theories
Authors:
Yang-Hui He,
James Read
Abstract:
We study Grothendieck's dessins d'enfants in the context of the $\mathcal{N}=2$ supersymmetric gauge theories in $\left(3+1\right)$ dimensions with product $SU\left(2\right)$ gauge groups which have recently been considered by Gaiotto et al. We identify the precise context in which dessins arise in these theories: they are the so-called ribbon graphs of such theories at certain isolated points in…
▽ More
We study Grothendieck's dessins d'enfants in the context of the $\mathcal{N}=2$ supersymmetric gauge theories in $\left(3+1\right)$ dimensions with product $SU\left(2\right)$ gauge groups which have recently been considered by Gaiotto et al. We identify the precise context in which dessins arise in these theories: they are the so-called ribbon graphs of such theories at certain isolated points in the Coulomb branch of the moduli space. With this point in mind, we highlight connections to other work on trivalent dessins, gauge theories, and the modular group.
△ Less
Submitted 15 September, 2015; v1 submitted 22 March, 2015;
originally announced March 2015.
-
Order theory and interpolation in operator algebras
Authors:
David P. Blecher,
Charles John Read
Abstract:
We continue our study of operator algebras with and contractive approximate identities (cais). In earlier papers we have introduced and studied a new notion of positivity in operator algebras, with an eye to extending certain C*-algebraic results and theories to more general algebras. Here we continue to develop this positivity and its associated ordering, proving many foundational facts. We also…
▽ More
We continue our study of operator algebras with and contractive approximate identities (cais). In earlier papers we have introduced and studied a new notion of positivity in operator algebras, with an eye to extending certain C*-algebraic results and theories to more general algebras. Here we continue to develop this positivity and its associated ordering, proving many foundational facts. We also give many applications, for example to noncommutative topology, noncommutative peak sets, lifting problems, peak interpolation, approximate identities, and to order relations between an operator algebra and the C*-algebra it generates. In much of this it is not necessary that the algebra have an approximate identity. Many of our results apply immediately to function algebras, but we will not take the time to point these out, although most of these applications seem new.
△ Less
Submitted 4 July, 2014;
originally announced July 2014.
-
Operator algebras with contractive approximate identities: Weak compactness and the spectrum
Authors:
David P. Blecher,
Charles John Read
Abstract:
We continue our study of operator algebras with contractive approximate identities (cais) by presenting a couple of interesting examples of operator algebras with cais, which in particular answer questions raised in previous papers in this series, for example about whether, roughly speaking, `weak compactness' of an operator algebra, or the lack of it, can be seen in the spectra of its elements.
We continue our study of operator algebras with contractive approximate identities (cais) by presenting a couple of interesting examples of operator algebras with cais, which in particular answer questions raised in previous papers in this series, for example about whether, roughly speaking, `weak compactness' of an operator algebra, or the lack of it, can be seen in the spectra of its elements.
△ Less
Submitted 4 July, 2014;
originally announced July 2014.
-
The Bidual of a Radical Operator algebra can be Semisimple
Authors:
Charles John Read
Abstract:
The paper of S. Gulick [Sidney (Denny) L. Gulick, Commutativity and ideals in the biduals of topological algebras, Pacific J. Math 18 No. 1, 1966] contains some good mathematics, but it also contains an error. It claims that for a Banach algebra A, the intersection of the Jacobson radical of A** with A is precisely the radical of A (this is claimed for either of the Arens products on A** - in itse…
▽ More
The paper of S. Gulick [Sidney (Denny) L. Gulick, Commutativity and ideals in the biduals of topological algebras, Pacific J. Math 18 No. 1, 1966] contains some good mathematics, but it also contains an error. It claims that for a Banach algebra A, the intersection of the Jacobson radical of A** with A is precisely the radical of A (this is claimed for either of the Arens products on A** - in itself a reasonable claim, because A is always contained in the topological centre of A**, so a fixed a in A lies in the radical of A** with the first Arens product, if and only if it lies in the radical of A** when that Banach space is given the second Arens product, if and only if ab is quasinilpotent for every b in A**). In this paper we begin with a simple counterexample to that claim, in which A is a radical operator algebra, but not every element of A lies in the radical of A**. We then develope a more complicated example A which, once again, is a radical operator algebra, but A** is semisimple. So rad A** $\cap$ A is zero, but rad A=A. We conclude by examining the uses Gulick's paper has been put to since 1966 (at least 8 subsequent papers refer to it), and we find that most authors have used the correct material from that paper, and avoided using the wrong result. We reckon, then, that we are not the first to suspect that the result rad A** $\cap$ A=rad A was wrong; but we believe we are the first to provide "neat" counterexamples as described.
△ Less
Submitted 24 March, 2014;
originally announced March 2014.
-
Hecke Groups, Dessins d'Enfants and the Archimedean Solids
Authors:
Yang-Hui He,
James Read
Abstract:
Grothendieck's dessins d'enfants arise with ever-increasing frequency in many areas of 21st century mathematical physics. In this paper, we review the connections between dessins and the theory of Hecke groups. Focussing on the restricted class of highly symmetric dessins corresponding to the so-called Archimedean solids, we apply this theory in order to provide a means of computing representative…
▽ More
Grothendieck's dessins d'enfants arise with ever-increasing frequency in many areas of 21st century mathematical physics. In this paper, we review the connections between dessins and the theory of Hecke groups. Focussing on the restricted class of highly symmetric dessins corresponding to the so-called Archimedean solids, we apply this theory in order to provide a means of computing representatives of the associated conjugacy classes of Hecke subgroups in each case. The aim of this paper is to demonstrate that dessins arising in mathematical physics can point to new and hitherto unexpected directions for further research. In addition, given the particular ubiquity of many of the dessins corresponding to the Archimedean solids, the hope is that the computational results of this paper will prove useful in the further study of these objects in mathematical physics contexts.
△ Less
Submitted 15 February, 2016; v1 submitted 9 September, 2013;
originally announced September 2013.
-
Operator algebras with contractive approximate identities: A large operator algebra in c0
Authors:
David P. Blecher,
Charles John Read
Abstract:
We exhibit a singly generated, semisimple commutative operator algebra with a contractive approximate identity, such that the spectrum of the generator is a null sequence and zero, but the algebra is not the closed linear span of the idempotents associated with the null sequence and obtained from the analytic functional calculus. Moreover the multiplication on the algebra is neither compact nor we…
▽ More
We exhibit a singly generated, semisimple commutative operator algebra with a contractive approximate identity, such that the spectrum of the generator is a null sequence and zero, but the algebra is not the closed linear span of the idempotents associated with the null sequence and obtained from the analytic functional calculus. Moreover the multiplication on the algebra is neither compact nor weakly compact. Thus we construct a `large' operator algebra of orthogonal idempotents, which may be viewed as a dense subalgebra of c0.
△ Less
Submitted 25 October, 2014; v1 submitted 8 September, 2013;
originally announced September 2013.
-
Operator algebras with contractive approximate identities, III
Authors:
David P. Blecher,
Charles John Read
Abstract:
We continue our study of operator algebras with contractive approximate identities (cais). In earlier papers we have introduced and studied a new notion of positivity in operator algebras, with an eye to extending certain $C^*$-algebraic results and theories to more general algebras. In the first part of this paper we do a more systematic development of this positivity and its associated ordering,…
▽ More
We continue our study of operator algebras with contractive approximate identities (cais). In earlier papers we have introduced and studied a new notion of positivity in operator algebras, with an eye to extending certain $C^*$-algebraic results and theories to more general algebras. In the first part of this paper we do a more systematic development of this positivity and its associated ordering, proving many foundational facts. In much of this it is not necessary that the algebra have an approximate identity. In the second part we study interesting examples of operator algebras with cais, which in particular answer questions raised in previous papers in this series. Indeed the present work solves almost all of the open questions raised in these papers. Many of our results apply immediately to function algebras, but we will not take the time to point these out, although most of these applications seem new.
△ Less
Submitted 14 September, 2013; v1 submitted 12 August, 2013;
originally announced August 2013.
-
Banach spaces with no proximinal subspaces of codimension 2
Authors:
Charles John Read
Abstract:
The classical theorem of Bishop-Phelps asserts that, for a Banach space X, the norm-achieving functionals in X* are dense in X*. Bela Bollobas's extension of the theorem gives a quantitative description of just how dense the norm-achieving functionals have to be: if (x,f) is in X x X* with ||x||=||f||=1 and |1-f(x)|< h^2/4 then there are (x',f') in X x X* with ||x'||= ||f'||=1, ||x-x'||, ||f-f'||<…
▽ More
The classical theorem of Bishop-Phelps asserts that, for a Banach space X, the norm-achieving functionals in X* are dense in X*. Bela Bollobas's extension of the theorem gives a quantitative description of just how dense the norm-achieving functionals have to be: if (x,f) is in X x X* with ||x||=||f||=1 and |1-f(x)|< h^2/4 then there are (x',f') in X x X* with ||x'||= ||f'||=1, ||x-x'||, ||f-f'||< h and f'(x')=1.
This means that there are always "proximinal" hyperplanes H in X (a nonempty subset E of a metric space is said to be "proximinal" if, for x not in E, the distance d(x,E) is always achieved - there is always an e in E with d(x,E)=d(x,e)); for if H= ker f (f in X*) then it is easy to see that H is proximinal if and only if f is norm-achieving. Indeed the set of proximinal hyperplanes H is, in the appropriate sense, dense in the set of all closed hyperplanes H in X.
Quite a long time ago [Problem 2.1 in his monograph "The Theory of Best approximation and Functional Analysis" Regional Conference series in Applied Mathematics, SIAM, 1974], Ivan Singer asked if this result generalized to closed subspaces of finite codimension - if every Banach space has a proximinal subspace of codimension 2, for example. In this paper I show that there is a Banach space X such that X has no proximinal subspace of finite codimension n>1. So we have a converse to Bishop-Phelps-Bollobas: a dense set of proximinal hyperplanes can always be found, but proximinal subspaces of larger, finite codimension need not be.
△ Less
Submitted 30 July, 2013;
originally announced July 2013.
-
Modular Subgroups, Dessins d'Enfants and Elliptic K3 Surfaces
Authors:
Yang-Hui He,
John McKay,
James Read
Abstract:
We consider the 33 conjugacy classes of genus zero, torsion-free modular subgroups, computing ramification data and Grothendieck's dessins d'enfants. In the particular case of the index 36 subgroups, the corresponding Calabi-Yau threefolds are identified, in analogy with the index 24 cases being associated with K3 surfaces. In a parallel vein, we study the 112 semi-stable elliptic fibrations over…
▽ More
We consider the 33 conjugacy classes of genus zero, torsion-free modular subgroups, computing ramification data and Grothendieck's dessins d'enfants. In the particular case of the index 36 subgroups, the corresponding Calabi-Yau threefolds are identified, in analogy with the index 24 cases being associated with K3 surfaces. In a parallel vein, we study the 112 semi-stable elliptic fibrations over P^1 as extremal K3 surfaces with six singular fibres. In each case, a representative of the corresponding class of subgroups is identified by specifying a generating set for that representative.
△ Less
Submitted 4 September, 2013; v1 submitted 8 November, 2012;
originally announced November 2012.
-
Operator algebras with contractive approximate identities II
Authors:
David Peter Blecher,
Charles John Read
Abstract:
We make several contributions to our recent program investigating structural properties of algebras of operators on a Hilbert space. For example, we make substantial contributions to the noncommutative peak interpolation program begun by Hay and the first author, Hay and Neal. Another sample result: an operator algebra has a contractive approximate identity iff the linear span of the elements with…
▽ More
We make several contributions to our recent program investigating structural properties of algebras of operators on a Hilbert space. For example, we make substantial contributions to the noncommutative peak interpolation program begun by Hay and the first author, Hay and Neal. Another sample result: an operator algebra has a contractive approximate identity iff the linear span of the elements with positive real part is dense. We also extend the theory of compact projections to the most general case. Despite the title, our algebras are often allowed to have no approximate identity.
△ Less
Submitted 20 November, 2012; v1 submitted 18 June, 2012;
originally announced June 2012.
-
Ideals and hereditary subalgebras in operator algebras
Authors:
Melahat Almus,
David P. Blecher,
Charles John Read
Abstract:
This paper may be viewed as having two aims. First, we continue our study of algebras of operators on a Hilbert space which have a contractive approximate identity, this time from a more Banach algebraic point of view. Namely, we mainly investigate topics concerned with the ideal structure, and hereditary subalgebras (HSA's), which are in some sense generalization of ideals. Second, we study prope…
▽ More
This paper may be viewed as having two aims. First, we continue our study of algebras of operators on a Hilbert space which have a contractive approximate identity, this time from a more Banach algebraic point of view. Namely, we mainly investigate topics concerned with the ideal structure, and hereditary subalgebras (HSA's), which are in some sense generalization of ideals. Second, we study properties of operator algebras which are hereditary subalgebras in their bidual, or equivalently which are `weakly compact'. We also give several examples answering natural questions that arise in such an investigation.
△ Less
Submitted 15 June, 2012;
originally announced June 2012.
-
On the flexibility of the design of Multiple Try Metropolis schemes
Authors:
Luca Martino,
Jesse Read
Abstract:
The Multiple Try Metropolis (MTM) method is a generalization of the classical Metropolis-Hastings algorithm in which the next state of the chain is chosen among a set of samples, according to normalized weights. In the literature, several extensions have been proposed. In this work, we show and remark upon the flexibility of the design of MTM-type methods, fulfilling the detailed balance condition…
▽ More
The Multiple Try Metropolis (MTM) method is a generalization of the classical Metropolis-Hastings algorithm in which the next state of the chain is chosen among a set of samples, according to normalized weights. In the literature, several extensions have been proposed. In this work, we show and remark upon the flexibility of the design of MTM-type methods, fulfilling the detailed balance condition. We discuss several possibilities and show different numerical results.
△ Less
Submitted 28 February, 2013; v1 submitted 3 January, 2012;
originally announced January 2012.
-
Operator algebras with contractive approximate identities
Authors:
David P. Blecher,
Charles John Read
Abstract:
We give several applications of a recent theorem of the second author, which solved a conjecture of the first author with Hay and Neal, concerning contractive approximate identities; and another of Hay from the theory of noncommutative peak sets, thereby putting the latter theory on a much firmer foundation. From this theorem it emerges there is a surprising amount of positivity present in any ope…
▽ More
We give several applications of a recent theorem of the second author, which solved a conjecture of the first author with Hay and Neal, concerning contractive approximate identities; and another of Hay from the theory of noncommutative peak sets, thereby putting the latter theory on a much firmer foundation. From this theorem it emerges there is a surprising amount of positivity present in any operator algebras with contractive approximate identity. We exploit this to generalize several results previously available only for $C^*$-algebras, and we give many other applications.
△ Less
Submitted 18 February, 2011; v1 submitted 16 November, 2010;
originally announced November 2010.
