Showing 1–8 of 8 results for author: Leinster, T

Entropy and Diversity: The Axiomatic Approach

Authors: Tom Leinster

Abstract: This book brings new mathematical rigour to the ongoing vigorous debate on how to quantify biological diversity. The question "what is diversity?" has surprising mathematical depth, and breadth too: this book involves parts of mathematics ranging from information theory, functional equations and probability theory to category theory, geometric measure theory and number theory. It applies the power… ▽ More This book brings new mathematical rigour to the ongoing vigorous debate on how to quantify biological diversity. The question "what is diversity?" has surprising mathematical depth, and breadth too: this book involves parts of mathematics ranging from information theory, functional equations and probability theory to category theory, geometric measure theory and number theory. It applies the power of the axiomatic method to a biological problem of pressing concern, but the new concepts and theorems are also motivated from a purely mathematical perspective. The main narrative thread requires no more than an undergraduate course in analysis. No familiarity with entropy or diversity is assumed. △ Less

Submitted 3 December, 2024; v1 submitted 3 December, 2020; originally announced December 2020.

Comments: Book, viii + 442 pages. Version 4: small number of minor corrections

MSC Class: 92B99; 94A17; 39B99; 26E60; 18D50

Journal ref: Cambridge University Press 2021, ISBN 9781108965576 (paperback), 9781108832700 (hardback)

The maximum entropy of a metric space

Authors: Tom Leinster, Emily Roff

Abstract: We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies generalise the Shannon and Rényi entropies of information theory. We prove that on any space X, there is a single probability measure maximising all these entrop… ▽ More We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies generalise the Shannon and Rényi entropies of information theory. We prove that on any space X, there is a single probability measure maximising all these entropies simultaneously. Moreover, all the entropies have the same maximum value: the maximum entropy of X. As X is scaled up, the maximum entropy grows; its asymptotics determine geometric information about X, including the volume and dimension. We also study the large-scale limit of the maximising measure itself, arguing that it should be regarded as the canonical or uniform measure on X. Primarily we work not with entropy itself but its exponential, called diversity and (in its finite form) used as a measure of biodiversity. Our main theorem was first proved in the finite case by Leinster and Meckes. △ Less

Submitted 16 December, 2020; v1 submitted 29 August, 2019; originally announced August 2019.

Comments: 39 pages. v2: new results in sections 7 and 9. v3: minor edits and rewordings. To appear in Quarterly Journal of Mathematics

Entropy modulo a prime

Authors: Tom Leinster

Abstract: Building on work of Kontsevich, we introduce a definition of the entropy of a finite probability distribution in which the "probabilities" are integers modulo a prime p. The entropy, too, is an integer mod p. Entropy mod p is shown to be uniquely characterized by a functional equation identical to the one that characterizes ordinary Shannon entropy. We also establish a sense in which certain real… ▽ More Building on work of Kontsevich, we introduce a definition of the entropy of a finite probability distribution in which the "probabilities" are integers modulo a prime p. The entropy, too, is an integer mod p. Entropy mod p is shown to be uniquely characterized by a functional equation identical to the one that characterizes ordinary Shannon entropy. We also establish a sense in which certain real entropies have residues mod p, connecting the concepts of entropy over R and over Z/pZ. Finally, entropy mod p is expressed as a polynomial which is shown to satisfy several identities, linking into work of Cathelineau, Elbaz-Vincent and Gangl on polylogarithms. △ Less

Submitted 1 December, 2020; v1 submitted 16 March, 2019; originally announced March 2019.

Comments: 28 pages. v2: minor corrections and rewordings. v3: minor edits and rewriting. To appear in Communications in Number Theory and Physics

MSC Class: 94A17; 11A07; 11A99; 11T06; 13N15

A short characterization of relative entropy

Authors: Tom Leinster

Abstract: We prove characterization theorems for relative entropy (also known as Kullback-Leibler divergence), q-logarithmic entropy (also known as Tsallis entropy), and q-logarithmic relative entropy. All three have been characterized axiomatically before, but we show that earlier proofs can be simplified considerably, at the same time relaxing some of the hypotheses. We prove characterization theorems for relative entropy (also known as Kullback-Leibler divergence), q-logarithmic entropy (also known as Tsallis entropy), and q-logarithmic relative entropy. All three have been characterized axiomatically before, but we show that earlier proofs can be simplified considerably, at the same time relaxing some of the hypotheses. △ Less

Submitted 13 December, 2017; originally announced December 2017.

Comments: 10 pages

Maximizing diversity in biology and beyond

Authors: Tom Leinster, Mark W. Meckes

Abstract: Entropy, under a variety of names, has long been used as a measure of diversity in ecology, as well as in genetics, economics and other fields. There is a spectrum of viewpoints on diversity, indexed by a real parameter q giving greater or lesser importance to rare species. Leinster and Cobbold proposed a one-parameter family of diversity measures taking into account both this variation and the va… ▽ More Entropy, under a variety of names, has long been used as a measure of diversity in ecology, as well as in genetics, economics and other fields. There is a spectrum of viewpoints on diversity, indexed by a real parameter q giving greater or lesser importance to rare species. Leinster and Cobbold proposed a one-parameter family of diversity measures taking into account both this variation and the varying similarities between species. Because of this latter feature, diversity is not maximized by the uniform distribution on species. So it is natural to ask: which distributions maximize diversity, and what is its maximum value? In principle, both answers depend on q, but our main theorem is that neither does. Thus, there is a single distribution that maximizes diversity from all viewpoints simultaneously, and any list of species has an unambiguous maximum diversity value. Furthermore, the maximizing distribution(s) can be computed in finite time, and any distribution maximizing diversity from some particular viewpoint q > 0 actually maximizes diversity for all q. Although we phrase our results in ecological terms, they apply very widely, with applications in graph theory and metric geometry. △ Less

Submitted 19 December, 2015; originally announced December 2015.

Comments: 29 pages

Journal ref: Entropy 18 (2016) no. 3, article 88

A Characterization of Entropy in Terms of Information Loss

Authors: John C. Baez, Tobias Fritz, Tom Leinster

Abstract: There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the entropy of a probability measure on a finite set, this characterization focuses on the `information loss', or change in entropy, associated with a measure-preservin… ▽ More There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the entropy of a probability measure on a finite set, this characterization focuses on the `information loss', or change in entropy, associated with a measure-preserving function. Information loss is a special case of conditional entropy: namely, it is the entropy of a random variable conditioned on some function of that variable. We show that Shannon entropy gives the only concept of information loss that is functorial, convex-linear and continuous. This characterization naturally generalizes to Tsallis entropy as well. △ Less

Submitted 18 November, 2011; v1 submitted 9 June, 2011; originally announced June 2011.

Comments: 11 pages LaTeX, minor revision

MSC Class: 94A17; 62B10

Journal ref: Entropy, Vol. 13 No. 11 (2011), 1945-1957

A multiplicative characterization of the power means

Authors: Tom Leinster

Abstract: A startlingly simple characterization of the p-norms has recently been found by Aubrun and Nechita (arXiv:1102.2618) and by Fernandez-Gonzalez, Palazuelos and Perez-Garcia. We deduce a simple characterization of the power means of order greater than or equal to 1. A startlingly simple characterization of the p-norms has recently been found by Aubrun and Nechita (arXiv:1102.2618) and by Fernandez-Gonzalez, Palazuelos and Perez-Garcia. We deduce a simple characterization of the power means of order greater than or equal to 1. △ Less

Submitted 8 June, 2011; v1 submitted 13 March, 2011; originally announced March 2011.

Comments: 7 pages. Version 3: references added; minor edits

MSC Class: 26E60 (primary); 47A30; 52A21 (secondary)

Journal ref: Bulletin of the London Mathematical Society 44 (2012), 106-112

A maximum entropy theorem with applications to the measurement of biodiversity

Authors: Tom Leinster

Abstract: This is a preliminary article stating and proving a new maximum entropy theorem. The entropies that we consider can be used as measures of biodiversity. In that context, the question is: for a given collection of species, which frequency distribution(s) maximize the diversity? The theorem provides the answer. The chief surprise is that although we are dealing with not just a single entropy, but a… ▽ More This is a preliminary article stating and proving a new maximum entropy theorem. The entropies that we consider can be used as measures of biodiversity. In that context, the question is: for a given collection of species, which frequency distribution(s) maximize the diversity? The theorem provides the answer. The chief surprise is that although we are dealing with not just a single entropy, but a one-parameter family of entropies, there is a single distribution maximizing all of them simultaneously. △ Less

Submitted 13 January, 2011; v1 submitted 5 October, 2009; originally announced October 2009.

Comments: 26 pages. v4: references added, and other minor edits