Showing 1–2 of 2 results for author: Obregón, O
-
On how generalised entropies without parameters impact information optimisation processes
Authors:
Jesús Fuentes,
Octavio Obregón
Abstract:
As an application of generalised statistical mechanics, it is studied a possible route toward a consistent generalised information theory in terms of a family of non-extensive, non-parametric entropies $H^\pm_D(P)$. Unlike other proposals based on non-extensive entropies with a parameter dependence, our scheme is asymptotically equivalent to the one formulated by Shannon, while it differs in regio…
▽ More
As an application of generalised statistical mechanics, it is studied a possible route toward a consistent generalised information theory in terms of a family of non-extensive, non-parametric entropies $H^\pm_D(P)$. Unlike other proposals based on non-extensive entropies with a parameter dependence, our scheme is asymptotically equivalent to the one formulated by Shannon, while it differs in regions where the density of states is reasonably small, which leads to information distributions constrained to their background. Two basic concepts are discussed to this aim. First, we prove two effective coding theorems for the entropies $H^\pm_D(P)$. Then we calculate the channel capacity of a binary symmetric channel (BSC) and a binary erasure channel (BEC) in terms of these entropies. We found that processes such as data compression and channel capacity maximisation can be improved in regions where there is a low density of states, whereas for high densities our results coincide with Shannon's formulation.
△ Less
Submitted 18 January, 2021;
originally announced March 2021.
-
A superstatistical formulation of complexity measures
Authors:
Jesús Fuentes,
Octavio Obregón
Abstract:
It is discussed how the superstatistical formulation of effective Boltzmann factors can be related to the concept of Kolmogorov complexity, generating an infinite set of complexity measures (CMs) for quantifying information. At this level, the information is treated according to its background, which means that the CM depends on the inherent attributes of the information scenario. While the basic…
▽ More
It is discussed how the superstatistical formulation of effective Boltzmann factors can be related to the concept of Kolmogorov complexity, generating an infinite set of complexity measures (CMs) for quantifying information. At this level, the information is treated according to its background, which means that the CM depends on the inherent attributes of the information scenario. While the basic Boltzmann factor directly produces the standard complexity measure (SCM), it succeeds in the description of large-scale scenarios where the data components are not interrelated with themselves, thus adopting the behaviour of a gas. What happens in scenarios in which the presence of sources and sinks of information cannot be neglected, needs of a CM other than the one produced by the ordinary Boltzmann factor. We introduce a set of flexible CMs, without free parameters, that converge asymptotically to the Kolmogorov complexity, but also quantify the information in scenarios with a reasonable small density of states. We prove that these CMs are obtained from a generalised relative entropy and we suggest why such measures are the only compatible generalisations of the SCM.
△ Less
Submitted 18 January, 2021;
originally announced January 2021.
