-
Normality, Relativization, and Randomness
Authors:
Wesley Calvert,
Emma Grunner,
Elvira Mayordomo,
Daniel Turetsky,
Java Darleen Villano
Abstract:
Normal numbers were introduced by Borel and later proven to be a weak notion of algorithmic randomness. We introduce here a natural relativization of normality based on generalized number representation systems. We explore the concepts of supernormal numbers that correspond to semicomputable relativizations, and that of highly normal numbers in terms of computable ones.
We prove several properti…
▽ More
Normal numbers were introduced by Borel and later proven to be a weak notion of algorithmic randomness. We introduce here a natural relativization of normality based on generalized number representation systems. We explore the concepts of supernormal numbers that correspond to semicomputable relativizations, and that of highly normal numbers in terms of computable ones.
We prove several properties of these new randomness concepts. Both supernormality and high normality generalize Borel absolute normality. Supernormality is strictly between 2-randomness and effective dimension 1, while high normality corresponds exactly to sequences of computable dimension 1 providing a more natural characterization of this class.
△ Less
Submitted 17 February, 2025; v1 submitted 15 December, 2023;
originally announced December 2023.
-
A point to set principle for finite-state dimension
Authors:
Elvira Mayordomo
Abstract:
Effective dimension has proven very useful in geometric measure theory through the point-to-set principle \cite{LuLu18}\ that characterizes Hausdorff dimension by relativized effective dimension. Finite-state dimension is the least demanding effectivization in this context \cite{FSD}\ that among other results can be used to characterize Borel normality \cite{BoHiVi05}.
In this paper we prove a c…
▽ More
Effective dimension has proven very useful in geometric measure theory through the point-to-set principle \cite{LuLu18}\ that characterizes Hausdorff dimension by relativized effective dimension. Finite-state dimension is the least demanding effectivization in this context \cite{FSD}\ that among other results can be used to characterize Borel normality \cite{BoHiVi05}.
In this paper we prove a characterization of finite-state dimension in terms of information content of a real number at a certain precision. We then use this characterization to give a robust concept of relativized normality and prove a finite-state dimension point-to-set principle. We finish with an open question on the equidistribution properties of relativized normality.
△ Less
Submitted 11 February, 2025; v1 submitted 30 July, 2022;
originally announced August 2022.
-
LDDMM meets GANs: Generative Adversarial Networks for diffeomorphic registration
Authors:
Ubaldo Ramon,
Monica Hernandez,
Elvira Mayordomo
Abstract:
The purpose of this work is to contribute to the state of the art of deep-learning methods for diffeomorphic registration. We propose an adversarial learning LDDMM method for pairs of 3D mono-modal images based on Generative Adversarial Networks. The method is inspired by the recent literature for deformable image registration with adversarial learning. We combine the best performing generative, d…
▽ More
The purpose of this work is to contribute to the state of the art of deep-learning methods for diffeomorphic registration. We propose an adversarial learning LDDMM method for pairs of 3D mono-modal images based on Generative Adversarial Networks. The method is inspired by the recent literature for deformable image registration with adversarial learning. We combine the best performing generative, discriminative, and adversarial ingredients from the state of the art within the LDDMM paradigm. We have successfully implemented two models with the stationary and the EPDiff-constrained non-stationary parameterizations of diffeomorphisms. Our unsupervised and data-hungry approach has shown a competitive performance with respect to a benchmark supervised and rich-data approach. In addition, our method has shown similar results to model-based methods with a computational time under one second.
△ Less
Submitted 24 November, 2021;
originally announced November 2021.
-
Dimension and the Structure of Complexity Classes
Authors:
Jack H. Lutz,
Neil Lutz,
Elvira Mayordomo
Abstract:
We prove three results on the dimension structure of complexity classes.
1. The Point-to-Set Principle, which has recently been used to prove several new theorems in fractal geometry, has resource-bounded instances. These instances characterize the resource-bounded dimension of a set $X$ of languages in terms of the relativized resource-bounded dimensions of the individual elements of $X$, provi…
▽ More
We prove three results on the dimension structure of complexity classes.
1. The Point-to-Set Principle, which has recently been used to prove several new theorems in fractal geometry, has resource-bounded instances. These instances characterize the resource-bounded dimension of a set $X$ of languages in terms of the relativized resource-bounded dimensions of the individual elements of $X$, provided that the former resource bound is large enough to parameterize the latter. Thus for example, the dimension of a class $X$ of languages in EXP is characterized in terms of the relativized p-dimensions of the individual elements of $X$.
2. Every language that is $\leq^P_m$-reducible to a p-selective set has p-dimension 0, and this fact holds relative to arbitrary oracles. Combined with a resource-bounded instance of the Point-to-Set Principle, this implies that if NP has positive dimension in EXP, then no quasipolynomial time selective language is $\leq^P_m$-hard for NP.
3. If the set of all disjoint pairs of NP languages has dimension 1 in the set of all disjoint pairs of EXP languages, then NP has positive dimension in EXP.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
Algorithmic Fractal Dimensions in Geometric Measure Theory
Authors:
Jack H. Lutz,
Elvira Mayordomo
Abstract:
The development of algorithmic fractal dimensions in this century has had many fruitful interactions with geometric measure theory, especially fractal geometry in Euclidean spaces. We survey these developments, with emphasis on connections with computable functions on the reals, recent uses of algorithmic dimensions in proving new theorems in classical (non-algorithmic) fractal geometry, and direc…
▽ More
The development of algorithmic fractal dimensions in this century has had many fruitful interactions with geometric measure theory, especially fractal geometry in Euclidean spaces. We survey these developments, with emphasis on connections with computable functions on the reals, recent uses of algorithmic dimensions in proving new theorems in classical (non-algorithmic) fractal geometry, and directions for future research.
△ Less
Submitted 28 July, 2020;
originally announced July 2020.
-
Extending the Reach of the Point-to-Set Principle
Authors:
Jack H. Lutz,
Neil Lutz,
Elvira Mayordomo
Abstract:
The point-to-set principle of J. Lutz and N. Lutz (2018) has recently enabled the theory of computing to be used to answer open questions about fractal geometry in Euclidean spaces $\mathbb{R}^n$. These are classical questions, meaning that their statements do not involve computation or related aspects of logic.
In this paper we extend the reach of the point-to-set principle from Euclidean space…
▽ More
The point-to-set principle of J. Lutz and N. Lutz (2018) has recently enabled the theory of computing to be used to answer open questions about fractal geometry in Euclidean spaces $\mathbb{R}^n$. These are classical questions, meaning that their statements do not involve computation or related aspects of logic.
In this paper we extend the reach of the point-to-set principle from Euclidean spaces to arbitrary separable metric spaces $X$. We first extend two fractal dimensions--computability-theoretic versions of classical Hausdorff and packing dimensions that assign dimensions $\dim(x)$ and $\textrm{Dim}(x)$ to individual points $x\in X$--to arbitrary separable metric spaces and to arbitrary gauge families. Our first two main results then extend the point-to-set principle to arbitrary separable metric spaces and to a large class of gauge families.
We demonstrate the power of our extended point-to-set principle by using it to prove new theorems about classical fractal dimensions in hyperspaces. (For a concrete computational example, the stages $E_0, E_1, E_2, \ldots$ used to construct a self-similar fractal $E$ in the plane are elements of the hyperspace of the plane, and they converge to $E$ in the hyperspace.) Our third main result, proven via our extended point-to-set principle, states that, under a wide variety of gauge families, the classical packing dimension agrees with the classical upper Minkowski dimension on all hyperspaces of compact sets. We use this theorem to give, for all sets $E$ that are analytic, i.e., $\mathbfΣ^1_1$, a tight bound on the packing dimension of the hyperspace of $E$ in terms of the packing dimension of $E$ itself.
△ Less
Submitted 13 February, 2021; v1 submitted 16 April, 2020;
originally announced April 2020.
-
Asymptotic Divergences and Strong Dichotomy
Authors:
Xiang Huang,
Jack H. Lutz,
Elvira Mayordomo,
Donald M. Stull
Abstract:
The Schnorr-Stimm dichotomy theorem concerns finite-state gamblers that bet on infinite sequences of symbols taken from a finite alphabet $Σ$.
In this paper we use the Kullback-Leibler divergence to formulate the $\textit{lower asymptotic divergence}$ $\text{div}(S||α)$ of a probability measure $α$ on $Σ$ from a sequence $S$ over $Σ$ and the $\textit{upper asymptotic divergence}$…
▽ More
The Schnorr-Stimm dichotomy theorem concerns finite-state gamblers that bet on infinite sequences of symbols taken from a finite alphabet $Σ$.
In this paper we use the Kullback-Leibler divergence to formulate the $\textit{lower asymptotic divergence}$ $\text{div}(S||α)$ of a probability measure $α$ on $Σ$ from a sequence $S$ over $Σ$ and the $\textit{upper asymptotic divergence}$ $\text{Div}(S||α)$ of $α$ from $S$ in such a way that a sequence $S$ is $α$-normal (meaning that every string $w$ has asymptotic frequency $α(w)$ in $S$) if and only if $\text{Div}(S||α)=0$. We also use the Kullback-Leibler divergence to quantify the $\textit{total risk }$ $\text{Risk}_G(w)$ that a finite-state gambler $G$ takes when betting along a prefix $w$ of $S$.
Our main theorem is a $\textit{strong dichotomy theorem}$ that uses the above notions to $\textit{quantify}$ the exponential rates of winning and losing on the two sides of the Schnorr-Stimm dichotomy theorem (with the latter routinely extended from normality to $α$-normality). Modulo asymptotic caveats in the paper, our strong dichotomy theorem says that the following two things hold for prefixes $w$ of $S$.
(1) The infinitely-often exponential rate of winning is $2^{\text{Div}(S||α)|w|}$.
(2) The exponential rate of loss is $2^{-\text{Risk}_G(w)}$.
We also use (1) to show that $1-\text{Div}(S||α)/c$, where $c= \log(1/ \min_{a\inΣ}α(a))$, is an upper bound on the finite-state $α$-dimension of $S$ and prove the dual fact that $1-\text{div}(S||α)/c$ is an upper bound on the finite-state strong $α$-dimension of $S$.
△ Less
Submitted 29 October, 2019;
originally announced October 2019.
-
Computing Absolutely Normal Numbers in Nearly Linear Time
Authors:
Jack H. Lutz,
Elvira Mayordomo
Abstract:
A real number $x$ is absolutely normal if, for every base $b\ge 2$, every two equally long strings of digits appear with equal asymptotic frequency in the base-$b$ expansion of $x$. This paper presents an explicit algorithm that generates the binary expansion of an absolutely normal number $x$, with the $n$th bit of $x$ appearing after $n$polylog$(n)$ computation steps. This speed is achieved by s…
▽ More
A real number $x$ is absolutely normal if, for every base $b\ge 2$, every two equally long strings of digits appear with equal asymptotic frequency in the base-$b$ expansion of $x$. This paper presents an explicit algorithm that generates the binary expansion of an absolutely normal number $x$, with the $n$th bit of $x$ appearing after $n$polylog$(n)$ computation steps. This speed is achieved by simultaneously computing and diagonalizing against a martingale that incorporates Lempel-Ziv parsing algorithms in all bases.
△ Less
Submitted 16 July, 2020; v1 submitted 17 November, 2016;
originally announced November 2016.
-
Effective dimension in some general metric spaces
Authors:
Elvira Mayordomo
Abstract:
We introduce the concept of effective dimension for a wide class of metric spaces that are not required to have a computable measure. Effective dimension was defined by Lutz in (Lutz 2003) for Cantor space and has also been extended to Euclidean space. Lutz effectivization uses the concept of gale and supergale, our extension of Hausdorff dimension to other metric spaces is also based on a superga…
▽ More
We introduce the concept of effective dimension for a wide class of metric spaces that are not required to have a computable measure. Effective dimension was defined by Lutz in (Lutz 2003) for Cantor space and has also been extended to Euclidean space. Lutz effectivization uses the concept of gale and supergale, our extension of Hausdorff dimension to other metric spaces is also based on a supergale characterization of dimension, which in practice avoids an extra quantifier present in the classical definition of dimension that is based on Hausdorff measure and therefore allows effectivization for small time-bounds.
We present here the concept of constructive dimension and its characterization in terms of Kolmogorov complexity, for which we extend the concept of Kolmogorov complexity to any metric space defining the Kolmogorov complexity of a point at a certain precision. Further research directions are indicated.
△ Less
Submitted 15 May, 2017; v1 submitted 31 March, 2014;
originally announced April 2014.
-
Resource-bounded Dimension in Computational Learning Theory
Authors:
Ricard Gavalda,
Maria Lopez-Valdes,
Elvira Mayordomo,
N. V. Vinodchandran
Abstract:
This paper focuses on the relation between computational learning theory and resource-bounded dimension. We intend to establish close connections between the learnability/nonlearnability of a concept class and its corresponding size in terms of effective dimension, which will allow the use of powerful dimension techniques in computational learning and viceversa, the import of learning results into…
▽ More
This paper focuses on the relation between computational learning theory and resource-bounded dimension. We intend to establish close connections between the learnability/nonlearnability of a concept class and its corresponding size in terms of effective dimension, which will allow the use of powerful dimension techniques in computational learning and viceversa, the import of learning results into complexity via dimension. Firstly, we obtain a tight result on the dimension of online mistake-bound learnable classes. Secondly, in relation with PAC learning, we show that the polynomial-space dimension of PAC learnable classes of concepts is zero. This provides a hypothesis on effective dimension that implies the inherent unpredictability of concept classes (the classes that verify this property are classes not efficiently PAC learnable using any hypothesis). Thirdly, in relation to space dimension of classes that are learnable by membership query algorithms, the main result proves that polynomial-space dimension of concept classes learnable by a membership-query algorithm is zero.
△ Less
Submitted 14 January, 2011; v1 submitted 26 October, 2010;
originally announced October 2010.
-
Polylog space compression, pushdown compression, and Lempel-Ziv are incomparable
Authors:
Elvira Mayordomo,
Philippe Moser,
Sylvain Perifel
Abstract:
The pressing need for efficient compression schemes for XML documents has recently been focused on stack computation, and in particular calls for a formulation of information-lossless stack or pushdown compressors that allows a formal analysis of their performance and a more ambitious use of the stack in XML compression, where so far it is mainly connected to parsing mechanisms. In this paper we…
▽ More
The pressing need for efficient compression schemes for XML documents has recently been focused on stack computation, and in particular calls for a formulation of information-lossless stack or pushdown compressors that allows a formal analysis of their performance and a more ambitious use of the stack in XML compression, where so far it is mainly connected to parsing mechanisms. In this paper we introduce the model of pushdown compressor, based on pushdown transducers that compute a single injective function while keeping the widest generality regarding stack computation.
We also consider online compression algorithms that use at most polylogarithmic space (plogon). These algorithms correspond to compressors in the data stream model.
We compare the performance of these two families of compressors with each other and with the general purpose Lempel-Ziv algorithm. This comparison is made without any a priori assumption on the data's source and considering the asymptotic compression ratio for infinite sequences. We prove that in all cases they are incomparable.
△ Less
Submitted 24 March, 2009;
originally announced March 2009.
-
Inseparability and Strong Hypotheses for Disjoint NP Pairs
Authors:
Lance Fortnow,
Jack H. Lutz,
Elvira Mayordomo
Abstract:
This paper investigates the existence of inseparable disjoint pairs of NP languages and related strong hypotheses in computational complexity. Our main theorem says that, if NP does not have measure 0 in EXP, then there exist disjoint pairs of NP languages that are P-inseparable, in fact TIME(2^(n^k))-inseparable. We also relate these conditions to strong hypotheses concerning randomness and gen…
▽ More
This paper investigates the existence of inseparable disjoint pairs of NP languages and related strong hypotheses in computational complexity. Our main theorem says that, if NP does not have measure 0 in EXP, then there exist disjoint pairs of NP languages that are P-inseparable, in fact TIME(2^(n^k))-inseparable. We also relate these conditions to strong hypotheses concerning randomness and genericity of disjoint pairs.
△ Less
Submitted 3 February, 2010; v1 submitted 16 February, 2009;
originally announced February 2009.
-
Curves That Must Be Retraced
Authors:
Xiaoyang Gu,
Jack H. Lutz,
Elvira Mayordomo
Abstract:
We exhibit a polynomial time computable plane curve GAMMA that has finite length, does not intersect itself, and is smooth except at one endpoint, but has the following property. For every computable parametrization f of GAMMA and every positive integer n, there is some positive-length subcurve of GAMMA that f retraces at least n times. In contrast, every computable curve of finite length that d…
▽ More
We exhibit a polynomial time computable plane curve GAMMA that has finite length, does not intersect itself, and is smooth except at one endpoint, but has the following property. For every computable parametrization f of GAMMA and every positive integer n, there is some positive-length subcurve of GAMMA that f retraces at least n times. In contrast, every computable curve of finite length that does not intersect itself has a constant-speed (hence non-retracing) parametrization that is computable relative to the halting problem.
△ Less
Submitted 19 May, 2009; v1 submitted 28 February, 2008;
originally announced February 2008.
-
Pushdown Compression
Authors:
Pilar Albert,
Elvira Mayordomo,
Philippe Moser,
Sylvain Perifel
Abstract:
The pressing need for eficient compression schemes for XML documents has recently been focused on stack computation [6, 9], and in particular calls for a formulation of information-lossless stack or pushdown compressors that allows a formal analysis of their performance and a more ambitious use of the stack in XML compression, where so far it is mainly connected to parsing mechanisms. In this pa…
▽ More
The pressing need for eficient compression schemes for XML documents has recently been focused on stack computation [6, 9], and in particular calls for a formulation of information-lossless stack or pushdown compressors that allows a formal analysis of their performance and a more ambitious use of the stack in XML compression, where so far it is mainly connected to parsing mechanisms. In this paper we introduce the model of pushdown compressor, based on pushdown transducers that compute a single injective function while keeping the widest generality regarding stack computation. The celebrated Lempel-Ziv algorithm LZ78 [10] was introduced as a general purpose compression algorithm that outperforms finite-state compressors on all sequences. We compare the performance of the Lempel-Ziv algorithm with that of the pushdown compressors, or compression algorithms that can be implemented with a pushdown transducer. This comparison is made without any a priori assumption on the data's source and considering the asymptotic compression ratio for infinite sequences. We prove that Lempel-Ziv is incomparable with pushdown compressors.
△ Less
Submitted 17 September, 2007; v1 submitted 14 September, 2007;
originally announced September 2007.
-
Bounded Pushdown dimension vs Lempel Ziv information density
Authors:
Pilar Albert,
Elvira Mayordomo,
Philippe Moser
Abstract:
In this paper we introduce a variant of pushdown dimension called bounded pushdown (BPD) dimension, that measures the density of information contained in a sequence, relative to a BPD automata, i.e. a finite state machine equipped with an extra infinite memory stack, with the additional requirement that every input symbol only allows a bounded number of stack movements. BPD automata are a natura…
▽ More
In this paper we introduce a variant of pushdown dimension called bounded pushdown (BPD) dimension, that measures the density of information contained in a sequence, relative to a BPD automata, i.e. a finite state machine equipped with an extra infinite memory stack, with the additional requirement that every input symbol only allows a bounded number of stack movements. BPD automata are a natural real-time restriction of pushdown automata. We show that BPD dimension is a robust notion by giving an equivalent characterization of BPD dimension in terms of BPD compressors. We then study the relationships between BPD compression, and the standard Lempel-Ziv (LZ) compression algorithm, and show that in contrast to the finite-state compressor case, LZ is not universal for bounded pushdown compressors in a strong sense: we construct a sequence that LZ fails to compress signicantly, but that is compressed by at least a factor 2 by a BPD compressor. As a corollary we obtain a strong separation between finite-state and BPD dimension.
△ Less
Submitted 18 April, 2007;
originally announced April 2007.
-
Points on Computable Curves
Authors:
Xiaoyang Gu,
Jack H. Lutz,
Elvira Mayordomo
Abstract:
The ``analyst's traveling salesman theorem'' of geometric measure theory characterizes those subsets of Euclidean space that are contained in curves of finite length. This result, proven for the plane by Jones (1990) and extended to higher-dimensional Euclidean spaces by Okikiolu (1991), says that a bounded set $K$ is contained in some curve of finite length if and only if a certain ``square bet…
▽ More
The ``analyst's traveling salesman theorem'' of geometric measure theory characterizes those subsets of Euclidean space that are contained in curves of finite length. This result, proven for the plane by Jones (1990) and extended to higher-dimensional Euclidean spaces by Okikiolu (1991), says that a bounded set $K$ is contained in some curve of finite length if and only if a certain ``square beta sum'', involving the ``width of $K$'' in each element of an infinite system of overlapping ``tiles'' of descending size, is finite.
In this paper we characterize those {\it points} of Euclidean space that lie on {\it computable} curves of finite length by formulating and proving a computable extension of the analyst's traveling salesman theorem. Our extension says that a point in Euclidean space lies on some computable curve of finite length if and only if it is ``permitted'' by some computable ``Jones constriction''. A Jones constriction here is an explicit assignment of a rational cylinder to each of the above-mentioned tiles in such a way that, when the radius of the cylinder corresponding to a tile is used in place of the ``width of $K$'' in each tile, the square beta sum is finite. A point is permitted by a Jones constriction if it is contained in the cylinder assigned to each tile containing the point. The main part of our proof is the construction of a computable curve of finite length traversing all the points permitted by a given Jones constriction. Our construction uses the main ideas of Jones's ``farthest insertion'' construction, but our algorithm for computing the curve must work exclusively with the Jones constriction itself, because it has no direct access to the (typically uncomputable) points permitted by the Jones constriction.
△ Less
Submitted 9 December, 2005;
originally announced December 2005.
-
Zeta-Dimension
Authors:
David Doty,
Xiaoyang Gu,
Jack H. Lutz,
Elvira Mayordomo,
Philippe Moser
Abstract:
The zeta-dimension of a set A of positive integers is the infimum s such that the sum of the reciprocals of the s-th powers of the elements of A is finite.
Zeta-dimension serves as a fractal dimension on the positive integers that extends naturally usefully to discrete lattices such as the set of all integer lattice points in d-dimensional space.
This paper reviews the origins of zeta-dimens…
▽ More
The zeta-dimension of a set A of positive integers is the infimum s such that the sum of the reciprocals of the s-th powers of the elements of A is finite.
Zeta-dimension serves as a fractal dimension on the positive integers that extends naturally usefully to discrete lattices such as the set of all integer lattice points in d-dimensional space.
This paper reviews the origins of zeta-dimension (which date to the eighteenth and nineteenth centuries) and develops its basic theory, with particular attention to its relationship with algorithmic information theory. New results presented include extended connections between zeta-dimension and classical fractal dimensions, a gale characterization of zeta-dimension, and a theorem on the zeta-dimensions of pointwise sums and products of sets of positive integers.
△ Less
Submitted 22 March, 2005;
originally announced March 2005.
-
Effective Strong Dimension, Algorithmic Information, and Computational Complexity
Authors:
Krishna B. Athreya,
John M. Hitchcock,
Jack H. Lutz,
Elvira Mayordomo
Abstract:
The two most important notions of fractal dimension are {\it Hausdorff dimension}, developed by Hausdorff (1919), and {\it packing dimension}, developed by Tricot (1982).
Lutz (2000) has recently proven a simple characterization of Hausdorff dimension in terms of {\it gales}, which are betting strategies that generalize martingales. Imposing various computability and complexity constraints on…
▽ More
The two most important notions of fractal dimension are {\it Hausdorff dimension}, developed by Hausdorff (1919), and {\it packing dimension}, developed by Tricot (1982).
Lutz (2000) has recently proven a simple characterization of Hausdorff dimension in terms of {\it gales}, which are betting strategies that generalize martingales. Imposing various computability and complexity constraints on these gales produces a spectrum of effective versions of Hausdorff dimension.
In this paper we show that packing dimension can also be characterized in terms of gales. Moreover, even though the usual definition of packing dimension is considerably more complex than that of Hausdorff dimension, our gale characterization of packing dimension is an exact dual of -- and every bit as simple as -- the gale characterization of Hausdorff dimension.
Effectivizing our gale characterization of packing dimension produces a variety of {\it effective strong dimensions}, which are exact duals of the effective dimensions mentioned above.
We develop the basic properties of effective strong dimensions and prove a number of results relating them to fundamental aspects of randomness, Kolmogorov complexity, prediction, Boolean circuit-size complexity, polynomial-time degrees, and data compression.
△ Less
Submitted 5 January, 2003; v1 submitted 20 November, 2002;
originally announced November 2002.