-
When Bi-interpretability implies Synonymy
Authors:
Harvey M. Friedman,
Albert Visser
Abstract:
Two salient notions of sameness of theories are synonymy, also known as definitional equivalence, and bi-interpretability. Of these two definitional equivalence is the strictest notion. In which cases can we infer synonymy from bi-interpretability? We study this question for the case of sequential theories. Our result is as follows. Suppose that two sequential theories are bi-interpretable and tha…
▽ More
Two salient notions of sameness of theories are synonymy, also known as definitional equivalence, and bi-interpretability. Of these two definitional equivalence is the strictest notion. In which cases can we infer synonymy from bi-interpretability? We study this question for the case of sequential theories. Our result is as follows. Suppose that two sequential theories are bi-interpretable and that the interpretations involved in the bi-interpretation are one-dimensional and identity preserving. Then, the theories are synonymous.
The crucial ingredient of our proof is a version of the Schröder-Bernstein theorem under very weak conditions. We think this last result has some independent interest.
We provide an example to show that this result is optimal. There are two finitely axiomatized sequential theories that are bi-interpretable but not synonymous, where precisely one of the interpretations involved in the bi-interpretation is not identity preserving.
△ Less
Submitted 1 June, 2025;
originally announced June 2025.
-
Squared Linear Models
Authors:
Hannah Friedman,
Bernd Sturmfels,
Maximilian Wiesmann
Abstract:
We study statistical models that are parametrized by squares of linear forms. All critical points of the likelihood function are real and positive. There is one for each region of the projective hyperplane arrangement. We study the ideal and singular locus of the model, and we give a determinantal presentation for its likelihood correspondence. We characterize tropical degenerations of the MLE, an…
▽ More
We study statistical models that are parametrized by squares of linear forms. All critical points of the likelihood function are real and positive. There is one for each region of the projective hyperplane arrangement. We study the ideal and singular locus of the model, and we give a determinantal presentation for its likelihood correspondence. We characterize tropical degenerations of the MLE, and we describe log-normal polytopes.
△ Less
Submitted 25 May, 2025;
originally announced May 2025.
-
Grassmann and Flag Varieties in Linear Algebra, Optimization, and Statistics: An Algebraic Perspective
Authors:
Hannah Friedman,
Serkan Hoşten
Abstract:
Grassmann and flag varieties lead many lives in pure and applied mathematics. Here we focus on the algebraic complexity of solving various problems in linear algebra and statistics as optimization problems over these varieties. The measure of the algebraic complexity is the amount of complex critical points of the corresponding optimization problem. After an exposition of different realizations of…
▽ More
Grassmann and flag varieties lead many lives in pure and applied mathematics. Here we focus on the algebraic complexity of solving various problems in linear algebra and statistics as optimization problems over these varieties. The measure of the algebraic complexity is the amount of complex critical points of the corresponding optimization problem. After an exposition of different realizations of these manifolds as algebraic varieties we present a sample of optimization problems over them and we compute their algebraic complexity.
△ Less
Submitted 21 May, 2025;
originally announced May 2025.
-
Decomposing conditional independence ideals with hidden variables
Authors:
Yulia Alexandr,
Kristen Dawson,
Hannah Friedman,
Fatemeh Mohammadi,
Pardis Semnani,
Teresa Yu
Abstract:
We study a family of determinantal ideals whose decompositions encode the structural zeros in conditional independence models with hidden variables. We provide explicit decompositions of these ideals and, for certain subclasses of models, we show that this is a decomposition into radical ideals by displaying Gröbner bases for the components. We identify conditions under which the components are pr…
▽ More
We study a family of determinantal ideals whose decompositions encode the structural zeros in conditional independence models with hidden variables. We provide explicit decompositions of these ideals and, for certain subclasses of models, we show that this is a decomposition into radical ideals by displaying Gröbner bases for the components. We identify conditions under which the components are prime, and establish formulas for the dimensions of these prime ideals.
Moreover, we show that the components in the decomposition can be grouped into equivalence classes defined by their combinatorial structure, and we derive a closed formula for the number of such classes.
△ Less
Submitted 5 May, 2025;
originally announced May 2025.
-
Likelihood Geometry of the Squared Grassmannian
Authors:
Hannah Friedman
Abstract:
We study projection determinantal point processes and their connection to the squared Grassmannian. We prove that the log-likelihood function of this statistical model has $(n - 1)!/2$ critical points, all of which are real and positive, thereby settling a conjecture of Devriendt, Friedman, Reinke, and Sturmfels.
We study projection determinantal point processes and their connection to the squared Grassmannian. We prove that the log-likelihood function of this statistical model has $(n - 1)!/2$ critical points, all of which are real and positive, thereby settling a conjecture of Devriendt, Friedman, Reinke, and Sturmfels.
△ Less
Submitted 10 March, 2025; v1 submitted 5 September, 2024;
originally announced September 2024.
-
The Two Lives of the Grassmannian
Authors:
Karel Devriendt,
Hannah Friedman,
Bernhard Reinke,
Bernd Sturmfels
Abstract:
The real Grassmannian is both a projective variety (via Plücker coordinates) and an affine variety (via orthogonal projections). We connect these two representations, and we develop the commutative algebra of the latter variety. We introduce the squared Grassmannian, and we study applications to determinantal point processes in statistics.
The real Grassmannian is both a projective variety (via Plücker coordinates) and an affine variety (via orthogonal projections). We connect these two representations, and we develop the commutative algebra of the latter variety. We introduce the squared Grassmannian, and we study applications to determinantal point processes in statistics.
△ Less
Submitted 4 July, 2024; v1 submitted 8 January, 2024;
originally announced January 2024.
-
Likelihood Geometry of Determinantal Point Processes
Authors:
Hannah Friedman,
Bernd Sturmfels,
Maksym Zubkov
Abstract:
We study determinantal point processes (DPP) through the lens of algebraic statistics. We count the critical points of the log-likelihood function, and we compute them for small models, thereby disproving a conjecture of Brunel, Moitra, Rigollet and Urschel.
We study determinantal point processes (DPP) through the lens of algebraic statistics. We count the critical points of the log-likelihood function, and we compute them for small models, thereby disproving a conjecture of Brunel, Moitra, Rigollet and Urschel.
△ Less
Submitted 22 November, 2023; v1 submitted 25 July, 2023;
originally announced July 2023.
-
Integration on the Surreals: a Conjecture of Conway, Kruskal and Norton
Authors:
Ovidiu Costin,
Philip Ehrlich,
Harvey M. Friedman
Abstract:
In his monograph On Numbers and Games, J. H. Conway introduced a real-closed field No of surreal numbers containing the reals and the ordinals, as well as a vast array of less familiar numbers. A longstanding aim has been to develop analysis on No as a powerful extension of ordinary analysis on the reals. This entails finding a natural way of extending important functions f from the reals to the r…
▽ More
In his monograph On Numbers and Games, J. H. Conway introduced a real-closed field No of surreal numbers containing the reals and the ordinals, as well as a vast array of less familiar numbers. A longstanding aim has been to develop analysis on No as a powerful extension of ordinary analysis on the reals. This entails finding a natural way of extending important functions f from the reals to the reals to functions f* from the surreals to the surreals, and naturally defining integration on the f*. The usual square root, log, and exp were naturally extended to No by Bach, Conway, Kruskal, and Norton, retaining their usual properties. Later Norton also proposed a treatment of integration, but Kruskal discovered it has flaws. In his recent survey [2, p. 438], Siegel characterizes the question of the existence of a reasonable definition of surreal integration as "perhaps the most important open problem in the theory of surreal numbers." This paper addresses this and related unresolved issues with positive and negative results. In the positive direction, we show that semi-algebraic, semi-analytic, analytic, meromorphic, or more generally Écalle-Borel transseriable functions extend naturally to No, and an integral with good properties exists on them. In the negative direction, we show there is a fundamental set-theoretic obstruction to naturally extending many larger families of functions.
△ Less
Submitted 24 August, 2015; v1 submitted 10 May, 2015;
originally announced May 2015.
-
Foundational aspects of singular integrals
Authors:
Ovidiu Costin,
Harvey M. Friedman
Abstract:
We investigate integration of classes of real-valued continuous functions on (0,1]. Of course difficulties arise if there is a non-$L^1$ element in the class, and the Hadamard finite part integral ({\em p.f.}) does not apply. Such singular integrals arise naturally in many contexts including PDEs and singular ODEs.
The Lebesgue integral as well as $p.f.$, starting at zero, obey two fundamental c…
▽ More
We investigate integration of classes of real-valued continuous functions on (0,1]. Of course difficulties arise if there is a non-$L^1$ element in the class, and the Hadamard finite part integral ({\em p.f.}) does not apply. Such singular integrals arise naturally in many contexts including PDEs and singular ODEs.
The Lebesgue integral as well as $p.f.$, starting at zero, obey two fundamental conditions: (i) they act as antiderivatives and, (ii) if $f =g$ on $(0,a)$, then their integrals from $0$ to $x$ coincide for any $x\in (0,a)$.
We find that integrals from zero with the essential properties of $p.f.$, plus positivity, exist by virtue of the Axiom of Choice (AC) on all functions on $(0,1]$ which are $L^1((ε,1])$ for all $ε>0$. However, this existence proof does not provide a satisfactory construction. Without some regularity at $0$, the existence of general antiderivatives which satisfy only (i) and (ii) above on classes with a non-$L^1$ element is independent of ZF (the usual ZFC axioms for mathematics without AC), and even of ZFDC (ZF with the Axiom of Dependent Choice). Moreover we show that there is no mathematical description that can be proved (within ZFC or even extensions of ZFC with large cardinal hypotheses) to uniquely define such an antiderivative operator.
Such results are precisely formulated for a variety of sets of functions, and proved using methods from mathematical logic, descriptive set theory and analysis. We also analyze $p.f.$ on analytic functions in the punctured unit disk, and make the connection to singular initial value problems.
△ Less
Submitted 19 August, 2014; v1 submitted 27 January, 2014;
originally announced January 2014.
-
The complex dynamics of wishful thinking: The critical positivity ratio
Authors:
Nicholas J. L. Brown,
Alan D. Sokal,
Harris L. Friedman
Abstract:
We examine critically the claims made by Fredrickson and Losada (2005) concerning the construct known as the "positivity ratio". We find no theoretical or empirical justification for the use of differential equations drawn from fluid dynamics, a subfield of physics, to describe changes in human emotions over time; furthermore, we demonstrate that the purported application of these equations contai…
▽ More
We examine critically the claims made by Fredrickson and Losada (2005) concerning the construct known as the "positivity ratio". We find no theoretical or empirical justification for the use of differential equations drawn from fluid dynamics, a subfield of physics, to describe changes in human emotions over time; furthermore, we demonstrate that the purported application of these equations contains numerous fundamental conceptual and mathematical errors. The lack of relevance of these equations and their incorrect application lead us to conclude that Fredrickson and Losada's claim to have demonstrated the existence of a critical minimum positivity ratio of 2.9013 is entirely unfounded. More generally, we urge future researchers to exercise caution in the use of advanced mathematical tools such as nonlinear dynamics and in particular to verify that the elementary conditions for their valid application have been met.
△ Less
Submitted 26 July, 2013;
originally announced July 2013.
-
Expansions of the real field by open sets: definability versus interpretability
Authors:
H. Friedman,
K. Kurdyka,
C. Miller,
P. Speissegger
Abstract:
An open set U of the real numbers R is produced such that the expansion (R,+,x,U) of the real field by U defines a Borel isomorph of (R,+,x,N) but does not define N. It follows that (R,+,x,U) defines sets in every level of the projective hierarchy but does not define all projective sets. This result is elaborated in various ways that involve geometric measure theory and working over o-minimal ex…
▽ More
An open set U of the real numbers R is produced such that the expansion (R,+,x,U) of the real field by U defines a Borel isomorph of (R,+,x,N) but does not define N. It follows that (R,+,x,U) defines sets in every level of the projective hierarchy but does not define all projective sets. This result is elaborated in various ways that involve geometric measure theory and working over o-minimal expansions of (R,+,x). In particular, there is a Cantor subset K of R such that for every exponentially bounded o-minimal expansion M of (R,+,x), every subset of R definable in (M,K) either has interior or is Hausdorff null.
△ Less
Submitted 5 December, 2008; v1 submitted 3 December, 2008;
originally announced December 2008.
-
Comment: Classifier Technology and the Illusion of Progress
Authors:
Jerome H. Friedman
Abstract:
Comment on Classifier Technology and the Illusion of Progress [math.ST/0606441]
Comment on Classifier Technology and the Illusion of Progress [math.ST/0606441]
△ Less
Submitted 19 June, 2006;
originally announced June 2006.
-
Finite functions and the necessary use of large cardinals
Authors:
Harvey M. Friedman
Abstract:
We present a coherent collection of finite mathematical theorems some of which can only be proved by going well beyond the usual axioms for mathematics. The proofs of these theorems illustrate in clear terms how one uses the well studied higher infinities of abstract set theory called large cardinals in an essential way in order to derive results in the context of the natural numbers. The findin…
▽ More
We present a coherent collection of finite mathematical theorems some of which can only be proved by going well beyond the usual axioms for mathematics. The proofs of these theorems illustrate in clear terms how one uses the well studied higher infinities of abstract set theory called large cardinals in an essential way in order to derive results in the context of the natural numbers. The findings raise the specific issue of what consitutes a valid mathematical proof and the general issue of objectivity in mathematics in a down to earth way.
Large cardinal axioms, which go beyond the usual axioms for mathematics, have been commonly used in abstract set theory since the 1960's. We believe that the results reported on here are the early stages of an evolutionary process in which new axioms for mathematics will be commonly used in an essential way in the more concrete parts of mathematics.
△ Less
Submitted 31 October, 1998;
originally announced November 1998.