Showing 1–16 of 16 results for author: Blum-Smith, B

Generic orbits, normal bases, and generation degree for fields of rational invariants

Authors: Ben Blum-Smith, Harm Derksen

Abstract: For a linear representation of a finite group in coprime characteristic, we bound the degrees of the invariant polynomials needed to generate the field of rational invariants as a field, in terms of the degrees of the polynomials needed to span the field of rational functions as a vector space over the invariant field. This provides a far-reaching generalization of a recent result of Edidin and Ka… ▽ More For a linear representation of a finite group in coprime characteristic, we bound the degrees of the invariant polynomials needed to generate the field of rational invariants as a field, in terms of the degrees of the polynomials needed to span the field of rational functions as a vector space over the invariant field. This provides a far-reaching generalization of a recent result of Edidin and Katz. △ Less

Submitted 5 June, 2025; originally announced June 2025.

Comments: 22 pages

Estimating the Euclidean distortion of an orbit space

Authors: Ben Blum-Smith, Harm Derksen, Dustin G. Mixon, Yousef Qaddura, Brantley Vose

Abstract: Given a finite-dimensional inner product space $V$ and a group $G$ of isometries, we consider the problem of embedding the orbit space $V/G$ into a Hilbert space in a way that preserves the quotient metric as well as possible. This inquiry is motivated by applications to invariant machine learning. We introduce several new theoretical tools before using them to tackle various fundamental instances… ▽ More Given a finite-dimensional inner product space $V$ and a group $G$ of isometries, we consider the problem of embedding the orbit space $V/G$ into a Hilbert space in a way that preserves the quotient metric as well as possible. This inquiry is motivated by applications to invariant machine learning. We introduce several new theoretical tools before using them to tackle various fundamental instances of this problem. △ Less

Submitted 4 June, 2025; originally announced June 2025.

A Galois theorem for machine learning: Functions on symmetric matrices and point clouds via lightweight invariant features

Authors: Ben Blum-Smith, Ningyuan Huang, Marco Cuturi, Soledad Villar

Abstract: In this work, we present a mathematical formulation for machine learning of (1) functions on symmetric matrices that are invariant with respect to the action of permutations by conjugation, and (2) functions on point clouds that are invariant with respect to rotations, reflections, and permutations of the points. To achieve this, we provide a general construction of generically separating invarian… ▽ More In this work, we present a mathematical formulation for machine learning of (1) functions on symmetric matrices that are invariant with respect to the action of permutations by conjugation, and (2) functions on point clouds that are invariant with respect to rotations, reflections, and permutations of the points. To achieve this, we provide a general construction of generically separating invariant features using ideas inspired by Galois theory. We construct $O(n^2)$ invariant features derived from generators for the field of rational functions on $n\times n$ symmetric matrices that are invariant under joint permutations of rows and columns. We show that these invariant features can separate all distinct orbits of symmetric matrices except for a measure zero set; such features can be used to universally approximate invariant functions on almost all weighted graphs. For point clouds in a fixed dimension, we prove that the number of invariant features can be reduced, generically without losing expressivity, to $O(n)$, where $n$ is the number of points. We combine these invariant features with DeepSets to learn functions on symmetric matrices and point clouds with varying sizes. We empirically demonstrate the feasibility of our approach on molecule property regression and point cloud distance prediction. △ Less

Submitted 13 February, 2025; v1 submitted 13 May, 2024; originally announced May 2024.

MSC Class: 68P01; 13A50

Degree bounds for rational generators of invariant fields of finite abelian groups

Authors: Ben Blum-Smith

Abstract: We study degree bounds on rational but not necessarily polynomial generators for the field $\mathbf{k}(V)^G$ of rational invariants of a linear action of a finite abelian group. We show that lattice-theoretic methods used recently by the author and collaborators to study polynomial generators for the same field largely carry over, after minor modifications to the arguments. It then develops that t… ▽ More We study degree bounds on rational but not necessarily polynomial generators for the field $\mathbf{k}(V)^G$ of rational invariants of a linear action of a finite abelian group. We show that lattice-theoretic methods used recently by the author and collaborators to study polynomial generators for the same field largely carry over, after minor modifications to the arguments. It then develops that the specific degree bounds found in that setting also carry over. △ Less

Submitted 14 June, 2024; v1 submitted 26 April, 2024; originally announced April 2024.

Comments: 11 pages. Minor corrections

Equivariant geometric convolutions for emulation of dynamical systems

Authors: Wilson G. Gregory, David W. Hogg, Ben Blum-Smith, Maria Teresa Arias, Kaze W. K. Wong, Soledad Villar

Abstract: Machine learning methods are increasingly being employed as surrogate models in place of computationally expensive and slow numerical integrators for a bevy of applications in the natural sciences. However, while the laws of physics are relationships between scalars, vectors, and tensors that hold regardless of the frame of reference or chosen coordinate system, surrogate machine learning models a… ▽ More Machine learning methods are increasingly being employed as surrogate models in place of computationally expensive and slow numerical integrators for a bevy of applications in the natural sciences. However, while the laws of physics are relationships between scalars, vectors, and tensors that hold regardless of the frame of reference or chosen coordinate system, surrogate machine learning models are not coordinate-free by default. We enforce coordinate freedom by using geometric convolutions in three model architectures: a ResNet, a Dilated ResNet, and a UNet. In numerical experiments emulating 2D compressible Navier-Stokes, we see better accuracy and improved stability compared to baseline surrogate models in almost all cases. The ease of enforcing coordinate freedom without making major changes to the model architecture provides an exciting recipe for any CNN-based method applied to an appropriate class of problems △ Less

Submitted 1 November, 2024; v1 submitted 21 May, 2023; originally announced May 2023.

Degree bounds for fields of rational invariants of $\mathbb{Z}/p\mathbb{Z}$ and other finite groups

Authors: Ben Blum-Smith, Thays Garcia, Rawin Hidalgo, Consuelo Rodriguez

Abstract: Degree bounds for algebra generators of invariant rings are a topic of longstanding interest in invariant theory. We study the analogous question for field generators for the field of rational invariants of a representation of a finite group, focusing on abelian groups and especially the case of $\mathbb{Z}/p\mathbb{Z}$. The inquiry is motivated by an application to signal processing. We give new… ▽ More Degree bounds for algebra generators of invariant rings are a topic of longstanding interest in invariant theory. We study the analogous question for field generators for the field of rational invariants of a representation of a finite group, focusing on abelian groups and especially the case of $\mathbb{Z}/p\mathbb{Z}$. The inquiry is motivated by an application to signal processing. We give new lower and upper bounds depending on the number of distinct nontrivial characters in the representation. We obtain additional detailed information in the case of two distinct nontrivial characters. We conjecture a sharper upper bound in the $\mathbb{Z}/p\mathbb{Z}$ case, and pose questions for further investigation. △ Less

Submitted 13 June, 2024; v1 submitted 9 March, 2023; originally announced March 2023.

Comments: 41 pages, 1 table. Minor corrections

MSC Class: 13A50 (Primary) 20M25; 52C05; 52C07; 94A12 (Secondary)

Journal ref: Journal of Pure and Applied Algebra 228:10 (2024) 107693

Machine learning and invariant theory

Authors: Ben Blum-Smith, Soledad Villar

Abstract: Inspired by constraints from physical law, equivariant machine learning restricts the learning to a hypothesis class where all the functions are equivariant with respect to some group action. Irreducible representations or invariant theory are typically used to parameterize the space of such functions. In this article, we introduce the topic and explain a couple of methods to explicitly parameteri… ▽ More Inspired by constraints from physical law, equivariant machine learning restricts the learning to a hypothesis class where all the functions are equivariant with respect to some group action. Irreducible representations or invariant theory are typically used to parameterize the space of such functions. In this article, we introduce the topic and explain a couple of methods to explicitly parameterize equivariant functions that are being used in machine learning applications. In particular, we explicate a general procedure, attributed to Malgrange, to express all polynomial maps between linear spaces that are equivariant under the action of a group $G$, given a characterization of the invariant polynomials on a bigger space. The method also parametrizes smooth equivariant maps in the case that $G$ is a compact Lie group. △ Less

Submitted 25 March, 2023; v1 submitted 29 September, 2022; originally announced September 2022.

Journal ref: Notices of the American Mathematical Society 70(8): 1205--1213, 2023

Dimensionless machine learning: Imposing exact units equivariance

Authors: Soledad Villar, Weichi Yao, David W. Hogg, Ben Blum-Smith, Bianca Dumitrascu

Abstract: Units equivariance (or units covariance) is the exact symmetry that follows from the requirement that relationships among measured quantities of physics relevance must obey self-consistent dimensional scalings. Here, we express this symmetry in terms of a (non-compact) group action, and we employ dimensional analysis and ideas from equivariant machine learning to provide a methodology for exactly… ▽ More Units equivariance (or units covariance) is the exact symmetry that follows from the requirement that relationships among measured quantities of physics relevance must obey self-consistent dimensional scalings. Here, we express this symmetry in terms of a (non-compact) group action, and we employ dimensional analysis and ideas from equivariant machine learning to provide a methodology for exactly units-equivariant machine learning: For any given learning task, we first construct a dimensionless version of its inputs using classic results from dimensional analysis, and then perform inference in the dimensionless space. Our approach can be used to impose units equivariance across a broad range of machine learning methods which are equivariant to rotations and other groups. We discuss the in-sample and out-of-sample prediction accuracy gains one can obtain in contexts like symbolic regression and emulation, where symmetry is important. We illustrate our approach with simple numerical examples involving dynamical systems in physics and ecology. △ Less

Submitted 31 December, 2022; v1 submitted 2 April, 2022; originally announced April 2022.

Journal ref: Journal of Machine Learning Research 24 (2023) 1--32

Scalars are universal: Equivariant machine learning, structured like classical physics

Authors: Soledad Villar, David W. Hogg, Kate Storey-Fisher, Weichi Yao, Ben Blum-Smith

Abstract: There has been enormous progress in the last few years in designing neural networks that respect the fundamental symmetries and coordinate freedoms of physical law. Some of these frameworks make use of irreducible representations, some make use of high-order tensor objects, and some apply symmetry-enforcing constraints. Different physical laws obey different combinations of fundamental symmetries,… ▽ More There has been enormous progress in the last few years in designing neural networks that respect the fundamental symmetries and coordinate freedoms of physical law. Some of these frameworks make use of irreducible representations, some make use of high-order tensor objects, and some apply symmetry-enforcing constraints. Different physical laws obey different combinations of fundamental symmetries, but a large fraction (possibly all) of classical physics is equivariant to translation, rotation, reflection (parity), boost (relativity), and permutations. Here we show that it is simple to parameterize universally approximating polynomial functions that are equivariant under these symmetries, or under the Euclidean, Lorentz, and Poincaré groups, at any dimensionality $d$. The key observation is that nonlinear O($d$)-equivariant (and related-group-equivariant) functions can be universally expressed in terms of a lightweight collection of scalars -- scalar products and scalar contractions of the scalar, vector, and tensor inputs. We complement our theory with numerical examples that show that the scalar-based method is simple, efficient, and scalable. △ Less

Submitted 7 February, 2023; v1 submitted 11 June, 2021; originally announced June 2021.

Comments: NeurIPS 2021

Journal ref: Advances in Neural Information Processing Systems, 34, 28848-28863. 2021

A rotation group whose subspace arrangement is not from a real reflection group

Authors: Ben Blum-Smith

Abstract: We exhibit a family of real rotation groups whose subspace arrangements are not contained in that of any real reflection group, answering a question of Martino and Singh. We exhibit a family of real rotation groups whose subspace arrangements are not contained in that of any real reflection group, answering a question of Martino and Singh. △ Less

Submitted 18 April, 2019; v1 submitted 12 April, 2019; originally announced April 2019.

Comments: 6 pages, no figures

MSC Class: 14N20; 20F55; 51F15

Journal ref: Linear Algebra and Its Applications 581 (2019) 405--412

Purely noncommuting groups

Authors: Ben Blum-Smith, Fedor Bogomolov

Abstract: In this paper we define and investigate a class of groups characterized by a representation-theoretic property we call purely noncommuting or PNC. This property guarantees that the group has an action on a smooth projective variety with mild quotient singularities. It has intrinsic group-theoretic interest as well. The main results are as follows. (i) All supersolvable groups are PNC. (ii) No nona… ▽ More In this paper we define and investigate a class of groups characterized by a representation-theoretic property we call purely noncommuting or PNC. This property guarantees that the group has an action on a smooth projective variety with mild quotient singularities. It has intrinsic group-theoretic interest as well. The main results are as follows. (i) All supersolvable groups are PNC. (ii) No nonabelian finite simple groups are PNC. (iii) A metabelian group is guaranteed to be PNC if its commutator subgroup's cyclic prime-power-order factors are all distinct, but not in general. We also give a criterion guaranteeing a group is PNC if its nonabelian subgroups are all large, in a suitable sense, and investigate the PNC property for permutations. △ Less

Submitted 11 October, 2018; originally announced October 2018.

Comments: 18 pages, 2 tables. Comments welcome!

Journal ref: European Journal of Mathematics 5 (2019) 1173--1191

Chords of an ellipse, Lucas polynomials, and cubic equations

Authors: Ben Blum-Smith, Japheth Wood

Abstract: A beautiful theorem of Thomas Price links the Fibonacci numbers and the Lucas polynomials to the plane geometry of an ellipse, generalizing a classic problem about circles. We give a brief history of the circle problem, an account of Price's ellipse proof, and a reorganized proof, with some new ideas, designed to situate the result within a dense web of connections to classical mathematics. It is… ▽ More A beautiful theorem of Thomas Price links the Fibonacci numbers and the Lucas polynomials to the plane geometry of an ellipse, generalizing a classic problem about circles. We give a brief history of the circle problem, an account of Price's ellipse proof, and a reorganized proof, with some new ideas, designed to situate the result within a dense web of connections to classical mathematics. It is inspired by Cardano's solution of the cubic equation and Newton's theorem on power sums, and yields an interpretation of generalized Lucas polynomials in terms of the theory of symmetric polynomials. We also develop additional connections that surface along the way; e.g., we give a parallel interpretation of generalized Fibonacci polynomials, and we show that Cardano's method can be used write down the roots of the Lucas polynomials. △ Less

Submitted 8 October, 2021; v1 submitted 30 September, 2018; originally announced October 2018.

Comments: 18 pages, 1 table, 2 figures. This is the "Accepted Manuscript" of the article, published in the American Mathematical Monthly on Sept. 21, 2020. For the published version, see DOI link below

Journal ref: Amer. Math. Monthly 127:8 (2020) 688--705

Two inquiries about finite groups and well-behaved quotients

Authors: Ben Blum-Smith

Abstract: This thesis addresses questions in representation and invariant theory of finite groups. The first concerns singularities of quotient spaces under actions of finite groups. We introduce a class of finite groups such that the quotients have at worst abelian quotient singularities. We prove that supersolvable groups belong to this class and show that nonabelian finite simple groups do not belong to… ▽ More This thesis addresses questions in representation and invariant theory of finite groups. The first concerns singularities of quotient spaces under actions of finite groups. We introduce a class of finite groups such that the quotients have at worst abelian quotient singularities. We prove that supersolvable groups belong to this class and show that nonabelian finite simple groups do not belong to it. The second question concerns the Cohen-Macaulayness of the invariant ring $\mathbb{Z}[x_1,\dots,x_n]^G$, where $G$ is a permutation group. We prove that this ring is Cohen-Macaulay if $G$ is generated by transpositions, double transpositions, and 3-cycles, and conjecture that the converse is true as well. △ Less

Submitted 22 March, 2018; v1 submitted 22 March, 2018; originally announced March 2018.

Comments: 166 pages, 19 figures, 4 tables. This is the author's PhD thesis

MSC Class: 13A50; 20C15

When are permutation invariants Cohen-Macaulay over all fields?

Authors: Ben Blum-Smith, Sophie Marques

Abstract: We prove that the polynomial invariants of a permutation group are Cohen-Macaulay for any choice of coefficient field if and only if the group is generated by transpositions, double transpositions, and 3-cycles. This unites and generalizes several previously known results. The "if" direction of the argument uses Stanley-Reisner theory and a recent result of Christian Lange in orbifold theory. The… ▽ More We prove that the polynomial invariants of a permutation group are Cohen-Macaulay for any choice of coefficient field if and only if the group is generated by transpositions, double transpositions, and 3-cycles. This unites and generalizes several previously known results. The "if" direction of the argument uses Stanley-Reisner theory and a recent result of Christian Lange in orbifold theory. The "only-if" direction uses a local-global result based on a theorem of Raynaud to reduce the problem to an analysis of inertia groups, and a combinatorial argument to identify inertia groups that obstruct Cohen-Macaulayness. △ Less

Submitted 17 May, 2018; v1 submitted 19 February, 2018; originally announced February 2018.

Comments: 30 pages, 5 figures. Rewrote the statement and proof of Lemma 3.7 in response to a referee report, and correspondingly updated later material relying on Lemma 3.7 such as Proposition 3.11 (formerly 3.8) statement and proof, and the proof of Proposition 4.2. Also, added a few remarks after the new proof of Lemma 3.7

Journal ref: Alg. Number Th. 12 (2018) 1787-1821

Estimation under group actions: recovering orbits from invariants

Authors: Afonso S. Bandeira, Ben Blum-Smith, Joe Kileel, Amelia Perry, Jonathan Niles-Weed, Alexander S. Wein

Abstract: We study a class of orbit recovery problems in which we observe independent copies of an unknown element of $\mathbb{R}^p$, each linearly acted upon by a random element of some group (such as $\mathbb{Z}/p$ or $\mathrm{SO}(3)$) and then corrupted by additive Gaussian noise. We prove matching upper and lower bounds on the number of samples required to approximately recover the group orbit of this u… ▽ More We study a class of orbit recovery problems in which we observe independent copies of an unknown element of $\mathbb{R}^p$, each linearly acted upon by a random element of some group (such as $\mathbb{Z}/p$ or $\mathrm{SO}(3)$) and then corrupted by additive Gaussian noise. We prove matching upper and lower bounds on the number of samples required to approximately recover the group orbit of this unknown element with high probability. These bounds, based on quantitative techniques in invariant theory, give a precise correspondence between the statistical difficulty of the estimation problem and algebraic properties of the group. Furthermore, we give computer-assisted procedures to certify these properties that are computationally efficient in many cases of interest. The model is motivated by geometric problems in signal processing, computer vision, and structural biology, and applies to the reconstruction problem in cryo-electron microscopy (cryo-EM), a problem of significant practical interest. Our results allow us to verify (for a given problem size) that if cryo-EM images are corrupted by noise with variance $σ^2$, the number of images required to recover the molecule structure scales as $σ^6$. We match this bound with a novel (albeit computationally expensive) algorithm for ab initio reconstruction in cryo-EM, based on invariant features of degree at most 3. We further discuss how to recover multiple molecular structures from mixed (or heterogeneous) cryo-EM samples. △ Less

Submitted 13 June, 2023; v1 submitted 29 December, 2017; originally announced December 2017.

Comments: 81 pages. Minor revisions since previous version, reflecting peer review feedback. To be published in Applied and Computational Harmonic Analysis

MSC Class: 62F10; 92C55; 16W22

Journal ref: Applied and Computational Harmonic Analysis 66 (2023) 236--319

The Fundamental Theorem on Symmetric Polynomials: History's First Whiff of Galois Theory

Authors: Ben Blum-Smith, Samuel Coskey

Abstract: We describe the Fundamental Theorem on Symmetric Polynomials (FTSP), exposit a classical proof, and offer a novel proof that arose out of an informal course on group theory. The paper develops this proof in tandem with the pedagogical context that led to it. We also discuss the role of the FTSP both as a lemma in the original historical development of Galois theory and as an early example of the c… ▽ More We describe the Fundamental Theorem on Symmetric Polynomials (FTSP), exposit a classical proof, and offer a novel proof that arose out of an informal course on group theory. The paper develops this proof in tandem with the pedagogical context that led to it. We also discuss the role of the FTSP both as a lemma in the original historical development of Galois theory and as an early example of the connection between symmetry and expressibility that is described by the theory. △ Less

Submitted 10 October, 2020; v1 submitted 29 January, 2013; originally announced January 2013.

Comments: 16 pages, 1 figure. Added an appendix acknowledging a precedent for the "brick-stacking" argument for Theorem 3

Journal ref: College mathematics journal 48(1):18-29, 2017