Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometry
Authors:
Giovanni Luca Marchetti,
Vahid Shahverdi,
Stefano Mereta,
Matthew Trager,
Kathlén Kohn
Abstract:
In this position paper, we promote the study of function spaces parameterized by machine learning models through the lens of algebraic geometry. To this end, we focus on algebraic models, such as neural networks with polynomial activations, whose associated function spaces are semi-algebraic varieties. We outline a dictionary between algebro-geometric invariants of these varieties, such as dimensi…
▽ More
In this position paper, we promote the study of function spaces parameterized by machine learning models through the lens of algebraic geometry. To this end, we focus on algebraic models, such as neural networks with polynomial activations, whose associated function spaces are semi-algebraic varieties. We outline a dictionary between algebro-geometric invariants of these varieties, such as dimension, degree, and singularities, and fundamental aspects of machine learning, such as sample complexity, expressivity, training dynamics, and implicit bias. Along the way, we review the literature and discuss ideas beyond the algebraic domain. This work lays the foundations of a research direction bridging algebraic geometry and deep learning, that we refer to as neuroalgebraic geometry.
△ Less
Submitted 30 May, 2025; v1 submitted 31 January, 2025;
originally announced January 2025.
Higher-dimensional cubical sliding puzzles
Authors:
Moritz Beyer,
Stefano Mereta,
Érika Roldán,
Peter Voran
Abstract:
We introduce higher-dimensional cubical sliding puzzles that are inspired by the classical 15 Puzzle from the 1880s. In our puzzles, on a $d$-dimensional cube, a labeled token can be slid from one vertex to another if it is topologically free to move on lower-dimensional faces. We analyze the solvability of these puzzles by studying how the puzzle graph changes with the number of labeled tokens vs…
▽ More
We introduce higher-dimensional cubical sliding puzzles that are inspired by the classical 15 Puzzle from the 1880s. In our puzzles, on a $d$-dimensional cube, a labeled token can be slid from one vertex to another if it is topologically free to move on lower-dimensional faces. We analyze the solvability of these puzzles by studying how the puzzle graph changes with the number of labeled tokens vs empty vertices. We give characterizations of the different regimes ranging from being completely stuck (and thus all puzzles unsolvable) to having only one giant component where almost all puzzles can be solved. For the Cube, the Tesseract, and the Penteract ($5$-dimensional cube) we have implemented an algorithm to completely analyze their solvability and we provide specific puzzles for which we know the minimum number of moves needed to solve them.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
