-
A Fibrational Theory of First Order Differential Structures
Authors:
Matteo Capucci,
Geoffrey S. H. Cruttwell,
Neil Ghani,
Fabio Zanasi
Abstract:
We develop a categorical framework for reasoning about abstract properties of differentiation, based on the theory of fibrations. Our work encompasses the first-order fragments of several existing categorical structures for differentiation, including cartesian differential categories, generalised cartesian differential categories, tangent categories, as well as the versions of these categories axi…
▽ More
We develop a categorical framework for reasoning about abstract properties of differentiation, based on the theory of fibrations. Our work encompasses the first-order fragments of several existing categorical structures for differentiation, including cartesian differential categories, generalised cartesian differential categories, tangent categories, as well as the versions of these categories axiomatising reverse derivatives. We explain uniformly and concisely the requirements expressed by these structures, using sections of suitable fibrations as unifying concept. Our perspective sheds light on their similarities and differences, as well as simplifying certain constructions from the literature.
△ Less
Submitted 9 September, 2024;
originally announced September 2024.
-
A Tangent Category Perspective on Connections in Algebraic Geometry
Authors:
G. S. H. Cruttwell,
Jean-Simon Pacaud Lemay,
Elias Vandenberg
Abstract:
There is an abstract notion of connection in any tangent category. In this paper, we show that when applied to the tangent category of affine schemes, this recreates the classical notion of a connection on a module (and similarly, in the tangent category of schemes, this recreates the notion of connection on a quasi-coherent sheaf of modules). By contrast, we also show that in the tangent category…
▽ More
There is an abstract notion of connection in any tangent category. In this paper, we show that when applied to the tangent category of affine schemes, this recreates the classical notion of a connection on a module (and similarly, in the tangent category of schemes, this recreates the notion of connection on a quasi-coherent sheaf of modules). By contrast, we also show that in the tangent category of algebras, there are no non-trivial connections.
△ Less
Submitted 21 November, 2024; v1 submitted 21 June, 2024;
originally announced June 2024.
-
Differential Bundles in Commutative Algebra and Algebraic Geometry
Authors:
G. S. H. Cruttwell,
Jean-Simon Pacaud Lemay
Abstract:
In this paper, we explain how the abstract notion of a differential bundle in a tangent category provides a new way of thinking about the category of modules over a commutative ring and its opposite category. MacAdam previously showed that differential bundles in the tangent category of smooth manifolds are precisely smooth vector bundles. Here we provide characterizations of differential bundles…
▽ More
In this paper, we explain how the abstract notion of a differential bundle in a tangent category provides a new way of thinking about the category of modules over a commutative ring and its opposite category. MacAdam previously showed that differential bundles in the tangent category of smooth manifolds are precisely smooth vector bundles. Here we provide characterizations of differential bundles in the tangent categories of commutative rings and (affine) schemes. For commutative rings, the category of differential bundles over a commutative ring is equivalent to the category of modules over that ring. For affine schemes, the category of differential bundles over the Spec of a commutative ring is equivalent to the opposite category of modules over said ring. Finally, for schemes, the category of differential bundles over a scheme is equivalent to the opposite category of quasi-coherent sheaves of modules over that scheme.
△ Less
Submitted 18 December, 2023; v1 submitted 13 January, 2023;
originally announced January 2023.
-
Categorical Foundations of Gradient-Based Learning
Authors:
G. S. H. Cruttwell,
Bruno Gavranović,
Neil Ghani,
Paul Wilson,
Fabio Zanasi
Abstract:
We propose a categorical semantics of gradient-based machine learning algorithms in terms of lenses, parametrised maps, and reverse derivative categories. This foundation provides a powerful explanatory and unifying framework: it encompasses a variety of gradient descent algorithms such as ADAM, AdaGrad, and Nesterov momentum, as well as a variety of loss functions such as as MSE and Softmax cross…
▽ More
We propose a categorical semantics of gradient-based machine learning algorithms in terms of lenses, parametrised maps, and reverse derivative categories. This foundation provides a powerful explanatory and unifying framework: it encompasses a variety of gradient descent algorithms such as ADAM, AdaGrad, and Nesterov momentum, as well as a variety of loss functions such as as MSE and Softmax cross-entropy, shedding new light on their similarities and differences. Our approach to gradient-based learning has examples generalising beyond the familiar continuous domains (modelled in categories of smooth maps) and can be realized in the discrete setting of boolean circuits. Finally, we demonstrate the practical significance of our framework with an implementation in Python.
△ Less
Submitted 13 July, 2021; v1 submitted 2 March, 2021;
originally announced March 2021.
-
Differential equations in a tangent category I: Complete vector fields, flows, and exponentials
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell,
J. -S. P. Lemay
Abstract:
This paper describes how to define and work with differential equations in the abstract setting of tangent categories. The key notion is that of a curve object which is, for differential geometry, the structural analogue of a natural number object. A curve object is a preinitial object for dynamical systems; dynamical systems may, in turn, be viewed as determining systems of differential equations…
▽ More
This paper describes how to define and work with differential equations in the abstract setting of tangent categories. The key notion is that of a curve object which is, for differential geometry, the structural analogue of a natural number object. A curve object is a preinitial object for dynamical systems; dynamical systems may, in turn, be viewed as determining systems of differential equations. The unique map from the curve object to a dynamical system is a solution of the system, and a dynamical system is said to be complete when for all initial conditions there is a solution. A subtle issue concerns the question of when a dynamical system is complete, and the paper provides abstract conditions for this.
This abstract formulation also allows new perspectives on topics such as commutative vector fields and flows. In addition, the stronger notion of a differential curve object, which is the centrepiece of the last section of the paper, has exponential maps and forms a differential exponential rig. This rig then, somewhat surprisingly, has an action on every differential object and bundle in the setting. In this manner, in a very strong sense, such a curve object plays the role of the real numbers in standard differential geometry.
△ Less
Submitted 8 February, 2021; v1 submitted 27 November, 2019;
originally announced November 2019.
-
Integral and differential structure on the free $C^{\infty}$-ring modality
Authors:
G. S. H. Cruttwell,
J. -S. P. Lemay,
R. B. B. Lucyshyn-Wright
Abstract:
Integral categories were recently developed as a counterpart to differential categories. In particular, integral categories come equipped with an integration operator, known as an integral transformation, whose axioms generalize the basic integration identities from calculus such as integration by parts. However, the literature on integral categories contains no example that captures integration o…
▽ More
Integral categories were recently developed as a counterpart to differential categories. In particular, integral categories come equipped with an integration operator, known as an integral transformation, whose axioms generalize the basic integration identities from calculus such as integration by parts. However, the literature on integral categories contains no example that captures integration of arbitrary smooth functions: the closest are examples involving integration of polynomial functions. This paper fills in this gap by developing an example of an integral category whose integral transformation operates on smooth 1-forms. We also provide an alternative viewpoint on the differential structure of this key example, investigate derivations and coderelictions in this context, and prove that free $C^{\infty}$-rings are Rota-Baxter algebras.
△ Less
Submitted 25 July, 2019; v1 submitted 12 February, 2019;
originally announced February 2019.
-
Affine geometric spaces in tangent categories
Authors:
R. F. Blute,
G. S. H. Cruttwell,
R. B. B. Lucyshyn-Wright
Abstract:
We continue the program of structural differential geometry that begins with the notion of a tangent category, an axiomatization of structural aspects of the tangent functor on the category of smooth manifolds. In classical geometry, having an affine structure on a manifold is equivalent to having a flat torsion-free connection on its tangent bundle. This equivalence allows us to define a category…
▽ More
We continue the program of structural differential geometry that begins with the notion of a tangent category, an axiomatization of structural aspects of the tangent functor on the category of smooth manifolds. In classical geometry, having an affine structure on a manifold is equivalent to having a flat torsion-free connection on its tangent bundle. This equivalence allows us to define a category of affine objects associated to a tangent category and we show that the resulting category is also a tangent category, as are several related categories. As a consequence of some of these ideas we also give two new characterizations of flat torsion-free connections.
We also consider 2-categorical structure associated to the category of tangent categories and demonstrate that assignment of the tangent category of affine objects to a tangent category induces a 2-comonad.
Finally, following work of Jubin, we consider monads and comonads on the category of affine objects associated to a tangent category. We show that there is a rich theory of monads and comonads in this setting as well as various distributive laws and mixed distributive laws relating these monads and comonads. Even in the category of smooth manifolds, several of these results are new or fill in gaps in the existing literature.
△ Less
Submitted 29 April, 2019; v1 submitted 25 July, 2018;
originally announced July 2018.
-
Connections in Tangent Categories
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell
Abstract:
Connections are an important tool of differential geometry. This paper investigates their definition and structure in the abstract setting of tangent categories. At this level of abstraction we derive several classically important results about connections, including the Bianchi identities, identities for curvature and torsion, almost complex structure, and parallel transport.
Connections are an important tool of differential geometry. This paper investigates their definition and structure in the abstract setting of tangent categories. At this level of abstraction we derive several classically important results about connections, including the Bianchi identities, identities for curvature and torsion, almost complex structure, and parallel transport.
△ Less
Submitted 27 July, 2017; v1 submitted 27 October, 2016;
originally announced October 2016.
-
A simplicial foundation for differential and sector forms in tangent categories
Authors:
G. S. H. Cruttwell,
Rory B. B. Lucyshyn-Wright
Abstract:
Tangent categories provide an axiomatic framework for understanding various tangent bundles and differential operations that occur in differential geometry, algebraic geometry, abstract homotopy theory, and computer science. Previous work has shown that one can formulate and prove a wide variety of definitions and results from differential geometry in an arbitrary tangent category, including gener…
▽ More
Tangent categories provide an axiomatic framework for understanding various tangent bundles and differential operations that occur in differential geometry, algebraic geometry, abstract homotopy theory, and computer science. Previous work has shown that one can formulate and prove a wide variety of definitions and results from differential geometry in an arbitrary tangent category, including generalizations of vector fields and their Lie bracket, vector bundles, and connections.
In this paper we investigate differential and sector forms in tangent categories. We show that sector forms in any tangent category have a rich structure: they form a symmetric cosimplicial object. This appears to be a new result in differential geometry, even for smooth manifolds. In the category of smooth manifolds, the resulting complex of sector forms has a subcomplex isomorphic to the de Rham complex of differential forms, which may be identified with alternating sector forms. Further, the symmetric cosimplicial structure on sector forms arises naturally through a new equational presentation of symmetric cosimplicial objects, which we develop herein.
△ Less
Submitted 11 April, 2018; v1 submitted 29 June, 2016;
originally announced June 2016.
-
Differential bundles and fibrations for tangent categories
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell
Abstract:
Tangent categories are categories equipped with a tangent functor: an endofunctor with certain natural transformations which make it behave like the tangent bundle functor on the category of smooth manifolds. They provide an abstract setting for differential geometry by axiomatizing key aspects of the subject which allow the basic theory of these geometric settings to be captured. Importantly, the…
▽ More
Tangent categories are categories equipped with a tangent functor: an endofunctor with certain natural transformations which make it behave like the tangent bundle functor on the category of smooth manifolds. They provide an abstract setting for differential geometry by axiomatizing key aspects of the subject which allow the basic theory of these geometric settings to be captured. Importantly, they have models not only in classical differential geometry and its extensions, but also in algebraic geometry, combinatorics, computer science, and physics.
This paper develops the theory of "differential bundles" for such categories, considers their relation to "differential objects", and develops the theory of fibrations of tangent categories. Differential bundles generalize the notion of smooth vector bundles in classical differential geometry. However, the definition departs from the standard one in several significant ways: in general, there is no scalar multiplication in the fibres of these bundles, and in general these bundles need not be locally trivial.
To understand how these differential bundles relate to differential objects, which are the generalization of vector spaces in smooth manifolds, requires some careful handling of the behaviour of pullbacks with respect to the tangent functor. This is captured by "transverse" and "display" systems for tangent categories, which leads one into the fibrational theory of tangent categories. A key example of a tangent fibration is provided by the "display" differential bundles of a tangent category with a display system. Strikingly, in such examples the fibres are Cartesian differential categories demonstrating a -- not unexpected -- tight connection between the theory of these categories and that of tangent categories.
△ Less
Submitted 9 March, 2017; v1 submitted 27 June, 2016;
originally announced June 2016.
-
Cartesian differential categories revisited
Authors:
G. S. H. Cruttwell
Abstract:
We revisit the definition of Cartesian differential categories, showing that a slightly more general version is useful for a number of reasons. As one application, we show that these general differential categories are comonadic over Cartesian categories, so that every Cartesian category has an associated cofree differential category. We also work out the corresponding results when the categories…
▽ More
We revisit the definition of Cartesian differential categories, showing that a slightly more general version is useful for a number of reasons. As one application, we show that these general differential categories are comonadic over Cartesian categories, so that every Cartesian category has an associated cofree differential category. We also work out the corresponding results when the categories involved have restriction structure, and show that these categories are closed under splitting restriction idempotents.
△ Less
Submitted 20 August, 2012;
originally announced August 2012.
-
Differential restriction categories
Authors:
J. R. B. Cockett,
G. S. H. Cruttwell,
J. D. Gallagher
Abstract:
We combine two recent ideas: cartesian differential categories, and restriction categories. The result is a new structure which axiomatizes the category of smooth maps defined on open subsets of $\R^n$ in a way that is completely algebraic. We also give other models for the resulting structure, discuss what it means for a partial map to be additive or linear, and show that differential restriction…
▽ More
We combine two recent ideas: cartesian differential categories, and restriction categories. The result is a new structure which axiomatizes the category of smooth maps defined on open subsets of $\R^n$ in a way that is completely algebraic. We also give other models for the resulting structure, discuss what it means for a partial map to be additive or linear, and show that differential restriction structure can be lifted through various completion operations.
△ Less
Submitted 20 August, 2012;
originally announced August 2012.
-
A unified framework for generalized multicategories
Authors:
G. S. H. Cruttwell,
Michael A. Shulman
Abstract:
Notions of generalized multicategory have been defined in numerous contexts throughout the literature, and include such diverse examples as symmetric multicategories, globular operads, Lawvere theories, and topological spaces. In each case, generalized multicategories are defined as the "lax algebras" or "Kleisli monoids" relative to a "monad" on a bicategory. However, the meanings of these words…
▽ More
Notions of generalized multicategory have been defined in numerous contexts throughout the literature, and include such diverse examples as symmetric multicategories, globular operads, Lawvere theories, and topological spaces. In each case, generalized multicategories are defined as the "lax algebras" or "Kleisli monoids" relative to a "monad" on a bicategory. However, the meanings of these words differ from author to author, as do the specific bicategories considered. We propose a unified framework: by working with monads on double categories and related structures (rather than bicategories), one can define generalized multicategories in a way that unifies all previous examples, while at the same time simplifying and clarifying much of the theory.
△ Less
Submitted 8 December, 2010; v1 submitted 14 July, 2009;
originally announced July 2009.